| Operating system | Count |
|---|---|
| CentOS 7 | 193 |
| Architecture | Count |
|---|---|
| x86_64 | 193 |
| Related packages | Count |
|---|---|
| kernel | 192 |
| kernel-lt | 1 |
Packages names with count less than the total count of reports are most probably not the cause of the problem.
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
kmem_cache_alloc
|
vmlinux |
0xffffffff8bc1c0f1
Build id: 3.10.0-957.5.1.el7.x86_64 |
0x41 |
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [nmbd:5626] Modules linked in: fuse tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink ipt_REJECT nf_reject_ipv4 xt_CHECKSUM vmw_vsock_vmci_transport vsock sunrpc coretemp ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_generic pata_acpi floppy vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm e1000 drm ata_piix mptspi scsi_transport_spi mptscsih libata mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod [last unloaded: nf_defrag_ipv4] CPU: 3 PID: 5626 Comm: nmbd Kdump: loaded Tainted: G W L ------------ 3.10.0-957.5.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014 task: ffff89bcb4ab6180 ti: ffff89c023244000 task.ti: ffff89c023244000 RIP: 0010:[<ffffffff8bc1c0f1>] [<ffffffff8bc1c0f1>] kmem_cache_alloc+0x41/0x1f0 RSP: 0018:ffff89c03fd83cb8 EFLAGS: 00010246 RAX: 0000000000000020 RBX: ffff89bf453f4400 RCX: 0000000000002000 RDX: 0000000000000020 RSI: 0000000000000020 RDI: ffff89bdffc01700 NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/0:1H:2459] NMI watchdog: BUG: soft lockup - CPU#2 stuck for 21s! [systemd-journal:30107] Modules linked in: Modules linked in: fuse fuse tun tun bridge bridge stp stp llc llc ebtable_filter ebtable_filter ebtables ebtables ip6table_filter ip6table_filter ip6_tables ip6_tables devlink devlink ipt_REJECT ipt_REJECT RBP: ffff89c03fd83ce8 R08: 0000000000000100 R09: ffffffff8c027a5a R10: f9a101021050a05b R11: 0000000000000000 R12: ffff89c03fd83c28 R13: ffffffff8c175df2 R14: ffff89c03fd83ce8 R15: 0000000000000200 FS: 00007fdb687ab880(0000) GS:ffff89c03fd80000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 nf_reject_ipv4 xt_CHECKSUM vmw_vsock_vmci_transport vsock sunrpc CR2: 00007fd16990d000 CR3: 00000003ac3fa000 CR4: 00000000001607e0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
kmem_cache_alloc
|
vmlinux |
0xffffffff98229054
Build id: 3.10.0-1160.59.1.el7.x86_64 |
0x74 |
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 52s! [postgres:29815] Modules linked in: veth xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs tun lockd grace fscache binfmt_misc overlay(T) nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc coretemp crc32_pclmul ghash_clmulni_intel ppdev aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd joydev sg pcspkr vmw_vmci parport_pc parport i2c_piix4 ip_tables xfs libcrc32c vmwgfx drm_kms_helper sr_mod cdrom syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod drm ata_generic pata_acpi crc_t10dif crct10dif_generic ata_piix libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw e1000 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod CPU: 0 PID: 18488 Comm: Domain unloader Kdump: loaded Tainted: G B L ------------ T 3.10.0-1160.59.1.el7.x86_64 #1 CPU: 2 PID: 1 Comm: systemd Kdump: loaded Tainted: G B L ------------ T 3.10.0-1160.59.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 10/22/2013 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 10/22/2013 task: ffff996a04d69080 ti: ffff9967177c4000 task.ti: ffff9967177c4000 task: ffff996836308000 ti: ffff996836304000 task.ti: ffff996836304000 RIP: 0010:[<ffffffffc084a261>] CPU: 1 PID: 29815 Comm: postgres Kdump: loaded Tainted: G B L ------------ T 3.10.0-1160.59.1.el7.x86_64 #1 RIP: 0010:[<ffffffff98229054>] [<ffffffff98229054>] kmem_cache_alloc+0x74/0x1f0 [<ffffffffc084a261>] nf_nat_cleanup_conntrack+0x41/0x70 [nf_nat]
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
kmem_cache_alloc
|
vmlinux |
0xffffffffb8023664
Build id: 3.10.0-1062.4.1.el7.x86_64 |
0x74 |
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 21s! [(journald):31596] Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13207(E) falcon_lsm_pinned_13109(E) falcon_lsm_pinned_13005(E) nls_utf8 isofs fuse rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache devlink binfmt_misc falcon_lsm_pinned_12905(E) ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel snd_hda_codec_generic lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel joydev snd_hda_codec virtio_balloon snd_hda_core sg snd_hwdep snd_seq parport_pc snd_seq_device parport snd_pcm snd_timer snd pcspkr i2c_piix4 soundcore auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_blk cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata serio_raw crct10dif_pclmul crct10dif_common virtio_pci crc32c_intel floppy virtio_ring virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal] CPU: 7 PID: 31596 Comm: (journald) Kdump: loaded Tainted: P W EL ------------ 3.10.0-1062.4.1.el7.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 task: ffffa0d535b1c1c0 ti: ffffa0cc97f20000 task.ti: ffffa0cc97f20000 RIP: 0010:[<ffffffffb8023664>] [<ffffffffb8023664>] kmem_cache_alloc+0x74/0x1f0 RSP: 0000:ffffa0d71f1c3d50 EFLAGS: 00010286 RAX: 0000000000000000 RBX: 0000000000000200 RCX: 0000000005596eee RDX: 0000000005596eed RSI: 0000000000000020 RDI: ffffa0a93fc03700 RBP: ffffa0d71f1c3d80 R08: 000000000001f120 R09: ffffffffb843bc5a R10: 0000000000000004 R11: 0000000000000005 R12: ffffa0d71f1c3cc8 R13: ffffffffb858cefa R14: ffffa0d71f1c3d80 R15: 0000000000000200 FS: 00007fdd2275a940(0000) GS:ffffa0d71f1c0000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00000000ee358007 CR3: 00000024d7f24000 CR4: 00000000001606e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
kmem_cache_alloc
|
vmlinux |
0xffffffffa3424fb8
Build id: 3.10.0-1062.12.1.el7.x86_64 |
0x78 |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 44s! [swapper/0:0] Modules linked in: tcp_lp nls_utf8 isofs rfcomm fuse lp xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security vmhgfs(OE) ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bnep vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel vmw_balloon btusb btrtl aesni_intel btbcm btintel lrw gf128mul glue_helper ablk_helper cryptd bluetooth snd_ens1371 snd_rawmidi nfit snd_ac97_codec ac97_bus libnvdimm snd_seq snd_seq_device joydev pcspkr snd_pcm sg snd_timer snd rfkill soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi serio_raw scsi_transport_spi libata mptscsih e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod CPU: 0 PID: 0 Comm: swapper/0 Kdump: loaded Tainted: G OEL ------------ 3.10.0-1062.12.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020 task: ffffffffa3e18480 ti: ffffffffa3e00000 task.ti: ffffffffa3e00000 RIP: 0010:[<ffffffffa3424fb8>] [<ffffffffa3424fb8>] kmem_cache_alloc+0x78/0x1f0 RSP: 0018:ffff9d1d7b6039a8 EFLAGS: 00000286 RAX: 0000000000000138 RBX: ffff9d1d08309700 RCX: 000000000000dd83 RDX: 000000000000dd82 RSI: 0000000000000020 RDI: ffff9d1d79c0cf00 RBP: ffff9d1d7b6039d8 R08: 00002e3e028039a0 R09: ffffffffc0a369d7 R10: ffff9d1d7b603b10 R11: ffffffffc0a4a300 R12: ffff9d1d7b603918 R13: ffffffffa398eefa R14: ffff9d1d7b6039d8 R15: ffff9d1d00409180 FS: 0000000000000000(0000) GS:ffff9d1d7b600000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f36fb36c000 CR3: 0000000076ffa000 CR4: 00000000003607f0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
kmem_cache_alloc
|
vmlinux |
0xffffffff81223503
Build id: 4.9.151-015.ali3000.alios7.x86_64 |
0x83 |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 33s! [kworker/0:0:4] Modules linked in: vfat fat bnep bluetooth rfkill xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 fuse tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter intel_rapl iosf_mbi x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel lrw glue_helper ablk_helper cryptd ipmi_devintf iTCO_wdt iTCO_vendor_support mei_me i2c_i801 lpc_ich ioatdma pcspkr sg dca mei mfd_core shpchp i2c_smbus wmi ipmi_si ipmi_msghandler acpi_pad acpi_power_meter nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c ax88179_178a usb_storage usbnet mii sd_mod ast i2c_algo_bit drm_kms_helper crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci libata i2c_core dm_mirror dm_region_hash dm_log dm_mod CPU: 0 PID: 4 Comm: kworker/0:0 Tainted: G L 4.9.151-015.ali3000.alios7.x86_64 #1 Hardware name: Inventec TB600G4_1U /TB600G4_1U , BIOS 1.0.PL.IV.P.027.12 09/22/2020 Workqueue: kacpid acpi_os_execute_deferred task: ffff881035718000 task.stack: ffffc9000029c000 RIP: 0010:[<ffffffff81223503>] [<ffffffff81223503>] kmem_cache_alloc+0x83/0x1a0 RSP: 0018:ffff88103c203e48 EFLAGS: 000102c6 RAX: ffff8802701c0d00 RBX: ffff8802701c2000 RCX: 00000001c1eb1681 RDX: 00000001c1eb1680 RSI: 0000000002080020 RDI: 000000000001d500 RBP: ffff88103c203e78 R08: ffff88103c21d500 R09: ffff8802701c0d00 R10: ffff880e94b9aa00 R11: 000000000001db00 R12: 0000000002080020 R13: ffffffff81608212 R14: ffff88103bc07480 R15: ffff88103bc07480 FS: 0000000000000000(0000) GS:ffff88103c200000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fcf7be5b140 CR3: 0000000001c08000 CR4: 00000000007606f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 PKRU: 55555554 Stack: ffff8802701c0d00 ffff880e94b9ab00 0000000002080020 ffff880e94b9ab00 ffff881028b048c0 ffff880e9451dcb7 ffff88103c203e98 ffffffff81608212 0000000000000000 00000000000017d0 ffff88103c203ed8 ffffffffa00c52ad Call Trace: