| Operating system | Count |
|---|---|
| CentOS 7 | 116 |
| Fedora 33 | 1 |
| Architecture | Count |
|---|---|
| x86_64 | 117 |
| Related packages | Count |
|---|---|
| kernel | 116 |
Packages names with count less than the total count of reports are most probably not the cause of the problem.
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__kmalloc_node_track_caller
|
vmlinux |
0xffffffffa1e26c5b
Build id: 3.10.0-1062.4.1.el7.x86_64 |
0x17b |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 24s! [gmain:7410] Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_14203(E) falcon_lsm_pinned_14108(E) falcon_lsm_pinned_14006(E) devlink binfmt_misc ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel snd_hda_codec_generic lrw gf128mul glue_helper ablk_helper cryptd joydev snd_hda_intel virtio_balloon snd_hda_codec sg snd_hda_core snd_hwdep parport_pc snd_seq parport snd_seq_device snd_pcm snd_timer snd i2c_piix4 pcspkr soundcore auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_blk cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata crct10dif_pclmul crct10dif_common crc32c_intel virtio_pci virtio_ring serio_raw virtio drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal] CPU: 0 PID: 7410 Comm: gmain Kdump: loaded Tainted: P EL ------------ 3.10.0-1062.4.1.el7.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 task: ffffa053ddca3150 ti: ffffa04bf47e8000 task.ti: ffffa04bf47e8000 RIP: 0010:[<ffffffffa1e26c5b>] [<ffffffffa1e26c5b>] __kmalloc_node_track_caller+0x17b/0x290 RSP: 0000:ffffa053df003d10 EFLAGS: 00010246 RAX: 0000000000000000 RBX: ffffa04748691e00 RCX: 00000000003387b4 RDX: 00000000003387b3 RSI: 0000000000000000 RDI: 000000000001f140 RBP: ffffa053df003d58 R08: ffffa053df01f140 R09: ffffa025ffc03600 R10: ffffa025ffc03600 R11: 0000000000000014 R12: ffffa053df003c88 R13: ffffffffa238cefa R14: ffffa053df003d58 R15: ffffa04748691e00 FS: 00007f9a6832b700(0000) GS:ffffa053df000000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00000000a2b64000 CR3: 00000027746e2000 CR4: 00000000001606f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__kmalloc_node_track_caller
|
vmlinux |
0xffffffff9822b28b
Build id: 3.10.0-1160.59.1.el7.x86_64 |
0x17b |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 28s! [NetworkManager:731] Modules linked in: talpa_vfshook(OE) talpa_pedconnector(OE) talpa_pedevice(OE) talpa_vcdevice(OE) talpa_core(OE) talpa_linux(OE) talpa_syscallhook(OE) ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 nf_log_ipv4 nf_log_common ip6table_filter nf_nat_ftp xt_REDIRECT nf_nat_redirect xt_conntrack nf_conntrack_ftp xt_LOG xt_limit xt_multiport iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 ip6table_mangle ip6table_raw ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 nf_nat nf_conntrack ip6_tables iptable_mangle iptable_raw ipt_REJECT nf_reject_ipv4 iptable_filter sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon joydev pcspkr sg parport_pc parport i2c_piix4 vmw_vmci tcp_htcp ip_tables xfs libcrc32c vmwgfx sr_mod cdrom drm_kms_helper ata_generic pata_acpi syscopyarea sysfillrect sysimgblt sd_mod crc_t10dif fb_sys_fops crct10dif_generic ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix serio_raw libata vmw_pvscsi e1000 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod CPU: 0 PID: 731 Comm: NetworkManager Kdump: loaded Tainted: G OEL ------------ 3.10.0-1160.59.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014 task: ffff99c62ee0a100 ti: ffff99c62e608000 task.ti: ffff99c62e608000 RIP: 0010:[<ffffffff9822b28b>] [<ffffffff9822b28b>] __kmalloc_node_track_caller+0x17b/0x290 RSP: 0018:ffff99c63fc038a0 EFLAGS: 00010246 RAX: 0000000000000000 RBX: ffffffff986aa874 RCX: 00000000003864c3 RDX: 00000000003864c2 RSI: 0000000000000000 RDI: 000000000001f160 RBP: ffff99c63fc038e8 R08: ffff99c63fc1f160 R09: ffff99c37fc01500 R10: ffff99c37fc01500 R11: 0000000000000007 R12: ffff99c63fc03818 R13: ffffffff9879afba R14: ffff99c63fc038e8 R15: ffff99c57f000e00 FS: 00007fd8fe3cd940(0000) GS:ffff99c63fc00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fde47e6b000 CR3: 000000042a304000 CR4: 00000000000407f0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__kmalloc_node_track_caller
|
vmlinux |
0xffffffffafffa6ab
Build id: 3.10.0-862.9.1.el7.x86_64 |
0x17b |
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [kworker/1:3:372] Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_10913(E) falcon_lsm_pinned_10807(E) falcon_lsm_pinned_10805(E) falcon_lsm_pinned_10801(E) falcon_lsm_pinned_10703(E) falcon_lsm_pinned_10404(E) falcon_lsm_pinned_10402(E) falcon_lsm_pinned_9917(E) falcon_lsm_pinned_9808(E) tcp_diag udp_diag inet_diag falcon_lsm_pinned_9806(E) falcon_lsm_pinned_9607(E) falcon_lsm_pinned_9804(E) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock falcon_lsm_pinned_9705(E) sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg vmw_vmci i2c_piix4 shpchp nfit libnvdimm parport_pc parport nfsd nfs_acl lockd grace auth_rpcgss sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm e1000 ata_piix mptspi i2c_core scsi_transport_spi crct10dif_pclmul crct10dif_common mptscsih libata mptbase crc32c_intel serio_raw dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_lsm_serviceable] CPU: 1 PID: 372 Comm: kworker/1:3 Tainted: P W EL ------------ 3.10.0-862.9.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018 Workqueue: events_freezable disk_events_workfn task: ffff897e2b2a2f70 ti: ffff897e94c70000 task.ti: ffff897e94c70000 RIP: 0010:[<ffffffffafffa6ab>] [<ffffffffafffa6ab>] __kmalloc_node_track_caller+0x17b/0x290 RSP: 0000:ffff897f21c43d10 EFLAGS: 00010246 RAX: 0000000000000000 RBX: 000000001a4ca146 RCX: 00000000afd66460 RDX: 00000000afd6645f RSI: 0000000000000000 RDI: 000000000001bb40 RBP: ffff897f21c43d58 R08: ffff897f21c5bb40 R09: ffff897c7fc03500 R10: ffff897c7fc03500 R11: 0000000000000000 R12: ffff897f21c43c88 R13: ffffffffb05217b2 R14: ffff897f21c43d58 R15: ffff897d606f6100 FS: 0000000000000000(0000) GS:ffff897f21c40000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f8e2460d3e4 CR3: 000000036875e000 CR4: 00000000001607e0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__kmalloc_node_track_caller
|
vmlinux |
0xffffffffa2dfa22b
Build id: 3.10.0-862.3.3.el7.x86_64 |
0x17b |
BUG: unable to handle kernel NULL pointer dereference at 0000000000000031 IP: [<ffffffffa2dfa22b>] __kmalloc_node_track_caller+0x17b/0x290 PGD 0 Oops: 0000 [#1] SMP Modules linked in: squashfs loop overlay(T) 8021q garp mrp stp llc beegfs(OE) nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ib_isert iscsi_target_mod ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ucm rpcrdma rdma_ucm ib_uverbs ib_iser rdma_cm iw_cm opa_vnic libiscsi ib_umad ib_ipoib scsi_transport_iscsi ib_cm iTCO_wdt iTCO_vendor_support sunrpc skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm hfi1 ast irqbypass crc32_pclmul ttm ipmi_ssif ghash_clmulni_intel drm_kms_helper aesni_intel lrw syscopyarea gf128mul sysfillrect glue_helper sysimgblt ablk_helper fb_sys_fops cryptd rdmavt ixgbe drm ib_core pcspkr ptp joydev pps_core mei_me mdio i2c_algo_bit i2c_i801 sg dca mei i2c_core shpchp lpc_ich wmi ipmi_si ipmi_devintf ipmi_msghandler nfit libnvdimm acpi_pad acpi_power_meter binfmt_misc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel ahci libahci libata CPU: 44 PID: 286704 Comm: kworker/44:1H Tainted: G W OEL ------------ T 3.10.0-862.3.3.el7.x86_64 #1 Hardware name: Intel Corporation S2600BPB/S2600BPB, BIOS SE5C620.86B.00.01.0013.030920180427 03/09/2018 Workqueue: xprtiod xs_tcp_data_receive_workfn [sunrpc] task: ffff939e20b31fa0 ti: ffff938caf750000 task.ti: ffff938caf750000 RIP: 0010:[<ffffffffa2dfa22b>] [<ffffffffa2dfa22b>] __kmalloc_node_track_caller+0x17b/0x290 RSP: 0018:ffff93a41e003c28 EFLAGS: 00010246 RAX: 0000000000000000 RBX: ffff93a8f06ffe00 RCX: 00000000009c2adc RDX: 00000000009c2adb RSI: 0000000000000000 RDI: 000000000001bae0 RBP: ffff93a41e003c70 R08: ffff93a41e01bae0 R09: ffff938dbfc07600 R10: ffff938dbfc07600 R11: 0000000000000400 R12: 0000000000010220 R13: 00000000000001c0 R14: 0000000000000031 R15: 00000000ffffffff FS: 0000000000000000(0000) GS:ffff93a41e000000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000000000031 CR3: 00000011f7ba4000 CR4: 00000000007607e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 PKRU: 00000000 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__kmalloc_node_track_caller
|
vmlinux |
0xffffffff97c2a93b
Build id: 3.10.0-1127.8.2.el7.x86_64 |
0x17b |
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 21s! [mongod:11265] Modules linked in: binfmt_misc xt_nat veth nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc coretemp crc32_pclmul ghash_clmulni_intel aesni_intel ppdev vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd sg joydev pcspkr vmw_vmci parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi drm ata_piix scsi_transport_spi mptscsih libata crct10dif_pclmul crct10dif_common crc32c_intel mptbase vmxnet3 serio_raw drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod CPU: 3 PID: 11265 Comm: mongod Kdump: loaded Tainted: G L ------------ T 3.10.0-1127.8.2.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014 task: ffff930c5aed41c0 ti: ffff930538d68000 task.ti: ffff930538d68000 RIP: 0010:[<ffffffff97c2a93b>] [<ffffffff97c2a93b>] __kmalloc_node_track_caller+0x17b/0x290 RSP: 0000:ffff930cbfd83d10 EFLAGS: 00010246 RAX: 0000000000000000 RBX: ffff930cbfd9acc0 RCX: 00000000004c1813 RDX: 00000000004c1812 RSI: 0000000000000000 RDI: 000000000001f160 RBP: ffff930cbfd83d58 R08: ffff930cbfd9f160 R09: ffff9305ffc01500 R10: ffff9305ffc01500 R11: ffff930c9f062000 R12: ffff930cbfd83c88 R13: ffffffff98193efa R14: ffff930cbfd83d58 R15: ffff930c755fd800 FS: 00007ff047263700(0000) GS:ffff930cbfd80000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007ff0510d2000 CR3: 00000007d1136000 CR4: 00000000000007e0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__kmalloc_node_track_caller
|
vmlinux |
0xffffffff9601f94f
Build id: 3.10.0-957.21.3.el7.x86_64 |
0x17f |
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 34s! [smbd:26765] Modules linked in: binfmt_misc xt_CHECKSUM tun devlink rpcsec_gss_krb5 nfsv4 nfs fscache ip_set_hash_ip rbd libceph dns_resolver ipmi_devintf ipmi_msghandler nf_nat_tftp nf_conntrack_tftp nf_conntrack_netbios_ns nf_conntrack_broadcast nf_nat_ftp nf_conntrack_ftp xt_set xt_multiport ip6t_MASQUERADE nf_nat_masquerade_ipv6 xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_mark ip6t_rpfilter ipt_REJECT nf_reject_ipv4 nf_log_ipv4 ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 nf_log_common xt_LOG xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg parport_pc parport i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common crc32c_intel mptspi libata serio_raw scsi_transport_spi nfit mptscsih libnvdimm mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod CPU: 3 PID: 26765 Comm: smbd Kdump: loaded Tainted: G W L ------------ 3.10.0-957.21.3.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018 task: ffff9249b6b930c0 ti: ffff92545b9bc000 task.ti: ffff92545b9bc000 RIP: 0010:[<ffffffff9601f94f>] [<ffffffff9601f94f>] __kmalloc_node_track_caller+0x17f/0x290 RSP: 0000:ffff924e67cc3d10 EFLAGS: 00000246 RAX: 0000000000000000 RBX: 00000000817bd256 RCX: 0000000000203e43 RDX: 0000000000203e42 RSI: 0000000000000000 RDI: 000000000001f140 RBP: ffff924e67cc3d58 R08: ffff924e67cdf140 R09: ffff9249bfc03600 R10: ffff9249bfc03600 R11: ffffeb5cd8907b00 R12: ffff924e67cc3c88 R13: ffffffff96576df2 R14: ffff924e67cc3d58 R15: ffff924cdd0bc800 FS: 00007fcae1de2900(0000) GS:ffff924e67cc0000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fcad1e6dee0 CR3: 0000000721074000 CR4: 00000000001607e0 Call Trace: