| Operating system | Count |
|---|---|
| CentOS 7 | 2,423 |
| Architecture | Count |
|---|---|
| x86_64 | 2,423 |
| Related packages | Count |
|---|---|
| kernel | 2,411 |
| kernel-lt | 12 |
Packages names with count less than the total count of reports are most probably not the cause of the problem.
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
e1000_alloc_rx_buffers
|
e1000 |
0xffffffffc00edc2e
Build id: 3.10.0-1062.18.1.el7.x86_64 |
0x3be |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [oracle:2429] Modules linked in: tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ppdev vmw_balloon sb_edac iosf_mbi snd_ens1371 crc32_pclmul snd_rawmidi snd_ac97_codec ghash_clmulni_intel ac97_bus snd_seq snd_seq_device aesni_intel lrw gf128mul snd_pcm glue_helper ablk_helper cryptd nfit libnvdimm pcspkr joydev snd_timer sg snd soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper ata_piix syscopyarea sysfillrect libata sysimgblt fb_sys_fops ttm drm e1000 crct10dif_pclmul crct10dif_common mptspi crc32c_intel scsi_transport_spi mptscsih mptbase serio_raw drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod CPU: 0 PID: 2429 Comm: oracle Kdump: loaded Tainted: G L ------------ 3.10.0-1062.18.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019 task: ffff9f6a74020000 ti: ffff9f6a7401c000 task.ti: ffff9f6a7401c000 RIP: 0010:[<ffffffffc00edc2e>] [<ffffffffc00edc2e>] e1000_alloc_rx_buffers+0x3be/0x610 [e1000] RSP: 0000:ffff9f6af6603ce0 EFLAGS: 00000286 RAX: ffffbd9ec0e82818 RBX: 0000000000000001 RCX: ffffffffae1accb0 RDX: 00000000000000cb RSI: 00000000bce21800 RDI: 00000000000005f2 RBP: ffff9f6af6603d38 R08: 00000000000005f2 R09: 0000000000000000 R10: ffff9f6af4e02640 R11: ffffddb9c004f880 R12: ffff9f6af6603c58 R13: ffffffffae58eefa R14: ffff9f6af6603d38 R15: 00000000000000cc FS: 00007f03fb201740(0000) GS:ffff9f6af6600000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000000011d357000 CR3: 00000001b4064000 CR4: 00000000001607f0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
e1000_alloc_rx_buffers
|
e1000 |
0xffffffffc02f7c2e
Build id: 3.10.0-1160.el7.x86_64 |
0x3be |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [khugepaged:48] Modules linked in: tun devlink scini(POE) bridge stp llc ip_set nfnetlink bnep vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 btusb btrtl iosf_mbi kvm_intel snd_rawmidi kvm snd_ac97_codec btbcm btintel irqbypass bluetooth ac97_bus snd_seq snd_seq_device snd_pcm crc32_pclmul ppdev ghash_clmulni_intel aesni_intel snd_timer snd rfkill lrw gf128mul soundcore glue_helper ablk_helper vmw_balloon cryptd pcspkr sg joydev ahci libahci parport_pc parport vmw_vmci i2c_piix4 xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common drm_kms_helper nfit crc32c_intel syscopyarea sysfillrect libnvdimm sysimgblt fb_sys_fops ttm ata_piix drm libata mptspi serio_raw scsi_transport_spi mptscsih mptbase e1000 drm_panel_orientation_quirks fuse [last unloaded: ip_tables] CPU: 0 PID: 48 Comm: khugepaged Kdump: loaded Tainted: P OE ------------ 3.10.0-1160.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020 task: ffff9093b8bd5280 ti: ffff9093aca10000 task.ti: ffff9093aca10000 RIP: 0010:[<ffffffffc02f7c2e>] [<ffffffffc02f7c2e>] e1000_alloc_rx_buffers+0x3be/0x610 [e1000] RSP: 0018:ffff9093b9603ce0 EFLAGS: 00000286 RAX: ffffb0b9c06c2818 RBX: ffff9093b9603c00 RCX: ffffffffa85b1370 RDX: 00000000000000bf RSI: 0000000061a3e240 RDI: 00000000000005f2 RBP: ffff9093b9603d38 R08: 00000000000005f2 R09: 0000000000000000 R10: ffff9092e1a3e240 R11: 000000000002cd80 R12: ffff9093b9603c58 R13: ffffffffa8994fba R14: ffff9093b9603d38 R15: 00000000000000c0 FS: 0000000000000000(0000) GS:ffff9093b9600000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00000000008ce2e4 CR3: 0000000032e10000 CR4: 00000000003607f0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
e1000_alloc_rx_buffers
|
e1000e |
0xffffffffc03d686f
Build id: 3.10.0-1160.49.1.el7.x86_64 |
0x26f |
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [redis-server:2177] Modules linked in: vsock_diag tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc ppdev sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon joydev pcspkr parport_pc parport sg vmw_vmci i2c_piix4 binfmt_misc ip_tables xfs libcrc32c ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper ahci syscopyarea sysfillrect sysimgblt fb_sys_fops ttm e1000e nfit libnvdimm crct10dif_pclmul crct10dif_common drm libahci crc32c_intel serio_raw ata_piix libata ptp pps_core vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse CPU: 1 PID: 2177 Comm: redis-server Kdump: loaded Tainted: G L ------------ 3.10.0-1160.49.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018 task: ffff9df3072a5280 ti: ffff9df50775c000 task.ti: ffff9df50775c000 RIP: 0010:[<ffffffffc03d686f>] [<ffffffffc03d686f>] e1000_alloc_rx_buffers+0x26f/0x2c0 [e1000e] RSP: 0018:ffff9df63fd03d48 EFLAGS: 00000246 RAX: ffffc37381bc2818 RBX: ffff9df309e79700 RCX: ffffffff823b1fd0 RDX: 0000000216084bc0 RSI: 0000000216084bc0 RDI: ffff9df375dc2098 RBP: ffff9df63fd03da0 R08: 0000000000000002 R09: 0000000000000000 R10: 0000000080000000 R11: ffff9df23550a800 R12: ffff9df63fd03cb8 R13: ffffffff82796fba R14: ffff9df63fd03da0 R15: 00000000000000b0 FS: 00007fe66ca59f80(0000) GS:ffff9df63fd00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fd9f8f68d00 CR3: 0000000328722000 CR4: 00000000003607e0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
e1000_alloc_rx_buffers
|
e1000 |
0xffffffffc03e1c0e
Build id: 3.10.0-957.5.1.el7.x86_64 |
0x3be |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 36s! [gsd-color:20124] Modules linked in: vfat fat uas usb_storage cmac arc4 md4 nls_utf8 cifs ccm dns_resolver fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc nfsv3 nfs_acl ebtable_filter nfs ebtables lockd grace ip6table_filter fscache ip6_tables devlink iptable_filter mvfs(OE) vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd sg soundcore nfit vmw_vmci i2c_piix4 libnvdimm parport_pc parport ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel vmwgfx serio_raw drm_kms_helper syscopyarea e1000 sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata mptspi scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks floppy CPU: 0 PID: 20124 Comm: gsd-color Kdump: loaded Tainted: G W OEL ------------ 3.10.0-957.5.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019 task: ffff9d28d1bc30c0 ti: ffff9d237b2f8000 task.ti: ffff9d237b2f8000 RIP: 0010:[<ffffffffc03e1c0e>] [<ffffffffc03e1c0e>] e1000_alloc_rx_buffers+0x3be/0x610 [e1000] RSP: 0000:ffff9d28f6403ce0 EFLAGS: 00000286 RAX: ffffb950c3342818 RBX: ffffffffb25614c0 RCX: 00000000000005f2 RDX: 000000000000004a RSI: ffff9d28f0d88c40 RDI: ffff9d290fb628c0 RBP: ffff9d28f6403d38 R08: 000000000001f120 R09: ffffffffb1e21717 R10: ffff9d28f641f120 R11: fffff77a15d49d00 R12: ffff9d28f6403c58 R13: ffffffffb1f75df2 R14: ffff9d28f6403d38 R15: 000000000000004b FS: 00007efcd6616a80(0000) GS:ffff9d28f6400000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f4b834e9c30 CR3: 00000005f9eaa000 CR4: 00000000001607f0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
e1000_alloc_rx_buffers
|
e1000 |
0xffffffffc0238c0e
Build id: 3.10.0-957.1.3.el7.x86_64 |
0x3be |
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [msgr-worker-1:132438] Modules linked in: xt_CHECKSUM iptable_mangle ipt_REJECT nf_reject_ipv4 tun ebtable_filter ebtables devlink ip6table_filter ip6_tables ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) iscsi_tcp libiscsi_tcp libiscsi target_core_user target_core_mod scsi_transport_iscsi uio vmhgfs(OE) vmw_vsock_vmci_transport vsock bnep sunrpc snd_seq_midi snd_seq_midi_event ppdev vmw_balloon coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr btusb btrtl btbcm snd_ens1371 btintel snd_rawmidi bluetooth snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm rfkill snd_timer snd soundcore sg parport_pc parport vmw_vmci i2c_piix4 dm_multipath ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_pclmul crct10dif_common crc32c_intel ata_generic pata_acpi serio_raw vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm e1000 mptspi scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks ata_piix libata nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod CPU: 1 PID: 132438 Comm: msgr-worker-1 Kdump: loaded Tainted: G OE ------------ T 3.10.0-957.1.3.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015 task: ffff8d9b256c6180 ti: ffff8d9b13778000 task.ti: ffff8d9b13778000 RIP: 0010:[<ffffffffc0238c0e>] [<ffffffffc0238c0e>] e1000_alloc_rx_buffers+0x3be/0x610 [e1000] RSP: 0018:ffff8d9b6d643d48 EFLAGS: 00000286 RAX: ffffa72241c82818 RBX: ffffffff96839579 RCX: 00000000000005f2 RDX: 0000000000000010 RSI: ffff8d9b687e2000 RDI: ffff8d9b6c81a8c0 RBP: ffff8d9b6d643da0 R08: 000000000001f120 R09: ffffffff96821717 R10: ffff8d9b6d65f120 R11: ffffcf0602b15f00 R12: ffff8d9b6d643cb8 R13: ffffffff96975df2 R14: ffff8d9b6d643da0 R15: 0000000000000011 FS: 00007f34dcbcb700(0000) GS:ffff8d9b6d640000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000000890f20 CR3: 00000003e5f48000 CR4: 00000000003607e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
e1000_alloc_rx_buffers
|
e1000 |
0xffffffffa010e55e
Build id: 3.10.0-327.el7.x86_64 |
0x24e |
BUG: soft lockup - CPU#27 stuck for 21s! [swapper/27:0] Modules linked in: xt_set xt_multiport ip_set_hash_ip ip_set nfnetlink rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun ip6t_rpfilter ip6t_REJECT ipt_REJECT xt_conntrack ebtable_nat ebtable_broute bridge stp llc ebtable_filter ebtables ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw ip6table_filter ip6_tables iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw iptable_filter nvidia_drm(POE) nvidia_modeset(POE) nvidia_uvm(OE) nvidia(POE) ext4 mbcache jbd2 sg ipmi_msghandler snd_hda_intel snd_hda_codec ppdev virtio_balloon snd_hda_core snd_hwdep i2c_i801 lpc_ich mfd_core snd_seq snd_seq_device snd_pcm snd_timer snd soundcore shpchp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc dm_multipath ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic virtio_blk cirrus syscopyarea sysfillrect sysimgblt drm_kms_helper ahci ttm libahci crct10dif_pclmul crct10dif_common virtio_pci virtio_ring crc32c_intel libata e1000 drm serio_raw virtio i2c_core dm_mirror dm_region_hash dm_log dm_mod CPU: 27 PID: 0 Comm: swapper/27 Tainted: P W OEL ------------ 3.10.0-327.el7.x86_64 #1 Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.8.2-0-g33fbe13 by qemu-project.org 04/01/2014 task: ffff8817fb038000 ti: ffff8817fb034000 task.ti: ffff8817fb034000 RIP: 0010:[<ffffffffa010e55e>] [<ffffffffa010e55e>] e1000_alloc_rx_buffers+0x24e/0x450 [e1000] RSP: 0018:ffff88307fd83c90 EFLAGS: 00000286 RAX: ffffc90028c82818 RBX: 0000000000000202 RCX: 000000007cee5800 RDX: 000000000000002b RSI: 000000007cee5800 RDI: ffff882ffa9ee098 RBP: ffff88307fd83ce0 R08: 0000000000000202 R09: 0000000000000000 R10: ffffffff81517cf7 R11: ffffea005f818980 R12: ffff88307fd83c08 R13: ffffffff8164655d R14: ffff88307fd83ce0 R15: ffff882ff9e868c0 FS: 0000000000000000(0000) GS:ffff88307fd80000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fade7b1fec0 CR3: 00000017f48b5000 CR4: 00000000001407e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Stack: ffff88307fd83cc0 ffff882ff9e86000 00000000000005f2 ffff882ff9e868c0 ffff882ffa9ee000 0000000000000000 000000000000002d ffff8817e0627c00 ffff880035e872d0 ffff880035e872c0 ffff88307fd83da0 ffffffffa010e16d Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
e1000_alloc_rx_buffers
|
e1000 |
0xffffffffc00b2a26
Build id: 3.10.0-693.5.2.el7.x86_64 |
0x366 |
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 28s! [packagekitd:1616] Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter xt_set ip_set nfnetlink ip_vs nf_conntrack vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul snd_ens1371 glue_helper ablk_helper cryptd snd_rawmidi snd_ac97_codec ac97_bus snd_seq ppdev snd_seq_device snd_pcm vmw_balloon snd_timer snd pcspkr joydev soundcore i2c_piix4 sg vmw_vmci shpchp nfit libnvdimm parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm crc32c_intel serio_raw e1000 ata_piix libata mptspi scsi_transport_spi mptscsih mptbase i2c_core CPU: 2 PID: 1616 Comm: packagekitd Tainted: G W L ------------ 3.10.0-693.5.2.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015 task: ffff8800b2266eb0 ti: ffff8800a096c000 task.ti: ffff8800a096c000 RIP: 0010:[<ffffffffc00b2a26>] [<ffffffffc00b2a26>] e1000_alloc_rx_buffers+0x366/0x5a0 [e1000] RSP: 0018:ffff880139683d08 EFLAGS: 00000286 RAX: ffffc90000702818 RBX: ffffffff81586f22 RCX: ffff88013688b000 RDX: 00000000000000f6 RSI: 0000000090f78fc0 RDI: 00000000000005f2 RBP: ffff880139683d60 R08: 00000000000005f2 R09: 0000000000000000 R10: ffff880090f78fc0 R11: ffffea00029cef00 R12: ffff880139683c78 R13: ffffffff816b5cdd R14: ffff880139683d60 R15: 00000000000000f7 FS: 00007fa21cd6d8c0(0000) GS:ffff880139680000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fa44d0ed440 CR3: 000000013587a000 CR4: 00000000000407e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Stack: 000005f239683d38 00000000000005f1 ffff880090f78fc0 ffff880110f78fc0 ffff88013688b000 ffff88013688b098 0000000000000000 ffff8801359ce8c0 ffff8800b4beef70 ffff8800a73bf500 ffff8800b4beef80 ffff880139683e08 Call Trace: