| Operating system | Count |
|---|---|
| CentOS 7 | 13 |
| Architecture | Count |
|---|---|
| x86_64 | 13 |
| Related packages | Count |
|---|---|
| kernel | 13 |
Packages names with count less than the total count of reports are most probably not the cause of the problem.
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__ip_dev_find
|
vmlinux |
0xffffffff8159c029
Build id: 3.10.0-327.el7.x86_64 |
0x39 |
BUG: soft lockup - CPU#0 stuck for 22s! [kworker/0:2:393207] Modules linked in: 8021q garp stp mrp llc mpt2sas raid_class scsi_transport_sas mptctl mptbase beegfs(OE) rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache ib_isert iscsi_target_mod ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt dell_rbu ib_ucm ext4 mbcache jbd2 dcdbas coretemp kvm_intel svcrdma xprtrdma kvm rdma_ucm crc32_pclmul ib_uverbs(OE) ghash_clmulni_intel ib_iser ib_umad rdma_cm ipmi_devintf ib_ipoib iw_cm aesni_intel lrw ib_cm gf128mul libiscsi glue_helper ablk_helper ib_sa cryptd scsi_transport_iscsi pcspkr raid0 sg shpchp wmi ipmi_si ipmi_msghandler acpi_pad acpi_power_meter nfsd auth_rpcgss nfs_acl lockd grace ip_tables sd_mod crc_t10dif crct10dif_generic hfi1(OE) crct10dif_pclmul crct10dif_common rdmavt(OE) crc32c_intel ib_mad i40e ib_core igb ib_addr vxlan i2c_algo_bit ahci ip6_udp_tunnel i2c_core libahci dca udp_tunnel ptp pps_core libata usb_storage sunrpc CPU: 0 PID: 393207 Comm: kworker/0:2 Tainted: G OEL ------------ 3.10.0-327.el7.x86_64 #1 Hardware name: Dell Inc. PowerEdge C6420/0XG00K, BIOS 2.19.1 06/12/2023 Workqueue: events i40e_service_task [i40e] task: ffff88178b9af300 ti: ffff8817853d4000 task.ti: ffff8817853d4000 RIP: 0010:[<ffffffff8159c029>] [<ffffffff8159c029>] __ip_dev_find+0x39/0x130 RSP: 0000:ffff8817df603868 EFLAGS: 00000203 RAX: 000000000000002a RBX: ffff8817df603830 RCX: ffff882fb316de80 RDX: 0000000000000000 RSI: 000000002703020a RDI: ffffffff81a25e00 RBP: ffff8817df6038b8 R08: 00000000000032dc R09: 000000002703020a R10: 00000000c200020a R11: 0000000000000006 R12: ffff8817df6037d8 R13: ffffffff8164655d R14: ffff8817df6038b8 R15: 0000000000000000 FS: 0000000000000000(0000) GS:ffff8817df600000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00000000000000b8 CR3: 000000000194a000 CR4: 00000000003407f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Stack: 0000000000000000 0000000000000000 ffffffff810e0620 ffff8817df60da58 ffff8817df6038b0 ffffffff8108e8ee ffff8817df6039c8 00018da288cc0d24 0000000041a29114 ffff8817df6039b0 ffff8817df603938 ffffffff81562727 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__ip_dev_find
|
vmlinux |
0xffffffff816016dc
Build id: 3.10.0-693.el7.x86_64 |
0x5c |
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 28s! [kworker/1:2:42393] Modules linked in: xt_nat veth nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay(T) vmhgfs(OE) bnep vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event ext4 mbcache jbd2 crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper btusb ablk_helper btrtl cryptd ppdev btbcm btintel snd_ens1371 bluetooth snd_rawmidi vmw_balloon snd_ac97_codec ac97_bus snd_seq snd_seq_device pcspkr snd_pcm joydev nfit snd_timer rfkill snd sg libnvdimm soundcore vmw_vmci i2c_piix4 shpchp parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm e1000 crct10dif_pclmul crct10dif_common crc32c_intel mptspi ata_piix scsi_transport_spi libata serio_raw mptscsih mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod CPU: 1 PID: 42393 Comm: kworker/1:2 Tainted: G W OEL ------------ T 3.10.0-693.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020 Workqueue: events_freezable vmballoon_work [vmw_balloon] task: ffff88022776bf40 ti: ffff88003720c000 task.ti: ffff88003720c000 RIP: 0010:[<ffffffff816016dc>] [<ffffffff816016dc>] __ip_dev_find+0x5c/0x140 RSP: 0018:ffff880235643ac8 EFLAGS: 00000246 RAX: ffff8802206c1000 RBX: 0000000000000010 RCX: ffff8802207ec600 RDX: 0000000000000000 RSI: 00000000040014ac RDI: ffff8800a7731440 RBP: ffff880235643b48 R08: ffff8800a7731440 R09: 00000000040014ac R10: 000000000450a8c0 R11: 0000000000000006 R12: ffff880235643a38 R13: ffffffff816b5c1d R14: ffff880235643b48 R15: 0000000000000000 FS: 0000000000000000(0000) GS:ffff880235640000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f2cb92bb000 CR3: 0000000229e26000 CR4: 00000000003407e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Stack: ffffffff81d86920 ffff880235643b40 000000000001e41b 0000000000062995 ffffffff81d86120 00000000ffffffff ffff880235643b08 ffffffff8108828c ffff880235643b30 ffffffff8108831f ffffffff81dd3d80 0000000000000000 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__ip_dev_find
|
vmlinux |
0xffffffff816016b6
Build id: 3.10.0-693.el7.x86_64 |
0x36 |
NMI watchdog: BUG: soft lockup - CPU#10 stuck for 23s! [ksoftirqd/10:58] Modules linked in: xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common ahci libahci libata crc32c_intel serio_raw vmxnet3 vmw_pvscsi i2c_core dm_mirror dm_region_hash dm_log dm_mod CPU: 10 PID: 58 Comm: ksoftirqd/10 Tainted: G L ------------ 3.10.0-693.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/28/2020 task: ffff88017459bf40 ti: ffff8801745e4000 task.ti: ffff8801745e4000 RIP: 0010:[<ffffffff816016b6>] [<ffffffff816016b6>] __ip_dev_find+0x36/0x140 RSP: 0000:ffff88081f4838b8 EFLAGS: 00000216 RAX: 0000000000000035 RBX: 0000000000000246 RCX: 000000006018000a RDX: 0000000000000000 RSI: 000000006018000a RDI: ffffffff81ad9d40 RBP: ffff88081f483938 R08: ffffffff81ad9d40 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000007 R12: ffff88081f483828 R13: ffffffff816b5c1d R14: ffff88081f483938 R15: 0000000000000000 FS: 0000000000000000(0000) GS:ffff88081f480000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f5f358c7898 CR3: 00000007e1687000 CR4: 00000000003407e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Stack: ffff88081f483940 ffff88081f483900 ffffffff810c83a4 ffff88081f4838e0 0000000000000000 0000000000000000 000000003fb020dd ffff88017459bf40 ffff88081f483948 ffff88081f4839a0 ffffffff810b3481 000000000000000a Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__ip_dev_find
|
vmlinux |
0xffffffff816016dc
Build id: 3.10.0-693.el7.x86_64 |
0x5c |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/0:0:85898] Modules linked in: tcp_lp fuse xt_CHECKSUM ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype iptable_filter xt_conntrack iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack ip_tables devlink veth br_netfilter overlay(T) tun ip_set nfnetlink bridge stp llc vmw_vsock_vmci_transport vsock sb_edac edac_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev nfit vmw_balloon pcspkr joydev sg libnvdimm parport_pc parport vmw_vmci i2c_piix4 shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc xfs libcrc32c ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx mptspi scsi_transport_spi mptscsih drm_kms_helper mptbase crct10dif_pclmul crct10dif_common crc32c_intel syscopyarea sysfillrect ata_piix sysimgblt fb_sys_fops ttm libata drm serio_raw e1000 i2c_core dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables] CPU: 0 PID: 85898 Comm: kworker/0:0 Tainted: G W L ------------ T 3.10.0-693.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017 Workqueue: events do_cache_clean [sunrpc] task: ffff8800162aeeb0 ti: ffff8800063fc000 task.ti: ffff8800063fc000 RIP: 0010:[<ffffffff816016dc>] [<ffffffff816016dc>] __ip_dev_find+0x5c/0x140 RSP: 0018:ffff880139603ac8 EFLAGS: 00000246 RAX: ffff8800b52b9000 RBX: ffffffffffffff5a RCX: ffff8800a3e27700 RDX: 0000000000000000 RSI: 00000000020012ac RDI: ffff8800b0db9440 RBP: ffff880139603b48 R08: ffff8800b0db9440 R09: 00000000020012ac R10: 0000000034edc70a R11: 0000000000000006 R12: ffff880139603a38 R13: ffffffff816b5c1d R14: ffff880139603b48 R15: 0000000000000000 FS: 0000000000000000(0000) GS:ffff880139600000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: ffffffffc0500fd5 CR3: 00000000019f2000 CR4: 00000000003407f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Stack: ffff88013181e000 ffff88013181e084 00000000000000a5 00000000000000a5 ffff8800063ffd58 ffff880139603b10 ffffffff81134159 0000000000000013 0000000000000013 ffff880139603b48 0000000000000046 0000000000000000 Call Trace: