| Operating system | Count |
|---|---|
| CentOS 7 | 86 |
| Architecture | Count |
|---|---|
| x86_64 | 86 |
| Related packages | Count |
|---|---|
| kernel | 86 |
Packages names with count less than the total count of reports are most probably not the cause of the problem.
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
queue_work_on
|
vmlinux |
0xffffffffbd0bc1ed
Build id: 3.10.0-1160.21.1.el7.x86_64 |
0x2d |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [feconf:8500] Modules linked in: tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ib_isert iscsi_target_mod ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt rpcrdma rdma_ucm ib_umad ib_iser ib_ipoib rdma_cm iw_cm libiscsi scsi_transport_iscsi ib_cm iTCO_wdt iTCO_vendor_support mxm_wmi sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm snd_hda_codec_realtek snd_hda_codec_generic irqbypass crc32_pclmul ghash_clmulni_intel ftdi_sio aesni_intel snd_hda_intel lrw gf128mul glue_helper ablk_helper snd_hda_codec cryptd pcspkr mlx5_ib snd_hda_core sg snd_hwdep snd_seq ib_uverbs snd_seq_device snd_pcm lpc_ich joydev ib_core i2c_i801 snd_timer snd soundcore ipmi_si ipmi_devintf ipmi_msghandler wmi acpi_power_meter flx(OE) io_rcc(POE) openafs(POE) auth_rpcgss binfmt_misc cmem_rcc(OE) sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mlx5_core drm ahci libahci libata crct10dif_pclmul crct10dif_common crc32c_intel igb serio_raw mlxfw devlink ptp drm_panel_orientation_quirks dca i2c_algo_bit pps_core dm_mirror dm_region_hash dm_log dm_mod CPU: 0 PID: 8500 Comm: feconf Kdump: loaded Tainted: P OEL ------------ 3.10.0-1160.21.1.el7.x86_64 #1 Hardware name: Supermicro X10SRA-F/X10SRA-F, BIOS 2.0 01/28/2016 task: ffff8b49cca54200 ti: ffff8b51bd24c000 task.ti: ffff8b51bd24c000 RIP: 0010:[<ffffffffbd0bc1ed>] [<ffffffffbd0bc1ed>] queue_work_on+0x2d/0x50 RSP: 0000:ffff8b51df203e48 EFLAGS: 00000246 RAX: 0000000000000000 RBX: ffffffffbd0bbba5 RCX: 0000000000000001 RDX: 0000000000000001 RSI: 0000000000000092 RDI: 0000000000000246 RBP: ffff8b51df203e50 R08: ffff8b51df21a560 R09: ffffffffbe104bc0 R10: 000000000000bc4b R11: 000000000000041d R12: ffff8b51df203db8 R13: ffffffffbd796fba R14: ffff8b51df203e50 R15: 0000000000000246 FS: 00007fd47f1f6740(0000) GS:ffff8b51df200000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fd47f28e4c0 CR3: 000000015fbb0000 CR4: 00000000001607f0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
queue_work_on
|
vmlinux |
0xffffffff918bc2ad
Build id: 3.10.0-1160.45.1.el7.x86_64 |
0x2d |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 32s! [kworker/0:1:28919] Modules linked in: ppp_deflate bsd_comp ppp_async crc_ccitt ppp_generic slhc tcp_lp nls_utf8 isofs vboxsf(OE) nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter binfmt_misc overlay(T) snd_intel8x0 snd_ac97_codec ac97_bus joydev snd_seq ppdev snd_seq_device vboxguest(OE) snd_pcm iosf_mbi sg snd_timer pcspkr snd i2c_piix4 soundcore parport_pc video parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod cdrom crct10dif_generic crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci ata_piix libahci drm libata crc32c_intel serio_raw e1000 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse CPU: 0 PID: 28919 Comm: kworker/0:1 Kdump: loaded Tainted: G OEL ------------ T 3.10.0-1160.45.1.el7.x86_64 #1 Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 task: ffff9eb1599b2100 ti: ffff9eb0898e4000 task.ti: ffff9eb0898e4000 RIP: 0010:[<ffffffff918bc2ad>] [<ffffffff918bc2ad>] queue_work_on+0x2d/0x50 RSP: 0018:ffff9eb15f203e48 EFLAGS: 00010246 RAX: 0000000000000001 RBX: ffffffff918bbc65 RCX: 0000000000000001 RDX: 0000000000000000 RSI: 0000000000000092 RDI: 0000000000000246 RBP: ffff9eb15f203e50 R08: ffffffff9201e640 R09: ffff9eb1599b2100 R10: 000000000000b6b9 R11: 0000000000000003 R12: ffff9eb15f203db8 R13: ffffffff91f96fba R14: ffff9eb15f203e50 R15: 0000000000000246 FS: 0000000000000000(0000) GS:ffff9eb15f200000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00000000000000b8 CR3: 00000000a6abe000 CR4: 00000000000206f0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
queue_work_on
|
vmlinux |
0xffffffff902bb5d0
Build id: 3.10.0-1062.4.1.el7.x86_64 |
- |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 27s! [kworker/0:1:4012] Modules linked in: veth nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache devlink binfmt_misc falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13601(E) ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ppdev iosf_mbi crc32_pclmul snd_hda_codec_generic ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel joydev snd_hda_codec virtio_balloon snd_hda_core sg snd_hwdep snd_seq parport_pc snd_seq_device parport snd_pcm snd_timer snd soundcore pcspkr i2c_piix4 auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_blk cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common libata crc32c_intel floppy serio_raw virtio_pci virtio_ring drm_panel_orientation_quirks virtio dm_mirror dm_region_hash dm_log dm_mod CPU: 0 PID: 4012 Comm: kworker/0:1 Kdump: loaded Tainted: P EL ------------ T 3.10.0-1062.4.1.el7.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Workqueue: events_freezable disk_events_workfn task: ffff8834194c62a0 ti: ffff8833feae8000 task.ti: ffff8833feae8000 RIP: 0010:[<ffffffff902bb5d0>] [<ffffffff902bb5d0>] queue_work_on+0x0/0x50 RSP: 0018:ffff88341f003e58 EFLAGS: 00010246 RAX: ffff8833feaebfd8 RBX: ffffffff91301c00 RCX: ffff883418771878 RDX: ffff883418771b58 RSI: ffff88341f2fcc00 RDI: 0000000000001400 RBP: ffff88341f003e60 R08: ffffffff91302328 R09: ffffffff91301c00 R10: 0000000000000004 R11: 0000000000000005 R12: ffff88341f003dc8 R13: ffffffff9098cefa R14: ffff88341f003e60 R15: ffffffff91301c00 FS: 0000000000000000(0000) GS:ffff88341f000000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000039030000 CR3: 0000000035dde000 CR4: 00000000001606f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
queue_work_on
|
vmlinux |
0xffffffffad2b114d
Build id: 3.10.0-862.el7.x86_64 |
0x2d |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 31s! [java:19709] fb_sys_fops ttm mptspi ata_piix scsi_transport_spi drm crct10dif_pclmul crct10dif_common libata Modules linked in: xt_CHECKSUM iptable_mangle mptscsih CPU: 7 PID: 15513 Comm: kworker/u64:3 Kdump: loaded Tainted: G W L ------------ T 3.10.0-862.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 ipt_REJECT nf_reject_ipv4 ipt_MASQUERADE tun Workqueue: writeback bdi_writeback_workfn nf_nat_masquerade_ipv4 FS: 0000000000000000(0000) GS:ffff8d861ef00000(0000) knlGS:0000000000000000 iptable_nat nf_conntrack_ipv4 (flush-253:0) ebtable_filter CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b nf_defrag_ipv4 crc32c_intel ebtables nf_nat_ipv4 xt_addrtype e1000 xt_conntrack CR2: 00007f38649aa000 CR3: 0000000283fb8000 CR4: 00000000000007e0 task: ffff8d81dd880000 ti: ffff8d7e56ce0000 task.ti: ffff8d7e56ce0000 nf_nat nf_conntrack ip6table_filter ip6_tables RIP: 0010:[<ffffffffad2b114d>] [<ffffffffad2b114d>] queue_work_on+0x2d/0x50
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
queue_work_on
|
vmlinux |
0xffffffffbe6b80ed
Build id: 3.10.0-957.el7.x86_64 |
0x2d |
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 31s! [swapper/2:0] Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon joydev pcspkr parport_pc parport sg vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod crct10dif_generic cdrom crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmwgfx ata_generic pata_acpi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi ata_piix mptscsih drm mptbase libata e1000 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod CPU: 2 PID: 0 Comm: swapper/2 Kdump: loaded Not tainted 3.10.0-957.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 task: ffff8cc8fa7bd140 ti: ffff8cc8fa7f4000 task.ti: ffff8cc8fa7f4000 RIP: 0010:[<ffffffffbe6b80ed>] [<ffffffffbe6b80ed>] queue_work_on+0x2d/0x50 RSP: 0018:ffff8ccb66883e48 EFLAGS: 00000246 RAX: 0000000000000001 RBX: ffffffffbe6b7a92 RCX: 0000000000000001 RDX: 0000000000000000 RSI: 0000000000000092 RDI: 0000000000000246 RBP: ffff8ccb66883e50 R08: ffffffffbee1dae0 R09: ffff8cc8fa7bd140 R10: ccd20a4b19a011c0 R11: ffff8ccb66883de8 R12: ffff8ccb66883db8 R13: ffffffffbed75df2 R14: ffff8ccb66883e50 R15: 0000000000000246 FS: 0000000000000000(0000) GS:ffff8ccb66880000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f313e5a86b8 CR3: 00000003d436a000 CR4: 00000000000007e0 Call Trace: