| Operating system | Count |
|---|---|
| CentOS 7 | 105 |
| Architecture | Count |
|---|---|
| x86_64 | 105 |
| Related packages | Count |
|---|---|
| kernel | 105 |
Packages names with count less than the total count of reports are most probably not the cause of the problem.
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
rcu_process_callbacks
|
vmlinux |
0xffffffff8ad63256
Build id: 3.10.0-1160.114.2.el7.x86_64 |
0x206 |
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 8065s! [swapper/2:0] Modules linked in: xt_nat veth nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc snd_intel8x0 crc32_pclmul snd_ac97_codec ghash_clmulni_intel ac97_bus joydev ppdev snd_seq snd_seq_device aesni_intel snd_pcm lrw gf128mul glue_helper ablk_helper cryptd vboxguest(OE) snd_timer pcspkr sg snd video parport_pc soundcore parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx serio_raw drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ahci ttm libahci crct10dif_pclmul crct10dif_common crc32c_intel ata_piix drm e1000 libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse CPU: 2 PID: 0 Comm: swapper/2 Kdump: loaded Tainted: G W OE ------------ T 3.10.0-1160.114.2.el7.x86_64 #1 Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 task: ffff9d783aecd280 ti: ffff9d783aee0000 task.ti: ffff9d783aee0000 RIP: 0010:[<ffffffff8ad63256>] [<ffffffff8ad63256>] rcu_process_callbacks+0x206/0x580 RSP: 0018:ffff9d78d9d03ec0 EFLAGS: 00010286 RAX: 0000000000000001 RBX: ffff9d785cdd3d80 RCX: 00000001802a0023 RDX: ffff9d785cdd5000 RSI: ffffe88d06737500 RDI: 0000000040000000 RBP: ffff9d78d9d03f10 R08: ffff9d785cdd4240 R09: 00000001802a0023 R10: 000000005cdd4101 R11: ffff9d785cdd4240 R12: ffff9d78d9d03e38 R13: ffffffff8b3c63f2 R14: ffff9d78d9d03f10 R15: ffffffff8b87a3c0 FS: 0000000000000000(0000) GS:ffff9d78d9d00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f44866f39d0 CR3: 00000000d7e66000 CR4: 00000000000206e0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
rcu_process_callbacks
|
vmlinux |
0xffffffff811395ab
Build id: 3.10.0-514.el7.x86_64 |
0x20b |
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 24s! [java:6794] Modules linked in: fuse uinput xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter snd_hda_codec_generic iosf_mbi crc32_pclmul snd_hda_intel ghash_clmulni_intel aesni_intel snd_hda_codec lrw gf128mul glue_helper ablk_helper snd_hda_core snd_hwdep snd_seq ppdev snd_seq_device cryptd snd_pcm snd_timer snd pcspkr parport_pc virtio_balloon parport sg i2c_piix4 soundcore nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_console virtio_blk virtio_net qxl drm_kms_helper crct10dif_pclmul syscopyarea crct10dif_common sysfillrect crc32c_intel sysimgblt ata_piix fb_sys_fops serio_raw ttm drm virtio_pci virtio_ring virtio libata i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod CPU: 2 PID: 6794 Comm: java Tainted: G L ------------ 3.10.0-514.el7.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 task: ffff880091c1de20 ti: ffff880091c3c000 task.ti: ffff880091c3c000 RIP: 0010:[<ffffffff811395ab>] [<ffffffff811395ab>] rcu_process_callbacks+0x20b/0x550 RSP: 0000:ffff880239d03e80 EFLAGS: 00010286 RAX: ffff880239d101e8 RBX: ffffffff81a1a580 RCX: ffff880239d101a0 RDX: ffff880004469000 RSI: ffff880087fcec00 RDI: 0000000000000000 RBP: ffff880239d03ed0 R08: ffff880006ec4f00 R09: ffff880239d101a0 R10: 0000000006ec4e01 R11: ffffea00001bb100 R12: ffff880239d03df8 R13: ffffffff8169721d R14: ffff880239d03ed0 R15: ffffffff81a1a580 FS: 00007fa77ffc1700(0000) GS:ffff880239d00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00000000bb9dd002 CR3: 00000000b8d9f000 CR4: 00000000000406e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Stack: ffff880087fcec00 0000000000000000 ffff880239d101e8 ffff880091c1de20 ffff880091c3ffd8 0000000000000009 0000000000000009 ffffffff81d1b500 ffffffff819b30c8 0000000000000001 ffff880239d03f40 ffffffff8108f0ff Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
rcu_process_callbacks
|
vmlinux |
0xffffffffb7d5a963
Build id: 3.10.0-1160.71.1.el7.x86_64 |
0x13 |
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 27s! [miniserv.pl:1455] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack libcrc32c ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod ppdev crc32_pclmul ghash_clmulni_intel vboxvideo(OE) aesni_intel lrw joydev gf128mul pcspkr glue_helper ablk_helper cryptd snd_intel8x0 ttm snd_ac97_codec drm_kms_helper ac97_bus syscopyarea snd_seq sysfillrect snd_seq_device sysimgblt snd_pcm sg fb_sys_fops snd_timer parport_pc drm parport snd drm_panel_orientation_quirks vboxguest(OE) soundcore i2c_piix4 video ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi ahci ata_piix libahci crct10dif_pclmul crct10dif_common serio_raw crc32c_intel libata e1000 fuse CPU: 1 PID: 1455 Comm: miniserv.pl Kdump: loaded Tainted: G OE ------------ 3.10.0-1160.71.1.el7.x86_64 #1 Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 task: ffff8c3df565d280 ti: ffff8c3fd6868000 task.ti: ffff8c3fd6868000 RIP: 0010:[<ffffffffb7d5a963>] [<ffffffffb7d5a963>] rcu_process_callbacks+0x13/0x570 RSP: 0018:ffff8c3fdfd03f18 EFLAGS: 00010202 RAX: 0000000000000001 RBX: ffff8c3fdfd1acc0 RCX: ffffffffb895e300 RDX: ffff8c3fdfd00000 RSI: 00000000000031e0 RDI: ffffffffb8807108 RBP: ffff8c3fdfd03f80 R08: 0000000000000000 R09: 0000000000000001 R10: 000000000063349e R11: 0000000000000000 R12: ffff8c3fdfd03e88 R13: ffffffffb839afba R14: ffff8c3fdfd03f80 R15: 0000000000000009 FS: 00007fe86cf0a740(0000) GS:ffff8c3fdfd00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00005645b936e380 CR3: 00000001ced96000 CR4: 00000000000006e0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
rcu_process_callbacks
|
vmlinux |
0xffffffff8315a526
Build id: 3.10.0-1062.18.1.el7.x86_64 |
0x206 |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 40s! [gsd-color:6742] stp llc nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nf_conntrack auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif ata_generic crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi scsi_transport_spi nfit crct10dif_pclmul libata crct10dif_common crc32c_intel mptscsih libnvdimm serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal] Modules linked in: CPU: 14 PID: 189 Comm: kswapd0 Kdump: loaded Tainted: P EL ------------ T 3.10.0-1062.18.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018 task: ffff89133e8ae2a0 ti: ffff89033d214000 task.ti: ffff89033d214000 falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_14203(E) RIP: 0010:[<ffffffff8315a526>] [<ffffffff8315a526>] rcu_process_callbacks+0x206/0x570
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
rcu_process_callbacks
|
vmlinux |
0xffffffffac35a6b8
Build id: 3.10.0-1160.6.1.el7.x86_64 |
0x318 |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 266s! [sh:28057] <EOI> Modules linked in: tcp_lp nls_utf8 isofs fuse veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter usblp overlay(T) prl_fs_freeze(POE) prl_fs(POE) prl_eth(POE) sunrpc snd_hda_codec_generic gpio_ich coretemp snd_hda_intel iosf_mbi crc32_pclmul snd_hda_codec ghash_clmulni_intel ppdev snd_hda_core snd_hwdep snd_seq aesni_intel lrw gf128mul glue_helper ablk_helper snd_seq_device cryptd snd_pcm joydev snd_timer sg snd pcspkr soundcore i2c_i801 lpc_ich virtio_balloon sbs sbshc parport_pc parport ip_tables ext4 mbcache jbd2 sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi ahci virtio_net ata_piix net_failover libahci failover crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw prl_vid(POE) virtio_pci virtio_ring virtio prl_tg(POE) dm_mirror dm_region_hash dm_log dm_mod CPU: 0 PID: 28057 Comm: sh Kdump: loaded Tainted: P OEL ------------ T 3.10.0-1160.6.1.el7.x86_64 #1 Hardware name: Parallels Software International Inc. Parallels Virtual Platform/Parallels Virtual Platform, BIOS 16.0.1 (48919) 09/04/2020 task: ffff90d984fd1080 ti: ffff90d984fdc000 task.ti: ffff90d984fdc000 RIP: 0010:[<ffffffffac35a6b8>] [<ffffffffac35a6b8>] rcu_process_callbacks+0x318/0x570 RSP: 0000:ffff90d9fce03ec0 EFLAGS: 00000246 RAX: fffffffface8eb68 RBX: fffffffface7a380 RCX: ffff90d9fce16228 RDX: ffff90d9fce16228 RSI: ffff90d9fce16200 RDI: 0000000000000246 RBP: ffff90d9fce03f10 R08: ffff90d982df7900 R09: 0000000000214ebd R10: fffffffface7a380 R11: 0000000000000005 R12: ffff90d9fce03e38 R13: ffffffffac995fba R14: ffff90d9fce03f10 R15: fffffffface65b40 FS: 00007f8972c3e740(0000) GS:ffff90d9fce00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f89722d13c0 CR3: 0000000012e28000 CR4: 00000000003606f0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
rcu_process_callbacks
|
vmlinux |
0xffffffffb7f58a06
Build id: 3.10.0-1062.4.1.el7.x86_64 |
0x206 |
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [BESClient:3661] Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13109(E) falcon_lsm_pinned_13005(E) nls_utf8 isofs fuse rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache devlink binfmt_misc falcon_lsm_pinned_12905(E) ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel snd_hda_codec_generic lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel joydev snd_hda_codec virtio_balloon snd_hda_core sg snd_hwdep snd_seq parport_pc snd_seq_device parport snd_pcm snd_timer snd pcspkr i2c_piix4 soundcore auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_blk cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata serio_raw crct10dif_pclmul crct10dif_common virtio_pci crc32c_intel floppy virtio_ring virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal] CPU: 2 PID: 3661 Comm: BESClient Kdump: loaded Tainted: P W EL ------------ 3.10.0-1062.4.1.el7.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 task: ffffa0aafeeb20e0 ti: ffffa0d7093c4000 task.ti: ffffa0d7093c4000 RIP: 0010:[<ffffffffb7f58a06>] [<ffffffffb7f58a06>] rcu_process_callbacks+0x206/0x570 RSP: 0000:ffffa0d71f083ec0 EFLAGS: 00010286 RAX: ffffa0d71f0962c0 RBX: ffffffffb8a78b00 RCX: ffffa0d71f0962c0 RDX: ffffa0d6e86a0b00 RSI: ffffa0d71f096308 RDI: 0000000000000000 RBP: ffffa0d71f083f10 R08: ffffa0d52da67d70 R09: 000000000240d4bd R10: ffffffffb8a78c00 R11: 0000000000000000 R12: ffffa0d71f083e38 R13: ffffffffb858cefa R14: ffffa0d71f083f10 R15: ffffffffb8a78b00 FS: 00007f4869ffb700(0000) GS:ffffa0d71f080000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000000092002 CR3: 0000002f4362a000 CR4: 00000000001606e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
rcu_process_callbacks
|
vmlinux |
0xffffffffb055ae66
Build id: 3.10.0-1127.18.2.el7.x86_64 |
0x206 |
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [gnome-shell:2048] Modules linked in: tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink binfmt_misc sunrpc nfit libnvdimm ppdev iosf_mbi sg parport_pc i2c_piix4 parport crc32_pclmul ghash_clmulni_intel joydev virtio_balloon aesni_intel pcspkr lrw gf128mul glue_helper ablk_helper cryptd ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix virtio_console virtio_blk libata 8139too crct10dif_pclmul crct10dif_common serio_raw drm_panel_orientation_quirks virtio_pci floppy crc32c_intel 8139cp virtio_ring virtio mii dm_mirror dm_region_hash dm_log dm_mod CPU: 4 PID: 2048 Comm: gnome-shell Kdump: loaded Tainted: G W L ------------ 3.10.0-1127.18.2.el7.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 task: ffff9663f5c720e0 ti: ffff96646aef8000 task.ti: ffff96646aef8000 RIP: 0010:[<ffffffffb055ae66>] [<ffffffffb055ae66>] rcu_process_callbacks+0x206/0x570 RSP: 0000:ffff96653a203ec0 EFLAGS: 00010286 RAX: 0000000000000001 RBX: ffffffffb107a280 RCX: 000000018020001e RDX: ffff9663db715000 RSI: fffffb89406dc500 RDI: 0000000040000000 RBP: ffff96653a203f10 R08: ffff9663db714000 R09: 000000018020001e R10: 00000000db714801 R11: ffff9663db714000 R12: ffff96653a203e38 R13: ffffffffb0b93efa R14: ffff96653a203f10 R15: ffffffffb107a280 FS: 00007f5c518f3a80(0000) GS:ffff96653a200000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000000003528a004 CR3: 00000000aaf52000 CR4: 00000000007606e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 PKRU: 55555554 Call Trace: