Complete report #24076
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
thread_group_cputime
|
vmlinux |
0xffffffff852def5f
Build id: 3.10.0-1160.2.2.el7.x86_64
|
0x4f
|
|
2
|
thread_group_cputime_adjusted
|
vmlinux |
0xffffffff852df0d3
Build id: 3.10.0-1160.2.2.el7.x86_64
|
0x33
|
|
3
|
do_sys_times
|
vmlinux |
0xffffffff852b82db
Build id: 3.10.0-1160.2.2.el7.x86_64
|
0x3b
|
|
4
|
SyS_times
|
vmlinux |
0xffffffff852b838e
Build id: 3.10.0-1160.2.2.el7.x86_64
|
0x2e
|
|
5
|
|
vmlinux |
0xffffffff8533e6a6
Build id: 3.10.0-1160.2.2.el7.x86_64
|
0x1f6
|
|
6
|
|
vmlinux |
0xffffffff8533e454
Build id: 3.10.0-1160.2.2.el7.x86_64
|
0xb4
|
|
7
|
system_call_fastpath
|
vmlinux |
0xffffffff85993f92
Build id: 3.10.0-1160.2.2.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 26s! [vmtoolsd:90586]
Modules linked in: tcp_lp rfcomm xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bnep vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel btusb snd_ens1371 lrw vmw_balloon gf128mul glue_helper ablk_helper snd_rawmidi btrtl cryptd btbcm btintel snd_ac97_codec bluetooth ac97_bus snd_seq
snd_seq_device joydev pcspkr snd_pcm sg snd_timer rfkill snd soundcore vmw_vmci i2c_piix4 parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common drm_kms_helper crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit ata_piix libnvdimm serio_raw drm libata mptspi scsi_transport_spi e1000 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 90586 Comm: vmtoolsd Kdump: loaded Not tainted 3.10.0-1160.2.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff8a5bd1406300 ti: ffff8a5bd15c0000 task.ti: ffff8a5bd15c0000
RIP: 0010:[<ffffffff852def5f>] [<ffffffff852def5f>] thread_group_cputime+0x4f/0x190
RSP: 0018:ffff8a5bd15c3e28 EFLAGS: 00010246
RAX: ffff8a5c26292cc4 RBX: 000085ea360f1bf5 RCX: 00005604880ddbf0
RDX: ffff8a5bd15c3ee8 RSI: ffff8a5bd15c3e98 RDI: ffff8a5bd1406300
RBP: ffff8a5bd15c3e88 R08: 000000000000001e R09: 000000000003d46c
R10: 00005604880ddbf0 R11: 0000000000000246 R12: ffff8a5bd15c3dd0
R13: 00000000d15c3db0 R14: ffff8a5bd15c3d90 R15: 0000000000000000
FS: 00007fa4e4e43780(0000) GS:ffff8a5cf96c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb74175c000 CR3: 00000000114be000 CR4: 00000000001607e0
Call Trace:
[<ffffffff852df0d3>] thread_group_cputime_adjusted+0x33/0x70
[<ffffffff852b82db>] do_sys_times+0x3b/0xc0
[<ffffffff852b838e>] SyS_times+0x2e/0x90
[<ffffffff8533e6a6>] ? __audit_syscall_exit+0x1f6/0x2b0
[<ffffffff8533e454>] ? __audit_syscall_entry+0xb4/0x110
[<ffffffff85993f92>] system_call_fastpath+0x25/0x2a
Code: 48 8b 04 25 28 00 00 00 48 89 45 d0 31 c0 49 8d 84 24 44 04 00 00 c7 45 b4 00 00 00 00 48 89 45 a0 f6 45 b4 01 0f 85 09 01 00 00 <41> 8b 84 24 40 04 00 00 a8 01 89 45 b4 0f 85 08 01 00 00 48 c7
Complete report #1378994
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
cputime_adjust
|
vmlinux |
0xffffffff888de2f3
Build id: 3.10.0-1160.el7.x86_64
|
0x13
|
|
2
|
thread_group_cputime_adjusted
|
vmlinux |
0xffffffff888df0f0
Build id: 3.10.0-1160.el7.x86_64
|
0x50
|
|
3
|
do_sys_times
|
vmlinux |
0xffffffff888b82db
Build id: 3.10.0-1160.el7.x86_64
|
0x3b
|
|
4
|
SyS_times
|
vmlinux |
0xffffffff888b838e
Build id: 3.10.0-1160.el7.x86_64
|
0x2e
|
|
5
|
|
vmlinux |
0xffffffff8893e6a6
Build id: 3.10.0-1160.el7.x86_64
|
0x1f6
|
|
6
|
|
vmlinux |
0xffffffff8893e454
Build id: 3.10.0-1160.el7.x86_64
|
0xb4
|
|
7
|
system_call_fastpath
|
vmlinux |
0xffffffff88f93f92
Build id: 3.10.0-1160.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 57s! [vmtoolsd:2574]
Modules linked in: tcp_lp nls_utf8 isofs xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm crc32_pclmul ghash_clmulni_intel aesni_intel snd_timer snd lrw ppdev gf128mul glue_helper soundcore ablk_helper cryptd vmw_balloon pcspkr sg joydev parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod cdrom crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common crc32c_intel
drm_kms_helper syscopyarea sysfillrect sysimgblt serio_raw fb_sys_fops ttm ata_piix e1000 mptspi nfit drm scsi_transport_spi libata mptscsih libnvdimm mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 2574 Comm: vmtoolsd Kdump: loaded Not tainted 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 03/24/2025
task: ffff903397a94200 ti: ffff903397ab4000 task.ti: ffff903397ab4000
RIP: 0010:[<ffffffff888de2f3>] [<ffffffff888de2f3>] cputime_adjust+0x13/0xd0
RSP: 0018:ffff903397ab7e78 EFLAGS: 00000282
RAX: 0000000000000000 RBX: 00000839048c6168 RCX: ffff903397ab7ee8
RDX: ffff903397ab7ee0 RSI: ffff9033ae69ace0 RDI: ffff903397ab7e98
RBP: ffff903397ab7e88 R08: ffff9033ab12c798 R09: ffff903397ab7df0
R10: 00005604f613c190 R11: 0000000000000246 R12: ffffffff888deed4
R13: ffff903397ab7e18 R14: ffff9033ab12c200 R15: ffff903397ab7e40
FS: 00007feb9add1780(0000) GS:ffff9034396c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f17c49601a8 CR3: 0000000097bd0000 CR4: 0000000000740fe0
PKRU: 55555554
Call Trace:
[<ffffffff888df0f0>] thread_group_cputime_adjusted+0x50/0x70
[<ffffffff888b82db>] do_sys_times+0x3b/0xc0
[<ffffffff888b838e>] SyS_times+0x2e/0x90
[<ffffffff8893e6a6>] ? __audit_syscall_exit+0x1f6/0x2b0
[<ffffffff8893e454>] ? __audit_syscall_entry+0xb4/0x110
[<ffffffff88f93f92>] system_call_fastpath+0x25/0x2a
Code: ff e8 b2 0c 07 00 5d c3 55 48 89 e5 e8 27 ff ff ff 5d c3 0f 1f 44 00 00 66 66 66 66 90 55 48 89 e5 41 57 49 89 cf 41 56 49 89 d6 <41> 55 4c 8d 6e 10 41 54 49 89 fc 4c 89 ef 53 48 89 f3 e8 d6 b7
Complete report #975484
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
_raw_spin_lock_irqsave
|
vmlinux |
0xffffffff8df89aec
Build id: 3.10.0-1160.el7.x86_64
|
0xc
|
|
2
|
cputime_adjust
|
vmlinux |
0xffffffff8d8de30a
Build id: 3.10.0-1160.el7.x86_64
|
0x2a
|
|
3
|
thread_group_cputime_adjusted
|
vmlinux |
0xffffffff8d8df0f0
Build id: 3.10.0-1160.el7.x86_64
|
0x50
|
|
4
|
do_sys_times
|
vmlinux |
0xffffffff8d8b82db
Build id: 3.10.0-1160.el7.x86_64
|
0x3b
|
|
5
|
SyS_times
|
vmlinux |
0xffffffff8d8b838e
Build id: 3.10.0-1160.el7.x86_64
|
0x2e
|
|
6
|
|
vmlinux |
0xffffffff8d93e6a6
Build id: 3.10.0-1160.el7.x86_64
|
0x1f6
|
|
7
|
|
vmlinux |
0xffffffff8d93e454
Build id: 3.10.0-1160.el7.x86_64
|
0xb4
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffff8df93f92
Build id: 3.10.0-1160.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 35s! [vmtoolsd:2580]
Modules linked in: tcp_lp nls_utf8 isofs rfcomm xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock bnep sunrpc snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi ppdev snd_ac97_codec ac97_bus btusb aesni_intel snd_seq btrtl btbcm btintel lrw gf128mul glue_helper ablk_helper vmw_balloon
cryptd bluetooth snd_seq_device snd_pcm joydev pcspkr snd_timer snd sg rfkill soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix nfit drm libata libnvdimm mptspi scsi_transport_spi mptscsih serio_raw mptbase e1000 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 2580 Comm: vmtoolsd Kdump: loaded Tainted: G L ------------ 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9e928bea6300 ti: ffff9e928bfe0000 task.ti: ffff9e928bfe0000
RIP: 0010:[<ffffffff8df89aec>] [<ffffffff8df89aec>] _raw_spin_lock_irqsave+0xc/0x40
RSP: 0018:ffff9e928bfe3e48 EFLAGS: 00000282
RAX: 0000000000000282 RBX: ffff9e928bfe3e48 RCX: ffff9e928bfe3ee8
RDX: ffff9e928bfe3ee0 RSI: ffff9e9292e450e0 RDI: ffff9e9292e450f0
RBP: ffff9e928bfe3e50 R08: ffff9e92b4da2698 R09: ffff9e928bfe3df0
R10: 0000000000000000 R11: 0000000000000246 R12: ffff9e92bb61acc0
R13: ffff9e928bea6300 R14: 00000e217d0d7e69 R15: ffffffff8d8e43cc
FS: 00007fcad729a780(0000) GS:ffff9e92bb600000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7bccb76000 CR3: 000000004be06000 CR4: 0000000000340ff0
Call Trace:
[<ffffffff8d8de30a>] cputime_adjust+0x2a/0xd0
[<ffffffff8d8df0f0>] thread_group_cputime_adjusted+0x50/0x70
[<ffffffff8d8b82db>] do_sys_times+0x3b/0xc0
[<ffffffff8d8b838e>] SyS_times+0x2e/0x90
[<ffffffff8d93e6a6>] ? __audit_syscall_exit+0x1f6/0x2b0
[<ffffffff8d93e454>] ? __audit_syscall_entry+0xb4/0x110
[<ffffffff8df93f92>] system_call_fastpath+0x25/0x2a
Code: b1 17 85 c0 75 01 c3 55 89 c6 48 89 e5 e8 9d 18 ff ff 5d c3 90 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 53 9c 58 <66> 66 90 66 90 48 89 c3 fa 66 66 90 66 66 90 31 c0 ba 01 00 00
Complete report #655552
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
_raw_spin_unlock_irqrestore
|
vmlinux |
0xffffffffa4d6a175
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x15
|
|
2
|
cputime_adjust
|
vmlinux |
0xffffffffa46da1c4
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x94
|
|
3
|
thread_group_cputime_adjusted
|
vmlinux |
0xffffffffa46dadf0
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x50
|
|
4
|
do_sys_times
|
vmlinux |
0xffffffffa46b44eb
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x3b
|
|
5
|
SyS_times
|
vmlinux |
0xffffffffa46b459e
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x2e
|
|
6
|
|
vmlinux |
0xffffffffa4738ba4
Build id: 3.10.0-957.5.1.el7.x86_64
|
0xb4
|
|
7
|
system_call_fastpath
|
vmlinux |
0xffffffffa4d74ddb
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x22
|
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 25s! [vmtoolsd:11294]
Modules linked in: fileaccess_mod(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter mfeaack(OE) vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper vmw_balloon ablk_helper cryptd joydev pcspkr sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmwgfx vmxnet3 drm_kms_helper ahci syscopyarea vmw_pvscsi libahci sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm
libata drm_panel_orientation_quirks nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 7 PID: 11294 Comm: vmtoolsd Kdump: loaded Tainted: G OE ------------ 3.10.0-957.5.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9f3007cac100 ti: ffff9f3000e04000 task.ti: ffff9f3000e04000
RIP: 0010:[<ffffffffa4d6a175>] [<ffffffffa4d6a175>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9f3000e07e40 EFLAGS: 00000286
RAX: 0000000186634b19 RBX: ffff9f3007cac904 RCX: ffff9f3000e07ee8
RDX: 00000000310842e8 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff9f3000e07e40 R08: 0000000186634b19 R09: 000000009c94d6c0
R10: 000000004fc5fb58 R11: 00000001931435a3 R12: ffff9f300d7dab80
R13: ffff9f3007cac100 R14: 00000406ed1e2437 R15: ffffffffa46e015c
FS: 00007ff4e8f60880(0000) GS:ffff9f300d7c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f48e2a82000 CR3: 0000000bf7e6e000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa46da1c4>] cputime_adjust+0x94/0x150
[<ffffffffa46dadf0>] thread_group_cputime_adjusted+0x50/0x70
[<ffffffffa46b44eb>] do_sys_times+0x3b/0xc0
[<ffffffffa46b459e>] SyS_times+0x2e/0x90
[<ffffffffa4738ba4>] ? __audit_syscall_entry+0xb4/0x110
[<ffffffffa4d74ddb>] system_call_fastpath+0x22/0x27
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #476375
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
thread_group_cputime
|
vmlinux |
0xffffffff834dfa47
Build id: 3.10.0-1127.el7.x86_64
|
0x57
|
|
2
|
|
vmlinux |
0xffffffff834dedd4
Build id: 3.10.0-1127.el7.x86_64
|
0x94
|
|
3
|
thread_group_cputime_adjusted
|
vmlinux |
0xffffffff834dfbb3
Build id: 3.10.0-1127.el7.x86_64
|
0x33
|
|
4
|
do_sys_times
|
vmlinux |
0xffffffff834b8d4b
Build id: 3.10.0-1127.el7.x86_64
|
0x3b
|
|
5
|
SyS_times
|
vmlinux |
0xffffffff834b8dfe
Build id: 3.10.0-1127.el7.x86_64
|
0x2e
|
|
6
|
|
vmlinux |
0xffffffff8353efc6
Build id: 3.10.0-1127.el7.x86_64
|
0x1e6
|
|
7
|
|
vmlinux |
0xffffffff8353ed84
Build id: 3.10.0-1127.el7.x86_64
|
0xb4
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffff83b92ed2
Build id: 3.10.0-1127.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 24s! [vmtoolsd:2755]
Modules linked in: tcp_lp nls_utf8 isofs rfcomm fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock bnep sunrpc snd_seq_midi snd_seq_midi_event ppdev snd_ens1371 btusb iosf_mbi btrtl snd_rawmidi btbcm btintel snd_ac97_codec crc32_pclmul ghash_clmulni_intel ac97_bus bluetooth snd_seq snd_seq_device aesni_intel snd_pcm
sg lrw gf128mul glue_helper ablk_helper rfkill cryptd snd_timer snd soundcore pcspkr vmw_balloon joydev parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ata_piix ttm crct10dif_pclmul crct10dif_common crc32c_intel drm mptspi scsi_transport_spi libata serio_raw mptscsih nfit libnvdimm mptbase e1000 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 2755 Comm: vmtoolsd Kdump: loaded Tainted: G W ------------ 3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff9be007ba62a0 ti: ffff9be00451c000 task.ti: ffff9be00451c000
RIP: 0010:[<ffffffff834dfa47>] [<ffffffff834dfa47>] thread_group_cputime+0x57/0x190
RSP: 0018:ffff9be00451fe28 EFLAGS: 00000246
RAX: 0000000000000006 RBX: 000001d083822326 RCX: 00005582444d4ed0
RDX: ffff9be00451fee8 RSI: ffff9be00451fe98 RDI: ffff9be007ba62a0
RBP: ffff9be00451fe88 R08: 0000000000000001 R09: 0000000000003832
R10: 00005582444d4ed0 R11: 0000000000000246 R12: ffff9be00451fdd0
R13: 000000000451fdb0 R14: ffff9be00451fd90 R15: 0000000000000000
FS: 00007fda7bbcf880(0000) GS:ffff9be03b6c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f440806d000 CR3: 000000004457a000 CR4: 00000000003607e0
Call Trace:
[<ffffffff834dedd4>] ? cputime_adjust+0x94/0x150
[<ffffffff834dfbb3>] thread_group_cputime_adjusted+0x33/0x70
[<ffffffff834b8d4b>] do_sys_times+0x3b/0xc0
[<ffffffff834b8dfe>] SyS_times+0x2e/0x90
[<ffffffff8353efc6>] ? __audit_syscall_exit+0x1e6/0x280
[<ffffffff8353ed84>] ? __audit_syscall_entry+0xb4/0x110
[<ffffffff83b92ed2>] system_call_fastpath+0x25/0x2a
Code: 48 89 45 d0 31 c0 49 8d 84 24 44 04 00 00 c7 45 b4 00 00 00 00 48 89 45 a0 f6 45 b4 01 0f 85 09 01 00 00 41 8b 84 24 40 04 00 00 <a8> 01 89 45 b4 0f 85 08 01 00 00 48 c7 45 a8 00 00 00 00 49 8b
Complete report #415707
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
_raw_spin_unlock_irqrestore
|
vmlinux |
0xffffffff843817c5
Build id: 3.10.0-1062.el7.x86_64
|
0x15
|
|
2
|
cputime_adjust
|
vmlinux |
0xffffffff83cdd614
Build id: 3.10.0-1062.el7.x86_64
|
0x94
|
|
3
|
thread_group_cputime_adjusted
|
vmlinux |
0xffffffff83cde410
Build id: 3.10.0-1062.el7.x86_64
|
0x50
|
|
4
|
do_sys_times
|
vmlinux |
0xffffffff83cb778b
Build id: 3.10.0-1062.el7.x86_64
|
0x3b
|
|
5
|
SyS_times
|
vmlinux |
0xffffffff83cb783e
Build id: 3.10.0-1062.el7.x86_64
|
0x2e
|
|
6
|
|
vmlinux |
0xffffffff83d3c814
Build id: 3.10.0-1062.el7.x86_64
|
0xb4
|
|
7
|
system_call_fastpath
|
vmlinux |
0xffffffff8438bede
Build id: 3.10.0-1062.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [vmtoolsd:753]
Modules linked in: tcp_lp nls_utf8 isofs fuse binfmt_misc xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ppdev snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus vmw_balloon snd_seq snd_seq_device iosf_mbi snd_pcm crc32_pclmul ghash_clmulni_intel aesni_intel snd_timer lrw gf128mul glue_helper ablk_helper cryptd snd soundcore pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 sch_fq_codel ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common nfit drm crc32c_intel libnvdimm ata_piix mptspi libata serio_raw scsi_transport_spi mptscsih e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 753 Comm: vmtoolsd Not tainted 3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff9f8bf79162a0 ti: ffff9f8bf793c000 task.ti: ffff9f8bf793c000
RIP: 0010:[<ffffffff843817c5>] [<ffffffff843817c5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9f8bf793fe40 EFLAGS: 00000286
RAX: 0000000086748294 RBX: ffff9f8bf793fe48 RCX: ffff9f8bf793fee8
RDX: 0000000010366400 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff9f8bf793fe40 R08: 0000000086748294 R09: 000000007a120000
R10: 000000007ac91b00 R11: 000000018e64479f R12: ffff9f8bfc61ac40
R13: ffff9f8bf79162a0 R14: 0000022e4ceebc90 R15: ffffffff83ce375c
FS: 00007f4bcb86c880(0000) GS:ffff9f8bfc600000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00002c5d180a6000 CR3: 000000003aaa6000 CR4: 00000000003607f0
Call Trace:
[<ffffffff83cdd614>] cputime_adjust+0x94/0x150
[<ffffffff83cde410>] thread_group_cputime_adjusted+0x50/0x70
[<ffffffff83cb778b>] do_sys_times+0x3b/0xc0
[<ffffffff83cb783e>] SyS_times+0x2e/0x90
[<ffffffff83d3c814>] ? __audit_syscall_entry+0xb4/0x110
[<ffffffff8438bede>] system_call_fastpath+0x25/0x2a
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #231698
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
thread_group_cputime
|
vmlinux |
0xffffffff96cdfa47
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x57
|
|
2
|
|
vmlinux |
0xffffffff96cdedd4
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x94
|
|
3
|
thread_group_cputime_adjusted
|
vmlinux |
0xffffffff96cdfbb3
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x33
|
|
4
|
do_sys_times
|
vmlinux |
0xffffffff96cb8d4b
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x3b
|
|
5
|
SyS_times
|
vmlinux |
0xffffffff96cb8dfe
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x2e
|
|
6
|
|
vmlinux |
0xffffffff96d3efd6
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x1e6
|
|
7
|
|
vmlinux |
0xffffffff96d3ed94
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xb4
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffff97392ed2
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [vmtoolsd:2962]
Modules linked in: vfat fat ext4 mbcache jbd2 uas usb_storage tcp_lp nls_utf8 isofs fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul vmw_balloon glue_helper ablk_helper cryptd snd_ens1371 snd_rawmidi snd_ac97_codec
ac97_bus snd_seq snd_seq_device snd_pcm joydev pcspkr snd_timer snd sg soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic vmwgfx crct10dif_pclmul crct10dif_common crc32c_intel ata_generic pata_acpi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit drm ata_piix serio_raw libnvdimm libata mptspi e1000 scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 2962 Comm: vmtoolsd Kdump: loaded Tainted: G L ------------ 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff9a6976223150 ti: ffff9a68d4c98000 task.ti: ffff9a68d4c98000
RIP: 0010:[<ffffffff96cdfa47>] [<ffffffff96cdfa47>] thread_group_cputime+0x57/0x190
RSP: 0018:ffff9a68d4c9be28 EFLAGS: 00000246
RAX: 0000000000000002 RBX: 0000ee720080f634 RCX: 0000556669a90480
RDX: ffff9a68d4c9bee8 RSI: ffff9a68d4c9be98 RDI: ffff9a6976223150
RBP: ffff9a68d4c9be88 R08: 0000000000000001 R09: 00000000000512dc
R10: 0000556669a90480 R11: 0000000000000246 R12: ffff9a68d4c9bdd0
R13: 00000000d4c9bdb0 R14: ffff9a68d4c9bd90 R15: 0000000000000000
FS: 00007f64e0c81880(0000) GS:ffff9a6979600000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007efcf0a779c8 CR3: 0000000094d44000 CR4: 00000000001007f0
Call Trace:
[<ffffffff96cdedd4>] ? cputime_adjust+0x94/0x150
[<ffffffff96cdfbb3>] thread_group_cputime_adjusted+0x33/0x70
[<ffffffff96cb8d4b>] do_sys_times+0x3b/0xc0
[<ffffffff96cb8dfe>] SyS_times+0x2e/0x90
[<ffffffff96d3efd6>] ? __audit_syscall_exit+0x1e6/0x280
[<ffffffff96d3ed94>] ? __audit_syscall_entry+0xb4/0x110
[<ffffffff97392ed2>] system_call_fastpath+0x25/0x2a
Code: 48 89 45 d0 31 c0 49 8d 84 24 44 04 00 00 c7 45 b4 00 00 00 00 48 89 45 a0 f6 45 b4 01 0f 85 09 01 00 00 41 8b 84 24 40 04 00 00 <a8> 01 89 45 b4 0f 85 08 01 00 00 48 c7 45 a8 00 00 00 00 49 8b
Complete report #8235
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
_raw_spin_unlock_irqrestore
|
vmlinux |
0xffffffff8c1883c5
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x15
|
|
2
|
cputime_adjust
|
vmlinux |
0xffffffff8badedd4
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x94
|
|
3
|
thread_group_cputime_adjusted
|
vmlinux |
0xffffffff8badfbd0
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x50
|
|
4
|
do_sys_times
|
vmlinux |
0xffffffff8bab8d4b
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x3b
|
|
5
|
SyS_times
|
vmlinux |
0xffffffff8bab8dfe
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x2e
|
|
6
|
|
vmlinux |
0xffffffff8bb3ef86
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x1e6
|
|
7
|
|
vmlinux |
0xffffffff8bb3ed44
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0xb4
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffff8c192ed2
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [vmtoolsd:2664]
Modules linked in: tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 ipt_REJECT nf_reject_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype tun xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm aesni_intel lrw gf128mul glue_helper vmw_balloon ablk_helper cryptd snd_timer snd joydev pcspkr soundcore sg parport_pc parport i2c_piix4 vmw_vmci binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod ata_generic
crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm mptspi serio_raw scsi_transport_spi nfit mptscsih libnvdimm e1000 mptbase ata_piix libata drm_panel_orientation_quirks
CPU: 1 PID: 2664 Comm: vmtoolsd Kdump: loaded Tainted: G L ------------ T 3.10.0-1127.10.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff9c9b424f1070 ti: ffff9c9b424a8000 task.ti: ffff9c9b424a8000
RIP: 0010:[<ffffffff8c1883c5>] [<ffffffff8c1883c5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9c9b424abe40 EFLAGS: 00000286
RAX: 0000c191a04b36b0 RBX: ffff9c9b424abe48 RCX: ffff9c9b424abee8
RDX: 0000000000005a8f RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff9c9b424abe40 R08: 0000c191a04b36b0 R09: 00000000a84174e4
R10: 000000000000a59d R11: 00008ef1497ddef8 R12: ffff9c9b7b65acc0
R13: ffff9c9b424f1070 R14: 00004c8ac07d06ca R15: ffffffff8bae4eac
FS: 00007f9974584880(0000) GS:ffff9c9b7b640000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fab632d8000 CR3: 000000004c3ec000 CR4: 00000000003607e0
Call Trace:
[<ffffffff8badedd4>] cputime_adjust+0x94/0x150
[<ffffffff8badfbd0>] thread_group_cputime_adjusted+0x50/0x70
[<ffffffff8bab8d4b>] do_sys_times+0x3b/0xc0
[<ffffffff8bab8dfe>] SyS_times+0x2e/0x90
[<ffffffff8bb3ef86>] ? __audit_syscall_exit+0x1e6/0x280
[<ffffffff8bb3ed44>] ? __audit_syscall_entry+0xb4/0x110
[<ffffffff8c192ed2>] system_call_fastpath+0x25/0x2a
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #159957
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
_raw_spin_unlock_irqrestore
|
vmlinux |
0xffffffff97b883c5
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x15
|
|
2
|
cputime_adjust
|
vmlinux |
0xffffffff974dedd4
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x94
|
|
3
|
thread_group_cputime_adjusted
|
vmlinux |
0xffffffff974dfbd0
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x50
|
|
4
|
do_sys_times
|
vmlinux |
0xffffffff974b8d4b
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x3b
|
|
5
|
SyS_times
|
vmlinux |
0xffffffff974b8dfe
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x2e
|
|
6
|
|
vmlinux |
0xffffffff9753efd6
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x1e6
|
|
7
|
|
vmlinux |
0xffffffff9753ed94
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xb4
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffff97b92ed2
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 21s! [vmtoolsd:78851]
Modules linked in: tcp_lp rfcomm fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter bnep vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel btusb snd_ens1371 btrtl vmw_balloon btbcm snd_rawmidi btintel bluetooth aesni_intel snd_ac97_codec lrw gf128mul glue_helper ac97_bus ablk_helper cryptd snd_seq snd_seq_device snd_pcm snd_timer rfkill joydev snd pcspkr soundcore sg vmw_vmci i2c_piix4 parport_pc parport ip_tables ext4 mbcache jbd2 sr_mod sd_mod
cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel mptspi scsi_transport_spi nfit mptscsih libnvdimm libata serio_raw e1000 mptbase drm_panel_orientation_quirks
CPU: 6 PID: 78851 Comm: vmtoolsd Kdump: loaded Tainted: G W L ------------ 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff965cf39ab150 ti: ffff965dee010000 task.ti: ffff965dee010000
RIP: 0010:[<ffffffff97b883c5>] [<ffffffff97b883c5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff965dee013e40 EFLAGS: 00000286
RAX: 00000bf9cfeb2290 RBX: ffff965dee013e48 RCX: ffff965dee013ee8
RDX: 000000000005fca1 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff965dee013e40 R08: 00000bf9cfeb2290 R09: 00000000bdbfc70e
R10: 00000000000bd22b R11: 00000be5fa219fc2 R12: ffff965dee99acc0
R13: ffff965cf39ab150 R14: 0000075f4096d074 R15: ffffffff974e4eac
FS: 00007fa31ef98880(0000) GS:ffff965dee980000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00003c17c76d0000 CR3: 000000015b7b0000 CR4: 00000000003607e0
Call Trace:
[<ffffffff974dedd4>] cputime_adjust+0x94/0x150
[<ffffffff974dfbd0>] thread_group_cputime_adjusted+0x50/0x70
[<ffffffff974b8d4b>] do_sys_times+0x3b/0xc0
[<ffffffff974b8dfe>] SyS_times+0x2e/0x90
[<ffffffff9753efd6>] ? __audit_syscall_exit+0x1e6/0x280
[<ffffffff9753ed94>] ? __audit_syscall_entry+0xb4/0x110
[<ffffffff97b92ed2>] system_call_fastpath+0x25/0x2a
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48