Complete report #1420971
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff8118c3d3
Build id: 3.10.0-693.el7.x86_64
|
0x433
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118caf6
Build id: 3.10.0-693.el7.x86_64
|
0x176
|
|
3
|
|
vmlinux |
0xffffffff816a8f8d
Build id: 3.10.0-693.el7.x86_64
|
0x39d
|
|
4
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1108
Build id: 3.10.0-693.el7.x86_64
|
0x98
|
|
5
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0442fd8
Build id: 3.10.0-693.el7.x86_64
|
0x3b8
|
|
6
|
process_one_work
|
vmlinux |
0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64
|
0x17a
|
|
7
|
worker_thread
|
vmlinux |
0xffffffff810a94e6
Build id: 3.10.0-693.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffff810a93c0
Build id: 3.10.0-693.el7.x86_64
|
0x2a0
|
|
9
|
kthread
|
vmlinux |
0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
|
0xcf
|
|
10
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork
|
vmlinux |
0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
|
0x58
|
|
12
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [kworker/0:2:155]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter arc4 md4 nls_utf8 cifs dns_resolver vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg parport_pc parport shpchp vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptsas drm scsi_transport_sas
ata_piix mptscsih crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 155 Comm: kworker/0:2 Tainted: G L ------------ 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff880c0a91eeb0 ti: ffff880c0a6b0000 task.ti: ffff880c0a6b0000
RIP: 0010:[<ffffffff8118c3d3>] [<ffffffff8118c3d3>] get_page_from_freelist+0x433/0x9e0
RSP: 0000:ffff880c0a6b3bc8 EFLAGS: 00000246
RAX: 0000000000000012 RBX: 000000000000001e RCX: 000000000001a164
RDX: 000000000001a237 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff880c0a6b3cc8 R08: ffffffffffffffbe R09: 0000000000000000
R10: ffff880c3fbd09e0 R11: 0000000000000000 R12: ffff880c0a6b3b48
R13: ffff880c3ffd8230 R14: 0000000000000004 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff880c0f000000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f34c57f77a8 CR3: 0000000bef790000 CR4: 00000000003407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
00000000000017c0 ffff880c3ffd9008 00000000000000fd 0000000000000002
0000000000000bc0 ffff880c0f01a1d8 ffff880c0f01a1e8 ffff880c3ffd8068
0000000000000000 0000000200000077 ffff880c3ffd9000 0000000000000000
Call Trace:
[<ffffffff8118caf6>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff816a8f8d>] ? __schedule+0x39d/0x8b0
[<ffffffff811d1108>] alloc_pages_current+0x98/0x110
[<ffffffffc0442fd8>] vmballoon_work+0x3b8/0x615 [vmw_balloon]
[<ffffffff810a881a>] process_one_work+0x17a/0x440
[<ffffffff810a94e6>] worker_thread+0x126/0x3c0
[<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 e0 1b 01 00 8b 55 9c e8 63 6d 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #1013004
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffffb4b9da13
Build id: 3.10.0-862.el7.x86_64
|
0x433
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffb4b9e157
Build id: 3.10.0-862.el7.x86_64
|
0x197
|
|
3
|
|
xfs |
0xffffffffc044d2a9
Build id: 3.10.0-862.el7.x86_64
|
0x89
|
|
4
|
|
vmlinux |
0xffffffffb4ad816c
Build id: 3.10.0-862.el7.x86_64
|
0x14c
|
|
5
|
|
vmlinux |
0xffffffffb4a2959e
Build id: 3.10.0-862.el7.x86_64
|
0xce
|
|
6
|
alloc_pages_current
|
vmlinux |
0xffffffffb4be8528
Build id: 3.10.0-862.el7.x86_64
|
0x98
|
|
7
|
vmballoon_work
|
vmw_balloon |
0xffffffffc05e7fe8
Build id: 3.10.0-862.el7.x86_64
|
0x3c8
|
|
8
|
process_one_work
|
vmlinux |
0xffffffffb4ab2dff
Build id: 3.10.0-862.el7.x86_64
|
0x17f
|
|
9
|
worker_thread
|
vmlinux |
0xffffffffb4ab3ac6
Build id: 3.10.0-862.el7.x86_64
|
0x126
|
|
10
|
|
vmlinux |
0xffffffffb4ab39a0
Build id: 3.10.0-862.el7.x86_64
|
0x2a0
|
|
11
|
kthread
|
vmlinux |
0xffffffffb4abae31
Build id: 3.10.0-862.el7.x86_64
|
0xd1
|
|
12
|
|
vmlinux |
0xffffffffb4abad60
Build id: 3.10.0-862.el7.x86_64
|
0x40
|
|
13
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffb511f637
Build id: 3.10.0-862.el7.x86_64
|
0x21
|
|
14
|
|
vmlinux |
0xffffffffb4abad60
Build id: 3.10.0-862.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/2:2:25248]
Modules linked in: nfsv3 nfs fscache binfmt_misc rpcsec_gss_krb5 vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev sg vmw_balloon joydev pcspkr parport_pc parport vmw_vmci shpchp i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm mptspi scsi_transport_spi libata crct10dif_pclmul mptscsih crct10dif_common crc32c_intel serio_raw mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 25248 Comm: kworker/2:2 Kdump: loaded Tainted: G L ------------ 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff91dc6b485ee0 ti: ffff91dc24784000 task.ti: ffff91dc24784000
RIP: 0010:[<ffffffffb4b9da13>] [<ffffffffb4b9da13>] get_page_from_freelist+0x433/0x9e0
RSP: 0018:ffff91dc24787b40 EFLAGS: 00000246
RAX: 0000000000000023 RBX: ffff91dc24787b30 RCX: 000000000001c040
RDX: 000000000001c0b7 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff91dc24787c40 R08: ffffffffffffffc9 R09: 0000000000000000
R10: ffff91dfffbca700 R11: 0000000000000000 R12: ffffffffb4d683ed
R13: ffff91dc24787ac0 R14: ffffffff00000000 R15: ffff91dc24787ab8
FS: 0000000000000000(0000) GS:ffff91dfffc80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 000055dfa1b42338 CR3: 000000042560e000 CR4: 00000000001607e0
Call Trace:
[<ffffffffb4b9e157>] __alloc_pages_nodemask+0x197/0xbb0
[<ffffffffc044d2a9>] ? xfs_reclaim_inodes_ag+0x89/0x390 [xfs]
[<ffffffffb4ad816c>] ? update_curr+0x14c/0x1e0
[<ffffffffb4a2959e>] ? __switch_to+0xce/0x580
[<ffffffffb4be8528>] alloc_pages_current+0x98/0x110
[<ffffffffc05e7fe8>] vmballoon_work+0x3c8/0x63d [vmw_balloon]
[<ffffffffb4ab2dff>] process_one_work+0x17f/0x440
[<ffffffffb4ab3ac6>] worker_thread+0x126/0x3c0
[<ffffffffb4ab39a0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffffb4abae31>] kthread+0xd1/0xe0
[<ffffffffb4abad60>] ? insert_kthread_work+0x40/0x40
[<ffffffffb511f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb4abad60>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 80 5c 01 00 8b 55 9c e8 83 7a 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #1095947
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffffa879da48
Build id: 3.10.0-862.el7.x86_64
|
0x468
|
|
2
|
|
vmlinux |
0xffffffffa8d1291c
Build id: 3.10.0-862.el7.x86_64
|
0x41c
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffa879e157
Build id: 3.10.0-862.el7.x86_64
|
0x197
|
|
4
|
|
vmlinux |
0xffffffffa86d816c
Build id: 3.10.0-862.el7.x86_64
|
0x14c
|
|
5
|
|
vmlinux |
0xffffffffa86d5fac
Build id: 3.10.0-862.el7.x86_64
|
0x3c
|
|
6
|
alloc_pages_current
|
vmlinux |
0xffffffffa87e8528
Build id: 3.10.0-862.el7.x86_64
|
0x98
|
|
7
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0772062
Build id: 3.10.0-862.el7.x86_64
|
0x442
|
|
8
|
process_one_work
|
vmlinux |
0xffffffffa86b2dff
Build id: 3.10.0-862.el7.x86_64
|
0x17f
|
|
9
|
worker_thread
|
vmlinux |
0xffffffffa86b3ac6
Build id: 3.10.0-862.el7.x86_64
|
0x126
|
|
10
|
|
vmlinux |
0xffffffffa86b39a0
Build id: 3.10.0-862.el7.x86_64
|
0x2a0
|
|
11
|
kthread
|
vmlinux |
0xffffffffa86bae31
Build id: 3.10.0-862.el7.x86_64
|
0xd1
|
|
12
|
|
vmlinux |
0xffffffffa86bad60
Build id: 3.10.0-862.el7.x86_64
|
0x40
|
|
13
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffa8d1f637
Build id: 3.10.0-862.el7.x86_64
|
0x21
|
|
14
|
|
vmlinux |
0xffffffffa86bad60
Build id: 3.10.0-862.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/0:1:18414]
Modules linked in: nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev nfit vmw_balloon sg joydev pcspkr libnvdimm i2c_piix4 parport_pc
shpchp vmw_vmci parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif vmwgfx crct10dif_generic drm_kms_helper ahci syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm libahci crct10dif_pclmul crct10dif_common ata_piix crc32c_intel libata serio_raw vmxnet3 vmw_pvscsi i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 18414 Comm: kworker/0:1 Kdump: loaded Tainted: G ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8a7ca52b2f70 ti: ffff8a7c212b8000 task.ti: ffff8a7c212b8000
RIP: 0010:[<ffffffffa879da48>] [<ffffffffa879da48>] get_page_from_freelist+0x468/0x9e0
RSP: 0000:ffff8a7c212bbb40 EFLAGS: 00010287
RAX: 0000000000000000 RBX: ffff8a7c212bbb30 RCX: 0000000000000000
RDX: ffffffffa9074fa8 RSI: 0000000000000000 RDI: ffffe35ec07c4000
RBP: ffff8a7c212bbc40 R08: ffffffffa9074f97 R09: ffffe35ec07c8000
R10: ffffe35ec07c0040 R11: fffffffffffffffc R12: 0000000000000200
R13: ffffe35ec07c8000 R14: ffff8a7cbffd7ca0 R15: 000000000000000a
FS: 0000000000000000(0000) GS:ffff8a7cbfc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000424b1a CR3: 00000000bacdc000 CR4: 00000000007607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 00000000
Call Trace:
[<ffffffffa8d1291c>] ? __schedule+0x41c/0xa20
[<ffffffffa879e157>] __alloc_pages_nodemask+0x197/0xbb0
[<ffffffffa86d816c>] ? update_curr+0x14c/0x1e0
[<ffffffffa86d5fac>] ? set_next_entity+0x3c/0xe0
[<ffffffffa87e8528>] alloc_pages_current+0x98/0x110
[<ffffffffc0772062>] vmballoon_work+0x442/0x63d [vmw_balloon]
[<ffffffffa86b2dff>] process_one_work+0x17f/0x440
[<ffffffffa86b3ac6>] worker_thread+0x126/0x3c0
[<ffffffffa86b39a0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffffa86bae31>] kthread+0xd1/0xe0
[<ffffffffa86bad60>] ? insert_kthread_work+0x40/0x40
[<ffffffffa8d1f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa86bad60>] ? insert_kthread_work+0x40/0x40
Code: 0f 8e f8 02 00 00 44 8b 4d b0 4d 8d 55 40 4c 89 ef 49 c7 c0 97 4f 07 a9 31 c9 48 c7 c2 a8 4f 07 a9 49 c1 e1 06 4d 01 d1 0f 1f 00 <8b> 47 18 48 89 ce 83 f8 ff 8b 47 1c 49 0f 45 f0 48 83 7f 08 00
Complete report #1072611
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff81dd3630
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x2e0
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff81dd3fa4
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x184
|
|
3
|
|
vmlinux |
0xffffffff81cef2c3
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x1a3
|
|
4
|
|
vmlinux |
0xffffffff81ce4345
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x85
|
|
5
|
|
vmlinux |
0xffffffff81ceb01c
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x11c
|
|
6
|
alloc_pages_current
|
vmlinux |
0xffffffff81e25a98
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x98
|
|
7
|
vmballoon_work
|
vmw_balloon |
0xffffffffc072608a
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x53a
|
|
8
|
process_one_work
|
vmlinux |
0xffffffff81cc32ef
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x17f
|
|
9
|
worker_thread
|
vmlinux |
0xffffffff81cc4436
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x126
|
|
10
|
|
vmlinux |
0xffffffff81cc4310
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x2b0
|
|
11
|
kthread
|
vmlinux |
0xffffffff81ccb621
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0xd1
|
|
12
|
|
vmlinux |
0xffffffff81ccb550
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x40
|
|
13
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff823c51f7
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x21
|
|
14
|
|
vmlinux |
0xffffffff81ccb550
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 26s! [kworker/4:0:4748]
Modules linked in: nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper vmw_balloon cryptd pcspkr joydev sg parport_pc vmw_vmci parport i2c_piix4 binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm ahci drm libahci ata_piix nfit crct10dif_pclmul crct10dif_common crc32c_intel libata serio_raw libnvdimm vmxnet3 vmw_pvscsi drm_panel_orientation_quirks fuse
CPU: 4 PID: 4748 Comm: kworker/4:0 Kdump: loaded Tainted: G L ------------ 3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9ebf2f715280 ti: ffff9ebd7a964000 task.ti: ffff9ebd7a964000
RIP: 0010:[<ffffffff81dd3630>] [<ffffffff81dd3630>] get_page_from_freelist+0x2e0/0xad0
RSP: 0018:ffff9ebd7a967b40 EFLAGS: 00010287
RAX: 0000000000000000 RBX: ffff9ebd7a967b30 RCX: 0000000000000000
RDX: ffffffff826902a8 RSI: 0000000000000000 RDI: fffff33a013b2000
RBP: ffff9ebd7a967c48 R08: ffffffff82690297 R09: fffff33a013b8000
R10: ffff9ebf3ffd6120 R11: fffffffffffffff8 R12: ffffffff81fbd47d
R13: ffff9ebd7a967ac0 R14: 0000000000000086 R15: 0000000000000086
FS: 0000000000000000(0000) GS:ffff9ebf2fd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2cd70d1000 CR3: 000000042e0a2000 CR4: 00000000001607e0
Call Trace:
[<ffffffff81dd3fa4>] __alloc_pages_nodemask+0x184/0xbf0
[<ffffffff81cef2c3>] ? load_balance+0x1a3/0xa20
[<ffffffff81ce4345>] ? sched_clock_cpu+0x85/0xc0
[<ffffffff81ceb01c>] ? dequeue_entity+0x11c/0x5d0
[<ffffffff81e25a98>] alloc_pages_current+0x98/0x110
[<ffffffffc072608a>] vmballoon_work+0x53a/0x70f [vmw_balloon]
[<ffffffff81cc32ef>] process_one_work+0x17f/0x440
[<ffffffff81cc4436>] worker_thread+0x126/0x3c0
[<ffffffff81cc4310>] ? manage_workers.isra.26+0x2b0/0x2b0
[<ffffffff81ccb621>] kthread+0xd1/0xe0
[<ffffffff81ccb550>] ? insert_kthread_work+0x40/0x40
[<ffffffff823c51f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff81ccb550>] ? insert_kthread_work+0x40/0x40
Code: 00 00 44 8b 4d 84 49 8d 5d 40 4c 89 ef 49 c7 c0 97 02 69 82 31 c9 48 c7 c2 a8 02 69 82 49 c1 e1 06 49 01 d9 0f 1f 80 00 00 00 00 <8b> 47 18 48 89 ce 83 f8 ff 8b 47 1c 49 0f 45 f0 48 83 7f 08 00
Complete report #493668
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff81d9da13
Build id: 3.10.0-862.el7.x86_64
|
0x433
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff81d9e157
Build id: 3.10.0-862.el7.x86_64
|
0x197
|
|
3
|
|
vmlinux |
0xffffffff81cd816c
Build id: 3.10.0-862.el7.x86_64
|
0x14c
|
|
4
|
|
vmlinux |
0xffffffff81cd5fac
Build id: 3.10.0-862.el7.x86_64
|
0x3c
|
|
5
|
alloc_pages_current
|
vmlinux |
0xffffffff81de8528
Build id: 3.10.0-862.el7.x86_64
|
0x98
|
|
6
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0606fe8
Build id: 3.10.0-862.el7.x86_64
|
0x3c8
|
|
7
|
process_one_work
|
vmlinux |
0xffffffff81cb2dff
Build id: 3.10.0-862.el7.x86_64
|
0x17f
|
|
8
|
worker_thread
|
vmlinux |
0xffffffff81cb3ac6
Build id: 3.10.0-862.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffff81cb39a0
Build id: 3.10.0-862.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffff81cbae31
Build id: 3.10.0-862.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffff81cbad60
Build id: 3.10.0-862.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff8231f637
Build id: 3.10.0-862.el7.x86_64
|
0x21
|
|
13
|
|
vmlinux |
0xffffffff81cbad60
Build id: 3.10.0-862.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#18 stuck for 21s! [ReadOnlyService:13538]
NMI watchdog: BUG: soft lockup - CPU#13 stuck for 21s! [kworker/13:0:7897]
Modules linked in: iptable_raw xt_multiport ip_set_hash_ip ip_set_hash_net ipip tunnel4 ip_tunnel veth xt_set ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_bitmap_port ip_set dummy rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables iptable_mangle xt_comment xt_mark xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_nat_ipv4 nf_nat br_netfilter bridge stp llc overlay(T) vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon vmw_vmci i2c_piix4 sg joydev shpchp pcspkr parport_pc parport
nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nfsd auth_rpcgss nfs_acl lockd nf_conntrack grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif pata_acpi crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ata_piix mptspi ttm scsi_transport_spi libata mptscsih crct10dif_pclmul drm crct10dif_common mptbase crc32c_intel serio_raw vmxnet3 i2c_core floppy
CPU: 13 PID: 7897 Comm: kworker/13:0 Tainted: G L ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffffa013a2402f70 ti: ffffa0112febc000 task.ti: ffffa0112febc000
RIP: 0010:[<ffffffff81d9da13>] [<ffffffff81d9da13>] get_page_from_freelist+0x433/0x9e0
RSP: 0000:ffffa0112febfb40 EFLAGS: 00000246
RAX: 0000000000000049 RBX: ffffa0112febfb30 RCX: 000000000001c060
RDX: 000000000001c0b8 RSI: 0000000000000020 RDI: 0000000000000246
RBP: ffffa0112febfc40 R08: ffffffffffffffe9 R09: 0000000000000000
R10: ffffa01327fd6ee0 R11: 0000000000000000 R12: ffffffff81f683ed
R13: ffffa0112febfac0 R14: ffffa01327fd9bd0 R15: 0000000000000008
FS: 0000000000000000(0000) GS:ffffa01700340000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000ccc89000 CR3: 0000000a9fc0e000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff81d9e157>] __alloc_pages_nodemask+0x197/0xbb0
[<ffffffff81cd816c>] ? update_curr+0x14c/0x1e0
[<ffffffff81cd5fac>] ? set_next_entity+0x3c/0xe0
[<ffffffff81de8528>] alloc_pages_current+0x98/0x110
[<ffffffffc0606fe8>] vmballoon_work+0x3c8/0x63d [vmw_balloon]
[<ffffffff81cb2dff>] process_one_work+0x17f/0x440
[<ffffffff81cb3ac6>] worker_thread+0x126/0x3c0
[<ffffffff81cb39a0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff81cbae31>] kthread+0xd1/0xe0
[<ffffffff81cbad60>] ? insert_kthread_work+0x40/0x40
[<ffffffff8231f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff81cbad60>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 80 5c 01 00 8b 55 9c e8 83 7a 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #441545
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffffa05c8587
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x2a7
|
|
2
|
|
vmlinux |
0xffffffffa04d2d90
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x20
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffa05c8f24
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x184
|
|
4
|
|
vmlinux |
0xffffffffa04e495c
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x14c
|
|
5
|
|
vmlinux |
0xffffffffa04de400
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x50
|
|
6
|
|
vmlinux |
0xffffffffa07a64a7
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x37
|
|
7
|
alloc_pages_current
|
vmlinux |
0xffffffffa06193b8
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x98
|
|
8
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0785f84
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x454
|
|
9
|
process_one_work
|
vmlinux |
0xffffffffa04bdfbf
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x17f
|
|
10
|
worker_thread
|
vmlinux |
0xffffffffa04bf0d6
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x126
|
|
11
|
|
vmlinux |
0xffffffffa04befb0
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x2a0
|
|
12
|
kthread
|
vmlinux |
0xffffffffa04c5f91
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0xd1
|
|
13
|
|
vmlinux |
0xffffffffa04c5ec0
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x40
|
|
14
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffa0b99ddd
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x7
|
|
15
|
|
vmlinux |
0xffffffffa04c5ec0
Build id: 3.10.0-1160.66.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 21s! [kworker/2:2:958]
Modules linked in: btrfs raid6_pq xor vfat msdos fat xfs ebtable_filter ebtables devlink ip6table_filter ip6_tables ipt_REJECT nf_reject_ipv4 xt_comment nf_conntrack_ipv4 nf_defrag_ipv4 xt_iprange xt_conntrack vmw_vsock_vmci_transport vsock nf_conntrack libcrc32c iptable_filter sunrpc ppdev vmw_balloon iosf_mbi joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 ip_tables ext4 mbcache jbd2 sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif drm_kms_helper syscopyarea sysfillrect sysimgblt crct10dif_pclmul fb_sys_fops crc32_pclmul ttm ghash_clmulni_intel ahci nfit drm aesni_intel libahci ata_piix libnvdimm serio_raw libata vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log authenc cmac zlib wp512 twofish_generic twofish_avx_x86_64 twofish_x86_64_3way twofish_x86_64 twofish_common tea sha512_ssse3 sha512_generic serpent_avx2 serpent_avx_x86_64 serpent_sse2_x86_64 serpent_generic seed salsa20_generic salsa20_x86_64 rmd320 rmd256 rmd160 rmd128 michael_mic md4 khazad ghash_generic gcm fcrypt drbg dm_crypt dm_mod des_generic deflate cts crypto_null crct10dif_generic crct10dif_common crc32c_intel ccm cast6_avx_x86_64 cast6_generic cast_common camellia_generic camellia_aesni_avx2 camellia_aesni_avx_x86_64 ablk_helper cryptd camellia_x86_64 xts lrw gf128mul glue_helper blowfish_generic blowfish_x86_64 blowfish_common arc4 ansi_cprng fuse [last unloaded: tcrypt]
CPU: 2 PID: 958 Comm: kworker/2:2 Tainted: G L ------------ 3.10.0-1160.66.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff90a31647b180 ti: ffff90a89b868000 task.ti: ffff90a89b868000
RIP: 0010:[<ffffffffa05c8587>] [<ffffffffa05c8587>] get_page_from_freelist+0x2a7/0xac0
RSP: 0018:ffff90a89b86bb40 EFLAGS: 00000246
RAX: 00000000000000f8 RBX: ffff90a89b86bb30 RCX: 000000000001fd58
RDX: 000000000001fdd0 RSI: 0000000000000020 RDI: 0000000000000246
RBP: ffff90a89b86bc48 R08: ffffffffffffffdd R09: 0000000000003d55
R10: 0000000000003724 R11: ffffffffffffffff R12: ffffffffa07a660d
R13: ffff90a89b86bac0 R14: ffff90a53ffda298 R15: 0000000000000005
FS: 0000000000000000(0000) GS:ffff90a52fa80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c000674000 CR3: 00000002fd610000 CR4: 00000000007607e0
PKRU: 00000000
Call Trace:
[<ffffffffa04d2d90>] ? task_rq_unlock+0x20/0x20
[<ffffffffa05c8f24>] __alloc_pages_nodemask+0x184/0xbe0
[<ffffffffa04e495c>] ? update_curr+0x14c/0x1e0
[<ffffffffa04de400>] ? sched_clock_cpu+0x50/0xc0
[<ffffffffa07a64a7>] ? __list_add+0x37/0xc0
[<ffffffffa06193b8>] alloc_pages_current+0x98/0x110
[<ffffffffc0785f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffffa04bdfbf>] process_one_work+0x17f/0x440
[<ffffffffa04bf0d6>] worker_thread+0x126/0x3c0
[<ffffffffa04befb0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffa04c5f91>] kthread+0xd1/0xe0
[<ffffffffa04c5ec0>] ? insert_kthread_work+0x40/0x40
[<ffffffffa0b99ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffa04c5ec0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 60 7e 01 00 8b 55 b0 e8 4f 8a 01 00 48 8b 7d b8 57 9d <0f> 1f 44 00 00 8b 75 b4 85 f6 0f 8e b1 03 00 00 44 8b 4d 84 49
Complete report #327720
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff8cf9da13
Build id: 3.10.0-862.el7.x86_64
|
0x433
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8cf9e157
Build id: 3.10.0-862.el7.x86_64
|
0x197
|
|
3
|
|
vmlinux |
0xffffffff8ced816c
Build id: 3.10.0-862.el7.x86_64
|
0x14c
|
|
4
|
|
vmlinux |
0xffffffff8ce2959e
Build id: 3.10.0-862.el7.x86_64
|
0xce
|
|
5
|
alloc_pages_current
|
vmlinux |
0xffffffff8cfe8528
Build id: 3.10.0-862.el7.x86_64
|
0x98
|
|
6
|
vmballoon_work
|
vmw_balloon |
0xffffffffc058bfe8
Build id: 3.10.0-862.el7.x86_64
|
0x3c8
|
|
7
|
process_one_work
|
vmlinux |
0xffffffff8ceb2dff
Build id: 3.10.0-862.el7.x86_64
|
0x17f
|
|
8
|
worker_thread
|
vmlinux |
0xffffffff8ceb3ac6
Build id: 3.10.0-862.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffff8ceb39a0
Build id: 3.10.0-862.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffff8cebae31
Build id: 3.10.0-862.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffff8cebad60
Build id: 3.10.0-862.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff8d51f637
Build id: 3.10.0-862.el7.x86_64
|
0x21
|
|
13
|
|
vmlinux |
0xffffffff8cebad60
Build id: 3.10.0-862.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [kworker/0:0:3986]
Modules linked in: tcp_lp xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink fuse vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec crc32_pclmul ghash_clmulni_intel ac97_bus aesni_intel lrw gf128mul snd_seq glue_helper snd_seq_device snd_pcm ablk_helper snd_timer snd pcspkr cryptd soundcore joydev nfit ppdev parport_pc parport sg libnvdimm vmw_balloon shpchp vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm crct10dif_pclmul ata_piix drm crct10dif_common crc32c_intel mptspi libata scsi_transport_spi e1000 mptscsih serio_raw mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 3986 Comm: kworker/0:0 Kdump: loaded Tainted: G L ------------ 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff95a9034dcf10 ti: ffff95a8e18c0000 task.ti: ffff95a8e18c0000
RIP: 0010:[<ffffffff8cf9da13>] [<ffffffff8cf9da13>] get_page_from_freelist+0x433/0x9e0
RSP: 0000:ffff95a8e18c3b40 EFLAGS: 00000246
RAX: 00000000000000f5 RBX: ffff95a8e18c3b30 RCX: 000000000001bf32
RDX: 000000000001c04f RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff95a8e18c3c40 R08: fffffffffffffff0 R09: 0000000000000000
R10: ffff95a93ffd7f60 R11: 0000000000000000 R12: ffffdfffc17304c0
R13: 0000000000000001 R14: ffff95a93ffd9b68 R15: 0000000000000007
FS: 0000000000000000(0000) GS:ffff95a93b600000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000004416b2 CR3: 00000000780ec000 CR4: 00000000007607f0
PKRU: 00000000
Call Trace:
[<ffffffff8cf9e157>] __alloc_pages_nodemask+0x197/0xbb0
[<ffffffff8ced816c>] ? update_curr+0x14c/0x1e0
[<ffffffff8ce2959e>] ? __switch_to+0xce/0x580
[<ffffffff8cfe8528>] alloc_pages_current+0x98/0x110
[<ffffffffc058bfe8>] vmballoon_work+0x3c8/0x63d [vmw_balloon]
[<ffffffff8ceb2dff>] process_one_work+0x17f/0x440
[<ffffffff8ceb3ac6>] worker_thread+0x126/0x3c0
[<ffffffff8ceb39a0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff8cebae31>] kthread+0xd1/0xe0
[<ffffffff8cebad60>] ? insert_kthread_work+0x40/0x40
[<ffffffff8d51f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8cebad60>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 80 5c 01 00 8b 55 9c e8 83 7a 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #270659
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff917c8567
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x2a7
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff917c8f04
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x184
|
|
3
|
|
vmlinux |
0xffffffff916e8ea3
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x1a3
|
|
4
|
|
vmlinux |
0xffffffff916de305
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x85
|
|
5
|
alloc_pages_current
|
vmlinux |
0xffffffff918193b8
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x98
|
|
6
|
vmballoon_work
|
vmw_balloon |
0xffffffffc05f3f84
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x454
|
|
7
|
process_one_work
|
vmlinux |
0xffffffff916bde8f
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x17f
|
|
8
|
worker_thread
|
vmlinux |
0xffffffff916befa6
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffff916bee80
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffff916c5e61
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffff916c5d90
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff91d95df7
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x21
|
|
13
|
|
vmlinux |
0xffffffff916c5d90
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 27s! [kworker/2:0:4822]
Modules linked in: xt_addrtype xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 ipt_REJECT nf_reject_ipv4 iptable_filter xt_conntrack iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle ip_tables veth br_netfilter overlay(T) ip_set tun bridge stp llc devlink vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel pcspkr vmw_balloon sg cryptd joydev parport_pc parport i2c_piix4 vmw_vmci xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sd_mod sysimgblt fb_sys_fops ttm crc_t10dif crct10dif_generic drm ata_piix libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log
dm_mod fuse [last unloaded: ip_tables]
CPU: 2 PID: 4822 Comm: kworker/2:0 Kdump: loaded Tainted: G ------------ T 3.10.0-1160.42.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8e072e226300 ti: ffff8e052fd44000 task.ti: ffff8e052fd44000
RIP: 0010:[<ffffffff917c8567>] [<ffffffff917c8567>] get_page_from_freelist+0x2a7/0xac0
RSP: 0018:ffff8e052fd47b40 EFLAGS: 00000246
RAX: 000000000000001d RBX: ffff8e052fd47b30 RCX: 000000000001fd40
RDX: 000000000001fd67 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff8e052fd47c48 R08: fffffffffffffff7 R09: 0000000000000000
R10: ffff8e073fbd6980 R11: fffffffffffffff8 R12: ffffe3ffca9ac440
R13: 0000000000000001 R14: ffff8e033652ae70 R15: ffff8e033652ae00
FS: 0000000000000000(0000) GS:ffff8e073fc80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc9fa2fbc60 CR3: 000000042ce54000 CR4: 00000000001607e0
Call Trace:
[<ffffffff917c8f04>] __alloc_pages_nodemask+0x184/0xbe0
[<ffffffff916e8ea3>] ? load_balance+0x1a3/0xa10
[<ffffffff916de305>] ? sched_clock_cpu+0x85/0xc0
[<ffffffff918193b8>] alloc_pages_current+0x98/0x110
[<ffffffffc05f3f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff916bde8f>] process_one_work+0x17f/0x440
[<ffffffff916befa6>] worker_thread+0x126/0x3c0
[<ffffffff916bee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff916c5e61>] kthread+0xd1/0xe0
[<ffffffff916c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffff91d95df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff916c5d90>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 60 7e 01 00 8b 55 b0 e8 6f 8a 01 00 48 8b 7d b8 57 9d <0f> 1f 44 00 00 8b 75 b4 85 f6 0f 8e b1 03 00 00 44 8b 4d 84 49
Complete report #212042
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff929c6fb4
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x344
|
|
2
|
|
vmlinux |
0xffffffff928d31c0
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x20
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff929c7894
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x184
|
|
4
|
|
vmlinux |
0xffffffff928e486c
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x14c
|
|
5
|
|
vmlinux |
0xffffffff9282b59e
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0xce
|
|
6
|
|
vmlinux |
0xffffffff92f7f568
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x448
|
|
7
|
alloc_pages_current
|
vmlinux |
0xffffffff92a16298
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x98
|
|
8
|
vmballoon_work
|
vmw_balloon |
0xffffffffc06c3f84
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x454
|
|
9
|
process_one_work
|
vmlinux |
0xffffffff928be21f
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x17f
|
|
10
|
worker_thread
|
vmlinux |
0xffffffff928bf336
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x126
|
|
11
|
|
vmlinux |
0xffffffff928bf210
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x2a0
|
|
12
|
kthread
|
vmlinux |
0xffffffff928c61f1
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0xd1
|
|
13
|
|
vmlinux |
0xffffffff928c6120
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x40
|
|
14
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff92f8cd37
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x21
|
|
15
|
|
vmlinux |
0xffffffff928c6120
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 31s! [kworker/0:2:9459]
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [CRTC:37:crtc-0] flip_done timed out
Modules linked in: nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache binfmt_misc vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod coretemp crc32_pclmul ppdev ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg parport_pc vmw_vmci parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm libahci ata_piix crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw vmxnet3 nfit libnvdimm vmw_pvscsi drm_panel_orientation_quirks
CPU: 0 PID: 9459 Comm: kworker/0:2 Kdump: loaded Tainted: G L ------------ 3.10.0-1062.4.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9a2bd2e941c0 ti: ffff9a2c53a94000 task.ti: ffff9a2c53a94000
RIP: 0010:[<ffffffff929c6fb4>] [<ffffffff929c6fb4>] get_page_from_freelist+0x344/0xaa0
RSP: 0018:ffff9a2c53a97b40 EFLAGS: 00000246
RAX: 00000000000000fd RBX: ffff9a2c53a97b30 RCX: 000000000001fc18
RDX: 000000000001fcff RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff9a2c53a97c48 R08: fffffffffffffff3 R09: 0000000000000000
R10: ffff9a2cffbd7e80 R11: 0000000000000000 R12: ffffdf6cc298a0c0
R13: 0000000000000001 R14: 0000000000000096 R15: ffff9a2c53a97aa8
FS: 0000000000000000(0000) GS:ffff9a2cffc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f6eb015d000 CR3: 000000008d55c000 CR4: 00000000000007f0
Call Trace:
[<ffffffff928d31c0>] ? task_rq_unlock+0x20/0x20
[<ffffffff929c7894>] __alloc_pages_nodemask+0x184/0xbe0
[<ffffffff928e486c>] ? update_curr+0x14c/0x1e0
[<ffffffff9282b59e>] ? __switch_to+0xce/0x580
[<ffffffff92f7f568>] ? __schedule+0x448/0x9c0
[<ffffffff92a16298>] alloc_pages_current+0x98/0x110
[<ffffffffc06c3f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff928be21f>] process_one_work+0x17f/0x440
[<ffffffff928bf336>] worker_thread+0x126/0x3c0
[<ffffffff928bf210>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff928c61f1>] kthread+0xd1/0xe0
[<ffffffff928c6120>] ? insert_kthread_work+0x40/0x40
[<ffffffff92f8cd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff928c6120>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 c0 7d 01 00 8b 55 b0 e8 52 86 01 00 48 8b 7d c0 57 9d <66> 66 90 66 90 8b 75 b4 85 f6 0f 8e 19 03 00 00 44 8b 4d 84 49
Complete report #21342
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffffb8bc6fb4
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x344
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffb8bc7894
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x184
|
|
3
|
|
vmlinux |
0xffffffffb8ae486c
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x14c
|
|
4
|
|
vmlinux |
0xffffffffb8a2b59e
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0xce
|
|
5
|
alloc_pages_current
|
vmlinux |
0xffffffffb8c16298
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x98
|
|
6
|
vmballoon_work
|
vmw_balloon |
0xffffffffc04f4f84
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x454
|
|
7
|
process_one_work
|
vmlinux |
0xffffffffb8abe21f
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x17f
|
|
8
|
worker_thread
|
vmlinux |
0xffffffffb8abf336
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffffb8abf210
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffffb8ac61f1
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffffb8ac6120
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffb918cd37
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x21
|
|
13
|
|
vmlinux |
0xffffffffb8ac6120
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 27s! [kworker/5:1:5610]
Modules linked in: vxlan ip6_udp_tunnel udp_tunnel xt_statistic xt_nat xt_recent xt_comment xt_mark nf_conntrack_netlink nfnetlink xt_addrtype xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 ppdev vmw_balloon coretemp joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 br_netfilter bridge stp llc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic crct10dif_common pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata serio_raw vmxnet3
vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 5610 Comm: kworker/5:1 Kdump: loaded Tainted: G L ------------ T 3.10.0-1062.4.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff993998f19070 ti: ffff99399c4a0000 task.ti: ffff99399c4a0000
RIP: 0010:[<ffffffffb8bc6fb4>] [<ffffffffb8bc6fb4>] get_page_from_freelist+0x344/0xaa0
RSP: 0018:ffff99399c4a3b40 EFLAGS: 00000246
RAX: 0000000000000017 RBX: ffff99399c4a3b30 RCX: 000000000001fd50
RDX: 000000000001fdcf RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff99399c4a3c48 R08: ffffffffffffffb0 R09: 0000000000000000
R10: ffff9939dffd7780 R11: 0000000000000050 R12: ffffffffb8da09dd
R13: ffff99399c4a3ac0 R14: 00000000000029b1 R15: 0000000000000001
FS: 0000000000000000(0000) GS:ffff9939d0080000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fdef034ab80 CR3: 00000007ecb1e000 CR4: 00000000000007e0
Call Trace:
[<ffffffffb8bc7894>] __alloc_pages_nodemask+0x184/0xbe0
[<ffffffffb8ae486c>] ? update_curr+0x14c/0x1e0
[<ffffffffb8a2b59e>] ? __switch_to+0xce/0x580
[<ffffffffb8c16298>] alloc_pages_current+0x98/0x110
[<ffffffffc04f4f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffffb8abe21f>] process_one_work+0x17f/0x440
[<ffffffffb8abf336>] worker_thread+0x126/0x3c0
[<ffffffffb8abf210>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffb8ac61f1>] kthread+0xd1/0xe0
[<ffffffffb8ac6120>] ? insert_kthread_work+0x40/0x40
[<ffffffffb918cd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb8ac6120>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 c0 7d 01 00 8b 55 b0 e8 52 86 01 00 48 8b 7d c0 57 9d <66> 66 90 66 90 8b 75 b4 85 f6 0f 8e 19 03 00 00 44 8b 4d 84 49
Complete report #20508
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffffad39da13
Build id: 3.10.0-862.el7.x86_64
|
0x433
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffad39e157
Build id: 3.10.0-862.el7.x86_64
|
0x197
|
|
3
|
|
vmlinux |
0xffffffffad2dc5f8
Build id: 3.10.0-862.el7.x86_64
|
0x178
|
|
4
|
|
vmlinux |
0xffffffffad22959e
Build id: 3.10.0-862.el7.x86_64
|
0xce
|
|
5
|
alloc_pages_current
|
vmlinux |
0xffffffffad3e8528
Build id: 3.10.0-862.el7.x86_64
|
0x98
|
|
6
|
vmballoon_work
|
vmw_balloon |
0xffffffffc03d6fe8
Build id: 3.10.0-862.el7.x86_64
|
0x3c8
|
|
7
|
process_one_work
|
vmlinux |
0xffffffffad2b2dff
Build id: 3.10.0-862.el7.x86_64
|
0x17f
|
|
8
|
worker_thread
|
vmlinux |
0xffffffffad2b3ac6
Build id: 3.10.0-862.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffffad2b39a0
Build id: 3.10.0-862.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffffad2bae31
Build id: 3.10.0-862.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffffad2bad60
Build id: 3.10.0-862.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffad91f637
Build id: 3.10.0-862.el7.x86_64
|
0x21
|
|
13
|
|
vmlinux |
0xffffffffad2bad60
Build id: 3.10.0-862.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [kworker/1:0:30360]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_REJECT nf_reject_ipv4 ipt_MASQUERADE tun nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 ebtable_filter nf_defrag_ipv4 ebtables nf_nat_ipv4 xt_addrtype xt_conntrack nf_nat nf_conntrack ip6table_filter ip6_tables br_netfilter iptable_filter bridge stp llc devlink vmw_vsock_vmci_transport vsock overlay(T) sunrpc coretemp kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd vmw_balloon joydev pcspkr vmw_vmci sg i2c_piix4 floppy parport_pc parport shpchp ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi ata_piix scsi_transport_spi drm crct10dif_pclmul
crct10dif_common libata mptscsih crc32c_intel e1000 serio_raw mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 30360 Comm: kworker/1:0 Kdump: loaded Tainted: G W L ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8d7e4ea8eeb0 ti: ffff8d832a374000 task.ti: ffff8d832a374000
RIP: 0010:[<ffffffffad39da13>] [<ffffffffad39da13>] get_page_from_freelist+0x433/0x9e0
RSP: 0018:ffff8d832a377b40 EFLAGS: 00000246
RAX: 0000000000000043 RBX: ffff8d832a377b30 RCX: 000000000001c048
RDX: 000000000001c0b7 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff8d832a377c40 R08: ffffffffffffffe7 R09: 0000000000000000
R10: ffff8d863fbb9740 R11: 0000000000000000 R12: ffffe0e358568540
R13: 0000000000000001 R14: ffff8d863ffbe368 R15: 0000000000000007
FS: 0000000000000000(0000) GS:ffff8d861ee40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 000000c4203af180 CR3: 00000005294e6000 CR4: 00000000000007e0
Call Trace:
[<ffffffffad39e157>] __alloc_pages_nodemask+0x197/0xbb0
[<ffffffffad2dc5f8>] ? load_balance+0x178/0x9a0
[<ffffffffad22959e>] ? __switch_to+0xce/0x580
[<ffffffffad3e8528>] alloc_pages_current+0x98/0x110
[<ffffffffc03d6fe8>] vmballoon_work+0x3c8/0x63d [vmw_balloon]
[<ffffffffad2b2dff>] process_one_work+0x17f/0x440
[<ffffffffad2b3ac6>] worker_thread+0x126/0x3c0
[<ffffffffad2b39a0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffffad2bae31>] kthread+0xd1/0xe0
[<ffffffffad2bad60>] ? insert_kthread_work+0x40/0x40
[<ffffffffad91f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffad2bad60>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 80 5c 01 00 8b 55 9c e8 83 7a 01 00 48 8b 7d c0 57 9d <66> 66 90 66 90 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d