Complete report #1420971
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff8118c3d3
Build id: 3.10.0-693.el7.x86_64
|
0x433
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118caf6
Build id: 3.10.0-693.el7.x86_64
|
0x176
|
|
3
|
|
vmlinux |
0xffffffff816a8f8d
Build id: 3.10.0-693.el7.x86_64
|
0x39d
|
|
4
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1108
Build id: 3.10.0-693.el7.x86_64
|
0x98
|
|
5
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0442fd8
Build id: 3.10.0-693.el7.x86_64
|
0x3b8
|
|
6
|
process_one_work
|
vmlinux |
0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64
|
0x17a
|
|
7
|
worker_thread
|
vmlinux |
0xffffffff810a94e6
Build id: 3.10.0-693.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffff810a93c0
Build id: 3.10.0-693.el7.x86_64
|
0x2a0
|
|
9
|
kthread
|
vmlinux |
0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
|
0xcf
|
|
10
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork
|
vmlinux |
0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
|
0x58
|
|
12
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [kworker/0:2:155]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter arc4 md4 nls_utf8 cifs dns_resolver vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg parport_pc parport shpchp vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptsas drm scsi_transport_sas
ata_piix mptscsih crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 155 Comm: kworker/0:2 Tainted: G L ------------ 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff880c0a91eeb0 ti: ffff880c0a6b0000 task.ti: ffff880c0a6b0000
RIP: 0010:[<ffffffff8118c3d3>] [<ffffffff8118c3d3>] get_page_from_freelist+0x433/0x9e0
RSP: 0000:ffff880c0a6b3bc8 EFLAGS: 00000246
RAX: 0000000000000012 RBX: 000000000000001e RCX: 000000000001a164
RDX: 000000000001a237 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff880c0a6b3cc8 R08: ffffffffffffffbe R09: 0000000000000000
R10: ffff880c3fbd09e0 R11: 0000000000000000 R12: ffff880c0a6b3b48
R13: ffff880c3ffd8230 R14: 0000000000000004 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff880c0f000000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f34c57f77a8 CR3: 0000000bef790000 CR4: 00000000003407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
00000000000017c0 ffff880c3ffd9008 00000000000000fd 0000000000000002
0000000000000bc0 ffff880c0f01a1d8 ffff880c0f01a1e8 ffff880c3ffd8068
0000000000000000 0000000200000077 ffff880c3ffd9000 0000000000000000
Call Trace:
[<ffffffff8118caf6>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff816a8f8d>] ? __schedule+0x39d/0x8b0
[<ffffffff811d1108>] alloc_pages_current+0x98/0x110
[<ffffffffc0442fd8>] vmballoon_work+0x3b8/0x615 [vmw_balloon]
[<ffffffff810a881a>] process_one_work+0x17a/0x440
[<ffffffff810a94e6>] worker_thread+0x126/0x3c0
[<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 e0 1b 01 00 8b 55 9c e8 63 6d 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #1374867
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff8a1c8567
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x2a7
|
|
2
|
|
vmlinux |
0xffffffff8a1d5650
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x2e0
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8a1c9422
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x6a2
|
|
4
|
alloc_pages_current
|
vmlinux |
0xffffffff8a2193b8
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x98
|
|
5
|
vmballoon_work
|
vmw_balloon |
0xffffffffc03fef84
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x454
|
|
6
|
process_one_work
|
vmlinux |
0xffffffff8a0bde8f
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x17f
|
|
7
|
worker_thread
|
vmlinux |
0xffffffff8a0befa6
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffff8a0bee80
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x2a0
|
|
9
|
kthread
|
vmlinux |
0xffffffff8a0c5e61
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0xd1
|
|
10
|
|
vmlinux |
0xffffffff8a0c5d90
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff8a795ddd
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x7
|
|
12
|
|
vmlinux |
0xffffffff8a0c5d90
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 32s! [kworker/1:1:9766]
Modules linked in: binfmt_misc xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nf_nat_ftp nf_conntrack_ftp ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon sg joydev pcspkr parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif
crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix nfit drm libnvdimm mptspi crct10dif_pclmul crct10dif_common crc32c_intel scsi_transport_spi mptscsih serio_raw mptbase vmxnet3 libata drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 9766 Comm: kworker/1:1 Kdump: loaded Not tainted 3.10.0-1160.53.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff92282bafb180 ti: ffff9227bcce4000 task.ti: ffff9227bcce4000
RIP: 0010:[<ffffffff8a1c8567>] [<ffffffff8a1c8567>] get_page_from_freelist+0x2a7/0xac0
RSP: 0018:ffff9227bcce7b40 EFLAGS: 00000246
RAX: 0000000000000020 RBX: ffff9227bcce7b30 RCX: 000000000001fc24
RDX: 000000000001fcff RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff9227bcce7c48 R08: ffffffffffffffed R09: 0000000000000000
R10: ffff9228bfbd7ac0 R11: fffffffffffffffe R12: ffffffff8a3a681d
R13: ffff9227bcce7ac0 R14: ffff9228bffda230 R15: 0000000000000004
FS: 0000000000000000(0000) GS:ffff9228bfc80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5536093000 CR3: 0000000233232000 CR4: 00000000003607e0
Call Trace:
[<ffffffff8a1d5650>] ? do_try_to_free_pages+0x2e0/0x520
[<ffffffff8a1c9422>] __alloc_pages_nodemask+0x6a2/0xbe0
[<ffffffff8a2193b8>] alloc_pages_current+0x98/0x110
[<ffffffffc03fef84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff8a0bde8f>] process_one_work+0x17f/0x440
[<ffffffff8a0befa6>] worker_thread+0x126/0x3c0
[<ffffffff8a0bee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff8a0c5e61>] kthread+0xd1/0xe0
[<ffffffff8a0c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffff8a795ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff8a0c5d90>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 60 7e 01 00 8b 55 b0 e8 6f 8a 01 00 48 8b 7d b8 57 9d <0f> 1f 44 00 00 8b 75 b4 85 f6 0f 8e b1 03 00 00 44 8b 4d 84 49
Complete report #1360288
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffffafdc8127
Build id: 3.10.0-1160.el7.x86_64
|
0x2a7
|
|
2
|
|
vmlinux |
0xffffffffb0386e82
Build id: 3.10.0-1160.el7.x86_64
|
0x5a2
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffafdc8aa6
Build id: 3.10.0-1160.el7.x86_64
|
0x166
|
|
4
|
alloc_pages_current
|
vmlinux |
0xffffffffafe189d8
Build id: 3.10.0-1160.el7.x86_64
|
0x98
|
|
5
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0527f84
Build id: 3.10.0-1160.el7.x86_64
|
0x454
|
|
6
|
process_one_work
|
vmlinux |
0xffffffffafcbdc4f
Build id: 3.10.0-1160.el7.x86_64
|
0x17f
|
|
7
|
worker_thread
|
vmlinux |
0xffffffffafcbed66
Build id: 3.10.0-1160.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffffafcbec40
Build id: 3.10.0-1160.el7.x86_64
|
0x2a0
|
|
9
|
kthread
|
vmlinux |
0xffffffffafcc5c21
Build id: 3.10.0-1160.el7.x86_64
|
0xd1
|
|
10
|
|
vmlinux |
0xffffffffafcc5b50
Build id: 3.10.0-1160.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffb0393de4
Build id: 3.10.0-1160.el7.x86_64
|
0xe
|
|
12
|
|
vmlinux |
0xffffffffafcc5b50
Build id: 3.10.0-1160.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 26s! [kworker/5:0:26290]
Modules linked in: xt_nat veth nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache overlay(T) vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 ppdev vmw_balloon crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod syscopyarea crc_t10dif sysfillrect crct10dif_generic
sysimgblt fb_sys_fops ttm vmxnet3 ata_piix drm libata nfit crct10dif_pclmul crct10dif_common vmw_pvscsi serio_raw crc32c_intel drm_panel_orientation_quirks libnvdimm dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 5 PID: 26290 Comm: kworker/5:0 Kdump: loaded Tainted: G W L ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff993f8f789080 ti: ffff9963144f8000 task.ti: ffff9963144f8000
RIP: 0010:[<ffffffffafdc8127>] [<ffffffffafdc8127>] get_page_from_freelist+0x2a7/0xac0
RSP: 0000:ffff9963144fbbc8 EFLAGS: 00000246
RAX: 00000000000000d0 RBX: ffff997dfffda090 RCX: 000000000001fd78
RDX: 000000000001fd67 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff9963144fbcd0 R08: ffffffffffffffb7 R09: 0000000000b73669
R10: 0000000000005197 R11: fffffffffffffff6 R12: 0000000000000001
R13: 0000000000000141 R14: 0000000000005197 R15: fffffffffffffff6
FS: 0000000000000000(0000) GS:ffff997cff340000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb3bc500004 CR3: 00000039821de000 CR4: 00000000003407e0
Call Trace:
[<ffffffffb0386e82>] ? __schedule+0x5a2/0x860
[<ffffffffafdc8aa6>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffafe189d8>] alloc_pages_current+0x98/0x110
[<ffffffffc0527f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffffafcbdc4f>] process_one_work+0x17f/0x440
[<ffffffffafcbed66>] worker_thread+0x126/0x3c0
[<ffffffffafcbec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffafcc5c21>] kthread+0xd1/0xe0
[<ffffffffafcc5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffffb0393de4>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffffafcc5b50>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 60 7e 01 00 8b 55 b0 e8 bf 82 01 00 48 8b 7d b8 57 9d <66> 66 90 66 90 8b 75 b4 85 f6 0f 8e b1 03 00 00 44 8b 4d 84 49
Complete report #1322302
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
__cpuset_node_allowed_softwall
|
vmlinux |
0xffffffffb2b32f0b
Build id: 3.10.0-1160.el7.x86_64
|
0x5b
|
|
2
|
get_page_from_freelist
|
vmlinux |
0xffffffffb2bc85e4
Build id: 3.10.0-1160.el7.x86_64
|
0x764
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffb2bc8aa6
Build id: 3.10.0-1160.el7.x86_64
|
0x166
|
|
4
|
alloc_pages_current
|
vmlinux |
0xffffffffb2c189d8
Build id: 3.10.0-1160.el7.x86_64
|
0x98
|
|
5
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0545f84
Build id: 3.10.0-1160.el7.x86_64
|
0x454
|
|
6
|
process_one_work
|
vmlinux |
0xffffffffb2abdc4f
Build id: 3.10.0-1160.el7.x86_64
|
0x17f
|
|
7
|
worker_thread
|
vmlinux |
0xffffffffb2abed66
Build id: 3.10.0-1160.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffffb2abec40
Build id: 3.10.0-1160.el7.x86_64
|
0x2a0
|
|
9
|
kthread
|
vmlinux |
0xffffffffb2ac5c21
Build id: 3.10.0-1160.el7.x86_64
|
0xd1
|
|
10
|
|
vmlinux |
0xffffffffb2ac5b50
Build id: 3.10.0-1160.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffb3193de4
Build id: 3.10.0-1160.el7.x86_64
|
0xe
|
|
12
|
|
vmlinux |
0xffffffffb2ac5b50
Build id: 3.10.0-1160.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 41s! [kworker/1:2:21143]
Modules linked in: xt_nat veth nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache overlay(T) vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 ppdev crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev sg pcspkr vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm drm ata_piix nfit libnvdimm libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 21143 Comm: kworker/1:2 Kdump: loaded Tainted: G W L ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9cf5e27eb180 ti: ffff9d09a355c000 task.ti: ffff9d09a355c000
RIP: 0010:[<ffffffffb2b32f0b>] [<ffffffffb2b32f0b>] __cpuset_node_allowed_softwall+0x5b/0x140
RSP: 0000:ffff9d09a355fb98 EFLAGS: 00000207
RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff9d09a355fc98
RDX: ffff9d09a355ffd8 RSI: 0000000000020000 RDI: 0000000000000000
RBP: ffff9d09a355fbb8 R08: ffff9d333ffda000 R09: 0000000000000141
R10: 0000000000005197 R11: fffffffffffffff6 R12: 0000000000000001
R13: 0000000000000002 R14: ffff9d333ffdb008 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff9d323f240000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd9d3ee2000 CR3: 000000301da10000 CR4: 00000000003407e0
Call Trace:
[<ffffffffb2bc85e4>] get_page_from_freelist+0x764/0xac0
[<ffffffffb2bc8aa6>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffb2c189d8>] alloc_pages_current+0x98/0x110
[<ffffffffc0545f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffffb2abdc4f>] process_one_work+0x17f/0x440
[<ffffffffb2abed66>] worker_thread+0x126/0x3c0
[<ffffffffb2abec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffb2ac5c21>] kthread+0xd1/0xe0
[<ffffffffb2ac5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffffb3193de4>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffffb2ac5b50>] ? insert_kthread_work+0x40/0x40
Code: 0f 85 e2 00 00 00 81 e6 00 00 02 00 41 89 fc 89 c3 41 89 f6 0f 84 e6 00 00 00 65 4c 8b 2c 25 c0 0e 01 00 45 0f a3 a5 b0 08 00 00 <19> c0 85 c0 0f 85 b3 00 00 00 65 48 8b 04 25 b8 0e 01 00 48 8b
Complete report #1273115
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff9ebc8567
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x2a7
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff9ebc8f04
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x184
|
|
3
|
|
vmlinux |
0xffffffff9eae4d1c
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x11c
|
|
4
|
alloc_pages_current
|
vmlinux |
0xffffffff9ec193b8
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x98
|
|
5
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0515f84
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x454
|
|
6
|
process_one_work
|
vmlinux |
0xffffffff9eabde8f
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x17f
|
|
7
|
worker_thread
|
vmlinux |
0xffffffff9eabefa6
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffff9eabee80
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x2a0
|
|
9
|
kthread
|
vmlinux |
0xffffffff9eac5e61
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0xd1
|
|
10
|
|
vmlinux |
0xffffffff9eac5d90
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff9f199df7
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x21
|
|
12
|
|
vmlinux |
0xffffffff9eac5d90
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [kworker/0:0:3]
Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr i2c_piix4 sg joydev ppdev vmw_balloon vmw_vmci parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sd_mod sysfillrect sysimgblt fb_sys_fops crc_t10dif
ttm crct10dif_generic drm ata_piix crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 3 Comm: kworker/0:0 Kdump: loaded Not tainted 3.10.0-1160.59.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9c8afaec2100 ti: ffff9c8afaee4000 task.ti: ffff9c8afaee4000
RIP: 0010:[<ffffffff9ebc8567>] [<ffffffff9ebc8567>] get_page_from_freelist+0x2a7/0xac0
RSP: 0018:ffff9c8afaee7b40 EFLAGS: 00000246
RAX: 00000000000000e9 RBX: ffff9c8afaee7b30 RCX: 000000000001fc30
RDX: 000000000001fcff RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff9c8afaee7c48 R08: ffffffffffffffdb R09: 0000000000000000
R10: ffff9c8bbfbd3820 R11: 0000000000000000 R12: fffff9d3803ec540
R13: 0000000000000001 R14: 0000000200000000 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff9c8bbfc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5d69684000 CR3: 00000000b8cca000 CR4: 00000000001607f0
Call Trace:
[<ffffffff9ebc8f04>] __alloc_pages_nodemask+0x184/0xbe0
[<ffffffff9eae4d1c>] ? dequeue_entity+0x11c/0x5c0
[<ffffffff9ec193b8>] alloc_pages_current+0x98/0x110
[<ffffffffc0515f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff9eabde8f>] process_one_work+0x17f/0x440
[<ffffffff9eabefa6>] worker_thread+0x126/0x3c0
[<ffffffff9eabee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff9eac5e61>] kthread+0xd1/0xe0
[<ffffffff9eac5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffff9f199df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9eac5d90>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 60 7e 01 00 8b 55 b0 e8 6f 8a 01 00 48 8b 7d b8 57 9d <0f> 1f 44 00 00 8b 75 b4 85 f6 0f 8e b1 03 00 00 44 8b 4d 84 49
Complete report #1262686
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff811908f3
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x433
|
|
2
|
|
vmlinux |
0xffffffff816b3a1c
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x38c
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff81191016
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x176
|
|
4
|
alloc_pages_current
|
vmlinux |
0xffffffff811d5a38
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x98
|
|
5
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0417fe8
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x3c8
|
|
6
|
process_one_work
|
vmlinux |
0xffffffff810abe2f
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x17f
|
|
7
|
worker_thread
|
vmlinux |
0xffffffff810acaf6
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffff810ac9d0
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x2a0
|
|
9
|
kthread
|
vmlinux |
0xffffffff810b4031
Build id: 3.10.0-693.21.1.el7.x86_64
|
0xd1
|
|
10
|
|
vmlinux |
0xffffffff810b3f60
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork
|
vmlinux |
0xffffffff816c0577
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x77
|
|
12
|
|
vmlinux |
0xffffffff810b3f60
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 29s! [kworker/6:1:23144]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter binfmt_misc vmw_vsock_vmci_transport vsock sb_edac edac_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg nfit libnvdimm parport_pc i2c_piix4 parport shpchp vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod vmwgfx crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci libahci crct10dif_pclmul crct10dif_common
crc32c_intel drm serio_raw ata_piix libata vmxnet3 i2c_core vmw_pvscsi dm_mirror dm_region_hash dm_log dm_mod
CPU: 6 PID: 23144 Comm: kworker/6:1 Tainted: G L ------------ 3.10.0-693.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff880b46b7cf10 ti: ffff8800925d0000 task.ti: ffff8800925d0000
RIP: 0010:[<ffffffff811908f3>] [<ffffffff811908f3>] get_page_from_freelist+0x433/0x9e0
RSP: 0018:ffff8800925d3bc8 EFLAGS: 00000246
RAX: 0000000000000022 RBX: 000000000000001e RCX: 000000000001bf50
RDX: 000000000001bfb7 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff8800925d3cc8 R08: ffffffffffffffed R09: 0000000000000000
R10: ffff880c3fbd13e0 R11: fffffffffffffff8 R12: ffff8800925d3b48
R13: ffff880c3ffd7bd0 R14: 0000000000000008 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff880c3fd80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f18261ffa08 CR3: 0000000bf8fc2000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff816b3a1c>] ? __schedule+0x38c/0xa30
[<ffffffff81191016>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff811d5a38>] alloc_pages_current+0x98/0x110
[<ffffffffc0417fe8>] vmballoon_work+0x3c8/0x63d [vmw_balloon]
[<ffffffff810abe2f>] process_one_work+0x17f/0x440
[<ffffffff810acaf6>] worker_thread+0x126/0x3c0
[<ffffffff810ac9d0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b4031>] kthread+0xd1/0xe0
[<ffffffff810b3f60>] ? insert_kthread_work+0x40/0x40
[<ffffffff816c0577>] ret_from_fork+0x77/0xb0
[<ffffffff810b3f60>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 20 5c 01 00 8b 55 9c e8 83 6d 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #1083487
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffffa3fa0d8c
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x34c
|
|
2
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffffa450f12a
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x2dd
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffa3fa18b5
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x405
|
|
4
|
alloc_pages_current
|
vmlinux |
0xffffffffa3fec058
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x98
|
|
5
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0636f84
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x454
|
|
6
|
process_one_work
|
vmlinux |
0xffffffffa3eb613f
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x17f
|
|
7
|
worker_thread
|
vmlinux |
0xffffffffa3eb71d6
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffffa3eb70b0
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x2a0
|
|
9
|
kthread
|
vmlinux |
0xffffffffa3ebdf21
Build id: 3.10.0-862.14.4.el7.x86_64
|
0xd1
|
|
10
|
|
vmlinux |
0xffffffffa3ebde50
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffa45255f7
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x21
|
|
12
|
|
vmlinux |
0xffffffffa3ebde50
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [kworker/0:1:29266]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink binfmt_misc ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon pcspkr sg joydev parport_pc parport i2c_piix4 shpchp vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom ata_generic
pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx crct10dif_pclmul crct10dif_common drm_kms_helper crc32c_intel ahci syscopyarea sysfillrect sysimgblt mptsas fb_sys_fops ttm serio_raw scsi_transport_sas libahci mptscsih drm ata_piix mptbase libata e1000 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 29266 Comm: kworker/0:1 Kdump: loaded Tainted: G L ------------ 3.10.0-862.14.4.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9fb0f07adee0 ti: ffff9fb0c62e4000 task.ti: ffff9fb0c62e4000
RIP: 0010:[<ffffffffa3fa0d8c>] [<ffffffffa3fa0d8c>] get_page_from_freelist+0x34c/0xa70
RSP: 0018:ffff9fb0c62e7ad0 EFLAGS: 00000246
RAX: 0000000000000029 RBX: ffff9fb0c62e7ac0 RCX: 000000000001c030
RDX: 000000000001c0f7 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff9fb0c62e7bd8 R08: ffffffffffffffd3 R09: 0000000000000000
R10: ffff9fb13fbd6da0 R11: 0000000000000000 R12: fffffca14eada5c0
R13: 0000000000000001 R14: 0000000000000086 R15: 0000000000000086
FS: 0000000000000000(0000) GS:ffff9fb13fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff4361a8000 CR3: 00000000b9ff2000 CR4: 00000000001607f0
Call Trace:
[<ffffffffa450f12a>] __alloc_pages_slowpath+0x2dd/0x724
[<ffffffffa3fa18b5>] __alloc_pages_nodemask+0x405/0x420
[<ffffffffa3fec058>] alloc_pages_current+0x98/0x110
[<ffffffffc0636f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffffa3eb613f>] process_one_work+0x17f/0x440
[<ffffffffa3eb71d6>] worker_thread+0x126/0x3c0
[<ffffffffa3eb70b0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffffa3ebdf21>] kthread+0xd1/0xe0
[<ffffffffa3ebde50>] ? insert_kthread_work+0x40/0x40
[<ffffffffa45255f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa3ebde50>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 c0 5c 01 00 8b 55 b0 e8 fa 74 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f9 02 00 00 44 8b 4d 84 4d
Complete report #1007903
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff993c8160
Build id: 3.10.0-1160.el7.x86_64
|
0x2e0
|
|
2
|
|
vmlinux |
0xffffffff99986e82
Build id: 3.10.0-1160.el7.x86_64
|
0x5a2
|
|
3
|
|
vmlinux |
0xffffffff992e23a9
Build id: 3.10.0-1160.el7.x86_64
|
0xa9
|
|
4
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff993c8aa6
Build id: 3.10.0-1160.el7.x86_64
|
0x166
|
|
5
|
alloc_pages_current
|
vmlinux |
0xffffffff994189d8
Build id: 3.10.0-1160.el7.x86_64
|
0x98
|
|
6
|
vmballoon_work
|
vmw_balloon |
0xffffffffc078805a
Build id: 3.10.0-1160.el7.x86_64
|
0x52a
|
|
7
|
process_one_work
|
vmlinux |
0xffffffff992bdc4f
Build id: 3.10.0-1160.el7.x86_64
|
0x17f
|
|
8
|
worker_thread
|
vmlinux |
0xffffffff992bed66
Build id: 3.10.0-1160.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffff992bec40
Build id: 3.10.0-1160.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffff992c5c21
Build id: 3.10.0-1160.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffff992c5b50
Build id: 3.10.0-1160.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff99993de4
Build id: 3.10.0-1160.el7.x86_64
|
0xe
|
|
13
|
|
vmlinux |
0xffffffff992c5b50
Build id: 3.10.0-1160.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#15 stuck for 21s! [kworker/15:1:6640]
Modules linked in: btrfs raid6_pq xor vfat msdos fat xt_nat veth nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache overlay(T) vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 ppdev vmw_balloon crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod drm_kms_helper crc_t10dif crct10dif_generic
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix nfit crct10dif_pclmul crct10dif_common crc32c_intel libnvdimm libata serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 15 PID: 6640 Comm: kworker/15:1 Kdump: loaded Tainted: G W L ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8bbaaab55280 ti: ffff8bb9dd650000 task.ti: ffff8bb9dd650000
RIP: 0010:[<ffffffff993c8160>] [<ffffffff993c8160>] get_page_from_freelist+0x2e0/0xac0
RSP: 0018:ffff8bb9dd653bc8 EFLAGS: 00000287
RAX: 0000000000000000 RBX: ffff8bf97ffda068 RCX: 0000000000000000
RDX: ffffffff99c8e488 RSI: 0000000000000000 RDI: ffffe8da924ca000
RBP: ffff8bb9dd653cd0 R08: ffffffff99c8e477 R09: ffffe8da924d0000
R10: ffff8bf97fbbd140 R11: fffffffffffffff6 R12: ffff8bb9dd653b48
R13: 0000000000000000 R14: 0000000000000101 R15: ffff8bbaad340670
FS: 0000000000000000(0000) GS:ffff8bf87f5c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000036dfe30 CR3: 0000000231baa000 CR4: 00000000003407e0
Call Trace:
[<ffffffff99986e82>] ? __schedule+0x5a2/0x860
[<ffffffff992e23a9>] ? pick_next_entity+0xa9/0x190
[<ffffffff993c8aa6>] __alloc_pages_nodemask+0x166/0x450
[<ffffffff994189d8>] alloc_pages_current+0x98/0x110
[<ffffffffc078805a>] vmballoon_work+0x52a/0x6ff [vmw_balloon]
[<ffffffff992bdc4f>] process_one_work+0x17f/0x440
[<ffffffff992bed66>] worker_thread+0x126/0x3c0
[<ffffffff992bec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff992c5c21>] kthread+0xd1/0xe0
[<ffffffff992c5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffff99993de4>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffff992c5b50>] ? insert_kthread_work+0x40/0x40
Code: 00 00 44 8b 4d 84 49 8d 5d 40 4c 89 ef 49 c7 c0 77 e4 c8 99 31 c9 48 c7 c2 88 e4 c8 99 49 c1 e1 06 49 01 d9 0f 1f 80 00 00 00 00 <8b> 47 18 48 89 ce 83 f8 ff 8b 47 1c 49 0f 45 f0 48 83 7f 08 00
Complete report #1007847
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
dump_stack
|
vmlinux |
0xffffffff82581340
Build id: 3.10.0-1160.el7.x86_64
|
0x19
|
|
2
|
bad_page.part.75
|
vmlinux |
0xffffffff8257befd
Build id: 3.10.0-1160.el7.x86_64
|
0xdc
|
|
3
|
get_page_from_freelist
|
vmlinux |
0xffffffff81fc8625
Build id: 3.10.0-1160.el7.x86_64
|
0x7a5
|
|
4
|
|
vmlinux |
0xffffffff81ee43cc
Build id: 3.10.0-1160.el7.x86_64
|
0x14c
|
|
5
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff81fc8aa6
Build id: 3.10.0-1160.el7.x86_64
|
0x166
|
|
6
|
alloc_pages_current
|
vmlinux |
0xffffffff820189d8
Build id: 3.10.0-1160.el7.x86_64
|
0x98
|
|
7
|
vmballoon_work
|
vmw_balloon |
0xffffffffc073705a
Build id: 3.10.0-1160.el7.x86_64
|
0x52a
|
|
8
|
process_one_work
|
vmlinux |
0xffffffff81ebdc4f
Build id: 3.10.0-1160.el7.x86_64
|
0x17f
|
|
9
|
worker_thread
|
vmlinux |
0xffffffff81ebed66
Build id: 3.10.0-1160.el7.x86_64
|
0x126
|
|
10
|
|
vmlinux |
0xffffffff81ebec40
Build id: 3.10.0-1160.el7.x86_64
|
0x2a0
|
|
11
|
kthread
|
vmlinux |
0xffffffff81ec5c21
Build id: 3.10.0-1160.el7.x86_64
|
0xd1
|
|
12
|
|
vmlinux |
0xffffffff81ec5b50
Build id: 3.10.0-1160.el7.x86_64
|
0x40
|
|
13
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff82593df7
Build id: 3.10.0-1160.el7.x86_64
|
0x21
|
|
14
|
|
vmlinux |
0xffffffff81ec5b50
Build id: 3.10.0-1160.el7.x86_64
|
0x40
|
BUG: Bad page state in process kworker/2:2 pfn:a0d501
page:fffff48368354040 count:0 mapcount:0 mapping: (null) index:0x8000002
page flags: 0x2fffff08000000(kmemcg)
page dumped because: PAGE_FLAGS_CHECK_AT_PREP flag set
bad because of flags:
page flags: 0x8000000(kmemcg)
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper ablk_helper cryptd sg vmw_balloon pcspkr joydev i2c_piix4 parport_pc vmw_vmci parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci ata_piix drm libahci sd_mod crc_t10dif crct10dif_generic libata nfit libnvdimm crct10dif_pclmul crct10dif_common serio_raw crc32c_intel vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 9881 Comm: kworker/2:2 Kdump: loaded Tainted: G B ------------ 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
Call Trace:
[<ffffffff82581340>] dump_stack+0x19/0x1b
[<ffffffff8257befd>] bad_page.part.75+0xdc/0xf9
[<ffffffff81fc8625>] get_page_from_freelist+0x7a5/0xac0
[<ffffffff81ee43cc>] ? update_curr+0x14c/0x1e0
[<ffffffff81fc8aa6>] __alloc_pages_nodemask+0x166/0x450
[<ffffffff820189d8>] alloc_pages_current+0x98/0x110
[<ffffffffc073705a>] vmballoon_work+0x52a/0x6ff [vmw_balloon]
[<ffffffff81ebdc4f>] process_one_work+0x17f/0x440
[<ffffffff81ebed66>] worker_thread+0x126/0x3c0
[<ffffffff81ebec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff81ec5c21>] kthread+0xd1/0xe0
[<ffffffff81ec5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffff82593df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff81ec5b50>] ? insert_kthread_work+0x40/0x40
Complete report #951240
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff8118c3d3
Build id: 3.10.0-693.el7.x86_64
|
0x433
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118caf6
Build id: 3.10.0-693.el7.x86_64
|
0x176
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1108
Build id: 3.10.0-693.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0386fd8
Build id: 3.10.0-693.el7.x86_64
|
0x3b8
|
|
5
|
process_one_work
|
vmlinux |
0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64
|
0x17a
|
|
6
|
worker_thread
|
vmlinux |
0xffffffff810a94e6
Build id: 3.10.0-693.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffff810a93c0
Build id: 3.10.0-693.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
|
0xcf
|
|
9
|
|
vmlinux |
0xffffffff8108ddeb
Build id: 3.10.0-693.el7.x86_64
|
0x6bb
|
|
10
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork
|
vmlinux |
0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
|
0x58
|
|
12
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 33s! [kworker/0:1:11989]
Modules linked in: ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon sg pcspkr joydev parport_pc parport shpchp vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect
crct10dif_pclmul sysimgblt fb_sys_fops crct10dif_common ttm crc32c_intel mptspi serio_raw scsi_transport_spi drm ata_piix mptscsih libata mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 11989 Comm: kworker/0:1 Not tainted 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff88007f343f40 ti: ffff88009f70c000 task.ti: ffff88009f70c000
RIP: 0010:[<ffffffff8118c3d3>] [<ffffffff8118c3d3>] get_page_from_freelist+0x433/0x9e0
RSP: 0018:ffff88009f70fbc8 EFLAGS: 00000246
RAX: 00000000000000ea RBX: 0000000000000000 RCX: 000000000001a130
RDX: 000000000001a1cf RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff88009f70fcc8 R08: ffffffffffffffe6 R09: 0000000000000000
R10: ffff88033fbd4500 R11: 0000000000000000 R12: ffffea0001086a40
R13: ffff88009f70fca0 R14: 0000000000000001 R15: ffff88009f70fb70
FS: 0000000000000000(0000) GS:ffff88033fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f2deec36000 CR3: 00000000019f2000 CR4: 00000000000007f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000800 ffff88033ffd8008 0000000000000000 0000000000000002
0000000000000000 ffff88033fc1a170 ffff88033fc1a180 ffff88033ffd6868
0000000000000000 000000020000004d ffff88033ffd8000 0000000000000000
Call Trace:
[<ffffffff8118caf6>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff811d1108>] alloc_pages_current+0x98/0x110
[<ffffffffc0386fd8>] vmballoon_work+0x3b8/0x615 [vmw_balloon]
[<ffffffff810a881a>] process_one_work+0x17a/0x440
[<ffffffff810a94e6>] worker_thread+0x126/0x3c0
[<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff8108ddeb>] ? do_exit+0x6bb/0xa40
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 e0 1b 01 00 8b 55 9c e8 63 6d 01 00 48 8b 7d c0 57 9d <66> 66 90 66 90 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #891550
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff8118c403
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x433
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118cb26
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x176
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1078
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0440fd8
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x3b8
|
|
5
|
process_one_work
|
vmlinux |
0xffffffff810a882a
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x17a
|
|
6
|
worker_thread
|
vmlinux |
0xffffffff810a94f6
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffff810a93d0
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffff810b099f
Build id: 3.10.0-693.11.1.el7.x86_64
|
0xcf
|
|
9
|
|
vmlinux |
0xffffffff8108ddfb
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x6bb
|
|
10
|
|
vmlinux |
0xffffffff810b08d0
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork
|
vmlinux |
0xffffffff816b4fd8
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x58
|
|
12
|
|
vmlinux |
0xffffffff810b08d0
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [kworker/1:2:108034]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_16108(E) falcon_lsm_pinned_16004(E) falcon_lsm_pinned_15907(E) falcon_lsm_pinned_15805(E) falcon_lsm_pinned_15705(E) ip6table_filter ip6_tables xt_comment iptable_filter falcon_lsm_pinned_15604(E) nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache vmw_vsock_vmci_transport vsock ext4 mbcache jbd2 sb_edac edac_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg ppdev joydev nfit vmw_balloon pcspkr libnvdimm parport_pc parport shpchp vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc fuse ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod drm_kms_helper crc_t10dif crct10dif_generic syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ahci libahci ata_piix serio_raw libata vmxnet3 i2c_core vmw_pvscsi floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal]
CPU: 1 PID: 108034 Comm: kworker/1:2 Tainted: P W EL ------------ 3.10.0-693.11.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff88074ba73f40 ti: ffff8807356e8000 task.ti: ffff8807356e8000
RIP: 0010:[<ffffffff8118c403>] [<ffffffff8118c403>] get_page_from_freelist+0x433/0x9e0
RSP: 0018:ffff8807356ebbc8 EFLAGS: 00000246
RAX: 000000000000003f RBX: 000000000000001e RCX: 000000000001a148
RDX: 000000000001a237 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff8807356ebcc8 R08: ffffffffffffffc4 R09: 0000000000000000
R10: ffff8807bfbd41a0 R11: 0000000000000000 R12: ffff8807356ebb48
R13: ffff8807bffd8230 R14: 0000000000000004 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff88079f640000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f93fbe5b000 CR3: 000000003661b000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000009 ffff8807bffd9008 00000000356ebcc8 0000000000000002
ffff8807bffd8000 ffff88079f65a1d8 ffff88079f65a1e8 ffff8807bffd8068
0000000000000000 000000020000001e ffff8807bffd9000 0000000000000000
Call Trace:
[<ffffffff8118cb26>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff811d1078>] alloc_pages_current+0x98/0x110
[<ffffffffc0440fd8>] vmballoon_work+0x3b8/0x615 [vmw_balloon]
[<ffffffff810a882a>] process_one_work+0x17a/0x440
[<ffffffff810a94f6>] worker_thread+0x126/0x3c0
[<ffffffff810a93d0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b099f>] kthread+0xcf/0xe0
[<ffffffff8108ddfb>] ? do_exit+0x6bb/0xa40
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4fd8>] ret_from_fork+0x58/0x90
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 e0 1b 01 00 8b 55 9c e8 a3 6c 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #804327
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff8e9c8347
Build id: 3.10.0-1160.25.1.el7.x86_64
|
0x2a7
|
|
2
|
|
vmlinux |
0xffffffff8ef88c62
Build id: 3.10.0-1160.25.1.el7.x86_64
|
0x5b2
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8e9c8cc6
Build id: 3.10.0-1160.25.1.el7.x86_64
|
0x166
|
|
4
|
alloc_pages_current
|
vmlinux |
0xffffffff8ea18c88
Build id: 3.10.0-1160.25.1.el7.x86_64
|
0x98
|
|
5
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0567f84
Build id: 3.10.0-1160.25.1.el7.x86_64
|
0x454
|
|
6
|
process_one_work
|
vmlinux |
0xffffffff8e8bddcf
Build id: 3.10.0-1160.25.1.el7.x86_64
|
0x17f
|
|
7
|
worker_thread
|
vmlinux |
0xffffffff8e8beee6
Build id: 3.10.0-1160.25.1.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffff8e8bedc0
Build id: 3.10.0-1160.25.1.el7.x86_64
|
0x2a0
|
|
9
|
kthread
|
vmlinux |
0xffffffff8e8c5da1
Build id: 3.10.0-1160.25.1.el7.x86_64
|
0xd1
|
|
10
|
|
vmlinux |
0xffffffff8e8c5cd0
Build id: 3.10.0-1160.25.1.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff8ef95df7
Build id: 3.10.0-1160.25.1.el7.x86_64
|
0x21
|
|
12
|
|
vmlinux |
0xffffffff8e8c5cd0
Build id: 3.10.0-1160.25.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [kworker/6:2:127720]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables mfe_aac_100713183(OE) ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc ext4 iosf_mbi mbcache jbd2 crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr sg joydev parport_pc parport vmw_vmci i2c_piix4 binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod ahci crc_t10dif nfit crct10dif_generic libnvdimm ata_piix libahci drm libata crct10dif_pclmul crct10dif_common
crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 6 PID: 127720 Comm: kworker/6:2 Tainted: G OEL ------------ 3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9536fe198000 ti: ffff952e89fa0000 task.ti: ffff952e89fa0000
RIP: 0010:[<ffffffff8e9c8347>] [<ffffffff8e9c8347>] get_page_from_freelist+0x2a7/0xac0
RSP: 0018:ffff952e89fa3bc8 EFLAGS: 00000246
RAX: 00000000000000e6 RBX: 000000000000001e RCX: 000000000001fd64
RDX: 000000000001fd67 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff952e89fa3cd0 R08: fffffffffffffff1 R09: 0000000000000000
R10: ffff9538bfbd4660 R11: ffff952fcebb8040 R12: ffff952e89fa3b48
R13: ffff952e89fa3bb8 R14: ffff9538bffdb000 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff953895780000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000001bc8c30 CR3: 00000004af396000 CR4: 00000000007607e0
PKRU: 00000000
Call Trace:
[<ffffffff8ef88c62>] ? __schedule+0x5b2/0x870
[<ffffffff8e9c8cc6>] __alloc_pages_nodemask+0x166/0x450
[<ffffffff8ea18c88>] alloc_pages_current+0x98/0x110
[<ffffffffc0567f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff8e8bddcf>] process_one_work+0x17f/0x440
[<ffffffff8e8beee6>] worker_thread+0x126/0x3c0
[<ffffffff8e8bedc0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff8e8c5da1>] kthread+0xd1/0xe0
[<ffffffff8e8c5cd0>] ? insert_kthread_work+0x40/0x40
[<ffffffff8ef95df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8e8c5cd0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 60 7e 01 00 8b 55 b0 e8 df 82 01 00 48 8b 7d b8 57 9d <0f> 1f 44 00 00 8b 75 b4 85 f6 0f 8e b1 03 00 00 44 8b 4d 84 49
Complete report #732878
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff90fd3537
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x2a7
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff90fd4412
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x6b2
|
|
3
|
|
vmlinux |
0xffffffff90ee5d08
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x78
|
|
4
|
alloc_pages_current
|
vmlinux |
0xffffffff910259d8
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x98
|
|
5
|
vmballoon_work
|
vmw_balloon |
0xffffffffc06d8fb4
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x464
|
|
6
|
process_one_work
|
vmlinux |
0xffffffff90ec32ef
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x17f
|
|
7
|
worker_thread
|
vmlinux |
0xffffffff90ec4436
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffff90ec4310
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x2b0
|
|
9
|
kthread
|
vmlinux |
0xffffffff90ecb621
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0xd1
|
|
10
|
|
vmlinux |
0xffffffff90ecb550
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff915c51dd
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x7
|
|
12
|
|
vmlinux |
0xffffffff90ecb550
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [kworker/1:0:19016]
Modules linked in: vxlan ip6_udp_tunnel udp_tunnel xt_multiport xt_set ipt_rpfilter iptable_raw ip_set_hash_ip ip_set_hash_net ip_set veth xt_nat xt_statistic nf_tables ip6t_MASQUERADE nf_nat_masquerade_ipv6 ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle xt_mark xt_comment nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd joydev
pcspkr sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod ahci crc_t10dif crct10dif_generic nfit ata_piix drm libahci libnvdimm libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 19016 Comm: kworker/1:0 Kdump: loaded Tainted: G ------------ T 3.10.0-1160.88.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8f978a035280 ti: ffff8f94f01a0000 task.ti: ffff8f94f01a0000
RIP: 0010:[<ffffffff90fd3537>] [<ffffffff90fd3537>] get_page_from_freelist+0x2a7/0xad0
RSP: 0000:ffff8f94f01a3b40 EFLAGS: 00000246
RAX: 0000000000000023 RBX: ffff8f94f01a3b30 RCX: 000000000001fd40
RDX: 000000000001fd67 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff8f94f01a3c48 R08: 0000000000000000 R09: 0000000000000000
R10: ffff8f987fbd6ae0 R11: ffffffffffffffff R12: 0000000000000001
R13: ffffe1dc4bedefc0 R14: ffff8f987ffd9a30 R15: 0000000000000004
FS: 0000000000000000(0000) GS:ffff8f987fc40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000564055471016 CR3: 00000003c1ef4000 CR4: 00000000003607e0
Call Trace:
[<ffffffff90fd4412>] __alloc_pages_nodemask+0x6b2/0xbf0
[<ffffffff90ee5d08>] ? __enqueue_entity+0x78/0x80
[<ffffffff910259d8>] alloc_pages_current+0x98/0x110
[<ffffffffc06d8fb4>] vmballoon_work+0x464/0x70f [vmw_balloon]
[<ffffffff90ec32ef>] process_one_work+0x17f/0x440
[<ffffffff90ec4436>] worker_thread+0x126/0x3c0
[<ffffffff90ec4310>] ? manage_workers.isra.26+0x2b0/0x2b0
[<ffffffff90ecb621>] kthread+0xd1/0xe0
[<ffffffff90ecb550>] ? insert_kthread_work+0x40/0x40
[<ffffffff915c51dd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff90ecb550>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 60 7e 01 00 8b 55 b0 e8 1f 91 01 00 48 8b 7d b8 57 9d <0f> 1f 44 00 00 8b 75 b4 85 f6 0f 8e b9 03 00 00 44 8b 4d 84 49
Complete report #554479
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff9a5c8127
Build id: 3.10.0-1160.el7.x86_64
|
0x2a7
|
|
2
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff9ab7c47f
Build id: 3.10.0-1160.el7.x86_64
|
0x2dd
|
|
3
|
|
vmlinux |
0xffffffff9a4dfb00
Build id: 3.10.0-1160.el7.x86_64
|
0x30
|
|
4
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff9a5c8d76
Build id: 3.10.0-1160.el7.x86_64
|
0x436
|
|
5
|
alloc_pages_current
|
vmlinux |
0xffffffff9a6189d8
Build id: 3.10.0-1160.el7.x86_64
|
0x98
|
|
6
|
vmballoon_work
|
vmw_balloon |
0xffffffffc03cff84
Build id: 3.10.0-1160.el7.x86_64
|
0x454
|
|
7
|
process_one_work
|
vmlinux |
0xffffffff9a4bdc4f
Build id: 3.10.0-1160.el7.x86_64
|
0x17f
|
|
8
|
worker_thread
|
vmlinux |
0xffffffff9a4bed66
Build id: 3.10.0-1160.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffff9a4bec40
Build id: 3.10.0-1160.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffff9a4c5c21
Build id: 3.10.0-1160.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffff9a4c5b50
Build id: 3.10.0-1160.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff9ab93df7
Build id: 3.10.0-1160.el7.x86_64
|
0x21
|
|
13
|
|
vmlinux |
0xffffffff9a4c5b50
Build id: 3.10.0-1160.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 24s! [kswapd0:50]
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 24s! [kworker/2:1:1943]
Modules linked in: rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache zram ip6t_REJECT nf_reject_ipv6 nf_conntrack_ipv6 nf_defrag_ipv6 xt_conntrack nf_conntrack libcrc32c ip6table_filter ip6_tables vmw_vsock_vmci_transport vsock iptable_filter sunrpc coretemp crc32_pclmul ghash_clmulni_intel ppdev joydev aesni_intel vmw_balloon pcspkr lrw gf128mul glue_helper ablk_helper sg cryptd vmw_vmci i2c_piix4 parport_pc parport sch_fq_codel ip_tables ext4 mbcache jbd2 sr_mod cdrom vmwgfx drm_kms_helper ata_generic syscopyarea sysfillrect sysimgblt pata_acpi fb_sys_fops sd_mod ttm crc_t10dif crct10dif_generic drm ahci libahci ata_piix crct10dif_pclmul crct10dif_common libata serio_raw crc32c_intel vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 1943 Comm: kworker/2:1 Kdump: loaded Not tainted 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9fd56e1b2100 ti: ffff9fd4800f4000 task.ti: ffff9fd4800f4000
RIP: 0010:[<ffffffff9a5c8127>] [<ffffffff9a5c8127>] get_page_from_freelist+0x2a7/0xac0
RSP: 0018:ffff9fd4800f7ad8 EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff9fd6bffd1890 RCX: 000000000001fc24
RDX: 000000000001fcff RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff9fd4800f7be0 R08: ffffffffffffffe5 R09: 0000000000000000
R10: ffff9fd6bfbcf5e0 R11: ffffffffffffffff R12: 0000000000000001
R13: ffff9fd4800f7ac8 R14: 0000000000000087 R15: ffff9fd4800f7b28
FS: 0000000000000000(0000) GS:ffff9fd6b3200000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f106ed39130 CR3: 00000000b84a8000 CR4: 00000000000007e0
Call Trace:
[<ffffffff9ab7c47f>] __alloc_pages_slowpath+0x2dd/0x729
[<ffffffff9a4dfb00>] ? __enqueue_entity+0x30/0x80
[<ffffffff9a5c8d76>] __alloc_pages_nodemask+0x436/0x450
[<ffffffff9a6189d8>] alloc_pages_current+0x98/0x110
[<ffffffffc03cff84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff9a4bdc4f>] process_one_work+0x17f/0x440
[<ffffffff9a4bed66>] worker_thread+0x126/0x3c0
[<ffffffff9a4bec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff9a4c5c21>] kthread+0xd1/0xe0
[<ffffffff9a4c5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffff9ab93df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9a4c5b50>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 60 7e 01 00 8b 55 b0 e8 bf 82 01 00 48 8b 7d b8 57 9d <66> 66 90 66 90 8b 75 b4 85 f6 0f 8e b1 03 00 00 44 8b 4d 84 49
Complete report #553538
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff89dc061c
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x34c
|
|
2
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff8a35d075
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x2dd
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff89dc1145
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x405
|
|
4
|
alloc_pages_current
|
vmlinux |
0xffffffff89e0e0a8
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x98
|
|
5
|
vmballoon_work
|
vmw_balloon |
0xffffffffc066ff84
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x454
|
|
6
|
process_one_work
|
vmlinux |
0xffffffff89cb9d8f
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x17f
|
|
7
|
worker_thread
|
vmlinux |
0xffffffff89cbae26
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffff89cbad00
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x2a0
|
|
9
|
kthread
|
vmlinux |
0xffffffff89cc1c71
Build id: 3.10.0-957.5.1.el7.x86_64
|
0xd1
|
|
10
|
|
vmlinux |
0xffffffff89cc1ba0
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff8a374c37
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x21
|
|
12
|
|
vmlinux |
0xffffffff89cc1ba0
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/0:1:22144]
Modules linked in: binfmt_misc xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock ppdev vmw_balloon coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops floppy ttm drm ata_piix
mptspi libata scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 22144 Comm: kworker/0:1 Kdump: loaded Tainted: G L ------------ 3.10.0-957.5.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffffa0ad8349a080 ti: ffffa0a929674000 task.ti: ffffa0a929674000
RIP: 0010:[<ffffffff89dc061c>] [<ffffffff89dc061c>] get_page_from_freelist+0x34c/0xa70
RSP: 0018:ffffa0a929677ad0 EFLAGS: 00000246
RAX: 0000000000000012 RBX: ffffa0a929677ac0 RCX: 000000000001f748
RDX: 000000000001f767 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffffa0a929677bd8 R08: ffffffffffffffe5 R09: 0000000000000000
R10: ffffa0af3fbb9320 R11: 0000000000000000 R12: ffffffff89f9507d
R13: ffffa0a929677a50 R14: ffffa0af3ffbe230 R15: 0000000000000004
FS: 0000000000000000(0000) GS:ffffa0af3fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f38a9241260 CR3: 000000080132e000 CR4: 00000000000007f0
Call Trace:
[<ffffffff8a35d075>] __alloc_pages_slowpath+0x2dd/0x724
[<ffffffff89dc1145>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff89e0e0a8>] alloc_pages_current+0x98/0x110
[<ffffffffc066ff84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff89cb9d8f>] process_one_work+0x17f/0x440
[<ffffffff89cbae26>] worker_thread+0x126/0x3c0
[<ffffffff89cbad00>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff89cc1c71>] kthread+0xd1/0xe0
[<ffffffff89cc1ba0>] ? insert_kthread_work+0x40/0x40
[<ffffffff8a374c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff89cc1ba0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 80 7d 01 00 8b 55 b0 e8 6a 7d 01 00 48 8b 7d c0 57 9d <66> 66 90 66 90 8b 4d b4 85 c9 0f 8e f9 02 00 00 44 8b 4d 84 4d
Complete report #330164
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff8118c3d3
Build id: 3.10.0-693.el7.x86_64
|
0x433
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118caf6
Build id: 3.10.0-693.el7.x86_64
|
0x176
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1108
Build id: 3.10.0-693.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc058efd8
Build id: 3.10.0-693.el7.x86_64
|
0x3b8
|
|
5
|
process_one_work
|
vmlinux |
0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64
|
0x17a
|
|
6
|
worker_thread
|
vmlinux |
0xffffffff810a94e6
Build id: 3.10.0-693.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffff810a93c0
Build id: 3.10.0-693.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
|
0xcf
|
|
9
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork
|
vmlinux |
0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
|
0x58
|
|
11
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#17 stuck for 54s! [kworker/17:2:110345]
vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit crct10dif_pclmul ata_piix drm mptspi crct10dif_common crc32c_intel libnvdimm scsi_transport_spi libata mptscsih serio_raw mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 17 PID: 110345 Comm: kworker/17:2 Tainted: G OEL ------------ T 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff880586a7bf40 ti: ffff880069600000 task.ti: ffff880069600000
RIP: 0010:[<ffffffff8118c3d3>] [<ffffffff8118c3d3>] get_page_from_freelist+0x433/0x9e0
RSP: 0000:ffff880069603bc8 EFLAGS: 00000246
RAX: 000000000000002b RBX: 000000000000001e RCX: 000000000001a17d
RDX: 000000000001a237 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff880069603cc8 R08: ffffffffffffffc4 R09: 0000000000000000
R10: ffff88183fbcd000 R11: fffffffffffffff4 R12: ffff880069603b48
R13: ffff880069603bb8 R14: 00000002810ba588 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff8817dda40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000091d717c3010 CR3: 0000000821f31000 CR4: 00000000001407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000009 ffff88183ffd9008 0000000069603cc8 0000000000000002
ffff88183ffd8000 ffff8817dda5a1d8 ffff8817dda5a1e8 ffff88183ffd8068
0000000000000000 000000020000008f ffff88183ffd9000 0000000000000000
Call Trace:
[<ffffffff8118caf6>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff811d1108>] alloc_pages_current+0x98/0x110
[<ffffffffc058efd8>] vmballoon_work+0x3b8/0x615 [vmw_balloon]
[<ffffffff810a881a>] process_one_work+0x17a/0x440
[<ffffffff810a94e6>] worker_thread+0x126/0x3c0
[<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 e0 1b 01 00 8b 55 9c e8 63 6d 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #308564
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff831c7a07
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x2a7
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff831c8366
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x166
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffff83216c58
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc06e5f84
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x454
|
|
5
|
process_one_work
|
vmlinux |
0xffffffff830be34f
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x17f
|
|
6
|
worker_thread
|
vmlinux |
0xffffffff830bf466
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffff830bf340
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffff830c6321
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0xd1
|
|
9
|
|
vmlinux |
0xffffffff830c6250
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff8378dd37
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x21
|
|
11
|
|
vmlinux |
0xffffffff830c6250
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 26s! [kworker/6:1:8612]
Modules linked in: binfmt_misc cmac arc4 md4 nls_utf8 cifs ccm dns_resolver ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_comment xt_mark iptable_filter iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_netlink nfnetlink iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi overlay(T) vmw_vsock_vmci_transport falcon_lsm_serviceable(PE) vsock falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_12803(E) ext4 sb_edac mbcache iosf_mbi jbd2 crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper pcc_cpufreq cryptd ppdev vmw_balloon pcspkr joydev parport_pc parport vmw_vmci sg i2c_piix4 br_netfilter bridge stp llc nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nf_conntrack
auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif ata_generic crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi scsi_transport_spi nfit crct10dif_pclmul libata crct10dif_common crc32c_intel mptscsih libnvdimm serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 6 PID: 8612 Comm: kworker/6:1 Kdump: loaded Tainted: P E ------------ T 3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff88fdcc70a0e0 ti: ffff88f44b488000 task.ti: ffff88f44b488000
RIP: 0010:[<ffffffff831c7a07>] [<ffffffff831c7a07>] get_page_from_freelist+0x2a7/0xaa0
RSP: 0018:ffff88f44b48bbc8 EFLAGS: 00000246
RAX: 000000000000000b RBX: 000000000000001e RCX: 000000000001fd78
RDX: 000000000001fd67 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff88f44b48bcd0 R08: ffffffffffffff9f R09: 0000000000000000
R10: ffff89037ffd10e0 R11: fffffffffffffff4 R12: ffff88f44b48bb48
R13: ffff88f44b48bbb8 R14: 0000000000003477 R15: fffffffffffffff4
FS: 0000000000000000(0000) GS:ffff89033fb80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c422005000 CR3: 0000001ff7b54000 CR4: 00000000001607e0
Call Trace:
[<ffffffff831c8366>] __alloc_pages_nodemask+0x166/0x450
[<ffffffff83216c58>] alloc_pages_current+0x98/0x110
[<ffffffffc06e5f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff830be34f>] process_one_work+0x17f/0x440
[<ffffffff830bf466>] worker_thread+0x126/0x3c0
[<ffffffff830bf340>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff830c6321>] kthread+0xd1/0xe0
[<ffffffff830c6250>] ? insert_kthread_work+0x40/0x40
[<ffffffff8378dd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff830c6250>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 20 7e 01 00 8b 55 b0 e8 af 7f 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 75 b4 85 f6 0f 8e 59 03 00 00 44 8b 4d 84 49
Complete report #304073
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffffacfc6024
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x344
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffacfc68f6
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x176
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffffad014c68
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc038bf84
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x454
|
|
5
|
process_one_work
|
vmlinux |
0xffffffffacebd0ff
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x17f
|
|
6
|
worker_thread
|
vmlinux |
0xffffffffacebe216
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffffacebe0f0
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffffacec50d1
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0xd1
|
|
9
|
|
vmlinux |
0xffffffffacec5000
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffad58cd37
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x21
|
|
11
|
|
vmlinux |
0xffffffffacec5000
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 29s! [kworker/5:0:31332]
Modules linked in: ip6t_rpfilter ebtable_nat ip6table_nat nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ip_set nfnetlink ebtable_filter ebtables nfsv3 nfs_acl nfs lockd grace fscache vmw_vsock_vmci_transport vsock ip6t_REJECT nf_reject_ipv6 nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter sunrpc ppdev vmw_balloon sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul libata crct10dif_common crc32c_intel e1000 serio_raw vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ipmi_msghandler]
CPU: 5 PID: 31332 Comm: kworker/5:0 Tainted: G W L ------------ 3.10.0-1062.1.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff88b85635a0e0 ti: ffff88b830f7c000 task.ti: ffff88b830f7c000
RIP: 0010:[<ffffffffacfc6024>] [<ffffffffacfc6024>] get_page_from_freelist+0x344/0xaa0
RSP: 0018:ffff88b830f7fbc0 EFLAGS: 00000246
RAX: 000000000000001f RBX: ffff88b830f7fbb0 RCX: 000000000001fd50
RDX: 000000000001fd67 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff88b830f7fcc8 R08: ffffffffffffffc2 R09: 0000000000000000
R10: ffff88b87fbd5860 R11: fffffffffffffff8 R12: ffffffffad19f12d
R13: ffff88b830f7fb40 R14: 00000000aced55fe R15: ffffffffacee7444
FS: 0000000000000000(0000) GS:ffff88b87fd40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f6e4238a000 CR3: 00000009d73a4000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffacfc68f6>] __alloc_pages_nodemask+0x176/0x420
[<ffffffffad014c68>] alloc_pages_current+0x98/0x110
[<ffffffffc038bf84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffffacebd0ff>] process_one_work+0x17f/0x440
[<ffffffffacebe216>] worker_thread+0x126/0x3c0
[<ffffffffacebe0f0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffacec50d1>] kthread+0xd1/0xe0
[<ffffffffacec5000>] ? insert_kthread_work+0x40/0x40
[<ffffffffad58cd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffacec5000>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 c0 7d 01 00 8b 55 b0 e8 e2 7f 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 75 b4 85 f6 0f 8e 19 03 00 00 44 8b 4d 84 49
Complete report #290163
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffffaefa0d8c
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x34c
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffaefa1626
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x176
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffffaefec058
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0585f84
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x454
|
|
5
|
process_one_work
|
vmlinux |
0xffffffffaeeb613f
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x17f
|
|
6
|
worker_thread
|
vmlinux |
0xffffffffaeeb71d6
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffffaeeb70b0
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffffaeebdf21
Build id: 3.10.0-862.14.4.el7.x86_64
|
0xd1
|
|
9
|
|
vmlinux |
0xffffffffaeebde50
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffaf5255f7
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x21
|
|
11
|
|
vmlinux |
0xffffffffaeebde50
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [kworker/5:0:4641]
Modules linked in: binfmt_misc ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ext4 mbcache jbd2 sb_edac coretemp iosf_mbi ppdev crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul nfit glue_helper ablk_helper cryptd parport_pc sg joydev libnvdimm pcspkr vmw_balloon vmxnet3 parport i2c_piix4 vmw_vmci shpchp ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm crc32c_intel ata_piix serio_raw mptspi scsi_transport_spi libata mptscsih e1000 mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 4641 Comm: kworker/5:0 Kdump: loaded Tainted: G L ------------ 3.10.0-862.14.4.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff94ddfee08fd0 ti: ffff94db99a4c000 task.ti: ffff94db99a4c000
RIP: 0010:[<ffffffffaefa0d8c>] [<ffffffffaefa0d8c>] get_page_from_freelist+0x34c/0xa70
RSP: 0018:ffff94db99a4fbc0 EFLAGS: 00000246
RAX: 000000000000000b RBX: ffff94db99a4fbb0 RCX: 000000000001c030
RDX: 000000000001c0f7 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff94db99a4fcc8 R08: fffffffffffffffe R09: 0000000000000000
R10: ffff94de3fbd6f80 R11: 0000000000000000 R12: ffffffffaf16d0ad
R13: ffff94db99a4fb40 R14: ffffffffaeec7c4b R15: ffff94de3ffdb000
FS: 0000000000000000(0000) GS:ffff94de3fd40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd52c3b5f00 CR3: 00000003e1dd0000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffaefa1626>] __alloc_pages_nodemask+0x176/0x420
[<ffffffffaefec058>] alloc_pages_current+0x98/0x110
[<ffffffffc0585f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffffaeeb613f>] process_one_work+0x17f/0x440
[<ffffffffaeeb71d6>] worker_thread+0x126/0x3c0
[<ffffffffaeeb70b0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffffaeebdf21>] kthread+0xd1/0xe0
[<ffffffffaeebde50>] ? insert_kthread_work+0x40/0x40
[<ffffffffaf5255f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffaeebde50>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 c0 5c 01 00 8b 55 b0 e8 fa 74 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f9 02 00 00 44 8b 4d 84 4d
Complete report #252703
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
dump_stack
|
vmlinux |
0xffffffffbcf63107
Build id: 3.10.0-957.21.3.el7.x86_64
|
0x19
|
|
2
|
bad_page.part.76
|
vmlinux |
0xffffffffbcf5ddb3
Build id: 3.10.0-957.21.3.el7.x86_64
|
0xdc
|
|
3
|
get_page_from_freelist
|
vmlinux |
0xffffffffbc9c0d35
Build id: 3.10.0-957.21.3.el7.x86_64
|
0x755
|
|
4
|
|
vmlinux |
0xffffffffbcb75cd5
Build id: 3.10.0-957.21.3.el7.x86_64
|
0x35
|
|
5
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffbc9c11c6
Build id: 3.10.0-957.21.3.el7.x86_64
|
0x176
|
|
6
|
alloc_pages_current
|
vmlinux |
0xffffffffbca0e308
Build id: 3.10.0-957.21.3.el7.x86_64
|
0x98
|
|
7
|
vmballoon_work
|
vmw_balloon |
0xffffffffc06c8f84
Build id: 3.10.0-957.21.3.el7.x86_64
|
0x454
|
|
8
|
process_one_work
|
vmlinux |
0xffffffffbc8b9ebf
Build id: 3.10.0-957.21.3.el7.x86_64
|
0x17f
|
|
9
|
worker_thread
|
vmlinux |
0xffffffffbc8baf56
Build id: 3.10.0-957.21.3.el7.x86_64
|
0x126
|
|
10
|
|
vmlinux |
0xffffffffbc8bae30
Build id: 3.10.0-957.21.3.el7.x86_64
|
0x2a0
|
|
11
|
kthread
|
vmlinux |
0xffffffffbc8c1da1
Build id: 3.10.0-957.21.3.el7.x86_64
|
0xd1
|
|
12
|
|
vmlinux |
0xffffffffbc8c1cd0
Build id: 3.10.0-957.21.3.el7.x86_64
|
0x40
|
|
13
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffbcf75c1d
Build id: 3.10.0-957.21.3.el7.x86_64
|
0x7
|
|
14
|
|
vmlinux |
0xffffffffbc8c1cd0
Build id: 3.10.0-957.21.3.el7.x86_64
|
0x40
|
BUG: Bad page state in process kworker/2:1 pfn:ada30
page:ffffedcfc2b68c00 count:-1 mapcount:0 mapping: (null) index:0x0
page flags: 0x1fffff00000000()
page dumped because: nonzero _count
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev vmw_balloon edac_mce_amd joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi serio_raw e1000 libata scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 29702 Comm: kworker/2:1 Kdump: loaded Not tainted 3.10.0-957.21.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/22/2009
Workqueue: events_freezable vmballoon_work [vmw_balloon]
Call Trace:
[<ffffffffbcf63107>] dump_stack+0x19/0x1b
[<ffffffffbcf5ddb3>] bad_page.part.76+0xdc/0xf9
[<ffffffffbc9c0d35>] get_page_from_freelist+0x755/0xa70
[<ffffffffbcb75cd5>] ? cpumask_next_and+0x35/0x50
[<ffffffffbc9c11c6>] __alloc_pages_nodemask+0x176/0x420
[<ffffffffbca0e308>] alloc_pages_current+0x98/0x110
[<ffffffffc06c8f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffffbc8b9ebf>] process_one_work+0x17f/0x440
[<ffffffffbc8baf56>] worker_thread+0x126/0x3c0
[<ffffffffbc8bae30>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffffbc8c1da1>] kthread+0xd1/0xe0
[<ffffffffbc8c1cd0>] ? insert_kthread_work+0x40/0x40
[<ffffffffbcf75c1d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffbc8c1cd0>] ? insert_kthread_work+0x40/0x40
Complete report #246482
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff8118c3d3
Build id: 3.10.0-693.el7.x86_64
|
0x433
|
|
2
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff8169f991
Build id: 3.10.0-693.el7.x86_64
|
0x2dd
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118cd85
Build id: 3.10.0-693.el7.x86_64
|
0x405
|
|
4
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1108
Build id: 3.10.0-693.el7.x86_64
|
0x98
|
|
5
|
vmballoon_work
|
vmw_balloon |
0xffffffffc042afd8
Build id: 3.10.0-693.el7.x86_64
|
0x3b8
|
|
6
|
process_one_work
|
vmlinux |
0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64
|
0x17a
|
|
7
|
worker_thread
|
vmlinux |
0xffffffff810a94e6
Build id: 3.10.0-693.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffff810a93c0
Build id: 3.10.0-693.el7.x86_64
|
0x2a0
|
|
9
|
kthread
|
vmlinux |
0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
|
0xcf
|
|
10
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork
|
vmlinux |
0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
|
0x58
|
|
12
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [kworker/0:1:26315]
Modules linked in: binfmt_misc vfat fat isofs ext4 mbcache jbd2 vxlan ip6_udp_tunnel udp_tunnel iptable_mangle xt_mark veth xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) vboxpci(OE) vboxnetadp(OE) vboxnetflt(OE) vboxdrv(OE) vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr nfit ppdev joydev vmw_balloon sg libnvdimm shpchp parport_pc parport vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod
vmwgfx crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw vmxnet3 i2c_core vmw_pvscsi floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 26315 Comm: kworker/0:1 Tainted: G OEL ------------ T 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff88081d27bf40 ti: ffff8804f9ee8000 task.ti: ffff8804f9ee8000
RIP: 0010:[<ffffffff8118c3d3>] [<ffffffff8118c3d3>] get_page_from_freelist+0x433/0x9e0
RSP: 0018:ffff8804f9eebad8 EFLAGS: 00000246
RAX: 000000000000001e RBX: ffff88103ffa3000 RCX: 000000000001a248
RDX: 000000000001a2a0 RSI: 0000000000000020 RDI: 0000000000000246
RBP: ffff8804f9eebbd8 R08: fffffffffffffff9 R09: 0000000000000000
R10: ffff88103fb9e580 R11: 0000000000000001 R12: ffff8804f9eeba58
R13: ffff88103ffa3230 R14: 0000000000000004 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff88081fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 000000c4217ee000 CR3: 00000000019f2000 CR4: 00000000000407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 ffff88083ffdb008 00000001f9eebc90 0000000000000002
0000000000000000 ffff88081fc1a240 ffff88081fc1a250 ffff88103ffa3068
ffff88081d27c7f0 00000002000000a0 ffff88083ffdb000 0000000000000000
Call Trace:
[<ffffffff8169f991>] __alloc_pages_slowpath+0x2dd/0x724
[<ffffffff8118cd85>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff811d1108>] alloc_pages_current+0x98/0x110
[<ffffffffc042afd8>] vmballoon_work+0x3b8/0x615 [vmw_balloon]
[<ffffffff810a881a>] process_one_work+0x17a/0x440
[<ffffffff810a94e6>] worker_thread+0x126/0x3c0
[<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 e0 1b 01 00 8b 55 9c e8 63 6d 01 00 48 8b 7d c0 57 9d <66> 66 90 66 90 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #172588
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff83da0e43
Build id: 3.10.0-862.11.6.el7.x86_64
|
0x433
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff83da1566
Build id: 3.10.0-862.11.6.el7.x86_64
|
0x176
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffff83debf98
Build id: 3.10.0-862.11.6.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc05dcf84
Build id: 3.10.0-862.11.6.el7.x86_64
|
0x454
|
|
5
|
process_one_work
|
vmlinux |
0xffffffff83cb613f
Build id: 3.10.0-862.11.6.el7.x86_64
|
0x17f
|
|
6
|
worker_thread
|
vmlinux |
0xffffffff83cb71d6
Build id: 3.10.0-862.11.6.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffff83cb70b0
Build id: 3.10.0-862.11.6.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffff83cbdf21
Build id: 3.10.0-862.11.6.el7.x86_64
|
0xd1
|
|
9
|
|
vmlinux |
0xffffffff83cbde50
Build id: 3.10.0-862.11.6.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff843255e4
Build id: 3.10.0-862.11.6.el7.x86_64
|
0xe
|
|
11
|
|
vmlinux |
0xffffffff83cbde50
Build id: 3.10.0-862.11.6.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#12 stuck for 21s! [ps:10913]
NMI watchdog: BUG: soft lockup - CPU#15 stuck for 21s! [kworker/15:0:9803]
Modules linked in: tun vsock_diag udp_diag unix_diag binfmt_misc tcp_diag inet_diag iptable_filter ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_nat xt_REDIRECT nf_nat_redirect iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack vmw_vsock_vmci_transport vsock edac_mce_amd ppdev crc32_pclmul ghash_clmulni_intel aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport shpchp vmw_vmci i2c_piix4 auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi crct10dif_pclmul scsi_transport_spi crct10dif_common libata mptscsih crc32c_intel serio_raw mptbase vmxnet3 i2c_core dm_mirror
dm_region_hash dm_log dm_mod
CPU: 15 PID: 9803 Comm: kworker/15:0 Kdump: loaded Tainted: G W L ------------ 3.10.0-862.11.6.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9a58a3a51fa0 ti: ffff9a55b8af0000 task.ti: ffff9a55b8af0000
RIP: 0010:[<ffffffff83da0e43>] [<ffffffff83da0e43>] get_page_from_freelist+0x433/0x9e0
RSP: 0018:ffff9a55b8af3bc8 EFLAGS: 00000246
RAX: 0000000000000029 RBX: 000000000000001e RCX: 000000000001c15a
RDX: 000000000001c160 RSI: 0000000000000020 RDI: 0000000000000246
RBP: ffff9a55b8af3cc8 R08: ffffffffffffffc5 R09: 0000000000000000
R10: ffff9a49fffd5600 R11: 0000000000000000 R12: ffff9a55b8af3b48
R13: ffff9a49fffda230 R14: 0000000000000004 R15: 0000000000000000
FS: 00007f1d4d693700(0000) GS:ffff9a58a3d80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 000055b373da52e0 CR3: 0000001da3a80000 CR4: 00000000000407e0
Call Trace:
[<ffffffff83da1566>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff83debf98>] alloc_pages_current+0x98/0x110
[<ffffffffc05dcf84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff83cb613f>] process_one_work+0x17f/0x440
[<ffffffff83cb71d6>] worker_thread+0x126/0x3c0
[<ffffffff83cb70b0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff83cbdf21>] kthread+0xd1/0xe0
[<ffffffff83cbde50>] ? insert_kthread_work+0x40/0x40
[<ffffffff843255e4>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffff83cbde50>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 c0 5c 01 00 8b 55 9c e8 83 73 01 00 48 8b 7d c0 57 9d <66> 66 90 66 90 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #162595
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff8118c3d3
Build id: 3.10.0-693.el7.x86_64
|
0x433
|
|
2
|
|
vmlinux |
0xffffffff8119878c
Build id: 3.10.0-693.el7.x86_64
|
0xfc
|
|
3
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff8169f991
Build id: 3.10.0-693.el7.x86_64
|
0x2dd
|
|
4
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118cd85
Build id: 3.10.0-693.el7.x86_64
|
0x405
|
|
5
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1108
Build id: 3.10.0-693.el7.x86_64
|
0x98
|
|
6
|
vmballoon_work
|
vmw_balloon |
0xffffffffc04f7fd8
Build id: 3.10.0-693.el7.x86_64
|
0x3b8
|
|
7
|
process_one_work
|
vmlinux |
0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64
|
0x17a
|
|
8
|
worker_thread
|
vmlinux |
0xffffffff810a94e6
Build id: 3.10.0-693.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffff810a93c0
Build id: 3.10.0-693.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
|
0xcf
|
|
11
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork
|
vmlinux |
0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
|
0x58
|
|
13
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/0:2:31896]
Modules linked in: ip_vs_rr xt_ipvs ip_vs xt_nat veth vxlan ip6_udp_tunnel udp_tunnel iptable_mangle xt_mark xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache overlay(T) vmw_vsock_vmci_transport vsock vmw_balloon ppdev joydev pcspkr sg i2c_piix4 nfit shpchp vmw_vmci libnvdimm parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic 8021q garp vmwgfx crct10dif_pclmul crct10dif_common stp crc32_pclmul crc32c_intel llc mrp ghash_clmulni_intel drm_kms_helper aesni_intel syscopyarea sysfillrect
lrw sysimgblt gf128mul fb_sys_fops glue_helper ablk_helper ttm cryptd serio_raw drm ahci scsi_transport_iscsi vmxnet3 libahci ata_piix libata i2c_core vmw_pvscsi sunrpc dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 31896 Comm: kworker/0:2 Tainted: G L ------------ T 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff880bc3e4cf10 ti: ffff880ba7118000 task.ti: ffff880ba7118000
RIP: 0010:[<ffffffff8118c3d3>] [<ffffffff8118c3d3>] get_page_from_freelist+0x433/0x9e0
RSP: 0000:ffff880ba711bad8 EFLAGS: 00000246
RAX: 00000000000000ff RBX: ffff880c3ffb2890 RCX: 000000000001a12b
RDX: 000000000001a1cf RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff880ba711bbd8 R08: ffffffffffffffd9 R09: 0000000000000000
R10: ffff880c3fbab040 R11: 0000000000000000 R12: 0000000000000001
R13: 0000000000000352 R14: ffffffff8119548f R15: ffff880ba711bac8
FS: 0000000000000000(0000) GS:ffff880c3fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 000000c0001b6010 CR3: 0000000c013cb000 CR4: 00000000000007f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 ffff880c3ffb4008 00000000a711bc90 0000000000000002
0000000000000000 ffff880c3fc1a170 ffff880c3fc1a180 ffff880c3ffb2868
0000000000000000 000000020000000a ffff880c3ffb4000 0000000000000000
Call Trace:
[<ffffffff8119878c>] ? try_to_free_pages+0xfc/0x180
[<ffffffff8169f991>] __alloc_pages_slowpath+0x2dd/0x724
[<ffffffff8118cd85>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff811d1108>] alloc_pages_current+0x98/0x110
[<ffffffffc04f7fd8>] vmballoon_work+0x3b8/0x615 [vmw_balloon]
[<ffffffff810a881a>] process_one_work+0x17a/0x440
[<ffffffff810a94e6>] worker_thread+0x126/0x3c0
[<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 e0 1b 01 00 8b 55 9c e8 63 6d 01 00 48 8b 7d c0 57 9d <66> 66 90 66 90 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #98894
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff8118c3d3
Build id: 3.10.0-693.el7.x86_64
|
0x433
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118caf6
Build id: 3.10.0-693.el7.x86_64
|
0x176
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1108
Build id: 3.10.0-693.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0509fd8
Build id: 3.10.0-693.el7.x86_64
|
0x3b8
|
|
5
|
process_one_work
|
vmlinux |
0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64
|
0x17a
|
|
6
|
worker_thread
|
vmlinux |
0xffffffff810a94e6
Build id: 3.10.0-693.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffff810a93c0
Build id: 3.10.0-693.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
|
0xcf
|
|
9
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork
|
vmlinux |
0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
|
0x58
|
|
11
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 38s! [kworker/5:0:16825]
Modules linked in: ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_addrtype xt_conntrack iptable_filter nf_conntrack_netlink cfg80211 rfkill ip_vs_rr xt_ipvs ip_vs xt_nat veth vxlan ip6_udp_tunnel udp_tunnel xt_mark br_netfilter nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache overlay(T) ip_set nfnetlink bridge iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle vmw_vsock_vmci_transport vsock ppdev vmw_balloon joydev pcspkr nfit libnvdimm sg i2c_piix4 vmw_vmci shpchp parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32_pclmul crc32c_intel ghash_clmulni_intel vmwgfx drm_kms_helper aesni_intel lrw gf128mul glue_helper
ahci 8021q ablk_helper cryptd garp libahci stp syscopyarea serio_raw sysfillrect sysimgblt llc fb_sys_fops ttm mrp ata_piix drm vmxnet3 vmw_pvscsi libata i2c_core scsi_transport_iscsi sunrpc dm_mirror dm_region_hash dm_log dm_mod [last unloaded: iptable_filter]
CPU: 5 PID: 16825 Comm: kworker/5:0 Tainted: G ------------ T 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff88024537cf10 ti: ffff880bfa7b4000 task.ti: ffff880bfa7b4000
RIP: 0010:[<ffffffff8118c3d3>] [<ffffffff8118c3d3>] get_page_from_freelist+0x433/0x9e0
RSP: 0018:ffff880bfa7b7bc8 EFLAGS: 00000246
RAX: 0000000000000008 RBX: ffff880c3ffb3090 RCX: 000000000001a13c
RDX: 000000000001a237 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff880bfa7b7cc8 R08: ffffffffffffffda R09: 0000000000000000
R10: ffff880c3fbad880 R11: fffffffffffffffa R12: 0000000000000001
R13: ffff880c3ffb3368 R14: 0000000000000007 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff880c3fd40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 000000c000737000 CR3: 00000000019f2000 CR4: 00000000000007e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000009 ffff880c3ffb4008 00000000fa7b7cc8 0000000000000002
ffff880c3ffb3000 ffff880c3fd5a1d8 ffff880c3fd5a1e8 ffff880c3ffb3068
0000000000000000 0000000200000002 ffff880c3ffb4000 0000000000000000
Call Trace:
[<ffffffff8118caf6>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff811d1108>] alloc_pages_current+0x98/0x110
[<ffffffffc0509fd8>] vmballoon_work+0x3b8/0x615 [vmw_balloon]
[<ffffffff810a881a>] process_one_work+0x17a/0x440
[<ffffffff810a94e6>] worker_thread+0x126/0x3c0
[<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 e0 1b 01 00 8b 55 9c e8 63 6d 01 00 48 8b 7d c0 57 9d <66> 66 90 66 90 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #89977
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffffa0fc85c7
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x2a7
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffa0fc8f26
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x166
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffffa1018ea8
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0479f84
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x454
|
|
5
|
process_one_work
|
vmlinux |
0xffffffffa0ebe6bf
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x17f
|
|
6
|
worker_thread
|
vmlinux |
0xffffffffa0ebf7d6
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffffa0ebf6b0
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffffa0ec6691
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xd1
|
|
9
|
|
vmlinux |
0xffffffffa0ec65c0
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffa1592d37
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x21
|
|
11
|
|
vmlinux |
0xffffffffa0ec65c0
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 94s! [kworker/2:2:23644]
Modules linked in: fuse traps(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod sb_edac coretemp ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev sg pcspkr parport_pc parport i2c_piix4 vmw_vmci binfmt_misc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi scsi_transport_spi mptscsih
crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy [last unloaded: traps]
CPU: 2 PID: 23644 Comm: kworker/2:2 Kdump: loaded Tainted: G OEL ------------ 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff968f323f20e0 ti: ffff968dc3c88000 task.ti: ffff968dc3c88000
RIP: 0010:[<ffffffffa0fc85c7>] [<ffffffffa0fc85c7>] get_page_from_freelist+0x2a7/0xaa0
RSP: 0018:ffff968dc3c8bbc8 EFLAGS: 00000246
RAX: 000000000000000f RBX: 000000000000001e RCX: 000000000001fd50
RDX: 000000000001fd67 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff968dc3c8bcd0 R08: fffffffffffffffa R09: 0000000000000000
R10: ffff96917fbd1e80 R11: fffffffffffffff8 R12: ffff968dc3c8bb48
R13: ffff968dc3c8bcd0 R14: ffff96882eedcc18 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff96917fc80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ffd110189a9 CR3: 000000055237c000 CR4: 00000000001607e0
Call Trace:
[<ffffffffa0fc8f26>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffa1018ea8>] alloc_pages_current+0x98/0x110
[<ffffffffc0479f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffffa0ebe6bf>] process_one_work+0x17f/0x440
[<ffffffffa0ebf7d6>] worker_thread+0x126/0x3c0
[<ffffffffa0ebf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffa0ec6691>] kthread+0xd1/0xe0
[<ffffffffa0ec65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffa1592d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa0ec65c0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 60 7e 01 00 8b 55 b0 e8 7f 7f 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 75 b4 85 f6 0f 8e 59 03 00 00 44 8b 4d 84 49
Complete report #61449
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
dump_stack
|
vmlinux |
0xffffffff9d313754
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x19
|
|
2
|
bad_page.part.76
|
vmlinux |
0xffffffff9d30eba8
Build id: 3.10.0-862.14.4.el7.x86_64
|
0xdc
|
|
3
|
get_page_from_freelist
|
vmlinux |
0xffffffff9cda1195
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x755
|
|
4
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff9cda1626
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x176
|
|
5
|
alloc_pages_current
|
vmlinux |
0xffffffff9cdec058
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x98
|
|
6
|
vmballoon_work
|
vmw_balloon |
0xffffffffc04ebf84
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x454
|
|
7
|
process_one_work
|
vmlinux |
0xffffffff9ccb613f
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x17f
|
|
8
|
worker_thread
|
vmlinux |
0xffffffff9ccb71d6
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffff9ccb70b0
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffff9ccbdf21
Build id: 3.10.0-862.14.4.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffff9ccbde50
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff9d3255f7
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x21
|
|
13
|
|
vmlinux |
0xffffffff9ccbde50
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x40
|
BUG: Bad page state in process kworker/0:2 pfn:4a57f
page:fffff4ab01295fc0 count:-1 mapcount:0 mapping: (null) index:0x0
page flags: 0x1fffff00000000()
page dumped because: nonzero _count
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev coretemp vmw_balloon sg pcspkr joydev parport_pc parport vmw_vmci shpchp i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm drm serio_raw ata_piix mptspi scsi_transport_spi e1000 libata mptscsih mptbase i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 9767 Comm: kworker/0:2 Kdump: loaded Not tainted 3.10.0-862.14.4.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/22/2009
Workqueue: events_freezable vmballoon_work [vmw_balloon]
Call Trace:
[<ffffffff9d313754>] dump_stack+0x19/0x1b
[<ffffffff9d30eba8>] bad_page.part.76+0xdc/0xf9
[<ffffffff9cda1195>] get_page_from_freelist+0x755/0xa70
[<ffffffff9cda1626>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff9cdec058>] alloc_pages_current+0x98/0x110
[<ffffffffc04ebf84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff9ccb613f>] process_one_work+0x17f/0x440
[<ffffffff9ccb71d6>] worker_thread+0x126/0x3c0
[<ffffffff9ccb70b0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff9ccbdf21>] kthread+0xd1/0xe0
[<ffffffff9ccbde50>] ? insert_kthread_work+0x40/0x40
[<ffffffff9d3255f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9ccbde50>] ? insert_kthread_work+0x40/0x40
Complete report #27109
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff845c05dc
Build id: 3.10.0-957.1.3.el7.x86_64
|
0x34c
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff845c0e76
Build id: 3.10.0-957.1.3.el7.x86_64
|
0x176
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffff8460df68
Build id: 3.10.0-957.1.3.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0587f84
Build id: 3.10.0-957.1.3.el7.x86_64
|
0x454
|
|
5
|
process_one_work
|
vmlinux |
0xffffffff844b9d4f
Build id: 3.10.0-957.1.3.el7.x86_64
|
0x17f
|
|
6
|
worker_thread
|
vmlinux |
0xffffffff844bade6
Build id: 3.10.0-957.1.3.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffff844bacc0
Build id: 3.10.0-957.1.3.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffff844c1c31
Build id: 3.10.0-957.1.3.el7.x86_64
|
0xd1
|
|
9
|
|
vmlinux |
0xffffffff844c1b60
Build id: 3.10.0-957.1.3.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff84b74c37
Build id: 3.10.0-957.1.3.el7.x86_64
|
0x21
|
|
11
|
|
vmlinux |
0xffffffff844c1b60
Build id: 3.10.0-957.1.3.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 26s! [kworker/6:0:120470]
Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables gsch(OE) redirfs(OE) tcp_lp fuse dsa_filter(POE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip_set nfnetlink bridge stp llc vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 ppdev sb_edac vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport
i2c_piix4 vmw_vmci xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw floppy vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi libata scsi_transport_spi vmxnet3 drm_panel_orientation_quirks mptscsih mptbase dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
CPU: 6 PID: 120470 Comm: kworker/6:0 Kdump: loaded Tainted: P OEL ------------ 3.10.0-957.1.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9b22ca7b9040 ti: ffff9b222cfc8000 task.ti: ffff9b222cfc8000
RIP: 0010:[<ffffffff845c05dc>] [<ffffffff845c05dc>] get_page_from_freelist+0x34c/0xa70
RSP: 0000:ffff9b222cfcbbc0 EFLAGS: 00000246
RAX: 00000000000000f8 RBX: ffff9b222cfcbbb0 RCX: 000000000001f748
RDX: 000000000001f767 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff9b222cfcbcc8 R08: ffffffffffffffd3 R09: 0000000000000000
R10: ffff9b22ffbd5c00 R11: 0000000000000001 R12: ffffffff84794d0d
R13: ffff9b222cfcbb40 R14: 000000002cfcbb40 R15: ffffffff844e3ce4
FS: 0000000000000000(0000) GS:ffff9b22dd780000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007efdbebb8000 CR3: 00000003b0c10000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff845c0e76>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff8460df68>] alloc_pages_current+0x98/0x110
[<ffffffffc0587f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff844b9d4f>] process_one_work+0x17f/0x440
[<ffffffff844bade6>] worker_thread+0x126/0x3c0
[<ffffffff844bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff844c1c31>] kthread+0xd1/0xe0
[<ffffffff844c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffff84b74c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff844c1b60>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 80 7d 01 00 8b 55 b0 e8 6a 7c 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f9 02 00 00 44 8b 4d 84 4d
Complete report #23121
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff8118c3d3
Build id: 3.10.0-693.el7.x86_64
|
0x433
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118caf6
Build id: 3.10.0-693.el7.x86_64
|
0x176
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1108
Build id: 3.10.0-693.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc04a1fd8
Build id: 3.10.0-693.el7.x86_64
|
0x3b8
|
|
5
|
process_one_work
|
vmlinux |
0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64
|
0x17a
|
|
6
|
worker_thread
|
vmlinux |
0xffffffff810a94e6
Build id: 3.10.0-693.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffff810a93c0
Build id: 3.10.0-693.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
|
0xcf
|
|
9
|
|
vmlinux |
0xffffffff8108ddeb
Build id: 3.10.0-693.el7.x86_64
|
0x6bb
|
|
10
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork
|
vmlinux |
0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
|
0x58
|
|
12
|
|
vmlinux |
0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#20 stuck for 22s! [kworker/20:0:23496]
Modules linked in: tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_REJECT nf_reject_ipv4 tun xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink ebtable_filter ebtables xt_addrtype ip6table_filter ip6_tables devlink iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc mvfs(OE) nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache overlay(T) vmw_vsock_vmci_transport vsock ppdev sb_edac vmw_balloon edac_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_vmci sg joydev pcspkr shpchp parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx
drm_kms_helper mptspi nfit syscopyarea scsi_transport_spi sysfillrect sysimgblt ata_piix fb_sys_fops ttm crct10dif_pclmul libnvdimm crct10dif_common libata mptscsih crc32c_intel drm mptbase serio_raw vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 20 PID: 23496 Comm: kworker/20:0 Tainted: G OE ------------ T 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff881655ac4f10 ti: ffff88046f3f4000 task.ti: ffff88046f3f4000
RIP: 0010:[<ffffffff8118c3d3>] [<ffffffff8118c3d3>] get_page_from_freelist+0x433/0x9e0
RSP: 0018:ffff88046f3f7bc8 EFLAGS: 00000246
RAX: 00000000000000e8 RBX: ffff88183ffd8090 RCX: 000000000001a16e
RDX: 000000000001a237 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff88046f3f7cc8 R08: fffffffffffffffe R09: 0000000000000000
R10: ffff88183fbcef80 R11: fffffffffffffff6 R12: 0000000000000001
R13: ffff88183ffd7bd0 R14: 0000000000000008 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff8817ddb00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7b82fb4a18 CR3: 000000176b6bc000 CR4: 00000000001407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000009 ffff88183ffd9008 000000006f3f7cc8 0000000000000002
ffff88183ffd8000 ffff8817ddb1a1d8 ffff8817ddb1a1e8 ffff88183ffd8068
0000000000000000 0000000200000085 ffff88183ffd9000 0000000000000000
Call Trace:
[<ffffffff8118caf6>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff811d1108>] alloc_pages_current+0x98/0x110
[<ffffffffc04a1fd8>] vmballoon_work+0x3b8/0x615 [vmw_balloon]
[<ffffffff810a881a>] process_one_work+0x17a/0x440
[<ffffffff810a94e6>] worker_thread+0x126/0x3c0
[<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff8108ddeb>] ? do_exit+0x6bb/0xa40
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 e0 1b 01 00 8b 55 9c e8 63 6d 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f8 02 00 00 44 8b 4d b0 4d
Complete report #22173
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
dump_stack
|
vmlinux |
0xffffffff99561dc1
Build id: 3.10.0-957.el7.x86_64
|
0x19
|
|
2
|
bad_page.part.76
|
vmlinux |
0xffffffff9955ca73
Build id: 3.10.0-957.el7.x86_64
|
0xdc
|
|
3
|
get_page_from_freelist
|
vmlinux |
0xffffffff98fc0775
Build id: 3.10.0-957.el7.x86_64
|
0x755
|
|
4
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff98fc0c06
Build id: 3.10.0-957.el7.x86_64
|
0x176
|
|
5
|
alloc_pages_current
|
vmlinux |
0xffffffff9900dcf8
Build id: 3.10.0-957.el7.x86_64
|
0x98
|
|
6
|
vmballoon_work
|
vmw_balloon |
0xffffffffc06b7f84
Build id: 3.10.0-957.el7.x86_64
|
0x454
|
|
7
|
process_one_work
|
vmlinux |
0xffffffff98eb9d4f
Build id: 3.10.0-957.el7.x86_64
|
0x17f
|
|
8
|
worker_thread
|
vmlinux |
0xffffffff98ebade6
Build id: 3.10.0-957.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffff98ebacc0
Build id: 3.10.0-957.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffff98ec1c31
Build id: 3.10.0-957.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffff98ec1b60
Build id: 3.10.0-957.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff99574c37
Build id: 3.10.0-957.el7.x86_64
|
0x21
|
|
13
|
|
vmlinux |
0xffffffff98ec1b60
Build id: 3.10.0-957.el7.x86_64
|
0x40
|
BUG: Bad page state in process kworker/0:0 pfn:7919f
page:ffffdab381e467c0 count:-1 mapcount:0 mapping: (null) index:0x0
page flags: 0x1fffff00000000()
page dumped because: nonzero _count
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev coretemp vmw_balloon joydev pcspkr sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic crct10dif_common sr_mod cdrom serio_raw vmxnet3 vmw_pvscsi vmwgfx floppy ata_generic pata_acpi drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 21986 Comm: kworker/0:0 Kdump: loaded Not tainted 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/22/2009
Workqueue: events_freezable vmballoon_work [vmw_balloon]
Call Trace:
[<ffffffff99561dc1>] dump_stack+0x19/0x1b
[<ffffffff9955ca73>] bad_page.part.76+0xdc/0xf9
[<ffffffff98fc0775>] get_page_from_freelist+0x755/0xa70
[<ffffffff98fc0c06>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff9900dcf8>] alloc_pages_current+0x98/0x110
[<ffffffffc06b7f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff98eb9d4f>] process_one_work+0x17f/0x440
[<ffffffff98ebade6>] worker_thread+0x126/0x3c0
[<ffffffff98ebacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff98ec1c31>] kthread+0xd1/0xe0
[<ffffffff98ec1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffff99574c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff98ec1b60>] ? insert_kthread_work+0x40/0x40
Complete report #19751
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff957c092c
Build id: 3.10.0-957.21.2.el7.x86_64
|
0x34c
|
|
2
|
|
vmlinux |
0xffffffff956d3289
Build id: 3.10.0-957.21.2.el7.x86_64
|
0x19
|
|
3
|
|
vmlinux |
0xffffffff956d33bf
Build id: 3.10.0-957.21.2.el7.x86_64
|
0x6f
|
|
4
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff957c11c6
Build id: 3.10.0-957.21.2.el7.x86_64
|
0x176
|
|
5
|
alloc_pages_current
|
vmlinux |
0xffffffff9580e308
Build id: 3.10.0-957.21.2.el7.x86_64
|
0x98
|
|
6
|
vmballoon_work
|
vmw_balloon |
0xffffffffc057ff84
Build id: 3.10.0-957.21.2.el7.x86_64
|
0x454
|
|
7
|
process_one_work
|
vmlinux |
0xffffffff956b9ebf
Build id: 3.10.0-957.21.2.el7.x86_64
|
0x17f
|
|
8
|
worker_thread
|
vmlinux |
0xffffffff956baf56
Build id: 3.10.0-957.21.2.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffff956bae30
Build id: 3.10.0-957.21.2.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffff956c1da1
Build id: 3.10.0-957.21.2.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffff956c1cd0
Build id: 3.10.0-957.21.2.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff95d75c37
Build id: 3.10.0-957.21.2.el7.x86_64
|
0x21
|
|
13
|
|
vmlinux |
0xffffffff956c1cd0
Build id: 3.10.0-957.21.2.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [kworker/3:0:7279]
Modules linked in: tcp_lp nls_utf8 isofs fuse binfmt_misc xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nf_nat_ftp nf_conntrack_ftp ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev vmw_balloon ext4 sb_edac coretemp iosf_mbi crc32_pclmul mbcache jbd2 ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg vmw_vmci i2c_piix4
parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel ata_generic pata_acpi serio_raw vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata mptspi scsi_transport_spi pcnet32 mii mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 7279 Comm: kworker/3:0 Kdump: loaded Tainted: G L ------------ 3.10.0-957.21.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff96ec8be4e180 ti: ffff96eec4b74000 task.ti: ffff96eec4b74000
RIP: 0010:[<ffffffff957c092c>] [<ffffffff957c092c>] get_page_from_freelist+0x34c/0xa70
RSP: 0018:ffff96eec4b77bc0 EFLAGS: 00000246
RAX: 00000000000000f9 RBX: ffff96eec4b77bb0 RCX: 000000000001f736
RDX: 000000000001f767 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff96eec4b77cc8 R08: ffffffffffffffe1 R09: 0000000000000000
R10: ffff96f2bfbb9100 R11: fffffffffffffffa R12: ffffffff9599531d
R13: ffff96eec4b77b40 R14: 0000000000000082 R15: 0000000000000082
FS: 0000000000000000(0000) GS:ffff96f29d6c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff520094000 CR3: 00000006df2d8000 CR4: 00000000000607e0
Call Trace:
[<ffffffff956d3289>] ? ttwu_do_wakeup+0x19/0xe0
[<ffffffff956d33bf>] ? ttwu_do_activate+0x6f/0x80
[<ffffffff957c11c6>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff9580e308>] alloc_pages_current+0x98/0x110
[<ffffffffc057ff84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff956b9ebf>] process_one_work+0x17f/0x440
[<ffffffff956baf56>] worker_thread+0x126/0x3c0
[<ffffffff956bae30>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff956c1da1>] kthread+0xd1/0xe0
[<ffffffff956c1cd0>] ? insert_kthread_work+0x40/0x40
[<ffffffff95d75c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff956c1cd0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 80 7d 01 00 8b 55 b0 e8 fa 7c 01 00 48 8b 7d c0 57 9d <66> 66 90 66 90 8b 4d b4 85 c9 0f 8e f9 02 00 00 44 8b 4d 84 4d
Complete report #13905
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
dump_stack
|
vmlinux |
0xffffffff9197ff85
Build id: 3.10.0-1127.el7.x86_64
|
0x19
|
|
2
|
bad_page.part.75
|
vmlinux |
0xffffffff9197ab40
Build id: 3.10.0-1127.el7.x86_64
|
0xdc
|
|
3
|
get_page_from_freelist
|
vmlinux |
0xffffffff913c89f5
Build id: 3.10.0-1127.el7.x86_64
|
0x785
|
|
4
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff913c8e76
Build id: 3.10.0-1127.el7.x86_64
|
0x166
|
|
5
|
alloc_pages_current
|
vmlinux |
0xffffffff91418e18
Build id: 3.10.0-1127.el7.x86_64
|
0x98
|
|
6
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0592f84
Build id: 3.10.0-1127.el7.x86_64
|
0x454
|
|
7
|
process_one_work
|
vmlinux |
0xffffffff912be6bf
Build id: 3.10.0-1127.el7.x86_64
|
0x17f
|
|
8
|
worker_thread
|
vmlinux |
0xffffffff912bf7d6
Build id: 3.10.0-1127.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffff912bf6b0
Build id: 3.10.0-1127.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffff912c6691
Build id: 3.10.0-1127.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffff912c65c0
Build id: 3.10.0-1127.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff91992d37
Build id: 3.10.0-1127.el7.x86_64
|
0x21
|
|
13
|
|
vmlinux |
0xffffffff912c65c0
Build id: 3.10.0-1127.el7.x86_64
|
0x40
|
BUG: Bad page state in process kworker/3:1 pfn:0a3ba
page:fffff4818028ee80 count:-1 mapcount:0 mapping: (null) index:0x0
page flags: 0x1fffff00000000()
page dumped because: nonzero _count
Modules linked in: vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod ppdev vmw_balloon coretemp joydev sg pcspkr parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif crct10dif_generic cdrom crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi scsi_transport_spi mptscsih e1000 libata mptbase crc32c_intel serio_raw drm_panel_orientation_quirks floppy
CPU: 3 PID: 29775 Comm: kworker/3:1 Tainted: G L ------------ 3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 06/22/2012
Workqueue: events_freezable vmballoon_work [vmw_balloon]
Call Trace:
[<ffffffff9197ff85>] dump_stack+0x19/0x1b
[<ffffffff9197ab40>] bad_page.part.75+0xdc/0xf9
[<ffffffff913c89f5>] get_page_from_freelist+0x785/0xaa0
[<ffffffff913c8e76>] __alloc_pages_nodemask+0x166/0x450
[<ffffffff91418e18>] alloc_pages_current+0x98/0x110
[<ffffffffc0592f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff912be6bf>] process_one_work+0x17f/0x440
[<ffffffff912bf7d6>] worker_thread+0x126/0x3c0
[<ffffffff912bf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff912c6691>] kthread+0xd1/0xe0
[<ffffffff912c65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff91992d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff912c65c0>] ? insert_kthread_work+0x40/0x40
Complete report #11116
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff927c036c
Build id: 3.10.0-957.el7.x86_64
|
0x34c
|
|
2
|
|
vmlinux |
0xffffffff926e22cf
Build id: 3.10.0-957.el7.x86_64
|
0x2ef
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff927c0c06
Build id: 3.10.0-957.el7.x86_64
|
0x176
|
|
4
|
alloc_pages_current
|
vmlinux |
0xffffffff9280dcf8
Build id: 3.10.0-957.el7.x86_64
|
0x98
|
|
5
|
vmballoon_work
|
vmw_balloon |
0xffffffffc04baf84
Build id: 3.10.0-957.el7.x86_64
|
0x454
|
|
6
|
process_one_work
|
vmlinux |
0xffffffff926b9d4f
Build id: 3.10.0-957.el7.x86_64
|
0x17f
|
|
7
|
worker_thread
|
vmlinux |
0xffffffff926bade6
Build id: 3.10.0-957.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffff926bacc0
Build id: 3.10.0-957.el7.x86_64
|
0x2a0
|
|
9
|
kthread
|
vmlinux |
0xffffffff926c1c31
Build id: 3.10.0-957.el7.x86_64
|
0xd1
|
|
10
|
|
vmlinux |
0xffffffff926c1b60
Build id: 3.10.0-957.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff92d74c37
Build id: 3.10.0-957.el7.x86_64
|
0x21
|
|
12
|
|
vmlinux |
0xffffffff926c1b60
Build id: 3.10.0-957.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 49s! [kworker/0:1:4684]
Modules linked in: binfmt_misc veth xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) vmw_vsock_vmci_transport vsock sunrpc sb_edac ppdev coretemp iosf_mbi vmw_balloon crc32_pclmul ghash_clmulni_intel cryptd joydev pcspkr parport_pc sg parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmwgfx drm_kms_helper syscopyarea floppy sysfillrect ata_piix sysimgblt fb_sys_fops ttm libata drm mptspi e1000 scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 4684 Comm: kworker/0:1 Kdump: loaded Tainted: G ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9374d5c230c0 ti: ffff937767fa8000 task.ti: ffff937767fa8000
RIP: 0010:[<ffffffff927c036c>] [<ffffffff927c036c>] get_page_from_freelist+0x34c/0xa70
RSP: 0018:ffff937767fabbc0 EFLAGS: 00000246
RAX: 00000000000000ec RBX: ffff937767fabbb0 RCX: 000000000001f748
RDX: 000000000001f767 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff937767fabcc8 R08: ffffffffffffffd5 R09: 0000000000000000
R10: ffff9379ffbd5ba0 R11: fffffffffffffff8 R12: ffffe35e04a5f3c0
R13: 0000000000000001 R14: ffff9379fffda230 R15: 0000000000000004
FS: 0000000000000000(0000) GS:ffff9379ffc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c421323010 CR3: 000000053520a000 CR4: 00000000001607f0
Call Trace:
[<ffffffff926e22cf>] ? enqueue_entity+0x2ef/0xbe0
[<ffffffff927c0c06>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff9280dcf8>] alloc_pages_current+0x98/0x110
[<ffffffffc04baf84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff926b9d4f>] process_one_work+0x17f/0x440
[<ffffffff926bade6>] worker_thread+0x126/0x3c0
[<ffffffff926bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff926c1c31>] kthread+0xd1/0xe0
[<ffffffff926c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffff92d74c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff926c1b60>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 80 7d 01 00 8b 55 b0 e8 6a 7c 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f9 02 00 00 44 8b 4d 84 4d
Complete report #4693
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffffa93c8517
Build id: 3.10.0-1127.el7.x86_64
|
0x2a7
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffa93c8e76
Build id: 3.10.0-1127.el7.x86_64
|
0x166
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffffa9418e18
Build id: 3.10.0-1127.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0550f84
Build id: 3.10.0-1127.el7.x86_64
|
0x454
|
|
5
|
process_one_work
|
vmlinux |
0xffffffffa92be6bf
Build id: 3.10.0-1127.el7.x86_64
|
0x17f
|
|
6
|
worker_thread
|
vmlinux |
0xffffffffa92bf7d6
Build id: 3.10.0-1127.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffffa92bf6b0
Build id: 3.10.0-1127.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffffa92c6691
Build id: 3.10.0-1127.el7.x86_64
|
0xd1
|
|
9
|
|
vmlinux |
0xffffffffa92c65c0
Build id: 3.10.0-1127.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffa9992d37
Build id: 3.10.0-1127.el7.x86_64
|
0x21
|
|
11
|
|
vmlinux |
0xffffffffa92c65c0
Build id: 3.10.0-1127.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 21s! [kworker/6:2:482]
Modules linked in: vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod sb_edac coretemp ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper ata_piix syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptsas drm scsi_transport_sas mptscsih ahci libahci crct10dif_pclmul libata crct10dif_common mptbase crc32c_intel serio_raw vmxnet3 drm_panel_orientation_quirks
CPU: 6 PID: 482 Comm: kworker/6:2 Kdump: loaded Tainted: G L ------------ 3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff97509569b150 ti: ffff975094960000 task.ti: ffff975094960000
RIP: 0010:[<ffffffffa93c8517>] [<ffffffffa93c8517>] get_page_from_freelist+0x2a7/0xaa0
RSP: 0018:ffff975094963bc8 EFLAGS: 00000246
RAX: 00000000000000de RBX: 000000000000001e RCX: 000000000001fd5a
RDX: 000000000001fd67 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff975094963cd0 R08: 0000000000000000 R09: 0000000000000000
R10: ffff9750bfbd45e0 R11: fffffffffffffff6 R12: ffff975094963b48
R13: 0000000000000000 R14: ffff9749f4318c18 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff97509d780000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f65cda95198 CR3: 00000003d2a10000 CR4: 00000000001607e0
Call Trace:
[<ffffffffa93c8e76>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffa9418e18>] alloc_pages_current+0x98/0x110
[<ffffffffc0550f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffffa92be6bf>] process_one_work+0x17f/0x440
[<ffffffffa92bf7d6>] worker_thread+0x126/0x3c0
[<ffffffffa92bf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffa92c6691>] kthread+0xd1/0xe0
[<ffffffffa92c65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffa9992d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa92c65c0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 60 7e 01 00 8b 55 b0 e8 af 7f 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 75 b4 85 f6 0f 8e 59 03 00 00 44 8b 4d 84 49
Complete report #3554
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff9c9c036c
Build id: 3.10.0-957.el7.x86_64
|
0x34c
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff9c9c0c06
Build id: 3.10.0-957.el7.x86_64
|
0x176
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffff9ca0dcf8
Build id: 3.10.0-957.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0578f84
Build id: 3.10.0-957.el7.x86_64
|
0x454
|
|
5
|
process_one_work
|
vmlinux |
0xffffffff9c8b9d4f
Build id: 3.10.0-957.el7.x86_64
|
0x17f
|
|
6
|
worker_thread
|
vmlinux |
0xffffffff9c8bade6
Build id: 3.10.0-957.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffff9c8bacc0
Build id: 3.10.0-957.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffff9c8c1c31
Build id: 3.10.0-957.el7.x86_64
|
0xd1
|
|
9
|
|
vmlinux |
0xffffffff9c8c1b60
Build id: 3.10.0-957.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff9cf74c37
Build id: 3.10.0-957.el7.x86_64
|
0x21
|
|
11
|
|
vmlinux |
0xffffffff9c8c1b60
Build id: 3.10.0-957.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 33s! [kworker/7:2:37475]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc coretemp crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper vmw_balloon cryptd pcspkr joydev sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_generic pata_acpi e1000 vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata mptspi scsi_transport_spi mptscsih mptbase
drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 7 PID: 37475 Comm: kworker/7:2 Kdump: loaded Tainted: G W L ------------ 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8c98e07a0000 ti: ffff8c98bbf3c000 task.ti: ffff8c98bbf3c000
RIP: 0010:[<ffffffff9c9c036c>] [<ffffffff9c9c036c>] get_page_from_freelist+0x34c/0xa70
RSP: 0018:ffff8c98bbf3fbc0 EFLAGS: 00000246
RAX: 0000000000000019 RBX: ffff8c98bbf3fbb0 RCX: 000000000001f630
RDX: 000000000001f6ff RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff8c98bbf3fcc8 R08: fffffffffffffff3 R09: 0000000000000000
R10: ffff8c98f7bd0360 R11: fffffffffffffff8 R12: fffff62a826ac740
R13: 0000000000000001 R14: 0000000000000000 R15: 00000000ffffffff
FS: 0000000000000000(0000) GS:ffff8c98f57c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7e5d076e00 CR3: 00000003d82be000 CR4: 00000000000007e0
Call Trace:
[<ffffffff9c9c0c06>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff9ca0dcf8>] alloc_pages_current+0x98/0x110
[<ffffffffc0578f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff9c8b9d4f>] process_one_work+0x17f/0x440
[<ffffffff9c8bade6>] worker_thread+0x126/0x3c0
[<ffffffff9c8bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff9c8c1c31>] kthread+0xd1/0xe0
[<ffffffff9c8c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffff9cf74c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9c8c1b60>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 80 7d 01 00 8b 55 b0 e8 6a 7c 01 00 48 8b 7d c0 57 9d <66> 66 90 66 90 8b 4d b4 85 c9 0f 8e f9 02 00 00 44 8b 4d 84 4d
Complete report #1481
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffffbd3c19fc
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x34c
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffbd3c2296
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x176
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffffbd40f438
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0455f84
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x454
|
|
5
|
process_one_work
|
vmlinux |
0xffffffffbd2baf9f
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x17f
|
|
6
|
worker_thread
|
vmlinux |
0xffffffffbd2bc036
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffffbd2bbf10
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffffbd2c2e81
Build id: 3.10.0-957.27.2.el7.x86_64
|
0xd1
|
|
9
|
|
vmlinux |
0xffffffffbd2c2db0
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffbd976c37
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x21
|
|
11
|
|
vmlinux |
0xffffffffbd2c2db0
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#10 stuck for 44s! [kworker/10:0:26629]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_pkttype xt_multiport ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables nfs_layout_nfsv41_files tun devlink nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache ip_set nfnetlink bridge stp llc vmw_vsock_vmci_transport vsock ppdev vmw_balloon sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel parport_pc parport sg joydev aesni_intel vmw_vmci i2c_piix4 lrw gf128mul
glue_helper pcspkr ablk_helper cryptd nfsd nfs_acl lockd grace auth_rpcgss sunrpc xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea mptspi sysfillrect sysimgblt ata_piix fb_sys_fops crct10dif_pclmul ttm scsi_transport_spi nfit mptscsih crct10dif_common drm libnvdimm mptbase libata vmxnet3 serio_raw crc32c_intel drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
CPU: 10 PID: 26629 Comm: kworker/10:0 Kdump: loaded Tainted: G L ------------ 3.10.0-957.27.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9c3334fab0c0 ti: ffff9c37fc9d0000 task.ti: ffff9c37fc9d0000
RIP: 0010:[<ffffffffbd3c19fc>] [<ffffffffbd3c19fc>] get_page_from_freelist+0x34c/0xa70
RSP: 0018:ffff9c37fc9d3bc0 EFLAGS: 00000246
RAX: 0000000000000042 RBX: ffff9c37fc9d3bb0 RCX: 000000000001f778
RDX: 000000000001f767 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff9c37fc9d3cc8 R08: ffffffffffffffc2 R09: 0000000000000000
R10: ffff9c3a3ffd1e40 R11: fffffffffffffff4 R12: ffffdf825f59a9c0
R13: 0000000000000001 R14: ffff9c3a3ffda368 R15: 0000000000000007
FS: 0000000000000000(0000) GS:ffff9c39ffc80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fad5402f000 CR3: 0000001198c10000 CR4: 00000000001607e0
Call Trace:
[<ffffffffbd3c2296>] __alloc_pages_nodemask+0x176/0x420
[<ffffffffbd40f438>] alloc_pages_current+0x98/0x110
[<ffffffffc0455f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffffbd2baf9f>] process_one_work+0x17f/0x440
[<ffffffffbd2bc036>] worker_thread+0x126/0x3c0
[<ffffffffbd2bbf10>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffffbd2c2e81>] kthread+0xd1/0xe0
[<ffffffffbd2c2db0>] ? insert_kthread_work+0x40/0x40
[<ffffffffbd976c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffbd2c2db0>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 80 7d 01 00 8b 55 b0 e8 fa 7c 01 00 48 8b 7d c0 57 9d <0f> 1f 44 00 00 8b 4d b4 85 c9 0f 8e f9 02 00 00 44 8b 4d 84 4d
Complete report #1432
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
get_page_from_freelist
|
vmlinux |
0xffffffff90da0d8c
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x34c
|
|
2
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff90da1626
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x176
|
|
3
|
alloc_pages_current
|
vmlinux |
0xffffffff90dec058
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x98
|
|
4
|
vmballoon_work
|
vmw_balloon |
0xffffffffc0749f84
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x454
|
|
5
|
process_one_work
|
vmlinux |
0xffffffff90cb613f
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x17f
|
|
6
|
worker_thread
|
vmlinux |
0xffffffff90cb71d6
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffff90cb70b0
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffff90cbdf21
Build id: 3.10.0-862.14.4.el7.x86_64
|
0xd1
|
|
9
|
|
vmlinux |
0xffffffff90cbde50
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff913255f7
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x21
|
|
11
|
|
vmlinux |
0xffffffff90cbde50
Build id: 3.10.0-862.14.4.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [kworker/5:0:52939]
Modules linked in: xt_nat veth ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop overlay tcp_diag inet_diag binfmt_misc coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr joydev i2c_piix4 vmw_vmci sg shpchp parport_pc parport nfsd nfs_acl lockd grace auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod drm_kms_helper crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm crc32c_intel ata_piix libata
serio_raw vmxnet3 i2c_core vmw_pvscsi floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 52939 Comm: kworker/5:0 Kdump: loaded Tainted: G B L ------------ 3.10.0-862.14.4.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 10/22/2013
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff892604480fd0 ti: ffff8925488bc000 task.ti: ffff8925488bc000
RIP: 0010:[<ffffffff90da0d8c>] [<ffffffff90da0d8c>] get_page_from_freelist+0x34c/0xa70
RSP: 0018:ffff8925488bfbc0 EFLAGS: 00000246
RAX: 00000000000000e9 RBX: ffff8925488bfbb0 RCX: 000000000001c040
RDX: 000000000001c0f7 RSI: 000000000000001f RDI: 0000000000000246
RBP: ffff8925488bfcc8 R08: ffffffffffffffe2 R09: 0000000000000000
R10: ffff89277fbcab40 R11: fffffffffffffff8 R12: ffffffff90f6d0ad
R13: ffff8925488bfb40 R14: ffff89277ffce300 R15: 0000000000000006
FS: 0000000000000000(0000) GS:ffff89276e740000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c420097010 CR3: 000000024e20e000 CR4: 00000000000007e0
Call Trace:
[<ffffffff90da1626>] __alloc_pages_nodemask+0x176/0x420
[<ffffffff90dec058>] alloc_pages_current+0x98/0x110
[<ffffffffc0749f84>] vmballoon_work+0x454/0x6ff [vmw_balloon]
[<ffffffff90cb613f>] process_one_work+0x17f/0x440
[<ffffffff90cb71d6>] worker_thread+0x126/0x3c0
[<ffffffff90cb70b0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff90cbdf21>] kthread+0xd1/0xe0
[<ffffffff90cbde50>] ? insert_kthread_work+0x40/0x40
[<ffffffff913255f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff90cbde50>] ? insert_kthread_work+0x40/0x40
Code: f8 04 48 0f 45 d1 48 63 45 b4 48 8b bd 78 ff ff ff 4c 89 fe 65 48 01 04 d5 c0 5c 01 00 8b 55 b0 e8 fa 74 01 00 48 8b 7d c0 57 9d <66> 66 90 66 90 8b 4d b4 85 c9 0f 8e f9 02 00 00 44 8b 4d 84 4d