Info

Permalink
Function
vmballoon_lock_batched_page
First occurrence
2020-09-25
Last occurrence
2026-03-10
State
NEW
Components
kernel
Quality
-21

Statistics

Operating system Count
CentOS 7 321
Architecture Count
x86_64 321
Related packages Count
kernel 321
 0:3.10.0-693.el7 62
 0:3.10.0-957.27.2.el7 37
 0:3.10.0-1062.4.3.el7 29
 0:3.10.0-1160.el7 23
 0:3.10.0-1160.59.1.el7 16
 0:3.10.0-957.el7 13
 0:3.10.0-1160.76.1.el7 11
 0:3.10.0-1160.119.1.el7 9
 0:3.10.0-1127.19.1.el7 8
 0:3.10.0-1160.88.1.el7 8
 0:3.10.0-1062.18.1.el7 7
 0:3.10.0-1160.92.1.el7 7
 0:3.10.0-1160.108.1.el7 6
 0:3.10.0-862.el7 6
 0:3.10.0-693.5.2.el7 6
 0:3.10.0-1062.12.1.el7 5
 0:3.10.0-1160.11.1.el7 5
 0:3.10.0-1160.81.1.el7 5
 0:3.10.0-957.5.1.el7 5
 0:3.10.0-1062.1.2.el7 4
 0:3.10.0-1160.80.1.el7 4
 0:3.10.0-1062.el7 3
 0:3.10.0-1160.21.1.el7 3
 0:3.10.0-1160.49.1.el7 3
 0:3.10.0-957.10.1.el7 3
 0:3.10.0-1127.el7 2
 0:3.10.0-1160.102.1.el7 2
 0:3.10.0-1160.118.1.el7 2
 0:3.10.0-1160.45.1.el7 2
 0:3.10.0-1160.53.1.el7 2
 0:3.10.0-1160.71.1.el7 2
 0:3.10.0-862.6.3.el7 2
 0:3.10.0-862.14.4.el7 2
 0:3.10.0-862.3.2.el7 2
 0:3.10.0-1127.13.1.el7 1
 0:3.10.0-1160.114.2.el7 1
 0:3.10.0-1160.2.2.el7 1
 0:3.10.0-1160.24.1.el7 1
 0:3.10.0-1160.31.1.el7 1
 0:3.10.0-1160.42.2.el7 1
 0:3.10.0-1160.95.1.el7 1
 0:3.10.0-1062.9.1.el7 1
 0:3.10.0-957.1.3.el7 1
 0:3.10.0-957.21.3.el7 1
 0:3.10.0-862.9.1.el7 1
 0:3.10.0-1062.1.1.el7 1
 0:3.10.0-1160.15.2.el7 1
 0:3.10.0-693.21.1.el7 1
 0:3.10.0-1127.10.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #1223768
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc0818673
Build id: 3.10.0-862.14.4.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc08190d5
Build id: 3.10.0-862.14.4.el7.x86_64
0x5a5
3
process_one_work
vmlinux 0xffffffffaaeb613f
Build id: 3.10.0-862.14.4.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffffaaeb71d6
Build id: 3.10.0-862.14.4.el7.x86_64
0x126
5
? manage_workers.isra.24
vmlinux 0xffffffffaaeb70b0
Build id: 3.10.0-862.14.4.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffffaaebdf21
Build id: 3.10.0-862.14.4.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffffaaebde50
Build id: 3.10.0-862.14.4.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffffab5255f7
Build id: 3.10.0-862.14.4.el7.x86_64
0x21
9
? insert_kthread_work
vmlinux 0xffffffffaaebde50
Build id: 3.10.0-862.14.4.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [kworker/3:2:14912]
Modules linked in: binfmt_misc xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock ext4 mbcache jbd2 sb_edac iosf_mbi ppdev vmwgfx crc32_pclmul vmw_balloon ghash_clmulni_intel aesni_intel lrw gf128mul ttm glue_helper ablk_helper cryptd drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops drm pcnet32 pcspkr joydev vmw_vmci mii i2c_piix4 vmw_pvscsi sg i2c_core nfit shpchp libnvdimm parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi ata_piix
libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 14912 Comm: kworker/3:2 Kdump: loaded Tainted: G           OE  ------------   3.10.0-862.14.4.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8d3156410000 ti: ffff8d291c064000 task.ti: ffff8d291c064000
RIP: 0010:[<ffffffffc0818673>]  [<ffffffffc0818673>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0018:ffff8d291c067d88  EFLAGS: 00000202
RAX: 0000000000000000 RBX: ffff8d3156410000 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 0000000000fd8eea
RBP: ffff8d291c067dc0 R08: ffffffffab87606f R09: fffff00b0b1b6fc0
R10: ffffffffc081b438 R11: 0000000000000000 R12: ffff8d3156410000
R13: ffff8d37dffdb038 R14: ffff8d3700000000 R15: ffff8d37dffda000
FS:  0000000000000000(0000) GS:ffff8d37a0180000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f48a25db548 CR3: 0000001f78c0e000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc08190d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffffaaeb613f>] process_one_work+0x17f/0x440
[<ffffffffaaeb71d6>] worker_thread+0x126/0x3c0
[<ffffffffaaeb70b0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffffaaebdf21>] kthread+0xd1/0xe0
[<ffffffffaaebde50>] ? insert_kthread_work+0x40/0x40
[<ffffffffab5255f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffaaebde50>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d dc 8d 22 eb ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #1214308
Frame # Function Binary Source or offset Line
1
__list_add
vmlinux 0xffffffffb3f68283
Build id: 3.10.0-862.el7.x86_64
0x33
2
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc05c27d7
Build id: 3.10.0-862.el7.x86_64
0x1d7
3
vmballoon_work
vmw_balloon 0xffffffffc05c30d9
Build id: 3.10.0-862.el7.x86_64
0x4b9
4
process_one_work
vmlinux 0xffffffffb3cb2dff
Build id: 3.10.0-862.el7.x86_64
0x17f
5
worker_thread
vmlinux 0xffffffffb3cb3ac6
Build id: 3.10.0-862.el7.x86_64
0x126
6
? manage_workers.isra.24
vmlinux 0xffffffffb3cb39a0
Build id: 3.10.0-862.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffffb3cbae31
Build id: 3.10.0-862.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffffb3cbad60
Build id: 3.10.0-862.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffffb431f637
Build id: 3.10.0-862.el7.x86_64
0x21
10
? insert_kthread_work
vmlinux 0xffffffffb3cbad60
Build id: 3.10.0-862.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 55s! [kworker/1:2:23213]
Modules linked in: veth nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr nfit sg libnvdimm i2c_piix4
vmw_vmci shpchp parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod crc_t10dif crct10dif_generic drm ahci libahci crct10dif_pclmul crct10dif_common ata_piix crc32c_intel serio_raw libata vmxnet3 vmw_pvscsi i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 23213 Comm: kworker/1:2 Kdump: loaded Tainted: G             L ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8d6036304f10 ti: ffff8d5e27444000 task.ti: ffff8d5e27444000
RIP: 0010:[<ffffffffb3f68283>]  [<ffffffffb3f68283>] __list_add+0x33/0xc0
RSP: 0018:ffff8d5e27447d60  EFLAGS: 00010283
RAX: 0000000000000001 RBX: 0000000000000001 RCX: 0000000000000046
RDX: fffff32805a80fe0 RSI: ffffffffc05c53e0 RDI: fffff32805970820
RBP: ffff8d5e27447d78 R08: fffff32805a80fe0 R09: fffff328057f9e80
R10: ffffffffc05c5438 R11: 0000000000000000 R12: ffff8d6036304f10
R13: 0000000127447d18 R14: ffff8d603fd00000 R15: ffffffffb3c2959e
FS:  0000000000000000(0000) GS:ffff8d603fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0ef2b222a0 CR3: 000000023225e000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 00000000
Call Trace:
[<ffffffffc05c27d7>] vmballoon_lock_batched_page+0x1d7/0x230 [vmw_balloon]
[<ffffffffc05c30d9>] vmballoon_work+0x4b9/0x63d [vmw_balloon]
[<ffffffffb3cb2dff>] process_one_work+0x17f/0x440
[<ffffffffb3cb3ac6>] worker_thread+0x126/0x3c0
[<ffffffffb3cb39a0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffffb3cbae31>] kthread+0xd1/0xe0
[<ffffffffb3cbad60>] ? insert_kthread_work+0x40/0x40
[<ffffffffb431f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb3cbad60>] ? insert_kthread_work+0x40/0x40
Code: f5 41 54 49 89 d4 53 4c 8b 42 08 48 89 fb 49 39 f0 75 2a 4d 8b 45 00 4d 39 c4 75 68 4c 39 e3 74 3e 4c 39 eb 74 39 49 89 5c 24 08 <4c> 89 6b 08 4c 89 23 49 89 5d 00 5b 41 5c 41 5d 5d c3 49 89 d1 
Complete report #1033181
Frame # Function Binary Source or offset Line
1
__list_add
vmlinux 0xffffffffbd7a5a53
Build id: 3.10.0-1160.el7.x86_64
0x33
2
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc0776747
Build id: 3.10.0-1160.el7.x86_64
0x1d7
3
vmballoon_work
vmw_balloon 0xffffffffc07770d5
Build id: 3.10.0-1160.el7.x86_64
0x5a5
4
process_one_work
vmlinux 0xffffffffbd4bdc4f
Build id: 3.10.0-1160.el7.x86_64
0x17f
5
worker_thread
vmlinux 0xffffffffbd4bed66
Build id: 3.10.0-1160.el7.x86_64
0x126
6
? manage_workers.isra.26
vmlinux 0xffffffffbd4bec40
Build id: 3.10.0-1160.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffffbd4c5c21
Build id: 3.10.0-1160.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffffbd4c5b50
Build id: 3.10.0-1160.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffffbdb93de4
Build id: 3.10.0-1160.el7.x86_64
0xe
10
? insert_kthread_work
vmlinux 0xffffffffbd4c5b50
Build id: 3.10.0-1160.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 36s! [kworker/5:1:14526]
Modules linked in: xt_nat veth nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache overlay(T) vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 ppdev vmw_balloon crc32_pclmul ghash_clmulni_intel aesni_intel joydev lrw gf128mul glue_helper ablk_helper i2c_piix4 cryptd pcspkr sg vmw_vmci parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod drm_kms_helper crc_t10dif crct10dif_generic syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm ata_piix drm nfit libata libnvdimm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmw_pvscsi vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 5 PID: 14526 Comm: kworker/5:1 Kdump: loaded Tainted: G        W      ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9a08b83d8000 ti: ffff9a08a9fa0000 task.ti: ffff9a08a9fa0000
RIP: 0010:[<ffffffffbd7a5a53>]  [<ffffffffbd7a5a53>] __list_add+0x33/0xc0
RSP: 0018:ffff9a08a9fa3d60  EFLAGS: 00000297
RAX: 0000000000000200 RBX: ffff9a46bffda000 RCX: 00000000000001f8
RDX: ffffe7659e608020 RSI: ffffffffc0779408 RDI: ffffe7659f1b0020
RBP: ffff9a08a9fa3d78 R08: ffffe7659e608020 R09: ffffe7659d7d0000
R10: ffffffffc0779438 R11: fffffffffffffff6 R12: ffff9a08a9fa3d78
R13: 0000000000020202 R14: 0000000000000000 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff9a45bf340000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f163dfb6ac8 CR3: 00000002353d6000 CR4: 00000000003407e0
Call Trace:
[<ffffffffc0776747>] vmballoon_lock_batched_page+0x1d7/0x230 [vmw_balloon]
[<ffffffffc07770d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffffbd4bdc4f>] process_one_work+0x17f/0x440
[<ffffffffbd4bed66>] worker_thread+0x126/0x3c0
[<ffffffffbd4bec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffbd4c5c21>] kthread+0xd1/0xe0
[<ffffffffbd4c5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffffbdb93de4>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffffbd4c5b50>] ? insert_kthread_work+0x40/0x40
Code: f5 41 54 49 89 d4 53 4c 8b 42 08 48 89 fb 49 39 f0 75 2a 4d 8b 45 00 4d 39 c4 75 68 4c 39 e3 74 3e 4c 39 eb 74 39 49 89 5c 24 08 <4c> 89 6b 08 4c 89 23 49 89 5d 00 5b 41 5c 41 5d 5d c3 49 89 d1 
Complete report #937793
Frame # Function Binary Source or offset Line
1
__list_add
vmlinux 0xffffffffa37a66b3
Build id: 3.10.0-1160.45.1.el7.x86_64
0x33
2
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc0512747
Build id: 3.10.0-1160.45.1.el7.x86_64
0x1d7
3
vmballoon_work
vmw_balloon 0xffffffffc05130d5
Build id: 3.10.0-1160.45.1.el7.x86_64
0x5a5
4
process_one_work
vmlinux 0xffffffffa34bde8f
Build id: 3.10.0-1160.45.1.el7.x86_64
0x17f
5
worker_thread
vmlinux 0xffffffffa34befa6
Build id: 3.10.0-1160.45.1.el7.x86_64
0x126
6
? manage_workers.isra.26
vmlinux 0xffffffffa34bee80
Build id: 3.10.0-1160.45.1.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffffa34c5e61
Build id: 3.10.0-1160.45.1.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffffa34c5d90
Build id: 3.10.0-1160.45.1.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffffa3b95ddd
Build id: 3.10.0-1160.45.1.el7.x86_64
0x7
10
? insert_kthread_work
vmlinux 0xffffffffa34c5d90
Build id: 3.10.0-1160.45.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 33s! [kworker/2:1:113545]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_16206(E) falcon_lsm_pinned_16108(E) falcon_lsm_pinned_16004(E) falcon_lsm_pinned_15907(E) tcp_diag udp_diag inet_diag falcon_lsm_pinned_15805(E) vmw_vsock_vmci_transport vsock ext4 mbcache jbd2 iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon sg joydev pcspkr vmw_vmci i2c_piix4 parport_pc parport auth_rpcgss sunrpc ip_tables xfs libcrc32c ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod drm nfit crc_t10dif crct10dif_generic libnvdimm ata_piix crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash
dm_log dm_mod fuse [last unloaded: falcon_kal]
CPU: 2 PID: 113545 Comm: kworker/2:1 Kdump: loaded Tainted: P            E  ------------   3.10.0-1160.45.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9348e9c5c200 ti: ffff933935c3c000 task.ti: ffff933935c3c000
RIP: 0010:[<ffffffffa37a66b3>]  [<ffffffffa37a66b3>] __list_add+0x33/0xc0
RSP: 0000:ffff933935c3fd60  EFLAGS: 00010287
RAX: 0000000000000001 RBX: ffff9348e9c5c200 RCX: 00000000000000e7
RDX: fffff92bdce0a760 RSI: ffffffffc05153e0 RDI: fffff92be656ade0
RBP: ffff933935c3fd78 R08: fffff92bdce0a760 R09: fffff92beb743540
R10: ffffffffc0515438 R11: fffffffffffffff8 R12: ffff93493ffdb028
R13: ffffffffa347dfe9 R14: ffffffffa347dff5 R15: ffffffffa347dfe9
FS:  0000000000000000(0000) GS:ffff9348fd680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000000 CR3: 000000011e4a8000 CR4: 00000000003607e0
Call Trace:
[<ffffffffc0512747>] vmballoon_lock_batched_page+0x1d7/0x230 [vmw_balloon]
[<ffffffffc05130d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffffa34bde8f>] process_one_work+0x17f/0x440
[<ffffffffa34befa6>] worker_thread+0x126/0x3c0
[<ffffffffa34bee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffa34c5e61>] kthread+0xd1/0xe0
[<ffffffffa34c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffffa3b95ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffa34c5d90>] ? insert_kthread_work+0x40/0x40
Code: f5 41 54 49 89 d4 53 4c 8b 42 08 48 89 fb 49 39 f0 75 2a 4d 8b 45 00 4d 39 c4 75 68 4c 39 e3 74 3e 4c 39 eb 74 39 49 89 5c 24 08 <4c> 89 6b 08 4c 89 23 49 89 5d 00 5b 41 5c 41 5d 5d c3 49 89 d1 
Complete report #946906
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc0423673
Build id: 3.10.0-957.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc04240d5
Build id: 3.10.0-957.el7.x86_64
0x5a5
3
process_one_work
vmlinux 0xffffffff98cb9d4f
Build id: 3.10.0-957.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffff98cbade6
Build id: 3.10.0-957.el7.x86_64
0x126
5
? manage_workers.isra.25
vmlinux 0xffffffff98cbacc0
Build id: 3.10.0-957.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffff98cc1c31
Build id: 3.10.0-957.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffff98cc1b60
Build id: 3.10.0-957.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffff99374c37
Build id: 3.10.0-957.el7.x86_64
0x21
9
? insert_kthread_work
vmlinux 0xffffffff98cc1b60
Build id: 3.10.0-957.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 32s! [kworker/7:0:9402]
Modules linked in: tcp_lp fuse symap_custom_3_10_0_957_el7_x86_64(POE) symev_custom_3_10_0_957_el7_x86_64(OE) vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod ppdev vmw_balloon sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg i2c_piix4 vmw_vmci parport_pc parport binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm floppy nfit ahci libnvdimm libahci drm ata_piix libata vmw_pvscsi drm_panel_orientation_quirks
CPU: 7 PID: 9402 Comm: kworker/7:0 Kdump: loaded Tainted: P           OEL ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9711b6345140 ti: ffff971081aac000 task.ti: ffff971081aac000
RIP: 0010:[<ffffffffc0423673>]  [<ffffffffc0423673>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0018:ffff971081aafd88  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff9711b6345140 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 0000000000ff4306
RBP: ffff971081aafdc0 R08: ffffffff99681c99 R09: ffffd439f63c1700
R10: ffffffffc0426438 R11: 0000000000000000 R12: ffff9711b6345140
R13: 0000000000000000 R14: ffff971d00000000 R15: ffff971d3ffda000
FS:  0000000000000000(0000) GS:ffff971d3fdc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f263c035000 CR3: 00000002b366c000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc04240d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffff98cb9d4f>] process_one_work+0x17f/0x440
[<ffffffff98cbade6>] worker_thread+0x126/0x3c0
[<ffffffff98cbacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff98cc1c31>] kthread+0xd1/0xe0
[<ffffffff98cc1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffff99374c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff98cc1b60>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 1c 1b 42 d9 ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #826459
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc03eb703
Build id: 3.10.0-693.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc03ec0bd
Build id: 3.10.0-693.el7.x86_64
0x49d
3
process_one_work
vmlinux 0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64
0x17a
4
worker_thread
vmlinux 0xffffffff810a94e6
Build id: 3.10.0-693.el7.x86_64
0x126
5
? manage_workers.isra.24
vmlinux 0xffffffff810a93c0
Build id: 3.10.0-693.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
0xcf
7
? do_exit
vmlinux 0xffffffff8108ddeb
Build id: 3.10.0-693.el7.x86_64
0x6bb
8
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
9
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
0x58
10
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 24s! [kworker/0:2:31538]
Modules linked in: tcp_diag inet_diag vmw_vsock_vmci_transport vsock xfs libcrc32c sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr joydev sg parport_pc parport i2c_piix4 vmw_vmci shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables ext4 mbcache jbd2 sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix crct10dif_pclmul crct10dif_common libata drm crc32c_intel serio_raw mptspi scsi_transport_spi mptscsih vmxnet3 mptbase i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 31538 Comm: kworker/0:2 Tainted: G             L ------------   3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff880092179fa0 ti: ffff880175298000 task.ti: ffff880175298000
RIP: 0010:[<ffffffffc03eb703>]  [<ffffffffc03eb703>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0018:ffff88017529bd88  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff880092179fa0 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 0000000000035b3f
RBP: ffff88017529bdc0 R08: ffffffff81911047 R09: ffffea0006b18200
R10: ffffffffc03ee438 R11: fffffffffffffffa R12: ffff880092179fa0
R13: ffff8801bffd8028 R14: ffffffff00000000 R15: ffff8801bffd7000
FS:  0000000000000000(0000) GS:ffff8801bfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007fb1632bf448 CR3: 00000001a1edd000 CR4: 00000000000407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
 ffff880092179fa0 0000000000000000 0000000000001a00 0000000000000200
 0000000000000200 0000000000000000 ffffffffc03ee558 ffff88017529be18
 ffffffffc03ec0bd ffffffffc03ee438 00000000ffffffff 00000202921c9280
Call Trace:
 [<ffffffffc03ec0bd>] vmballoon_work+0x49d/0x615 [vmw_balloon]
 [<ffffffff810a881a>] process_one_work+0x17a/0x440
 [<ffffffff810a94e6>] worker_thread+0x126/0x3c0
 [<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
 [<ffffffff810b098f>] kthread+0xcf/0xe0
 [<ffffffff8108ddeb>] ? do_exit+0x6bb/0xa40
 [<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
 [<ffffffff816b4f18>] ret_from_fork+0x58/0x90
 [<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 04 85 63 c1 ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #315956
Frame # Function Binary Source or offset Line
1
__list_add
vmlinux 0xffffffff8133d873
Build id: 3.10.0-693.el7.x86_64
0x33
2
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc043f7d7
Build id: 3.10.0-693.el7.x86_64
0x1d7
3
vmballoon_work
vmw_balloon 0xffffffffc04400bd
Build id: 3.10.0-693.el7.x86_64
0x49d
4
process_one_work
vmlinux 0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64
0x17a
5
worker_thread
vmlinux 0xffffffff810a94e6
Build id: 3.10.0-693.el7.x86_64
0x126
6
? manage_workers.isra.24
vmlinux 0xffffffff810a93c0
Build id: 3.10.0-693.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
0xcf
8
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
9
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
0x58
10
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#11 stuck for 21s! [kworker/11:1:26039]
Modules linked in: arc4 md4 xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nls_utf8 cifs dns_resolver vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg shpchp parport_pc parport vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptsas ata_piix
drm scsi_transport_sas mptscsih crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 11 PID: 26039 Comm: kworker/11:1 Tainted: G             L ------------   3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8803e6a6cf10 ti: ffff880398d2c000 task.ti: ffff880398d2c000
RIP: 0010:[<ffffffff8133d873>]  [<ffffffff8133d873>] __list_add+0x33/0xc0
RSP: 0018:ffff880398d2fd60  EFLAGS: 00010283
RAX: 0000000000000001 RBX: ffffffff00000000 RCX: 00000000000000d8
RDX: ffffea001d7d1ae0 RSI: ffffffffc04423e0 RDI: ffffea0006e2b420
RBP: ffff880398d2fd78 R08: ffffea001d7d1ae0 R09: ffffea0006325e80
R10: ffffffffc0442438 R11: 0000000000000000 R12: ffffffff8118caf6
R13: ffff880398d2fd78 R14: 0000000000020202 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff880c0f4c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa38eba90c8 CR3: 00000000019f2000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
ffffffffc04423e0 0000000000000200 0000000000000000 ffff880398d2fdc0
ffffffffc043f7d7 ffffffffc04423f0 0000000100000000 00000000007a3a00
0000000000000200 0000000000000200 0000000000000000 ffffffffc0442558
Call Trace:
[<ffffffffc043f7d7>] vmballoon_lock_batched_page+0x1d7/0x230 [vmw_balloon]
[<ffffffffc04400bd>] vmballoon_work+0x49d/0x615 [vmw_balloon]
[<ffffffff810a881a>] process_one_work+0x17a/0x440
[<ffffffff810a94e6>] worker_thread+0x126/0x3c0
[<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: f5 41 54 49 89 d4 53 4c 8b 42 08 48 89 fb 49 39 f0 75 2a 4d 8b 45 00 4d 39 c4 75 68 4c 39 e3 74 3e 4c 39 eb 74 39 49 89 5c 24 08 <4c> 89 6b 08 4c 89 23 49 89 5d 00 5b 41 5c 41 5d 5d c3 49 89 d1 
Complete report #149079
Frame # Function Binary Source or offset Line
1
__list_add
vmlinux 0xffffffff8133d943
Build id: 3.10.0-693.5.2.el7.x86_64
0x33
2
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc038f7d7
Build id: 3.10.0-693.5.2.el7.x86_64
0x1d7
3
vmballoon_work
vmw_balloon 0xffffffffc03900bd
Build id: 3.10.0-693.5.2.el7.x86_64
0x49d
4
process_one_work
vmlinux 0xffffffff810a882a
Build id: 3.10.0-693.5.2.el7.x86_64
0x17a
5
worker_thread
vmlinux 0xffffffff810a94f6
Build id: 3.10.0-693.5.2.el7.x86_64
0x126
6
? manage_workers.isra.24
vmlinux 0xffffffff810a93d0
Build id: 3.10.0-693.5.2.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffff810b099f
Build id: 3.10.0-693.5.2.el7.x86_64
0xcf
8
? finish_task_switch
vmlinux 0xffffffff810bf114
Build id: 3.10.0-693.5.2.el7.x86_64
0x54
9
? insert_kthread_work
vmlinux 0xffffffff810b08d0
Build id: 3.10.0-693.5.2.el7.x86_64
0x40
10
ret_from_fork
vmlinux 0xffffffff816b4fd8
Build id: 3.10.0-693.5.2.el7.x86_64
0x58
11
? insert_kthread_work
vmlinux 0xffffffff810b08d0
Build id: 3.10.0-693.5.2.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/0:1:7910]
Modules linked in: ip_vs_rr xt_ipvs ip_vs xt_nat veth vxlan ip6_udp_tunnel udp_tunnel iptable_mangle xt_mark xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache overlay(T) vmw_vsock_vmci_transport vsock crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper vmwgfx cryptd vmw_vmci ttm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops vmw_balloon drm pcspkr ppdev joydev sg vmw_pvscsi vmxnet3 i2c_piix4 i2c_core shpchp nfit libnvdimm parport_pc parport floppy nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif
sr_mod crct10dif_generic cdrom ata_generic pata_acpi ata_piix ahci libahci crct10dif_pclmul libata crct10dif_common crc32c_intel serio_raw dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 7910 Comm: kworker/0:1 Tainted: G               ------------ T 3.10.0-693.5.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff880bc5f30000 ti: ffff8800b789c000 task.ti: ffff8800b789c000
RIP: 0010:[<ffffffff8133d943>]  [<ffffffff8133d943>] __list_add+0x33/0xc0
RSP: 0018:ffff8800b789fd60  EFLAGS: 00010287
RAX: 0000000000000001 RBX: ffffffff00000000 RCX: 000000000000008a
RDX: ffffea00227b9fe0 RSI: ffffffffc03923e0 RDI: ffffea0018974aa0
RBP: ffff8800b789fd78 R08: ffffea00227b9fe0 R09: ffffea000d093980
R10: ffffffffc0392438 R11: ffffffffffffffff R12: ffffffff8118cb26
R13: ffff8800b789fd78 R14: 0000000000020202 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff880c3fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f57a30ec000 CR3: 00000000019f2000 CR4: 00000000000007f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffffffffc03923e0 0000000000000200 0000000000000000 ffff8800b789fdc0
ffffffffc038f7d7 ffffffffc03923f0 0000000100000000 0000000000000000
0000000000000200 0000000000000200 0000000000000000 ffffffffc0392558
Call Trace:
[<ffffffffc038f7d7>] vmballoon_lock_batched_page+0x1d7/0x230 [vmw_balloon]
[<ffffffffc03900bd>] vmballoon_work+0x49d/0x615 [vmw_balloon]
[<ffffffff810a882a>] process_one_work+0x17a/0x440
[<ffffffff810a94f6>] worker_thread+0x126/0x3c0
[<ffffffff810a93d0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b099f>] kthread+0xcf/0xe0
[<ffffffff810bf114>] ? finish_task_switch+0x54/0x160
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4fd8>] ret_from_fork+0x58/0x90
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
Code: f5 41 54 49 89 d4 53 4c 8b 42 08 48 89 fb 49 39 f0 75 2a 4d 8b 45 00 4d 39 c4 75 68 4c 39 e3 74 3e 4c 39 eb 74 39 49 89 5c 24 08 <4c> 89 6b 08 4c 89 23 49 89 5d 00 5b 41 5c 41 5d 5d c3 49 89 d1 
Complete report #587584
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc0781673
Build id: 3.10.0-1160.76.1.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc07820d5
Build id: 3.10.0-1160.76.1.el7.x86_64
0x5a5
3
process_one_work
vmlinux 0xffffffff914bdfbf
Build id: 3.10.0-1160.76.1.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffff914bf0d6
Build id: 3.10.0-1160.76.1.el7.x86_64
0x126
5
? manage_workers.isra.26
vmlinux 0xffffffff914befb0
Build id: 3.10.0-1160.76.1.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffff914c5f91
Build id: 3.10.0-1160.76.1.el7.x86_64
0xd1
7
? system_call_after_swapgs
vmlinux 0xffffffff91b99ec9
Build id: 3.10.0-1160.76.1.el7.x86_64
0x96
8
? insert_kthread_work
vmlinux 0xffffffff914c5ec0
Build id: 3.10.0-1160.76.1.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffff91b99df7
Build id: 3.10.0-1160.76.1.el7.x86_64
0x21
10
? insert_kthread_work
vmlinux 0xffffffff914c5ec0
Build id: 3.10.0-1160.76.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [kworker/1:2:30170]
Modules linked in: xt_nat veth ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter binfmt_misc overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac coretemp ppdev iosf_mbi vmw_balloon crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev parport_pc sg parport vmw_vmci i2c_piix4 sch_fq_codel auth_rpcgss
sunrpc ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix mptspi scsi_transport_spi serio_raw libata mptscsih vmxnet3 mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 30170 Comm: kworker/1:2 Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.76.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8e439f7de300 ti: ffff8e43ae3d8000 task.ti: ffff8e43ae3d8000
RIP: 0010:[<ffffffffc0781673>]  [<ffffffffc0781673>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0000:ffff8e43ae3dbd88  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff8e43fffdb008 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 0000000000332de4
RBP: ffff8e43ae3dbdc0 R08: ffffffff91e8f4b7 R09: ffffdb6e048eb940
R10: ffffffffc0784438 R11: fffffffffffffff6 R12: ffff8e439f7de300
R13: 0000000000000001 R14: ffff8e439f7de300 R15: ffff8e439f7de300
FS:  0000000000000000(0000) GS:ffff8e43f3c40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc4e04a7308 CR3: 000000069e610000 CR4: 00000000000407e0
Call Trace:
[<ffffffffc07820d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffff914bdfbf>] process_one_work+0x17f/0x440
[<ffffffff914bf0d6>] worker_thread+0x126/0x3c0
[<ffffffff914befb0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff914c5f91>] kthread+0xd1/0xe0
[<ffffffff91b99ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff914c5ec0>] ? insert_kthread_work+0x40/0x40
[<ffffffff91b99df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff914c5ec0>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 9c 46 8c d1 ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #40606
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc0597673
Build id: 3.10.0-957.27.2.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc05980d5
Build id: 3.10.0-957.27.2.el7.x86_64
0x5a5
3
process_one_work
vmlinux 0xffffffffa3cbaf9f
Build id: 3.10.0-957.27.2.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffffa3cbc036
Build id: 3.10.0-957.27.2.el7.x86_64
0x126
5
? manage_workers.isra.25
vmlinux 0xffffffffa3cbbf10
Build id: 3.10.0-957.27.2.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffffa3cc2e81
Build id: 3.10.0-957.27.2.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffffa3cc2db0
Build id: 3.10.0-957.27.2.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffffa4376c37
Build id: 3.10.0-957.27.2.el7.x86_64
0x21
9
? insert_kthread_work
vmlinux 0xffffffffa3cc2db0
Build id: 3.10.0-957.27.2.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [pgrep:15819]
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 21s! [kworker/2:0:15383]
Modules linked in: ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 ip6table_filter nf_log_ipv4 nf_log_common nf_nat_ftp xt_REDIRECT nf_nat_redirect xt_conntrack nf_conntrack_ftp xt_LOG xt_limit xt_multiport iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 ip6table_mangle ip6table_raw ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 nf_nat nf_conntrack ip6_tables iptable_mangle iptable_raw ipt_REJECT nf_reject_ipv4 iptable_filter sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd vmw_balloon pcspkr joydev parport_pc sg parport i2c_piix4 vmw_vmci tcp_htcp ip_tables xfs libcrc32c vmwgfx drm_kms_helper sd_mod sr_mod syscopyarea cdrom sysfillrect crc_t10dif sysimgblt fb_sys_fops crct10dif_generic ata_generic pata_acpi
crct10dif_pclmul ttm ata_piix crct10dif_common drm crc32c_intel serio_raw e1000 vmw_pvscsi libata drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: talpa_syscallhook]
CPU: 2 PID: 15383 Comm: kworker/2:0 Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-957.27.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffffa0fc31e40000 ti: ffffa0fcf4e9c000 task.ti: ffffa0fcf4e9c000
RIP: 0010:[<ffffffffc0597673>]  [<ffffffffc0597673>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0018:ffffa0fcf4e9fd88  EFLAGS: 00000202
RAX: 0000000000000000 RBX: ffffa0fc31e40000 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 000000000042ae61
RBP: ffffa0fcf4e9fdc0 R08: ffffffffa4682979 R09: ffffef6c0bf60000
R10: ffffffffc059a438 R11: 0000000000000000 R12: ffffa0fc31e40000
R13: 0000000000000000 R14: ffffa0fd00000000 R15: ffffa0fd7ffce000
FS:  0000000000000000(0000) GS:ffffa0fd7fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f64ffd2b360 CR3: 00000001deaa2000 CR4: 00000000000407e0
Call Trace:
[<ffffffffc05980d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffffa3cbaf9f>] process_one_work+0x17f/0x440
[<ffffffffa3cbc036>] worker_thread+0x126/0x3c0
[<ffffffffa3cbbf10>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffffa3cc2e81>] kthread+0xd1/0xe0
[<ffffffffa3cc2db0>] ? insert_kthread_work+0x40/0x40
[<ffffffffa4376c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa3cc2db0>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d dc dd 2a e4 ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #508809
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc04c5703
Build id: 3.10.0-693.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc04c60bd
Build id: 3.10.0-693.el7.x86_64
0x49d
3
process_one_work
vmlinux 0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64
0x17a
4
worker_thread
vmlinux 0xffffffff810a94e6
Build id: 3.10.0-693.el7.x86_64
0x126
5
? manage_workers.isra.24
vmlinux 0xffffffff810a93c0
Build id: 3.10.0-693.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
0xcf
7
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
8
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
0x58
9
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#19 stuck for 32s! [kworker/19:2:53885]
Modules linked in: tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_REJECT nf_reject_ipv4 tun ebtable_filter ebtables devlink ip6table_filter ip6_tables xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc mvfs(OE) nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache overlay(T) vmw_vsock_vmci_transport vsock sb_edac ppdev edac_core vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr vmw_vmci joydev sg shpchp parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx
drm_kms_helper syscopyarea crct10dif_pclmul crct10dif_common crc32c_intel sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata nfit mptspi scsi_transport_spi libnvdimm serio_raw mptscsih mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 19 PID: 53885 Comm: kworker/19:2 Tainted: G        W  OEL ------------ T 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff881792a61fa0 ti: ffff880878264000 task.ti: ffff880878264000
RIP: 0010:[<ffffffffc04c5703>]  [<ffffffffc04c5703>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0018:ffff880878267d88  EFLAGS: 00000202
RAX: 0000000000000000 RBX: ffff881792a61fa0 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 0000000000bbc7cd
RBP: ffff880878267dc0 R08: ffffffff81911047 R09: ffffea0032885e00
R10: ffffffffc04c8438 R11: 0000000000000000 R12: ffff881792a61fa0
R13: 00000001d6934f78 R14: ffffffff00000000 R15: ffff88183ffd8000
FS:  0000000000000000(0000) GS:ffff8817ddac0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f19a2754c70 CR3: 000000176af5e000 CR4: 00000000001407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff881792a61fa0 0000000000000000 0000000000000000 0000000000000200
0000000000000200 0000000000000000 ffffffffc04c8558 ffff880878267e18
ffffffffc04c60bd ffffffffc04c8438 00000000ffffffff 00000202ddad1b60
Call Trace:
[<ffffffffc04c60bd>] vmballoon_work+0x49d/0x615 [vmw_balloon]
[<ffffffff810a881a>] process_one_work+0x17a/0x440
[<ffffffff810a94e6>] worker_thread+0x126/0x3c0
[<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 04 e5 55 c1 ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #413545
Frame # Function Binary Source or offset Line
1
vmballoon_unlock_batched_page
vmw_balloon 0xffffffffc07164ff
Build id: 3.10.0-1127.19.1.el7.x86_64
0x16f
2
vmballoon_work
vmw_balloon 0xffffffffc0716ec2
Build id: 3.10.0-1127.19.1.el7.x86_64
0x392
3
process_one_work
vmlinux 0xffffffff834be6bf
Build id: 3.10.0-1127.19.1.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffff834bf7d6
Build id: 3.10.0-1127.19.1.el7.x86_64
0x126
5
? manage_workers.isra.26
vmlinux 0xffffffff834bf6b0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffff834c6691
Build id: 3.10.0-1127.19.1.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffff834c65c0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffff83b92d37
Build id: 3.10.0-1127.19.1.el7.x86_64
0x21
9
? insert_kthread_work
vmlinux 0xffffffff834c65c0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 26s! [kworker/3:0:17761]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache vmw_vsock_vmci_transport vsock ppdev iosf_mbi ext4 crc32_pclmul ghash_clmulni_intel mbcache aesni_intel jbd2 lrw gf128mul glue_helper ablk_helper vmw_balloon cryptd pcspkr joydev parport_pc parport snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd soundcore sg i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic
vmwgfx sr_mod cdrom drm_kms_helper ata_generic pata_acpi syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common nfit ahci libahci drm crc32c_intel libnvdimm serio_raw ata_piix e1000 libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 17761 Comm: kworker/3:0 Kdump: loaded Not tainted 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff94478fb55230 ti: ffff9446f8be4000 task.ti: ffff9446f8be4000
RIP: 0010:[<ffffffffc07164ff>]  [<ffffffffc07164ff>] vmballoon_unlock_batched_page+0x16f/0x1e0 [vmw_balloon]
RSP: 0018:ffff9446f8be7d88  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff9449fffda000 RCX: 0000000000000007
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 0000000000525918
RBP: ffff9446f8be7dc0 R08: ffffd9ef854032a0 R09: 0000000000062f58
R10: ffffffffc0719438 R11: 0000000000000002 R12: 0000000200000001
R13: 0000000000000002 R14: ffff9449e96dfd38 R15: ffffd9ef00000002
FS:  0000000000000000(0000) GS:ffff9449e96c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0daed057d0 CR3: 00000002e1996000 CR4: 00000000007607e0
PKRU: 00000000
Call Trace:
[<ffffffffc0716ec2>] vmballoon_work+0x392/0x6ff [vmw_balloon]
[<ffffffff834be6bf>] process_one_work+0x17f/0x440
[<ffffffff834bf7d6>] worker_thread+0x126/0x3c0
[<ffffffff834bf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff834c6691>] kthread+0xd1/0xe0
[<ffffffff834c65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff83b92d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff834c65c0>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 10 f7 92 c3 ba 70 56 00 00 41 83 86 d4 00 00 00 01 b9 07 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <48> 85 c0 41 89 1a 41 b9 01 00 00 00 c7 45 d4 00 00 00 00 0f 85 
Complete report #400641
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc0593673
Build id: 3.10.0-957.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc05940d5
Build id: 3.10.0-957.el7.x86_64
0x5a5
3
process_one_work
vmlinux 0xffffffffb24b9d4f
Build id: 3.10.0-957.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffffb24bade6
Build id: 3.10.0-957.el7.x86_64
0x126
5
? manage_workers.isra.25
vmlinux 0xffffffffb24bacc0
Build id: 3.10.0-957.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffffb24c1c31
Build id: 3.10.0-957.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffffb24c1b60
Build id: 3.10.0-957.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffffb2b74c1d
Build id: 3.10.0-957.el7.x86_64
0x7
9
? insert_kthread_work
vmlinux 0xffffffffb24c1b60
Build id: 3.10.0-957.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [kworker/0:2:52]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmhgfs(OE) vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod iosf_mbi ppdev crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper vmw_balloon cryptd joydev pcspkr snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer sg snd soundcore parport_pc parport vmw_vmci i2c_piix4 ip_tables ext4 mbcache jbd2 sd_mod sr_mod cdrom crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common
crc32c_intel serio_raw vmwgfx ata_generic drm_kms_helper syscopyarea pata_acpi sysfillrect sysimgblt mptspi fb_sys_fops scsi_transport_spi ahci e1000 ttm ata_piix libahci mptscsih nfit drm libata libnvdimm drm_panel_orientation_quirks mptbase
CPU: 0 PID: 52 Comm: kworker/0:2 Tainted: G           OE  ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8c4a35dd30c0 ti: ffff8c4a35f00000 task.ti: ffff8c4a35f00000
RIP: 0010:[<ffffffffc0593673>]  [<ffffffffc0593673>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0018:ffff8c4a35f03d88  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff8c4a35dd30c0 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 00000000000460f0
RBP: ffff8c4a35f03dc0 R08: ffffffffb2e81c99 R09: ffffec32c0171640
R10: ffffffffc0596438 R11: ffffec32c1318180 R12: ffff8c4a35dd30c0
R13: ffff8c4a35179180 R14: ffffffff00000000 R15: ffff8c4a547d9800
FS:  0000000000000000(0000) GS:ffff8c4a50800000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa9a54d4000 CR3: 0000000045eb8000 CR4: 00000000003607f0
Call Trace:
[<ffffffffc05940d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffffb24b9d4f>] process_one_work+0x17f/0x440
[<ffffffffb24bade6>] worker_thread+0x126/0x3c0
[<ffffffffb24bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffffb24c1c31>] kthread+0xd1/0xe0
[<ffffffffb24c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffffb2b74c1d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffb24c1b60>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 1c 1b ab f2 ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #395263
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc06e5673
Build id: 3.10.0-1062.18.1.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc06e60d5
Build id: 3.10.0-1062.18.1.el7.x86_64
0x5a5
3
process_one_work
vmlinux 0xffffffff830be34f
Build id: 3.10.0-1062.18.1.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffff830bf466
Build id: 3.10.0-1062.18.1.el7.x86_64
0x126
5
? manage_workers.isra.26
vmlinux 0xffffffff830bf340
Build id: 3.10.0-1062.18.1.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffff830c6321
Build id: 3.10.0-1062.18.1.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffff830c6250
Build id: 3.10.0-1062.18.1.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffff8378dd37
Build id: 3.10.0-1062.18.1.el7.x86_64
0x21
9
? insert_kthread_work
vmlinux 0xffffffff830c6250
Build id: 3.10.0-1062.18.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 27s! [kworker/6:2:27956]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13109(E) falcon_lsm_pinned_13005(E) falcon_lsm_pinned_12905(E) binfmt_misc cmac arc4 md4 nls_utf8 cifs ccm dns_resolver ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_comment xt_mark iptable_filter iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_netlink nfnetlink iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi overlay(T) vmw_vsock_vmci_transport vsock falcon_lsm_pinned_12803(E) ext4 sb_edac mbcache iosf_mbi jbd2 crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper pcc_cpufreq cryptd ppdev vmw_balloon pcspkr joydev parport_pc parport vmw_vmci sg i2c_piix4 br_netfilter bridge stp
llc nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nf_conntrack auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif ata_generic crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi scsi_transport_spi nfit crct10dif_pclmul libata crct10dif_common crc32c_intel mptscsih libnvdimm serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal]
CPU: 6 PID: 27956 Comm: kworker/6:2 Kdump: loaded Tainted: P            EL ------------ T 3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff88fde1391070 ti: ffff89033ecbc000 task.ti: ffff89033ecbc000
RIP: 0010:[<ffffffffc06e5673>]  [<ffffffffc06e5673>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0018:ffff89033ecbfd88  EFLAGS: 00000202
RAX: 0000000000000000 RBX: ffff88fde1391070 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 0000000000ff81d6
RBP: ffff89033ecbfdc0 R08: ffffffff83a8b1ff R09: ffffc4fed2898700
R10: ffffffffc06e8438 R11: ffffffffffffffff R12: ffff89037ffdb038
R13: ffff890300000000 R14: ffff89037ffda000 R15: ffffffff831c8366
FS:  0000000000000000(0000) GS:ffff89033fb80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000eb65d000 CR3: 000000185775a000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc06e60d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffff830be34f>] process_one_work+0x17f/0x440
[<ffffffff830bf466>] worker_thread+0x126/0x3c0
[<ffffffff830bf340>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff830c6321>] kthread+0xd1/0xe0
[<ffffffff830c6250>] ? insert_kthread_work+0x40/0x40
[<ffffffff8378dd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff830c6250>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 5c ff 55 c3 ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #367536
Frame # Function Binary Source or offset Line
1
vmballoon_unlock_batched_page
vmw_balloon 0xffffffffc07414ff
Build id: 3.10.0-1062.el7.x86_64
0x16f
2
? __list_del_entry
vmlinux 0xffffffffb119f092
Build id: 3.10.0-1062.el7.x86_64
0x42
3
vmballoon_work
vmw_balloon 0xffffffffc0741ec2
Build id: 3.10.0-1062.el7.x86_64
0x392
4
process_one_work
vmlinux 0xffffffffb0ebd0ff
Build id: 3.10.0-1062.el7.x86_64
0x17f
5
worker_thread
vmlinux 0xffffffffb0ebe216
Build id: 3.10.0-1062.el7.x86_64
0x126
6
? manage_workers.isra.26
vmlinux 0xffffffffb0ebe0f0
Build id: 3.10.0-1062.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffffb0ec50d1
Build id: 3.10.0-1062.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffffb0ec5000
Build id: 3.10.0-1062.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffffb158bd37
Build id: 3.10.0-1062.el7.x86_64
0x21
10
? insert_kthread_work
vmlinux 0xffffffffb0ec5000
Build id: 3.10.0-1062.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 21s! [kworker/3:1:22932]
Modules linked in: nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ext4 mbcache jbd2 snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq ppdev vmw_balloon snd_seq_device snd_pcm snd_timer snd soundcore sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul vmw_vmci pcspkr glue_helper joydev ablk_helper cryptd sg i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic
ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit libnvdimm drm ata_piix libata mptspi crct10dif_pclmul crct10dif_common scsi_transport_spi mptscsih crc32c_intel e1000 mptbase serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 22932 Comm: kworker/3:1 Kdump: loaded Tainted: G             L ------------ T 3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8a57b98562a0 ti: ffff8a5a50fac000 task.ti: ffff8a5a50fac000
RIP: 0010:[<ffffffffc07414ff>]  [<ffffffffc07414ff>] vmballoon_unlock_batched_page+0x16f/0x1e0 [vmw_balloon]
RSP: 0018:ffff8a5a50fafd88  EFLAGS: 00000202
RAX: 0000000000000000 RBX: ffff8a5a50fafd50 RCX: 0000000000000007
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 0000000000423f9e
RBP: ffff8a5a50fafdc0 R08: ffffd79dca44a160 R09: 0000000000043a67
R10: ffffffffc0744438 R11: 0000000000000001 R12: ffff8a5a6d6dacc0
R13: ffff8a57b9856308 R14: ffffffffb0ee042e R15: ffff8a5a50fafd00
FS:  0000000000000000(0000) GS:ffff8a5a6d6c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fed7fea7000 CR3: 000000043f7be000 CR4: 00000000001607e0
Call Trace:
[<ffffffffb119f092>] ? __list_del_entry+0x42/0xd0
[<ffffffffc0741ec2>] vmballoon_work+0x392/0x6ff [vmw_balloon]
[<ffffffffb0ebd0ff>] process_one_work+0x17f/0x440
[<ffffffffb0ebe216>] worker_thread+0x126/0x3c0
[<ffffffffb0ebe0f0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffb0ec50d1>] kthread+0xd1/0xe0
[<ffffffffb0ec5000>] ? insert_kthread_work+0x40/0x40
[<ffffffffb158bd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb0ec5000>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d d0 40 30 f1 ba 70 56 00 00 41 83 86 d4 00 00 00 01 b9 07 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <48> 85 c0 41 89 1a 41 b9 01 00 00 00 c7 45 d4 00 00 00 00 0f 85 
Complete report #259147
Frame # Function Binary Source or offset Line
1
__list_add
vmlinux 0xffffffff86594f13
Build id: 3.10.0-957.5.1.el7.x86_64
0x33
2
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc06c3747
Build id: 3.10.0-957.5.1.el7.x86_64
0x1d7
3
vmballoon_work
vmw_balloon 0xffffffffc06c40d5
Build id: 3.10.0-957.5.1.el7.x86_64
0x5a5
4
process_one_work
vmlinux 0xffffffff862b9d8f
Build id: 3.10.0-957.5.1.el7.x86_64
0x17f
5
worker_thread
vmlinux 0xffffffff862bae26
Build id: 3.10.0-957.5.1.el7.x86_64
0x126
6
? manage_workers.isra.25
vmlinux 0xffffffff862bad00
Build id: 3.10.0-957.5.1.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffff862c1c71
Build id: 3.10.0-957.5.1.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffff862c1ba0
Build id: 3.10.0-957.5.1.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffff86974c37
Build id: 3.10.0-957.5.1.el7.x86_64
0x21
10
? insert_kthread_work
vmlinux 0xffffffff862c1ba0
Build id: 3.10.0-957.5.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [kworker/0:2:25213]
Modules linked in: binfmt_misc xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock ppdev vmw_balloon coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmwgfx floppy drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix
mptspi libata scsi_transport_spi vmxnet3 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 25213 Comm: kworker/0:2 Kdump: loaded Tainted: G             L ------------   3.10.0-957.5.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff894689d0e180 ti: ffff894698eec000 task.ti: ffff894698eec000
RIP: 0010:[<ffffffff86594f13>]  [<ffffffff86594f13>] __list_add+0x33/0xc0
RSP: 0018:ffff894698eefd60  EFLAGS: 00010287
RAX: 0000000000000001 RBX: ffff894e00000000 RCX: 00000000000000e6
RDX: ffffe568801e4ce0 RSI: ffffffffc06c63e0 RDI: ffffe56882ed41e0
RBP: ffff894698eefd78 R08: ffffe568801e4ce0 R09: ffffe5688d1417c0
R10: ffffffffc06c6438 R11: fffffffffffffff8 R12: ffffffff863c0eb6
R13: ffff894698eefd78 R14: 0000000000020202 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff894ebfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f71ea70070b CR3: 00000008136fa000 CR4: 00000000000007f0
Call Trace:
[<ffffffffc06c3747>] vmballoon_lock_batched_page+0x1d7/0x230 [vmw_balloon]
[<ffffffffc06c40d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffff862b9d8f>] process_one_work+0x17f/0x440
[<ffffffff862bae26>] worker_thread+0x126/0x3c0
[<ffffffff862bad00>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff862c1c71>] kthread+0xd1/0xe0
[<ffffffff862c1ba0>] ? insert_kthread_work+0x40/0x40
[<ffffffff86974c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff862c1ba0>] ? insert_kthread_work+0x40/0x40
Code: f5 41 54 49 89 d4 53 4c 8b 42 08 48 89 fb 49 39 f0 75 2a 4d 8b 45 00 4d 39 c4 75 68 4c 39 e3 74 3e 4c 39 eb 74 39 49 89 5c 24 08 <4c> 89 6b 08 4c 89 23 49 89 5d 00 5b 41 5c 41 5d 5d c3 49 89 d1 
Complete report #220364
Frame # Function Binary Source or offset Line
1
vmballoon_unlock_batched_page
vmw_balloon 0xffffffffc07994ff
Build id: 3.10.0-957.10.1.el7.x86_64
0x16f
2
vmballoon_work
vmw_balloon 0xffffffffc0799ec2
Build id: 3.10.0-957.10.1.el7.x86_64
0x392
3
process_one_work
vmlinux 0xffffffffa2ab9d8f
Build id: 3.10.0-957.10.1.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffffa2abae26
Build id: 3.10.0-957.10.1.el7.x86_64
0x126
5
? manage_workers.isra.25
vmlinux 0xffffffffa2abad00
Build id: 3.10.0-957.10.1.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffffa2ac1c71
Build id: 3.10.0-957.10.1.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffffa2ac1ba0
Build id: 3.10.0-957.10.1.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffffa3175c37
Build id: 3.10.0-957.10.1.el7.x86_64
0x21
9
? insert_kthread_work
vmlinux 0xffffffffa2ac1ba0
Build id: 3.10.0-957.10.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [kworker/1:2:28106]
Modules linked in: tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr sg vmw_balloon joydev nfit parport_pc parport libnvdimm i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops crct10dif_pclmul crct10dif_common ttm crc32c_intel serio_raw ata_piix drm mptspi e1000
libata scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 28106 Comm: kworker/1:2 Kdump: loaded Not tainted 3.10.0-957.10.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9a79eb6be180 ti: ffff9a7995394000 task.ti: ffff9a7995394000
RIP: 0010:[<ffffffffc07994ff>]  [<ffffffffc07994ff>] vmballoon_unlock_batched_page+0x16f/0x1e0 [vmw_balloon]
RSP: 0018:ffff9a7995397d88  EFLAGS: 00000202
RAX: 0000000000000000 RBX: ffff9a79fffd9800 RCX: 0000000000000007
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 000000000003544c
RBP: ffff9a7995397dc0 R08: ffffdc6a42a91c60 R09: 0000000000139581
R10: ffffffffc079c438 R11: 0000000000000001 R12: 0000000000000001
R13: 0000000000000000 R14: ffff9a79f7c5f6b0 R15: ffffdc6a00000004
FS:  0000000000000000(0000) GS:ffff9a79f7c40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000006ca8ac6bc CR3: 00000003dbe30000 CR4: 00000000000407e0
Call Trace:
[<ffffffffc0799ec2>] vmballoon_work+0x392/0x6ff [vmw_balloon]
[<ffffffffa2ab9d8f>] process_one_work+0x17f/0x440
[<ffffffffa2abae26>] worker_thread+0x126/0x3c0
[<ffffffffa2abad00>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffffa2ac1c71>] kthread+0xd1/0xe0
[<ffffffffa2ac1ba0>] ? insert_kthread_work+0x40/0x40
[<ffffffffa3175c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa2ac1ba0>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 90 bc ea e2 ba 70 56 00 00 41 83 86 d4 00 00 00 01 b9 07 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <48> 85 c0 41 89 1a 41 b9 01 00 00 00 c7 45 d4 00 00 00 00 0f 85 
Complete report #155399
Frame # Function Binary Source or offset Line
1
__list_add
vmlinux 0xffffffff9a9a4c73
Build id: 3.10.0-1127.19.1.el7.x86_64
0x33
2
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc0655747
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1d7
3
vmballoon_work
vmw_balloon 0xffffffffc06560d5
Build id: 3.10.0-1127.19.1.el7.x86_64
0x5a5
4
process_one_work
vmlinux 0xffffffff9a6be6bf
Build id: 3.10.0-1127.19.1.el7.x86_64
0x17f
5
worker_thread
vmlinux 0xffffffff9a6bf7d6
Build id: 3.10.0-1127.19.1.el7.x86_64
0x126
6
? manage_workers.isra.26
vmlinux 0xffffffff9a6bf6b0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffff9a6c6691
Build id: 3.10.0-1127.19.1.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffff9a6c65c0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffff9ad92d37
Build id: 3.10.0-1127.19.1.el7.x86_64
0x21
10
? insert_kthread_work
vmlinux 0xffffffff9a6c65c0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [kworker/0:2:31090]
NMI watchdog: BUG: soft lockup - CPU#15 stuck for 21s! [kworker/15:2:30631]
Modules linked in: binfmt_misc vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper pcspkr cryptd ppdev vmw_balloon joydev sg parport_pc parport vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi scsi_transport_spi mptscsih crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw mptbase vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 15 PID: 30631 Comm: kworker/15:2 Kdump: loaded Tainted: G             L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff98ecb05f3150 ti: ffff98e9c90e0000 task.ti: ffff98e9c90e0000
RIP: 0010:[<ffffffff9a9a4c73>]  [<ffffffff9a9a4c73>] __list_add+0x33/0xc0
RSP: 0018:ffff98e9c90e3d60  EFLAGS: 00010287
RAX: 0000000000000001 RBX: ffff98ecbffda000 RCX: 000000000000003d
RDX: ffffee75941c1ee0 RSI: ffffffffc06583e0 RDI: ffffee75935486e0
RBP: ffff98e9c90e3d78 R08: ffffee75941c1ee0 R09: ffffee758ccc13c0
R10: ffffffffc0658438 R11: ffffffffffffff83 R12: ffff98e9c90e3d78
R13: 0000000000020202 R14: 0000000000000000 R15: ffff98ecbffda000
FS:  0000000000000000(0000) GS:ffff98ecbfdc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc21618c504 CR3: 0000000632ba2000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc0655747>] vmballoon_lock_batched_page+0x1d7/0x230 [vmw_balloon]
[<ffffffffc06560d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffff9a6be6bf>] process_one_work+0x17f/0x440
[<ffffffff9a6bf7d6>] worker_thread+0x126/0x3c0
[<ffffffff9a6bf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff9a6c6691>] kthread+0xd1/0xe0
[<ffffffff9a6c65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff9ad92d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9a6c65c0>] ? insert_kthread_work+0x40/0x40
Code: f5 41 54 49 89 d4 53 4c 8b 42 08 48 89 fb 49 39 f0 75 2a 4d 8b 45 00 4d 39 c4 75 68 4c 39 e3 74 3e 4c 39 eb 74 39 49 89 5c 24 08 <4c> 89 6b 08 4c 89 23 49 89 5d 00 5b 41 5c 41 5d 5d c3 49 89 d1 
Complete report #100411
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc0431703
Build id: 3.10.0-693.21.1.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc04320d9
Build id: 3.10.0-693.21.1.el7.x86_64
0x4b9
3
process_one_work
vmlinux 0xffffffff810abe2f
Build id: 3.10.0-693.21.1.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffff810acaf6
Build id: 3.10.0-693.21.1.el7.x86_64
0x126
5
? manage_workers.isra.24
vmlinux 0xffffffff810ac9d0
Build id: 3.10.0-693.21.1.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffff810b4031
Build id: 3.10.0-693.21.1.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffff810b3f60
Build id: 3.10.0-693.21.1.el7.x86_64
0x40
8
ret_from_fork
vmlinux 0xffffffff816c0577
Build id: 3.10.0-693.21.1.el7.x86_64
0x77
9
? insert_kthread_work
vmlinux 0xffffffff810b3f60
Build id: 3.10.0-693.21.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 26s! [kworker/6:2:45540]
Modules linked in: binfmt_misc ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop vmw_vsock_vmci_transport vsock coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr joydev sg vmw_vmci shpchp i2c_piix4 parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel mptspi scsi_transport_spi
ata_piix mptscsih libata serio_raw e1000 mptbase i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 6 PID: 45540 Comm: kworker/6:2 Tainted: G             L ------------   3.10.0-693.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8802320e3f40 ti: ffff8801f6ebc000 task.ti: ffff8801f6ebc000
RIP: 0010:[<ffffffffc0431703>]  [<ffffffffc0431703>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0018:ffff8801f6ebfd88  EFLAGS: 00000202
RAX: 0000000000000000 RBX: ffff8802320e3f40 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 0000000000229a4c
RBP: ffff8801f6ebfdc0 R08: ffffffff81920f0f R09: ffffea0005790400
R10: ffffffffc0434438 R11: fffffffffffffff8 R12: ffff8802320e3f40
R13: ffff88023ffd8028 R14: ffff880200000000 R15: ffff88023ffd7000
FS:  0000000000000000(0000) GS:ffff880236780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f576b6f9000 CR3: 000000021f6da000 CR4: 00000000000007e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffc04320d9>] vmballoon_work+0x4b9/0x63d [vmw_balloon]
[<ffffffff810abe2f>] process_one_work+0x17f/0x440
[<ffffffff810acaf6>] worker_thread+0x126/0x3c0
[<ffffffff810ac9d0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b4031>] kthread+0xd1/0xe0
[<ffffffff810b3f60>] ? insert_kthread_work+0x40/0x40
[<ffffffff816c0577>] ret_from_fork+0x77/0xb0
[<ffffffff810b3f60>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 44 35 60 c1 ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #81894
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc0548673
Build id: 3.10.0-1160.15.2.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc05490d5
Build id: 3.10.0-1160.15.2.el7.x86_64
0x5a5
3
process_one_work
vmlinux 0xffffffffa66bde3f
Build id: 3.10.0-1160.15.2.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffffa66bef56
Build id: 3.10.0-1160.15.2.el7.x86_64
0x126
5
? manage_workers.isra.26
vmlinux 0xffffffffa66bee30
Build id: 3.10.0-1160.15.2.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffffa66c5e11
Build id: 3.10.0-1160.15.2.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffffa66c5d40
Build id: 3.10.0-1160.15.2.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffffa6d94df7
Build id: 3.10.0-1160.15.2.el7.x86_64
0x21
9
? insert_kthread_work
vmlinux 0xffffffffa66c5d40
Build id: 3.10.0-1160.15.2.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/2:2:418]
Modules linked in: tcp_lp rfcomm xt_CHECKSUM tun devlink ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_addrtype br_netfilter vmhgfs(OE) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay(T) bnep vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ext4 mbcache jbd2 ppdev btusb vmw_balloon coretemp snd_ens1371 btrtl btbcm btintel snd_rawmidi iosf_mbi crc32_pclmul bluetooth ghash_clmulni_intel
snd_ac97_codec aesni_intel ac97_bus lrw snd_seq gf128mul glue_helper ablk_helper cryptd snd_seq_device snd_pcm rfkill sg joydev pcspkr vmw_vmci snd_timer snd i2c_piix4 soundcore parport_pc parport ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nfit ata_piix e1000 libata crct10dif_pclmul crct10dif_common mptspi scsi_transport_spi mptscsih libnvdimm mptbase crc32c_intel serio_raw drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 418 Comm: kworker/2:2 Kdump: loaded Tainted: G           OE  ------------ T 3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff9e3fd2996300 ti: ffff9e3fd2a8c000 task.ti: ffff9e3fd2a8c000
RIP: 0010:[<ffffffffc0548673>]  [<ffffffffc0548673>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0018:ffff9e3fd2a8fd88  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff9e3fd2996300 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 00000000001703c0
RBP: ffff9e3fd2a8fdc0 R08: ffffffffa708e567 R09: ffffe5ad80069380
R10: ffffffffc054b438 R11: fffffffffffffffa R12: ffff9e3fecbdb028
R13: 0000000000000000 R14: ffff9e3fecbda000 R15: ffffffffa67c8c16
FS:  0000000000000000(0000) GS:ffff9e3fd7680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000013cd8b8 CR3: 00000002a1e10000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc05490d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffffa66bde3f>] process_one_work+0x17f/0x440
[<ffffffffa66bef56>] worker_thread+0x126/0x3c0
[<ffffffffa66bee30>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffa66c5e11>] kthread+0xd1/0xe0
[<ffffffffa66c5d40>] ? insert_kthread_work+0x40/0x40
[<ffffffffa6d94df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa66c5d40>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 9c d6 cf e6 ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #72180
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc0763703
Build id: 3.10.0-862.9.1.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc07640d9
Build id: 3.10.0-862.9.1.el7.x86_64
0x4b9
3
process_one_work
vmlinux 0xffffffff952b35ef
Build id: 3.10.0-862.9.1.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffff952b4686
Build id: 3.10.0-862.9.1.el7.x86_64
0x126
5
? manage_workers.isra.24
vmlinux 0xffffffff952b4560
Build id: 3.10.0-862.9.1.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffff952bb621
Build id: 3.10.0-862.9.1.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffff952bb550
Build id: 3.10.0-862.9.1.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffff959205dd
Build id: 3.10.0-862.9.1.el7.x86_64
0x7
9
? insert_kthread_work
vmlinux 0xffffffff952bb550
Build id: 3.10.0-862.9.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [kworker/5:2:17716]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 edac_mce_amd ppdev vmw_balloon pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 shpchp binfmt_misc ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic crct10dif_common
ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi libata scsi_transport_spi mptscsih e1000 serio_raw mptbase i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 17716 Comm: kworker/5:2 Kdump: loaded Tainted: G             L ------------   3.10.0-862.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff963cc0276eb0 ti: ffff963cce6e4000 task.ti: ffff963cce6e4000
RIP: 0010:[<ffffffffc0763703>]  [<ffffffffc0763703>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0018:ffff963cce6e7d88  EFLAGS: 00000216
RAX: 0000000000000000 RBX: 0000014100000000 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 0000000000813bb1
RBP: ffff963cce6e7dc0 R08: ffffffff95c75a4f R09: fffffe274fd17c40
R10: ffffffffc0766438 R11: 0000000000000246 R12: ffff963cc0276eb0
R13: ffff963cc0276eb0 R14: 0000000000000001 R15: ffff963cc0276eb0
FS:  00007f63a5843280(0000) GS:ffff963cffd40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f75c62c5000 CR3: 0000000810a40000 CR4: 00000000000007e0
Call Trace:
[<ffffffffc07640d9>] vmballoon_work+0x4b9/0x63d [vmw_balloon]
[<ffffffff952b35ef>] process_one_work+0x17f/0x440
[<ffffffff952b4686>] worker_thread+0x126/0x3c0
[<ffffffff952b4560>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff952bb621>] kthread+0xd1/0xe0
[<ffffffff952bb550>] ? insert_kthread_work+0x40/0x40
[<ffffffff959205dd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff952bb550>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 4c dd 6d d5 ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #19899
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc0740673
Build id: 3.10.0-957.27.2.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc07410d5
Build id: 3.10.0-957.27.2.el7.x86_64
0x5a5
3
process_one_work
vmlinux 0xffffffff9babaf9f
Build id: 3.10.0-957.27.2.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffff9babc036
Build id: 3.10.0-957.27.2.el7.x86_64
0x126
5
? manage_workers.isra.25
vmlinux 0xffffffff9babbf10
Build id: 3.10.0-957.27.2.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffff9bac2e81
Build id: 3.10.0-957.27.2.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffff9bac2db0
Build id: 3.10.0-957.27.2.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffff9c176c37
Build id: 3.10.0-957.27.2.el7.x86_64
0x21
9
? insert_kthread_work
vmlinux 0xffffffff9bac2db0
Build id: 3.10.0-957.27.2.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 25s! [kworker/4:0:16196]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nf_conntrack_netbios_ns nf_conntrack_broadcast xt_nat xt_mark ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi ppdev crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr sg joydev parport_pc i2c_piix4 parport vmw_vmci
ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptsas ata_piix scsi_transport_sas crct10dif_pclmul crct10dif_common mptscsih libata serio_raw mptbase crc32c_intel vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 4 PID: 16196 Comm: kworker/4:0 Kdump: loaded Tainted: G             L ------------   3.10.0-957.27.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8e5ab9c230c0 ti: ffff8e5a85004000 task.ti: ffff8e5a85004000
RIP: 0010:[<ffffffffc0740673>]  [<ffffffffc0740673>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0018:ffff8e5a85007d88  EFLAGS: 00000202
RAX: 0000000000000000 RBX: ffff8e5ab9c230c0 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 0000000000424f13
RBP: ffff8e5a85007dc0 R08: ffffffff9c482979 R09: ffffbf234b314700
R10: ffffffffc0743438 R11: fffffffffffffff8 R12: ffff8e5ab9c230c0
R13: ffff8e5d7ffcf028 R14: ffff8e5d00000000 R15: ffff8e5d7ffce000
FS:  0000000000000000(0000) GS:ffff8e5d7fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9b28f86000 CR3: 00000002a0610000 CR4: 00000000000407e0
Call Trace:
[<ffffffffc07410d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffff9babaf9f>] process_one_work+0x17f/0x440
[<ffffffff9babc036>] worker_thread+0x126/0x3c0
[<ffffffff9babbf10>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff9bac2e81>] kthread+0xd1/0xe0
[<ffffffff9bac2db0>] ? insert_kthread_work+0x40/0x40
[<ffffffff9c176c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9bac2db0>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d dc 4d f0 db ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #15311
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc0485673
Build id: 3.10.0-1062.9.1.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc04860d5
Build id: 3.10.0-1062.9.1.el7.x86_64
0x5a5
3
process_one_work
vmlinux 0xffffffffb9abe21f
Build id: 3.10.0-1062.9.1.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffffb9abf336
Build id: 3.10.0-1062.9.1.el7.x86_64
0x126
5
? manage_workers.isra.26
vmlinux 0xffffffffb9abf210
Build id: 3.10.0-1062.9.1.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffffb9ac61f1
Build id: 3.10.0-1062.9.1.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffffb9ac6120
Build id: 3.10.0-1062.9.1.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffffba18dd37
Build id: 3.10.0-1062.9.1.el7.x86_64
0x21
9
? insert_kthread_work
vmlinux 0xffffffffb9ac6120
Build id: 3.10.0-1062.9.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [kworker/1:1:27961]
Modules linked in: vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper vmw_balloon ablk_helper e1000e cryptd pcspkr ptp sg joydev pps_core parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod crc_t10dif ahci drm crct10dif_generic libahci ata_piix nfit libata libnvdimm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 27961 Comm: kworker/1:1 Kdump: loaded Tainted: G        W    L ------------   3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/03/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8cec5330b150 ti: ffff8cea82fe8000 task.ti: ffff8cea82fe8000
RIP: 0010:[<ffffffffc0485673>]  [<ffffffffc0485673>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0018:ffff8cea82febd88  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff8cec7ffd9008 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 00000000001f35be
RBP: ffff8cea82febdc0 R08: ffffffffba48afaf R09: fffff19c061e6f00
R10: ffffffffc0488438 R11: fffffffffffffff8 R12: ffff8cec5330b150
R13: 0000000000000001 R14: ffff8cec5330b150 R15: ffff8cec5330b150
FS:  0000000000000000(0000) GS:ffff8cec7fc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff71296d000 CR3: 00000000b9832000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc04860d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffffb9abe21f>] process_one_work+0x17f/0x440
[<ffffffffb9abf336>] worker_thread+0x126/0x3c0
[<ffffffffb9abf210>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffb9ac61f1>] kthread+0xd1/0xe0
[<ffffffffb9ac6120>] ? insert_kthread_work+0x40/0x40
[<ffffffffba18dd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb9ac6120>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 5c ff 1b fa ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #6591
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc04c6703
Build id: 3.10.0-862.6.3.el7.x86_64
0x103
2
vmballoon_work
vmw_balloon 0xffffffffc04c70d9
Build id: 3.10.0-862.6.3.el7.x86_64
0x4b9
3
process_one_work
vmlinux 0xffffffff994b35ef
Build id: 3.10.0-862.6.3.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffff994b4686
Build id: 3.10.0-862.6.3.el7.x86_64
0x126
5
? manage_workers.isra.24
vmlinux 0xffffffff994b4560
Build id: 3.10.0-862.6.3.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffff994bb621
Build id: 3.10.0-862.6.3.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffff994bb550
Build id: 3.10.0-862.6.3.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffff99b205f7
Build id: 3.10.0-862.6.3.el7.x86_64
0x21
9
? insert_kthread_work
vmlinux 0xffffffff994bb550
Build id: 3.10.0-862.6.3.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 24s! [kworker/2:2:13343]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr joydev sg parport_pc parport shpchp i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix crct10dif_pclmul crct10dif_common mptspi drm libata crc32c_intel
scsi_transport_spi e1000 mptscsih serio_raw mptbase i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 13343 Comm: kworker/2:2 Kdump: loaded Tainted: G        W      ------------   3.10.0-862.6.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff95ceb506dee0 ti: ffff95ce931cc000 task.ti: ffff95ce931cc000
RIP: 0010:[<ffffffffc04c6703>]  [<ffffffffc04c6703>] vmballoon_lock_batched_page+0x103/0x230 [vmw_balloon]
RSP: 0000:ffff95ce931cfd88  EFLAGS: 00000206
RAX: 0000000000000000 RBX: 0000004100000000 RCX: 0000000000000006
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 000000000001da9a
RBP: ffff95ce931cfdc0 R08: ffffffff99e75a4f R09: ffffe71208a7a300
R10: ffffffffc04c9438 R11: 0000000000000000 R12: ffff95ceb506dee0
R13: ffff95ceb506dee0 R14: 0000000000000001 R15: ffff95ceb506dee0
FS:  0000000000000000(0000) GS:ffff95ceb8e00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0c81ccfff6 CR3: 00000003d8e0e000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc04c70d9>] vmballoon_work+0x4b9/0x63d [vmw_balloon]
[<ffffffff994b35ef>] process_one_work+0x17f/0x440
[<ffffffff994b4686>] worker_thread+0x126/0x3c0
[<ffffffff994b4560>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff994bb621>] kthread+0xd1/0xe0
[<ffffffff994bb550>] ? insert_kthread_work+0x40/0x40
[<ffffffff99b205f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff994bb550>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 4c ad b7 d9 ba 70 56 00 00 41 83 87 c4 00 00 00 01 b9 06 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <45> 31 ed 48 85 c0 41 89 1a b9 01 00 00 00 0f 85 54 ff ff ff 45 
Complete report #2033
Frame # Function Binary Source or offset Line
1
vmballoon_lock_batched_page
vmw_balloon 0xffffffffc04c85c4
Build id: 3.10.0-1127.13.1.el7.x86_64
0x54
2
vmballoon_work
vmw_balloon 0xffffffffc04c90d5
Build id: 3.10.0-1127.13.1.el7.x86_64
0x5a5
3
process_one_work
vmlinux 0xffffffffb46be6bf
Build id: 3.10.0-1127.13.1.el7.x86_64
0x17f
4
worker_thread
vmlinux 0xffffffffb46bf7d6
Build id: 3.10.0-1127.13.1.el7.x86_64
0x126
5
? manage_workers.isra.26
vmlinux 0xffffffffb46bf6b0
Build id: 3.10.0-1127.13.1.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffffb46c6691
Build id: 3.10.0-1127.13.1.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffffb46c65c0
Build id: 3.10.0-1127.13.1.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffffb4d92d37
Build id: 3.10.0-1127.13.1.el7.x86_64
0x21
9
? insert_kthread_work
vmlinux 0xffffffffb46c65c0
Build id: 3.10.0-1127.13.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/0:0:7531]
Modules linked in: sunrpc iosf_mbi crc32_pclmul vmw_balloon ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg pcspkr joydev vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm ata_piix serio_raw libata mptspi scsi_transport_spi mptscsih mptbase vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 7531 Comm: kworker/0:0 Kdump: loaded Not tainted 3.10.0-1127.13.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable vmballoon_work [vmw_balloon]
task: ffff8cb849fd3150 ti: ffff8cbb9b424000 task.ti: ffff8cbb9b424000
RIP: 0010:[<ffffffffc04c85c4>]  [<ffffffffc04c85c4>] vmballoon_lock_batched_page+0x54/0x230 [vmw_balloon]
RSP: 0018:ffff8cbb9b427d88  EFLAGS: 00000202
RAX: 0000000000000000 RBX: ffff8cb849fd3150 RCX: 0000000000000008
RDX: 0000000000005670 RSI: 0000000000000200 RDI: 000000000081b591
RBP: ffff8cbb9b427dc0 R08: ffffffffb508d4df R09: ffffc8bf4b528000
R10: ffffffffc04cb438 R11: fffffffffffffffa R12: ffff8cbbbffbf028
R13: 0000000000000000 R14: ffff8cbbbffbe000 R15: ffffffffb47c8ed6
FS:  0000000000000000(0000) GS:ffff8cbb9e600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f93dcdc7008 CR3: 000000016bc10000 CR4: 00000000001607f0
Call Trace:
[<ffffffffc04c90d5>] vmballoon_work+0x5a5/0x6ff [vmw_balloon]
[<ffffffffb46be6bf>] process_one_work+0x17f/0x440
[<ffffffffb46bf7d6>] worker_thread+0x126/0x3c0
[<ffffffffb46bf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffb46c6691>] kthread+0xd1/0xe0
[<ffffffffb46c65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb4d92d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb46c65c0>] ? insert_kthread_work+0x40/0x40
Code: bf 80 00 00 00 48 2b 3d 4b d6 d7 f4 ba 70 56 00 00 41 83 87 c8 00 00 00 01 b9 08 00 00 00 b8 6f 6d 6c 45 48 c1 ff 06 48 89 fb ed <48> 85 c0 41 89 1a b9 00 02 00 00 41 bd 01 00 00 00 0f 84 ac 00