NMI watchdog: BUG: soft lockup - CPU#1 stuck for 30s! [kworker/1:1:31991]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter tun bridge stp llc nfsv3 nfs_acl nfs lockd grace fscache vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr joydev vmw_balloon sg i2c_piix4 parport_pc parport vmw_vmci auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ahci ttm sd_mod nfit crc_t10dif crct10dif_generic libahci libnvdimm
drm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel libata serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks fuse
CPU: 1 PID: 31991 Comm: kworker/1:1 Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.53.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
Workqueue: events vmw_fence_work_func [vmwgfx]
task: ffff99de9dbe5280 ti: ffff99de031d4000 task.ti: ffff99de031d4000
RIP: 0010:[<ffffffffc03684c6>]  [<ffffffffc03684c6>] vmw_generic_waiter_remove+0x66/0x90 [vmwgfx]
RSP: 0018:ffff99de031d7d80  EFLAGS: 00000246
RAX: 0000000000000021 RBX: ffff99de031d7d28 RCX: ffff99df09933000
RDX: 0000000000001070 RSI: 0000000000000004 RDI: ffff99e0b41c68b0
RBP: ffff99de031d7da0 R08: ffff99e0b053d6f0 R09: 987cd89154b3d6e8
R10: 987cd89154b3d6e8 R11: ffff99de03740700 R12: ffffffff8d8e482c
R13: ffff99de031d7d28 R14: ffff99de014a0010 R15: 0000000000100000
FS:  0000000000000000(0000) GS:ffff99e0bfc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007faf1fe95000 CR3: 000000028ddd0000 CR4: 00000000007607e0
PKRU: 00000000
Call Trace:
[<ffffffffc036856a>] vmw_goal_waiter_remove+0x1a/0x20 [vmwgfx]
[<ffffffffc036a6d0>] vmw_fence_work_func+0x120/0x150 [vmwgfx]
[<ffffffff8d8bde8f>] process_one_work+0x17f/0x440
[<ffffffff8d8befa6>] worker_thread+0x126/0x3c0
[<ffffffff8d8bee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff8d8c5e61>] kthread+0xd1/0xe0
[<ffffffff8d8c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffff8df95ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff8d8c5d90>] ? insert_kthread_work+0x40/0x40
Code: 0c 00 00 41 f7 d6 45 21 f5 4c 8d b3 b0 08 00 00 44 89 ab 30 0c 00 00 4c 89 f7 e8 06 36 c2 cd 8b 93 50 08 00 00 b8 21 00 00 00 ef <83> c2 01 44 89 e8 ef 4c 89 f7 c6 07 00 0f 1f 40 00 4c 89 e7 e8 

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 67s! [kworker/3:32:7197]
Modules linked in: tcp_lp devlink tun cmac rpcsec_gss_krb5 arc4 auth_rpcgss nfsv4 md4 nls_utf8 nfs cifs lockd grace fscache ccm dns_resolver ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw ip_set ebtable_filter ebtables ip6table_filter ip6_tables vmw_vsock_vmci_transport vsock ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat xt_CHECKSUM iptable_mangle iptable_security iptable_raw ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter sunrpc snd_seq_midi snd_seq_midi_event kvm_amd kvm snd_ens1371 irqbypass snd_rawmidi crc32_pclmul snd_ac97_codec ghash_clmulni_intel ppdev ac97_bus snd_seq
aesni_intel snd_seq_device vmw_balloon lrw snd_pcm gf128mul glue_helper ablk_helper cryptd sg snd_timer snd joydev pcspkr soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix libata drm crct10dif_pclmul crct10dif_common crc32c_intel nfit libnvdimm e1000 nvme serio_raw nvme_core drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 7197 Comm: kworker/3:32 Not tainted 3.10.0-1160.45.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
Workqueue: events vmw_fence_work_func [vmwgfx]
task: ffff9b47b29a0000 ti: ffff9b47b28d8000 task.ti: ffff9b47b28d8000
RIP: 0010:[<ffffffffb011799d>]  [<ffffffffb011799d>] native_queued_spin_lock_slowpath+0x1d/0x200
RSP: 0018:ffff9b47b28dbd50  EFLAGS: 00000293
RAX: 0000000000000001 RBX: 0000000000000000 RCX: 0000000000000001
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff9b47f43bec08
RBP: ffff9b47b28dbd50 R08: ffff9b47f3839170 R09: 92dfcd39ade39168
R10: 92dfcd39ade39168 R11: 0000000000003293 R12: ffffffffb00de305
R13: ffff9b46b8a90000 R14: 0000000200000003 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff9b47f36c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000f4acb60b950 CR3: 000000029d2be000 CR4: 00000000003407e0
Call Trace:
[<ffffffffb077dcf3>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffffb078bae3>] _raw_spin_lock_bh+0x33/0x40
[<ffffffffc059a488>] vmw_generic_waiter_remove+0x28/0x90 [vmwgfx]
[<ffffffffc059a56a>] vmw_goal_waiter_remove+0x1a/0x20 [vmwgfx]
[<ffffffffc059c6d0>] vmw_fence_work_func+0x120/0x150 [vmwgfx]
[<ffffffffb00bde8f>] process_one_work+0x17f/0x440
[<ffffffffb00befa6>] worker_thread+0x126/0x3c0
[<ffffffffb00bee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffb00c5e61>] kthread+0xd1/0xe0
[<ffffffffb00c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffffb0795de4>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffffb00c5d90>] ? insert_kthread_work+0x40/0x40
Code: 47 fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 66 90 b9 01 00 00 00 8b 17 85 d2 74 0d 83 fa 03 74 08 f3 90 <8b> 17 85 d2 75 f3 89 d0 f0 0f b1 0f 39 c2 75 e3 5d 66 90 c3 0f 

NMI watchdog: BUG: soft lockup - CPU#7 stuck for 32s! [kworker/7:0:11568]
Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul vmw_balloon glue_helper ablk_helper cryptd pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c sr_mod cdrom sd_mod ata_generic crc_t10dif vmwgfx crct10dif_generic
pata_acpi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata crct10dif_pclmul nfit crct10dif_common mptspi crc32c_intel scsi_transport_spi mptscsih libnvdimm serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 7 PID: 11568 Comm: kworker/7:0 Tainted: G             L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/19/2018
Workqueue: events vmw_fence_work_func [vmwgfx]
task: ffff9938471a20e0 ti: ffff993785414000 task.ti: ffff993785414000
RIP: 0010:[<ffffffffc03754c6>]  [<ffffffffc03754c6>] vmw_generic_waiter_remove+0x66/0x90 [vmwgfx]
RSP: 0018:ffff993785417d80  EFLAGS: 00000246
RAX: 0000000000000021 RBX: ffff9938495244e0 RCX: ffff99381e594de0
RDX: 0000000000001070 RSI: 0000000000000004 RDI: ffff99384bf188b0
RBP: ffff993785417da0 R08: ffff99384706d230 R09: 9b1e7d1cfe66d228
R10: 9b1e7d1cfe66d228 R11: 0000000000000000 R12: ffff99384d7d3940
R13: ffff9938495244e0 R14: ffff99384d7d3940 R15: ffff99384e3ed800
FS:  0000000000000000(0000) GS:ffff99384d7c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe7eb2ebb66 CR3: 0000000c0c4a8000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc037556a>] vmw_goal_waiter_remove+0x1a/0x20 [vmwgfx]
[<ffffffffc03776d0>] vmw_fence_work_func+0x120/0x150 [vmwgfx]
[<ffffffffac8be6bf>] process_one_work+0x17f/0x440
[<ffffffffac8bf7d6>] worker_thread+0x126/0x3c0
[<ffffffffac8bf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffac8c6691>] kthread+0xd1/0xe0
[<ffffffffac8c65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffacf92d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffac8c65c0>] ? insert_kthread_work+0x40/0x40
Code: 0c 00 00 41 f7 d6 45 21 f5 4c 8d b3 b0 08 00 00 44 89 ab 30 0c 00 00 4c 89 f7 e8 f6 31 c1 ec 8b 93 50 08 00 00 b8 21 00 00 00 ef <83> c2 01 44 89 e8 ef 4c 89 f7 c6 07 00 0f 1f 40 00 4c 89 e7 e8