NMI watchdog: BUG: soft lockup - CPU#13 stuck for 24s! [migration/13:73]
Modules linked in: xt_nat veth xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ppdev vmw_balloon sb_edac snd_ens1371 iosf_mbi snd_rawmidi snd_ac97_codec kvm_intel kvm ac97_bus snd_seq irqbypass snd_seq_device crc32_pclmul snd_pcm ghash_clmulni_intel snd_timer aesni_intel lrw gf128mul snd glue_helper ablk_helper cryptd pcspkr joydev sg soundcore vmw_vmci i2c_piix4 parport_pc parport sch_fq_codel ip_tables xfs libcrc32c sr_mod cdrom sd_mod ata_generic crc_t10dif
crct10dif_generic pata_acpi vmwgfx drm_kms_helper ata_piix libata syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nfit libnvdimm mptspi e1000 crct10dif_pclmul crct10dif_common scsi_transport_spi crc32c_intel mptscsih serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 13 PID: 73 Comm: migration/13 Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.71.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff88b258cc3180 ti: ffff88b258ce4000 task.ti: ffff88b258ce4000
RIP: 0010:[<ffffffff88ae2f6e>]  [<ffffffff88ae2f6e>] active_load_balance_cpu_stop+0xfe/0x290
RSP: 0018:ffff88b258ce7d20  EFLAGS: 00000202
RAX: 0000000000000088 RBX: ffff88c13d91acc0 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff88c11cac4200 RDI: ffff88c13d91acc0
RBP: ffff88b258ce7dc0 R08: ffffffff8921e640 R09: ffff88c0a4d0c200
R10: 000000000000000f R11: 0000000000000000 R12: 0000000100000000
R13: 000000008af4c600 R14: ffffffff88ae7638 R15: ffff88b258ce7cc8
FS:  0000000000000000(0000) GS:ffff88c13d940000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f23be968780 CR3: 0000000fd8142000 CR4: 00000000003607e0
Call Trace:
[<ffffffff88ae2e70>] ? can_migrate_task+0x5b0/0x5b0
[<ffffffff88b35f99>] cpu_stopper_thread+0x99/0x150
[<ffffffff88ace9e4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff88ace8a0>] ? lg_double_unlock+0x40/0x40
[<ffffffff88ac5f91>] kthread+0xd1/0xe0
[<ffffffff88ac5ec0>] ? insert_kthread_work+0x40/0x40
[<ffffffff89199df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff88ac5ec0>] ? insert_kthread_work+0x40/0x40
Code: 40 00 4d 85 f6 74 1d 4c 89 ef e8 ae bd 6a 00 4c 89 ef 4c 89 f6 e8 63 d6 ff ff 4c 89 ef c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <31> c0 48 8b 4d d0 65 48 33 0c 25 28 00 00 00 0f 85 61 01 00 00 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [migration/0:7]
Modules linked in: veth xt_nat xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock fuse vmhgfs(OE) overlay(T) sunrpc snd_seq_midi snd_seq_midi_event sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm joydev snd_timer snd pcspkr sg soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic
pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm serio_raw ata_piix mptspi libata scsi_transport_spi e1000 nfit mptscsih libnvdimm mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 7 Comm: migration/0 Kdump: loaded Tainted: G        W  OEL ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff8b743a35e180 ti: ffff8b7439cb8000 task.ti: ffff8b7439cb8000
RIP: 0010:[<ffffffff9f4de78b>]  [<ffffffff9f4de78b>] active_load_balance_cpu_stop+0xfb/0x280
RSP: 0018:ffff8b7439cbbd30  EFLAGS: 00000246
RAX: 0000000000000000 RBX: 00000000ed65ab80 RCX: 0000000000000000
RDX: 0000000000b71b00 RSI: 0000000000000400 RDI: ffff8b76ed61ab80
RBP: ffff8b7439cbbdc0 R08: 0000000000000000 R09: ffff8b76e6ef8000
R10: 0000000000000000 R11: 0000000000000000 R12: ffff8b7439cbbce8
R13: ffffffff9f4ddc09 R14: ffff8b7439cbbca0 R15: ffff8b76e6ef8000
FS:  0000000000000000(0000) GS:ffff8b76ed600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa8bbace000 CR3: 00000003f8ba4000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9f4de690>] ? can_migrate_task+0x500/0x500
[<ffffffff9f530009>] cpu_stopper_thread+0x99/0x150
[<ffffffff9fb6770f>] ? __schedule+0x3ff/0x890
[<ffffffff9f4ca5c4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff9f4ca480>] ? lg_double_unlock+0x40/0x40
[<ffffffff9f4c1c31>] kthread+0xd1/0xe0
[<ffffffff9f4c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffff9fb74c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9f4c1b60>] ? insert_kthread_work+0x40/0x40
Code: 85 db 75 e4 4c 89 ef c6 07 00 0f 1f 40 00 41 c7 84 24 00 09 00 00 00 00 00 00 4c 89 e7 c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <31> c0 48 8b 4d d0 65 48 33 0c 25 28 00 00 00 0f 85 1a 01 00 00 

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [migration/2:18]
Modules linked in: binfmt_misc xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nf_log_ipv4 nf_log_common xt_LOG ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev sg pcspkr parport_pc parport
i2c_piix4 vmw_vmci shpchp ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif ata_generic pata_acpi crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix mptspi scsi_transport_spi drm crct10dif_pclmul crct10dif_common libata mptscsih crc32c_intel serio_raw mptbase vmxnet3 i2c_core floppy
CPU: 2 PID: 18 Comm: migration/2 Kdump: loaded Tainted: G             L ------------   3.10.0-862.14.4.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff88de7cfc8000 ti: ffff88de7cfc4000 task.ti: ffff88de7cfc4000
RIP: 0010:[<ffffffff88ed99c8>]  [<ffffffff88ed99c8>] active_load_balance_cpu_stop+0xf8/0x280
RSP: 0000:ffff88de7cfc7d30  EFLAGS: 00000246
RAX: ffff88df3fc99478 RBX: ffff88df3fcd8b40 RCX: ffff88df3fc99478
RDX: 0000000000000008 RSI: ffff88df369ccf10 RDI: ffff88df3fc98b40
RBP: ffff88de7cfc7dc0 R08: 0000000000000002 R09: ffff88df3fc98bc0
R10: 0000000000000004 R11: 0000000000000000 R12: ffff88df3fcd8b40
R13: ffff88df3fcd8b40 R14: ffffffff88ed5105 R15: ffff88de7cfc7ca8
FS:  0000000000000000(0000) GS:ffff88df3fc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005611f3825514 CR3: 000000021c312000 CR4: 00000000000007e0
Call Trace:
[<ffffffff88ed98d0>] ? can_migrate_task+0x500/0x500
[<ffffffff88f29b79>] cpu_stopper_thread+0x99/0x150
[<ffffffff8951890c>] ? __schedule+0x41c/0xa20
[<ffffffff88ec6774>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff88ec6630>] ? lg_double_unlock+0x40/0x40
[<ffffffff88ebdf21>] kthread+0xd1/0xe0
[<ffffffff88ebde50>] ? insert_kthread_work+0x40/0x40
[<ffffffff895255f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff88ebde50>] ? insert_kthread_work+0x40/0x40
Code: 8b 1b 48 85 db 75 e4 4c 89 ef c6 07 00 66 66 66 90 41 c7 84 24 00 09 00 00 00 00 00 00 4c 89 e7 c6 07 00 66 66 66 90 fb 66 66 90 <66> 66 90 31 c0 48 8b 4d d0 65 48 33 0c 25 28 00 00 00 0f 85 1a 

NMI watchdog: BUG: soft lockup - CPU#14 stuck for 23s! [migration/14:81]
Modules linked in: veth ipt_MASQUERADE nf_nat_masquerade_ipv4 br_netfilter bridge stp llc overlay(T) xt_conntrack iptable_filter xt_addrtype iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nf_conntrack vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev sg joydev vmw_balloon pcspkr i2c_piix4 vmw_vmci parport_pc shpchp parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod ata_generic crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi ata_piix drm mptscsih crct10dif_pclmul crct10dif_common libata crc32c_intel
mptbase serio_raw vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 14 PID: 81 Comm: migration/14 Tainted: G               ------------ T 3.10.0-693.2.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/30/2013
task: ffff88023c008000 ti: ffff88023c010000 task.ti: ffff88023c010000
RIP: 0010:[<ffffffff810cbe78>]  [<ffffffff810cbe78>] active_load_balance_cpu_stop+0xf8/0x270
RSP: 0000:ffff88023c013d30  EFLAGS: 00000202
RAX: 0000000000000088 RBX: ffff88023fc96cc0 RCX: 0000000000000005
RDX: 0000000000000000 RSI: ffff88007c2ecf10 RDI: ffff88023fd16cc0
RBP: ffff88023c013dc0 R08: 0000000000000000 R09: ffff88013c673f40
R10: 0000000000000001 R11: ffff88023bb65100 R12: ffff88023fc96cc0
R13: ffff88023fd16cc0 R14: ffffffff810c76f5 R15: ffff88023c013ca8
FS:  0000000000000000(0000) GS:ffff88023fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c420338040 CR3: 000000023c3c7000 CR4: 00000000000407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000d3c013d58 ffff88023c068000 ffff88023fd16cc0 0000000d0000000e
ffff88023fc96cc0 0000000000000000 0000000000000000 0000000000000000
0000000000000000 0000000000000008 0000000000000000 0000000000000000
Call Trace:
[<ffffffff810cbd80>] ? can_migrate_task+0x500/0x500
[<ffffffff81116ab7>] cpu_stopper_thread+0x97/0x150
[<ffffffff816a8fad>] ? __schedule+0x39d/0x8b0
[<ffffffff810b909f>] smpboot_thread_fn+0x12f/0x180
[<ffffffff810b8f70>] ? lg_double_unlock+0x40/0x40
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f58>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 8b 1b 48 85 db 75 e4 4c 89 ef c6 07 00 66 66 66 90 41 c7 84 24 f0 08 00 00 00 00 00 00 4c 89 e7 c6 07 00 66 66 66 90 fb 66 66 90 <66> 66 90 31 c0 48 8b 4d d0 65 48 33 0c 25 28 00 00 00 0f 85 1a