NMI watchdog: BUG: soft lockup - CPU#9 stuck for 24s! [migration/9:55]
Modules linked in: netfilter_edr(OE) unix_diag udp_diag nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache sch_htb binfmt_misc tcp_diag inet_diag veth ipt_rpfilter xt_set xt_multiport iptable_raw ip_set_hash_ip ip_set_hash_net ip_set vxlan ip6_udp_tunnel udp_tunnel ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 xt_statistic xt_nat xt_recent xt_mark xt_comment nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash
dm_log dm_mod nfit libnvdimm iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi scsi_transport_spi crct10dif_pclmul mptscsih libata crct10dif_common e1000 serio_raw crc32c_intel mptbase vmxnet3 drm_panel_orientation_quirks floppy fuse
CPU: 9 PID: 55 Comm: migration/9 Kdump: loaded Tainted: G           OEL ------------ T 3.10.0-1160.49.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff9ed03657b180 ti: ffff9ed036590000 task.ti: ffff9ed036590000
RIP: 0010:[<ffffffff9df35b7a>]  [<ffffffff9df35b7a>] multi_cpu_stop+0x4a/0x110
RSP: 0000:ffff9ed036593d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff9ed036686400 RCX: dead000000000200
RDX: ffff9ed3afc560b0 RSI: 0000000000000286 RDI: ffff9ed31bc73b20
RBP: ffff9ed036593dc0 R08: ffff9ed31bc73ac0 R09: 0000000000000001
R10: 0000000000000001 R11: 00000000000051b6 R12: 0000000000000000
R13: ffff9ed036593d70 R14: ffffffff9dede305 R15: ffff9ed03667f000
FS:  0000000000000000(0000) GS:ffff9ed3afc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c001ffc630 CR3: 00000002a2a10000 CR4: 00000000001607e0
Call Trace:
[<ffffffff9df35b30>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff9df35e39>] cpu_stopper_thread+0x99/0x150
[<ffffffff9dece8b4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff9dece770>] ? lg_double_unlock+0x40/0x40
[<ffffffff9dec5e61>] kthread+0xd1/0xe0
[<ffffffff9dec5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffff9e595ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff9dec5d90>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#15 stuck for 22s! [migration/15:86]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_15508(E) rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache panfs(POE) 8021q garp mrp stp llc falcon_lsm_pinned_15402(E) rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) mlx5_fpga_tools(OE) ip6_tables iptable_filter iTCO_wdt dell_smbios iTCO_vendor_support sparse_keymap vfat fat dcdbas skx_edac edac_core intel_powerclamp coretemp intel_rapl iosf_mbi kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg pcspkr mei_me mei lpc_ich shpchp i2c_i801 wmi ipmi_si ipmi_devintf ipmi_msghandler nfit libnvdimm acpi_power_meter acpi_pad mlx5_ib(OE) mlx4_ib(OE) ib_uverbs(OE) mlx4_en(OE) binfmt_misc mlx5_core(OE) mlxfw(OE) vfio_mdev(OE) vfio_iommu_type1
vfio mdev(OE) ptp pps_core mlx4_core(OE) nfsd devlink knem(OE) auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic mgag200 i2c_algo_bit drm_kms_helper crct10dif_pclmul crct10dif_common syscopyarea crc32c_intel sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci megaraid_sas libata bnxt_en i2c_core ib_ipoib(OE) ib_cm(OE) ib_umad(OE) ib_core(OE) mlx_compat(OE) [last unloaded: falcon_kal]
CPU: 15 PID: 86 Comm: migration/15 Tainted: P        W  OEL ------------   3.10.0-693.5.2.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge C6420/0YTVTT, BIOS 2.2.11 06/14/2019
task: ffff8812b6200fd0 ti: ffff8812b620c000 task.ti: ffff8812b620c000
RIP: 0010:[<ffffffff8111681a>]  [<ffffffff8111681a>] multi_cpu_stop+0x4a/0x100
RSP: 0000:ffff8812b620fd98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: 0000000000016cc0 RCX: dead000000000200
RDX: ffff881825acffb0 RSI: 0000000000000286 RDI: ffff880c0cf3fb70
RBP: ffff8812b620fdc0 R08: ffff880c0cf3fb40 R09: 0000000000000001
R10: 000000000000b854 R11: 0000000000000001 R12: 0000000000000000
R13: ffff8812b620fdec R14: ffff8812bfc0f800 R15: ffff8812b62ba408
FS:  0000000000000000(0000) GS:ffff881825ac0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000016ee318 CR3: 0000000c1da39000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
ffff881825acffa8 ffff880c0cf3fb70 ffff881825acffa0 ffff880c0cf3fb98
ffffffff811167d0 ffff8812b620fe90 ffffffff81116ac7 ffff8812b620ffd8
ffff881825acffb0 0000000000000000 0000000000000000 ffff881825ad6cc0
Call Trace:
[<ffffffff811167d0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff81116ac7>] cpu_stopper_thread+0x97/0x150
[<ffffffff816a904d>] ? __schedule+0x39d/0x8b0
[<ffffffff810b90af>] smpboot_thread_fn+0x12f/0x180
[<ffffffff810b8f80>] ? lg_double_unlock+0x40/0x40
[<ffffffff810b099f>] kthread+0xcf/0xe0
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4fd8>] ret_from_fork+0x58/0x90
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 49 89 c5 48 8b 47 18 48 85 c0 0f 84 ab 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [migration/0:8]
Modules linked in: udp_diag nf_conntrack_ftp tcp_diag inet_diag xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod edac_mce_amd kvm_amd kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr vfat fat joydev sg ipmi_ssif ipmi_si ipmi_devintf ipmi_msghandler
pinctrl_amd i2c_designware_platform i2c_designware_core igb acpi_cpufreq i2c_piix4 sch_fq_codel ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel ast i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci libata drm_panel_orientation_quirks megaraid_sas ixgbe mdio ptp pps_core nfit dca libnvdimm
CPU: 0 PID: 8 Comm: migration/0 Kdump: loaded Tainted: G        W    L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: Suma R6240A0/62DB32, BIOS CXWH052028 05/09/2022
task: ffff9bb9a944d140 ti: ffff9bb9a947c000 task.ti: ffff9bb9a947c000
RIP: 0010:[<ffffffffafb2fdca>]  [<ffffffffafb2fdca>] multi_cpu_stop+0x4a/0x110
RSP: 0000:ffff9bb9a947fd98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff9bb9a93ba000 RCX: dead000000000200
RDX: ffff9bc84f615ff0 RSI: 0000000000000282 RDI: ffff9bc829b4fab0
RBP: ffff9bb9a947fdc0 R08: ffff9bc829b4fa50 R09: 0000000000000001
R10: 000000000000bacd R11: 0000000000000001 R12: 0000000000000000
R13: 000000000001ab80 R14: ffff9bb9a93afc00 R15: 0000000200000000
FS:  0000000000000000(0000) GS:ffff9bc84f600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa96c0496c8 CR3: 0000004004212000 CR4: 0000000000340ff0
Call Trace:
[<ffffffffafb2fd80>] ? cpu_stop_should_run+0x50/0x50
[<ffffffffafb30089>] cpu_stopper_thread+0x99/0x150
[<ffffffffb016772f>] ? __schedule+0x3ff/0x890
[<ffffffffb015bf73>] ? queued_spin_lock_slowpath+0xb/0xf
[<ffffffffafaca644>] smpboot_thread_fn+0x144/0x1a0
[<ffffffffafaca500>] ? lg_double_unlock+0x40/0x40
[<ffffffffafac1cb1>] kthread+0xd1/0xe0
[<ffffffffafac1be0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb0174c24>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffffafac1be0>] ? insert_kthread_work+0x40/0x40
Code: 66 90 66 90 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#38 stuck for 22s! [migration/38:199]
Modules linked in: veth nvidia_modeset(POE) binfmt_misc joydev nvidia_uvm(OE) udp_diag tcp_diag inet_diag ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc fuse overlay(T) dm_mirror dm_region_hash dm_log dm_mod ib_isert iscsi_target_mod ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ucm rpcrdma sunrpc rdma_ucm ib_uverbs ib_iser ib_umad rdma_cm ib_ipoib iw_cm iTCO_wdt iTCO_vendor_support libiscsi scsi_transport_iscsi ib_cm i40iw skx_edac edac_core coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd nvidia(POE) pcspkr sg mei_me mei shpchp i2c_i801 lpc_ich ipmi_si ipmi_devintf mlx5_ib ipmi_msghandler ib_core nfit libnvdimm acpi_power_meter ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper crct10dif_pclmul crct10dif_common mlx5_core crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ttm i40e nvme nvme_core drm ahci libahci devlink libata ptp pps_core i2c_core wmi [last unloaded: nvidia_modeset]
CPU: 38 PID: 199 Comm: migration/38 Tainted: P           OEL ------------ T 3.10.0-693.el7.x86_64 #1
Hardware name: Inspur NF5468M5/YZMB-01130-10C, BIOS 4.1.14 12/23/2020
task: ffff88606d5ddee0 ti: ffff88606d610000 task.ti: ffff88606d610000
RIP: 0010:[<ffffffff8111680f>]  [<ffffffff8111680f>] multi_cpu_stop+0x4f/0x100
RSP: 0000:ffff88606d613d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff88012d3dfc00 RCX: dead000000000200
RDX: ffff88bebde8ffb0 RSI: 0000000000000286 RDI: ffff88b51ccafb70
RBP: ffff88606d613dc0 R08: ffff88b51ccafb40 R09: 0000000000000001
R10: 000000000000b5c3 R11: 0000000000000001 R12: ffff88606d613d20
R13: ffff8803c5379fa0 R14: ffffffff810c12c8 R15: ffff88606d613d00
FS:  0000000000000000(0000) GS:ffff88bebde80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe1e0be6ee0 CR3: 00000000019f2000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
 ffff88bebde8ffa8 ffff88b51ccafb70 ffff88bebde8ffa0 ffff88b51ccafb98
 ffffffff811167c0 ffff88606d613e90 ffffffff81116ab7 ffff88606d613fd8
 ffff88bebde8ffb0 0000000000000000 0000000000000000 ffff88bebde96cc0
Call Trace:
 [<ffffffff811167c0>] ? cpu_stop_should_run+0x50/0x50
 [<ffffffff81116ab7>] cpu_stopper_thread+0x97/0x150
 [<ffffffff816a8f8d>] ? __schedule+0x39d/0x8b0
 [<ffffffff810b909f>] smpboot_thread_fn+0x12f/0x180
 [<ffffffff810b8f70>] ? lg_double_unlock+0x40/0x40
 [<ffffffff810b098f>] kthread+0xcf/0xe0
 [<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
 [<ffffffff816b4f18>] ret_from_fork+0x58/0x90
 [<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 89 c5 48 8b 47 18 48 85 c0 0f 84 ab 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 41 8b 5c 24 20 <39> c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 f6 75 6e f0 41 

NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [migration/14:85]
Modules linked in: dattobd(OE) sfs(OE) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc nfit libnvdimm iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr vmw_balloon joydev sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom
crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm mptspi scsi_transport_spi mptscsih ahci vmxnet3 libahci mptbase drm_panel_orientation_quirks ata_piix libata dm_mirror dm_region_hash dm_log dm_mod [last unloaded: dattobd]
CPU: 14 PID: 85 Comm: migration/14 Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff986ce6dab0c0 ti: ffff986ce6dbc000 task.ti: ffff986ce6dbc000
RIP: 0010:[<ffffffff89d2fd4a>]  [<ffffffff89d2fd4a>] multi_cpu_stop+0x4a/0x110
RSP: 0000:ffff986ce6dbfd98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff986a38d44100 RCX: dead000000000200
RDX: ffff986d2ca15ff0 RSI: 0000000000000282 RDI: ffff986785e5fab0
RBP: ffff986ce6dbfdc0 R08: ffff986785e5fa80 R09: 0000000000000001
R10: 000000000000bbd6 R11: 0000000000000001 R12: 0000000000000010
R13: ffff986df4a1ab80 R14: 0000000000000010 R15: 00080000e6dbfd00
FS:  0000000000000000(0000) GS:ffff986d2ca00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f6a54000024 CR3: 00000005182cc000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff89d2fd00>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff89d30009>] cpu_stopper_thread+0x99/0x150
[<ffffffff8a36770f>] ? __schedule+0x3ff/0x890
[<ffffffff8a35bf4b>] ? queued_spin_lock_slowpath+0xb/0xf
[<ffffffff89cca5c4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff89cca480>] ? lg_double_unlock+0x40/0x40
[<ffffffff89cc1c31>] kthread+0xd1/0xe0
[<ffffffff89cc1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffff8a374c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff89cc1b60>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#18 stuck for 22s! [migration/18:100]
NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [migration/10:59]
Modules linked in: iptable_filter vmw_vsock_vmci_transport vsock sb_edac ppdev edac_core iosf_mbi vmw_balloon crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg nfit parport_pc libnvdimm parport vmw_vmci i2c_piix4 shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix mptspi scsi_transport_spi drm mptscsih libata crct10dif_pclmul crct10dif_common mptbase crc32c_intel serio_raw vmw_pvscsi vmxnet3 i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 10 PID: 59 Comm: migration/10 Tainted: G        W    L ------------   3.10.0-693.11.6.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff88159e9f5ee0 ti: ffff88159ea34000 task.ti: ffff88159ea34000
RIP: 0010:[<ffffffff81118508>]  [<ffffffff81118508>] multi_cpu_stop+0x48/0x100
RSP: 0000:ffff88159ea37d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff8814ea388000 RCX: dead000000000200
RDX: ffff8829ebd13fb0 RSI: 0000000000000286 RDI: ffff88161ad3bb70
RBP: ffff88159ea37dc0 R08: ffff88161ad3bb10 R09: 0000000000000000
R10: 000000000000b9bc R11: 0000000000000001 R12: ffffffff810c00e1
R13: ffff88159ea37d20 R14: 0000000000000000 R15: ffff882b5131f6b4
FS:  0000000000000000(0000) GS:ffff8829ebd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7dd7eb19d8 CR3: 0000002d96986000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff811184c0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff811187b7>] cpu_stopper_thread+0x97/0x150
[<ffffffff816ab124>] ? __schedule+0x424/0x9b0
[<ffffffff816a070f>] ? queued_spin_lock_slowpath+0xb/0xf
[<ffffffff810bac3f>] smpboot_thread_fn+0x12f/0x180
[<ffffffff810bab10>] ? lg_double_unlock+0x40/0x40
[<ffffffff810b252f>] kthread+0xcf/0xe0
[<ffffffff810b2460>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b8798>] ret_from_fork+0x58/0x90
[<ffffffff810b2460>] ? insert_kthread_work+0x40/0x40
Code: 58 0f 1f 44 00 00 49 89 c5 48 8b 47 18 48 85 c0 0f 84 ab 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 <f3> 90 41 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 

NMI watchdog: BUG: soft lockup - CPU#32 stuck for 22s! [migration/32:171]
Modules linked in: veth xt_addrtype br_netfilter overlay(T) nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache devlink nls_utf8 isofs loop xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter iTCO_wdt iTCO_vendor_support dell_smbios sparse_keymap dcdbas vfat fat skx_edac edac_core intel_powerclamp coretemp intel_rapl iosf_mbi kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ipmi_ssif joydev sg pcspkr ipmi_si ipmi_devintf ipmi_msghandler mei_me mei shpchp nfit i2c_i801 lpc_ich acpi_power_meter wmi libnvdimm acpi_pad tpm_crb
nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic mgag200 i2c_algo_bit crct10dif_pclmul crct10dif_common drm_kms_helper crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci tg3 libata megaraid_sas bnxt_en ptp i2c_core pps_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 32 PID: 171 Comm: migration/32 Tainted: G        W    L ------------ T 3.10.0-693.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R740/0DY2X0, BIOS 2.8.2 08/27/2020
task: ffff880126695ee0 ti: ffff8801266e8000 task.ti: ffff8801266e8000
RIP: 0010:[<ffffffff8111680a>]  [<ffffffff8111680a>] multi_cpu_stop+0x4a/0x100
RSP: 0000:ffff8801266ebd98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff88808371af70 RCX: dead000000000200
RDX: ffff883f7e80ffb0 RSI: 0000000000000286 RDI: ffff8875a9103b70
RBP: ffff8801266ebdc0 R08: ffff8875a9103b10 R09: 0000000000000001
R10: 000000000000b827 R11: 0000000000000001 R12: ffffffff810be571
R13: ffff8801266ebd20 R14: 0000000000000000 R15: ffff88808371b774
FS:  0000000000000000(0000) GS:ffff883f7e800000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000099a51000 CR3: 00000080871fc000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
ffff883f7e80ffa8 ffff8875a9103b70 ffff883f7e80ffa0 ffff8875a9103b98
ffffffff811167c0 ffff8801266ebe90 ffffffff81116ab7 ffff8801266ebfd8
ffff883f7e80ffb0 0000000000000000 0000000000000000 ffff883f7e816cc0
Call Trace:
[<ffffffff811167c0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff81116ab7>] cpu_stopper_thread+0x97/0x150
[<ffffffff816a8f8d>] ? __schedule+0x39d/0x8b0
[<ffffffff810b909f>] smpboot_thread_fn+0x12f/0x180
[<ffffffff810b8f70>] ? lg_double_unlock+0x40/0x40
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 49 89 c5 48 8b 47 18 48 85 c0 0f 84 ab 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [migration/8:49]
Modules linked in: udf crc_itu_t nls_utf8 isofs unix_diag rpcrdma ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ipoib rdma_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_core squashfs overlay(T) tcp_diag inet_diag xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink loop nfsv3 nfs fscache ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter
dm_mirror dm_region_hash dm_log dm_mod ppdev crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev sg pcspkr parport_pc virtio_balloon parport i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom virtio_net net_failover virtio_console virtio_scsi failover ata_generic pata_acpi bochs_drm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata virtio_pci crct10dif_pclmul crct10dif_common virtio_ring crc32c_intel serio_raw virtio drm_panel_orientation_quirks floppy fuse
CPU: 8 PID: 49 Comm: migration/8 Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.49.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff98b813655280 ti: ffff98b813670000 task.ti: ffff98b813670000
RIP: 0010:[<ffffffffa4735b7a>]  [<ffffffffa4735b7a>] multi_cpu_stop+0x4a/0x110
RSP: 0000:ffff98b813673d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffffffffa46d718c RCX: dead000000000200
RDX: ffff98f487c160b0 RSI: 0000000000000286 RDI: ffff99313ab4fac0
RBP: ffff98b813673dc0 R08: ffff99313ab4fa60 R09: 0000000000000001
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000000
R13: ffff9963c8636b04 R14: 0000000000000008 R15: ffff98f487c1acc0
FS:  00007fe3b6b70700(0000) GS:ffff98f487c00000(0000) knlGS:00000000f7267b40
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe0d1b8aae0 CR3: 0000003b5392c000 CR4: 00000000003407e0
Call Trace:
[<ffffffffa4735b30>] ? cpu_stop_should_run+0x50/0x50
[<ffffffffa4735e39>] cpu_stopper_thread+0x99/0x150
[<ffffffffa46d4abe>] ? finish_task_switch+0x4e/0x1c0
[<ffffffffa4d88df0>] ? __schedule+0x320/0x680
[<ffffffffa46ce8b4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffffa46ce770>] ? lg_double_unlock+0x40/0x40
[<ffffffffa46c5e61>] kthread+0xd1/0xe0
[<ffffffffa46c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffffa4d95de4>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffffa46c5d90>] ? insert_kthread_work+0x40/0x40
Code: 66 90 66 90 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [migration/8:49]
Modules linked in: uas usb_storage binfmt_misc tcp_lp fuse xt_nat veth vxlan ip6_udp_tunnel udp_tunnel xt_mark nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter nfsd auth_rpcgss nfs_acl lockd grace nls_utf8 isofs xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack loop ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink overlay(T) rpcrdma ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod sunrpc ib_srp scsi_transport_srp scsi_tgt ib_ipoib rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm iTCO_wdt iTCO_vendor_support vfat fat i40iw skx_edac ib_core intel_powerclamp coretemp
intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel joydev aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ipmi_ssif pcspkr ses enclosure mei_me scsi_transport_sas sg mei shpchp lpc_ich i2c_i801 ipmi_si ipmi_devintf ipmi_msghandler nfit libnvdimm acpi_pad acpi_power_meter sch_fq_codel ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper crct10dif_pclmul syscopyarea crct10dif_common sysfillrect crc32c_intel sysimgblt fb_sys_fops ttm drm i40e ahci libahci libata megaraid_sas ptp pps_core i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 8 PID: 49 Comm: migration/8 Kdump: loaded Tainted: G   M         L ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: Inspur NF8480M5/IIMS, BIOS 4.1.11 12/26/2019
task: ffff89752dd0eeb0 ti: ffff89752dd54000 task.ti: ffff89752dd54000
RIP: 0010:[<ffffffff8a9265ea>]  [<ffffffff8a9265ea>] multi_cpu_stop+0x4a/0x110
RSP: 0000:ffff89752dd57d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff8a92bf218b00 RCX: dead000000000200
RDX: ffff89d2c0614030 RSI: 0000000000000282 RDI: ffff8a055fadfac0
RBP: ffff89752dd57dc0 R08: ffff8a055fadfa60 R09: 0000000000000001
R10: 000000000000b629 R11: 0000000000000001 R12: ffffffff00000000
R13: ffff89752dd57d18 R14: ffff89752cc65800 R15: 0000000200000008
FS:  0000000000000000(0000) GS:ffff89d2c0600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000563069231010 CR3: 0000006046798000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 00000000
Call Trace:
[<ffffffff8a9265a0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff8a9268a9>] cpu_stopper_thread+0x99/0x150
[<ffffffff8af1291c>] ? __schedule+0x41c/0xa20
[<ffffffff8a8c35e4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff8a8c34a0>] ? lg_double_unlock+0x40/0x40
[<ffffffff8a8bae31>] kthread+0xd1/0xe0
[<ffffffff8a8bad60>] ? insert_kthread_work+0x40/0x40
[<ffffffff8af1f61d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff8a8bad60>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [migration/3:25]
Modules linked in: binfmt_misc xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink nfsv3 nfs_acl nfs lockd grace fscache nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter xt_conntrack nf_conntrack libcrc32c mpt2sas raid_class scsi_transport_sas mptctl mptbase bonding dell_rbu sunrpc iTCO_wdt gpio_ich iTCO_vendor_support dcdbas intel_powerclamp rndis_host coretemp cdc_ether usbnet mii kvm cdc_acm joydev irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg pcspkr i7core_edac ipmi_si lpc_ich ipmi_devintf acpi_power_meter ipmi_msghandler wmi ip_tables ext4 mbcache jbd2 sr_mod sd_mod cdrom crc_t10dif
ata_generic crct10dif_generic pata_acpi mgag200 drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata igb crct10dif_pclmul crct10dif_common crc32c_intel serio_raw megaraid_sas ptp bnx2 pps_core drm_panel_orientation_quirks dca i2c_algo_bit dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 25 Comm: migration/3 Kdump: loaded Tainted: P          IOE  ------------   3.10.0-957.27.2.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R710/0MD99X, BIOS 6.6.0 05/22/2018
task: ffff89d83a5d5140 ti: ffff89d83a718000 task.ti: ffff89d83a718000
RIP: 0010:[<ffffffff95731348>]  [<ffffffff95731348>] multi_cpu_stop+0x48/0x110
RSP: 0000:ffff89d83a71bd98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff89d83a17fc00 RCX: dead000000000200
RDX: ffff89daefa55ff0 RSI: 0000000000000282 RDI: ffff89db3fedfab0
RBP: ffff89d83a71bdc0 R08: ffff89db3fedfa50 R09: 0000000000000001
R10: 000000000000b7e3 R11: 0000000000000001 R12: ffffffff00000000
R13: ffff89d83a71bd18 R14: ffff89d83a168400 R15: 0000000200000003
FS:  0000000000000000(0000) GS:ffff89daefa40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000075a8da000 CR3: 00000005e9810000 CR4: 00000000000207e0
Call Trace:
[<ffffffff95731300>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff95731609>] cpu_stopper_thread+0x99/0x150
[<ffffffff95d69aba>] ? __schedule+0x42a/0x860
[<ffffffff956cb814>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff956cb6d0>] ? lg_double_unlock+0x40/0x40
[<ffffffff956c2e81>] kthread+0xd1/0xe0
[<ffffffff956c2db0>] ? insert_kthread_work+0x40/0x40
[<ffffffff95d76c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff956c2db0>] ? insert_kthread_work+0x40/0x40
Code: 58 66 66 90 66 90 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 <f3> 90 41 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 

NMI watchdog: BUG: soft lockup - CPU#5 stuck for 21s! [migration/5:34]
Modules linked in: nfnetlink_queue nfnetlink_log bluetooth rfkill unix_diag tcp_diag inet_diag veeamsnap(OE) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink isofs loop nfsv3 nfs fscache ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter dm_mirror dm_region_hash dm_log dm_mod ppdev crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev sg virtio_balloon pcspkr i2c_piix4
parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom virtio_net net_failover virtio_console virtio_scsi failover ata_generic pata_acpi bochs_drm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix virtio_pci crct10dif_pclmul virtio_ring crct10dif_common libata drm_panel_orientation_quirks crc32c_intel serio_raw virtio floppy fuse
CPU: 5 PID: 34 Comm: migration/5 Kdump: loaded Tainted: G           OE  ------------   3.10.0-1160.36.2.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff8f5452c4b180 ti: ffff8f5452c80000 task.ti: ffff8f5452c80000
RIP: 0010:[<ffffffffa4d35b5a>]  [<ffffffffa4d35b5a>] multi_cpu_stop+0x4a/0x110
RSP: 0000:ffff8f5452c83d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffffffffa4cd716c RCX: dead000000000200
RDX: ffff8f9007d560b0 RSI: 0000000000000286 RDI: ffff90379639baf0
RBP: ffff8f5452c83dc0 R08: ffff90379639ba90 R09: 0000000000000001
R10: ffff8f9007d40000 R11: 0000000000000000 R12: 0000000000000000
R13: ffff9001efaa2904 R14: 000000000000001a R15: ffff904affc9acc0
FS:  00007fc3dc2e4700(0000) GS:ffff8f9007d40000(0000) knlGS:00000000f7351b40
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc1e6960390 CR3: 0000007b14322000 CR4: 00000000003407e0
Call Trace:
[<ffffffffa4d35b10>] ? cpu_stop_should_run+0x50/0x50
[<ffffffffa4d35e19>] cpu_stopper_thread+0x99/0x150
[<ffffffffa4cd4a9e>] ? finish_task_switch+0x4e/0x1c0
[<ffffffffa5388e10>] ? __schedule+0x320/0x680
[<ffffffffa4cce894>] smpboot_thread_fn+0x144/0x1a0
[<ffffffffa4cce750>] ? lg_double_unlock+0x40/0x40
[<ffffffffa4cc5e41>] kthread+0xd1/0xe0
[<ffffffffa4cc5d70>] ? insert_kthread_work+0x40/0x40
[<ffffffffa5395de4>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffffa4cc5d70>] ? insert_kthread_work+0x40/0x40
Code: 66 90 66 90 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [migration/1:13]
Modules linked in: ebt_arp ebtable_nat vhost_net vhost macvtap macvlan tun nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache iscsi_tcp libiscsi_tcp ebtable_filter ebtables ip6table_filter ip6_tables bnx2i libiscsi bnx2fc cnic uio fcoe libfcoe libfc scsi_transport_fc scsi_tgt openvswitch nf_conntrack_ipv6 nf_nat_ipv6 nf_nat_ipv4 nf_defrag_ipv6 nf_nat xt_physdev br_netfilter ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_multiport xt_conntrack nf_conntrack iptable_filter dm_service_time intel_powerclamp coretemp kvm_intel kvm irqbypass sg iTCO_wdt gpio_ich iTCO_vendor_support ipmi_si lpc_ich ipmi_devintf pcspkr shpchp dcdbas i7core_edac ipmi_msghandler acpi_power_meter edac_core bridge nfsd auth_rpcgss nfs_acl lockd bonding grace dm_multipath ip_tables ext4 mbcache jbd2
dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c sd_mod crc_t10dif crct10dif_generic mgag200 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32_pclmul crc32c_intel drm ghash_clmulni_intel mpt2sas aesni_intel scsi_transport_iscsi 8021q lrw gf128mul garp glue_helper ablk_helper stp cryptd llc r8169 mrp serio_raw i2c_core bnx2 raid_class scsi_transport_sas mii sunrpc dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 13 Comm: migration/1 Tainted: G          I  L ------------   3.10.0-693.11.6.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R510/0DPRKF, BIOS 1.9.0 10/21/2011
task: ffff880174e3cf10 ti: ffff880174e4c000 task.ti: ffff880174e4c000
RIP: 0010:[<ffffffff8111850a>]  [<ffffffff8111850a>] multi_cpu_stop+0x4a/0x100
RSP: 0018:ffff880174e4fd98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff88100f358a00 RCX: dead000000000200
RDX: ffff88080fa13fb0 RSI: 0000000000000286 RDI: ffff880efeeab6a0
RBP: ffff880174e4fdc0 R08: ffff880efeeab640 R09: 0000000000000001
R10: 000000000000b972 R11: 0000000000000001 R12: ffffffff816b9bff
R13: ffffffff816b9c06 R14: ffffffff816b9c0d R15: ffffffff816b9c14
FS:  0000000000000000(0000) GS:ffff88080fa00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f58fa086850 CR3: 0000000f0ab46000 CR4: 00000000000227e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff811184c0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff811187b7>] cpu_stopper_thread+0x97/0x150
[<ffffffff816ab124>] ? __schedule+0x424/0x9b0
[<ffffffff810bac3f>] smpboot_thread_fn+0x12f/0x180
[<ffffffff810bab10>] ? lg_double_unlock+0x40/0x40
[<ffffffff810b252f>] kthread+0xcf/0xe0
[<ffffffff810b2460>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b8798>] ret_from_fork+0x58/0x90
[<ffffffff810b2460>] ? insert_kthread_work+0x40/0x40
Code: 66 90 66 90 49 89 c5 48 8b 47 18 48 85 c0 0f 84 ab 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#112 stuck for 22s! [migration/112:576]
Modules linked in: tcp_lp fuse binfmt_misc nf_conntrack_netlink xt_addrtype br_netfilter socwatch2_13(OE) xt_CHECKSUM tun bridge stp llc devlink sep5(OE) socperf3(OE) pax(OE) nfsv3 nfs fscache overlay(T) nf_conntrack_netbios_ns nf_conntrack_broadcast nf_nat_tftp nf_conntrack_tftp ip6t_MASQUERADE nf_nat_masquerade_ipv6 ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter dcdbas vfat fat amd64_edac_mod nouveau
edac_mce_amd kvm_amd kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd mxm_wmi pcspkr wmi video sg k10temp ccp i2c_piix4 ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter pcc_cpufreq acpi_cpufreq nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic mgag200 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common ahci crc32c_intel drm megaraid_sas libahci tg3 libata ptp drm_panel_orientation_quirks pps_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 112 PID: 576 Comm: migration/112 Kdump: loaded Tainted: G           OEL ------------ T 3.10.0-1062.1.1.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R7425/08V001, BIOS 1.6.7 10/29/2018
task: ffff8b56347c0000 ti: ffff8b56347bc000 task.ti: ffff8b56347bc000
RIP: 0010:[<ffffffffabb33abf>]  [<ffffffffabb33abf>] multi_cpu_stop+0x4f/0x110
RSP: 0018:ffff8b56347bfd98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff8b563406a400 RCX: dead000000000200
RDX: ffff8b5d1f596010 RSI: 0000000000000286 RDI: ffff8b8d86d6b590
RBP: ffff8b56347bfdc0 R08: ffff8b8d86d6b560 R09: 0000000000000001
R10: 000000000000bd37 R11: 0000000000000001 R12: ffff8b56347bfd20
R13: ffff8b95178c62a0 R14: ffffffffabad6500 R15: ffff8b56347bfd00
FS:  00007febee3fd700(0000) GS:ffff8b5d1f580000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007febee3fc8d6 CR3: 0000001a95810000 CR4: 00000000003407e0
Call Trace:
[<ffffffffabb33a70>] ? cpu_stop_should_run+0x50/0x50
[<ffffffffabb33d79>] cpu_stopper_thread+0x99/0x150
[<ffffffffac17ec88>] ? __schedule+0x448/0x9c0
[<ffffffffac181b8b>] ? _raw_spin_lock_irqsave+0xb/0x40
[<ffffffffabacdb04>] smpboot_thread_fn+0x144/0x1a0
[<ffffffffabacd9c0>] ? lg_double_unlock+0x40/0x40
[<ffffffffabac50d1>] kthread+0xd1/0xe0
[<ffffffffabac5000>] ? insert_kthread_work+0x40/0x40
[<ffffffffac18cd24>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffffabac5000>] ? insert_kthread_work+0x40/0x40
Code: 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 41 8b 5c 24 20 <39> c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 f6 75 6e f0 41 

NMI watchdog: BUG: soft lockup - CPU#20 stuck for 22s! [migration/20:110]
Modules linked in: veth vxlan ip6_udp_tunnel udp_tunnel xt_set ip_set_hash_ipportnet ip_set_bitmap_port ip_set_hash_ipportip ip_set_hash_ipport ip_set dummy ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 xt_comment xt_mark nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc symap_custom_3_10_0_862_el7_x86_64(POE) ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr symev_custom_3_10_0_862_el7_x86_64(OE) ip_vs_rr ip_vs nf_conntrack overlay(T) vmw_vsock_vmci_transport vsock sunrpc xfs libcrc32c ppdev vmw_balloon joydev pcspkr sg shpchp vmw_vmci i2c_piix4
nfit libnvdimm parport_pc parport ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci ata_piix libata serio_raw vmxnet3 i2c_core vmw_pvscsi floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 20 PID: 110 Comm: migration/20 Kdump: loaded Tainted: P           OEL ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff929ea987dee0 ti: ffff929ea98a0000 task.ti: ffff929ea98a0000
RIP: 0010:[<ffffffffa3b265ea>]  [<ffffffffa3b265ea>] multi_cpu_stop+0x4a/0x110
RSP: 0000:ffff929ea98a3d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff929dffb58b00 RCX: dead000000000200
RDX: ffff92adff414030 RSI: 0000000000000282 RDI: ffff92aadae47ac0
RBP: ffff929ea98a3dc0 R08: ffff92aadae47a90 R09: 0000000000000000
R10: 000000000000ba8f R11: 0000000000000001 R12: 0000000000000000
R13: 0000000000018b00 R14: ffff929ea9951c00 R15: 0000000200000014
FS:  0000000000000000(0000) GS:ffff92adff400000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007fbbeaa8a570 CR3: 0000001d7fa0e000 CR4: 00000000000007e0
Call Trace:
[<ffffffffa3b265a0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffffa3b268a9>] cpu_stopper_thread+0x99/0x150
[<ffffffffa411291c>] ? __schedule+0x41c/0xa20
[<ffffffffa41156db>] ? _raw_spin_lock_irqsave+0xb/0x40
[<ffffffffa3ac35e4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffffa3ac34a0>] ? lg_double_unlock+0x40/0x40
[<ffffffffa3abae31>] kthread+0xd1/0xe0
[<ffffffffa3abad60>] ? insert_kthread_work+0x40/0x40
[<ffffffffa411f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa3abad60>] ? insert_kthread_work+0x40/0x40
Code: 66 90 66 90 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#53 stuck for 22s! [migration/53:274]
Modules linked in: squashfs loop overlay(T) mmfs26(OE) mmfslinux(OE) tracedev(OE) devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter dell_rbu dm_mirror dm_region_hash dm_log joydev iTCO_wdt iTCO_vendor_support dell_smbios dcdbas sparse_keymap skx_edac edac_core intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul crc32c_intel ghash_clmulni_intel mgag200 ttm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops drm aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr mei_me mei shpchp i2c_i801 lpc_ich wmi ipmi_si ipmi_devintf ipmi_msghandler nfit libnvdimm acpi_power_meter acpi_pad binfmt_misc ip_tables bnxt_en nvme nvme_core qed hpilo dm_thin_pool dm_bio_prison dm_persistent_data dm_bufio dm_mod udf crc_itu_t vfat fat
br_netfilter bridge stp llc xfs isci libsas qla3xxx hpsa e1000e ixgbe(OE) igb(OE) i2c_algo_bit i2c_core dca aacraid aic79xx ata_piix mpt2sas raid_class mptspi scsi_transport_spi mptsas mptscsih mptbase scsi_transport_sas arcmsr sata_nv sata_svw bnx2x(OE) mdio libcrc32c bnx2(OE) ext4 mbcache jbd2 sata_sil e1000 nfsv3 nfs_acl nfs lockd grace sunrpc fscache tun sd_mod crc_t10dif crct10dif_generic sg crct10dif_pclmul crct10dif_common i40e(OE) ahci megaraid_sas libahci tg3(OE) ptp libata pps_core [last unloaded: tracedev]
CPU: 53 PID: 274 Comm: migration/53 Tainted: G    B      OEL ------------ T 3.10.0-693.2.2.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R440/0WKGTH, BIOS 2.8.1 06/30/2020
task: ffff883075605ee0 ti: ffff883075630000 task.ti: ffff883075630000
RIP: 0010:[<ffffffff8111680a>]  [<ffffffff8111680a>] multi_cpu_stop+0x4a/0x100
RSP: 0000:ffff883075633d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: 0000000000016cc0 RCX: dead000000000200
RDX: ffff885f7c48ffb0 RSI: 0000000000000286 RDI: ffff88250ce37b70
RBP: ffff883075633dc0 R08: ffff88250ce37b40 R09: 0000000000000001
R10: 000000000000b91b R11: 0000000000000001 R12: 0000000000000000
R13: ffff883075633dec R14: ffff8830bfc0b400 R15: ffff8830757d6408
FS:  0000000000000000(0000) GS:ffff885f7c480000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00002aab8ada2968 CR3: 00000000019f2000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
ffff885f7c48ffa8 ffff88250ce37b70 ffff885f7c48ffa0 ffff88250ce37b98
ffffffff811167c0 ffff883075633e90 ffffffff81116ab7 ffff883075633fd8
ffff885f7c48ffb0 0000000000000000 0000000000000000 ffff885f7c496cc0
Call Trace:
[<ffffffff811167c0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff81116ab7>] cpu_stopper_thread+0x97/0x150
[<ffffffff816a8fad>] ? __schedule+0x39d/0x8b0
[<ffffffff810b909f>] smpboot_thread_fn+0x12f/0x180
[<ffffffff810b8f70>] ? lg_double_unlock+0x40/0x40
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f58>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 49 89 c5 48 8b 47 18 48 85 c0 0f 84 ab 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [migration/1:13]
Modules linked in: vhost_net vhost macvtap macvlan ebt_arp tun ext4 mbcache jbd2 fuse scsi_transport_iscsi ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ip_set nfnetlink ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables xt_physdev br_netfilter ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_multiport xt_conntrack nf_conntrack iptable_filter dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx dm_service_time sb_edac edac_core intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass
crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd iTCO_wdt iTCO_vendor_support pcspkr joydev i2c_i801 sg mei_me mei ioatdma shpchp lpc_ich wmi ipmi_si ipmi_devintf ipmi_msghandler dm_multipath nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic mgag200 drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm isci drm libsas ahci igb scsi_transport_sas libahci crct10dif_pclmul crct10dif_common crc32c_intel libata uas usb_storage ptp pps_core dca i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod 8021q garp mrp bridge stp llc bonding
CPU: 1 PID: 13 Comm: migration/1 Tainted: G             L ------------   3.10.0-693.11.6.el7.x86_64 #1
Hardware name: Supermicro X9DRFR/X9DRFR, BIOS 1.0b 11/28/2012
task: ffff880174badee0 ti: ffff880174bd0000 task.ti: ffff880174bd0000
RIP: 0010:[<ffffffff8111850f>]  [<ffffffff8111850f>] multi_cpu_stop+0x4f/0x100
RSP: 0018:ffff880174bd3d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff88085fc18a00 RCX: dead000000000200
RDX: ffff88085fa53fb0 RSI: 0000000000000286 RDI: ffff881059a03900
RBP: ffff880174bd3dc0 R08: ffff881059a038a0 R09: 0000000000000000
R10: 000000000000bd98 R11: 0000000000000001 R12: ffffffff816b9bff
R13: ffffffff816b9c06 R14: ffffffff816b9c0d R15: ffffffff816b9c14
FS:  0000000000000000(0000) GS:ffff88085fa40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5fb59d6e80 CR3: 00000000019fa000 CR4: 00000000000627e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff811184c0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff811187b7>] cpu_stopper_thread+0x97/0x150
[<ffffffff816ab124>] ? __schedule+0x424/0x9b0
[<ffffffff816a070f>] ? queued_spin_lock_slowpath+0xb/0xf
[<ffffffff810bac3f>] smpboot_thread_fn+0x12f/0x180
[<ffffffff810bab10>] ? lg_double_unlock+0x40/0x40
[<ffffffff810b252f>] kthread+0xcf/0xe0
[<ffffffff810b2460>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b8798>] ret_from_fork+0x58/0x90
[<ffffffff810b2460>] ? insert_kthread_work+0x40/0x40
Code: 89 c5 48 8b 47 18 48 85 c0 0f 84 ab 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 41 8b 5c 24 20 <39> c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 f6 75 6e f0 41 

NMI watchdog: BUG: soft lockup - CPU#61 stuck for 23s! [migration/61:315]
Modules linked in: vhost_net vhost macvtap macvlan vfio_pci vfio_iommu_type1 vfio xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nfsv3 nfs_acl nfs lockd grace fscache bridge stp llc falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_11611(E) sunrpc iTCO_wdt iTCO_vendor_support skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg mei_me i2c_i801 lpc_ich mei shpchp wmi ipmi_si ipmi_devintf ipmi_msghandler nfit libnvdimm
acpi_cpufreq acpi_pad acpi_power_meter ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel i40e ahci drm libahci libata ptp pps_core i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 61 PID: 315 Comm: migration/61 Tainted: P            EL ------------   3.10.0-862.el7.x86_64 #1
Hardware name: Supermicro SYS-4029GP-TRT-IN001/X11DPG-OT-CPU, BIOS 3.0a 02/26/2019
task: ffff9f695dc84f10 ti: ffff9f695dcb0000 task.ti: ffff9f695dcb0000
RIP: 0010:[<ffffffffb89265ef>]  [<ffffffffb89265ef>] multi_cpu_stop+0x4f/0x110
RSP: 0018:ffff9f695dcb3d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff9f680f158b00 RCX: dead000000000200
RDX: ffff9fa04e154030 RSI: 0000000000000282 RDI: ffff9f2451b0b5c0
RBP: ffff9f695dcb3dc0 R08: ffff9f2451b0b590 R09: 0000000000000001
R10: 000000000000b7e9 R11: 0000000000000001 R12: 0000000000000000
R13: 0000000000018b00 R14: ffff9f695dda5c00 R15: 000000020000003d
FS:  0000000000000000(0000) GS:ffff9fa04e140000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7f06c20000 CR3: 00000079baa0e000 CR4: 00000000007627e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 00000000
Call Trace:
[<ffffffffb89265a0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffffb89268a9>] cpu_stopper_thread+0x99/0x150
[<ffffffffb8f1291c>] ? __schedule+0x41c/0xa20
[<ffffffffb88c35e4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffffb88c34a0>] ? lg_double_unlock+0x40/0x40
[<ffffffffb88bae31>] kthread+0xd1/0xe0
[<ffffffffb88bad60>] ? insert_kthread_work+0x40/0x40
[<ffffffffb8f1f61d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffb88bad60>] ? insert_kthread_work+0x40/0x40
Code: 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 41 8b 5c 24 20 <39> c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 f6 75 6e f0 41 

NMI watchdog: BUG: soft lockup - CPU#204 stuck for 23s! [migration/204:1036]
Modules linked in: iscsi_target_mod target_core_mod macsec tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag ip_vs nf_conntrack libcrc32c binfmt_misc vfat fat uas usb_storage tcp_lp fuse nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache bonding sunrpc dm_mirror dm_region_hash dm_log dm_mod edac_mce_amd kvm_amd kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr sg ipmi_si ipmi_devintf ipmi_msghandler pinctrl_amd i2c_designware_platform i2c_designware_core acpi_cpufreq i2c_piix4 sch_fq_codel ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci
drm_panel_orientation_quirks libata megaraid_sas ixgbe igb(OE) mdio ptp pps_core i2c_algo_bit dca nfit libnvdimm [last unloaded: amifldrv_mod]
CPU: 204 PID: 1036 Comm: migration/204 Kdump: loaded Tainted: P        W  OEL ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: N/A 2U Rack Server/65N32-US, BIOS SZZQ042030 07/27/2020
task: ffffa0cce68a6180 ti: ffffa0cce68cc000 task.ti: ffffa0cce68cc000
RIP: 0010:[<ffffffffba92fd4f>]  [<ffffffffba92fd4f>] multi_cpu_stop+0x4f/0x110
RSP: 0000:ffffa0cce68cfd98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffffffffba8d2c1c RCX: dead000000000200
RDX: ffffa10bbfd15ff0 RSI: 0000000000000282 RDI: ffffa0cd5f397ab0
RBP: ffffa0cce68cfdc0 R08: ffffa0cd5f397a80 R09: 0000000000000001
R10: 000000000000ba5d R11: 0000000000000001 R12: 0000000000000000
R13: ffffa10ba4fe5944 R14: 000000000000006e R15: ffffa18bbf99ab80
FS:  0000000000000000(0000) GS:ffffa10bbfd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007faa1dcc6210 CR3: 000001800a0cc000 CR4: 0000000000340fe0
Call Trace:
[<ffffffffba92fd00>] ? cpu_stop_should_run+0x50/0x50
[<ffffffffba930009>] cpu_stopper_thread+0x99/0x150
[<ffffffffbaf6770f>] ? __schedule+0x3ff/0x890
[<ffffffffba8ca5c4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffffba8ca480>] ? lg_double_unlock+0x40/0x40
[<ffffffffba8c1c31>] kthread+0xd1/0xe0
[<ffffffffba8c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffffbaf74c24>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffffba8c1b60>] ? insert_kthread_work+0x40/0x40
Code: 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 41 8b 5c 24 20 <39> c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 f6 75 6e f0 41 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [migration/1:13]
Modules linked in: squashfs loop overlay(T) mmfs26(OE) mmfslinux(OE) tracedev(OE) devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter dell_rbu dm_mirror dm_region_hash dm_log skx_edac edac_core intel_powerclamp coretemp iTCO_wdt intel_rapl iTCO_vendor_support iosf_mbi dcdbas kvm_intel kvm irqbypass crc32_pclmul crc32c_intel ghash_clmulni_intel mgag200 ttm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops drm aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr mei_me mei i2c_i801 shpchp lpc_ich ipmi_si ipmi_devintf ipmi_msghandler nfit libnvdimm acpi_power_meter acpi_pad binfmt_misc ip_tables fuse btrfs raid6_pq xor msdos bnxt_en nvme nvme_core qed hpilo dm_thin_pool dm_bio_prison dm_persistent_data dm_bufio dm_mod udf crc_itu_t vfat fat br_netfilter
bridge stp llc xfs isci libsas qla3xxx hpsa e1000e ixgbe(OE) igb(OE) i2c_algo_bit i2c_core dca aacraid aic79xx ata_piix mpt2sas raid_class mptspi scsi_transport_spi mptsas mptscsih mptbase scsi_transport_sas arcmsr sata_nv sata_svw bnx2x(OE) mdio libcrc32c bnx2(OE) ext4 mbcache jbd2 sata_sil e1000 nfsv3 nfs_acl nfs lockd grace sunrpc fscache tun sd_mod crc_t10dif crct10dif_generic sg crct10dif_pclmul crct10dif_common i40e(OE) ahci libahci megaraid_sas libata tg3(OE) ptp pps_core [last unloaded: ipmi_msghandler]
CPU: 1 PID: 13 Comm: migration/1 Tainted: G           OE  ------------ T 3.10.0-693.2.2.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R440/0WKGTH, BIOS 1.3.7 02/09/2018
task: ffff883076a34f10 ti: ffff883076a4c000 task.ti: ffff883076a4c000
RIP: 0010:[<ffffffff81116808>]  [<ffffffff81116808>] multi_cpu_stop+0x48/0x100
RSP: 0000:ffff883076a4fd98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff885f7be16cc0 RCX: dead000000000200
RDX: ffff885f7be0ffb0 RSI: 0000000000000286 RDI: ffff8830e4de3b70
RBP: ffff883076a4fdc0 R08: ffff8830e4de3b10 R09: 0000000000000001
R10: 000000000000b491 R11: 0000000000000001 R12: 0000000000000000
R13: ffff883076a4fdec R14: ffff8830bfc08000 R15: ffff8830750a7008
FS:  0000000000000000(0000) GS:ffff885f7be00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000077d9ef00 CR3: 00000013886f0000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
ffff885f7be0ffa8 ffff8830e4de3b70 ffff885f7be0ffa0 ffff8830e4de3b98
ffffffff811167c0 ffff883076a4fe90 ffffffff81116ab7 ffff883076a4ffd8
ffff885f7be0ffb0 0000000000000000 0000000000000000 ffff885f7be16cc0
Call Trace:
[<ffffffff811167c0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff81116ab7>] cpu_stopper_thread+0x97/0x150
[<ffffffff816a8fad>] ? __schedule+0x39d/0x8b0
[<ffffffff810b909f>] smpboot_thread_fn+0x12f/0x180
[<ffffffff810b8f70>] ? lg_double_unlock+0x40/0x40
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f58>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 58 0f 1f 44 00 00 49 89 c5 48 8b 47 18 48 85 c0 0f 84 ab 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 <f3> 90 41 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 

NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [migration/5:35]
Modules linked in: mpt3sas mptctl mptbase xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc amd64_edac_mod edac_mce_amd kvm irqbypass crc32_pclmul ghash_clmulni_intel ixgbe aesni_intel lrw gf128mul glue_helper ablk_helper cryptd mdio ipmi_si joydev ipmi_devintf ipmi_msghandler pcspkr sp5100_tco fam15h_power
k10temp i2c_piix4 osst st sg acpi_cpufreq ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm libahci igb mpt2sas libata crct10dif_pclmul crct10dif_common crc32c_intel megaraid_sas ptp serio_raw pps_core raid_class drm_panel_orientation_quirks dca scsi_transport_sas i2c_algo_bit dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 5 PID: 35 Comm: migration/5 Kdump: loaded Tainted: G             L ------------   3.10.0-1160.6.1.el7.x86_64 #1
Hardware name: Supermicro H8DG6/H8DGi/H8DG6/H8DGi, BIOS 3.5        11/25/2013
task: ffff9d5c9977b180 ti: ffff9d5c99f44000 task.ti: ffff9d5c99f44000
RIP: 0010:[<ffffffff8d935740>]  [<ffffffff8d935740>] multi_cpu_stop+0x90/0x110
RSP: 0000:ffff9d5c99f47d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: 0000000000000000 RCX: dead000000000200
RDX: ffff9d6407c560b0 RSI: 0000000000000286 RDI: ffff9d5d26977b30
RBP: ffff9d5c99f47dc0 R08: ffff9d5d26977ad0 R09: 0000000000000001
R10: ffff9d6407c40000 R11: 0000000000000000 R12: 000000050000000d
R13: ffff9d7427c5acc0 R14: ffff9d5ca7c0e400 R15: ffff9d5c9a756400
FS:  00007f23beac8700(0000) GS:ffff9d6407c40000(0000) knlGS:00000000f7731700
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 000000000899393c CR3: 0000000dded5a000 CR4: 00000000000407e0
Call Trace:
[<ffffffff8d9356b0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff8d9359b9>] cpu_stopper_thread+0x99/0x150
[<ffffffff8df86d4f>] ? __schedule+0x3af/0x860
[<ffffffff8df89bab>] ? _raw_spin_lock_irqsave+0xb/0x40
[<ffffffff8d8ce674>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff8d8ce530>] ? lg_double_unlock+0x40/0x40
[<ffffffff8d8c5c21>] kthread+0xd1/0xe0
[<ffffffff8d8c5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffff8df94de4>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffff8d8c5b50>] ? insert_kthread_work+0x40/0x40
Code: 4c 24 24 0f 94 c0 84 c0 0f 1f 00 74 17 41 8b 44 24 20 41 8b 54 24 10 83 c0 01 41 89 54 24 24 41 89 44 24 20 83 fb 04 74 0a 89 d8 <eb> b6 66 0f 1f 44 00 00 4c 89 ef 57 9d 66 66 90 66 90 5b 41 5c 

NMI watchdog: BUG: soft lockup - CPU#9 stuck for 22s! [migration/9:55]
Modules linked in: ext4 mbcache jbd2 rbd libceph dns_resolver xt_multiport iptable_raw ip_set_hash_ip ip_set_hash_net ipip tunnel4 ip_tunnel veth xt_set ip_set_hash_ipportnet ip_set_hash_ipport ip_set_bitmap_port ip_set_hash_ipportip ip_set dummy ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 xt_comment xt_mark nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat xt_conntrack ipt_REJECT nf_reject_ipv4 tun overlay(T) bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nf_conntrack vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel
lrw gf128mul glue_helper ppdev ablk_helper cryptd vmw_balloon joydev pcspkr sg shpchp i2c_piix4 nfit libnvdimm parport_pc vmw_vmci parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod ahci crc_t10dif ata_piix drm libahci crct10dif_generic i2c_core libata crct10dif_pclmul crct10dif_common vmxnet3 crc32c_intel serio_raw vmw_pvscsi floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 9 PID: 55 Comm: migration/9 Tainted: G             L ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff9d5b7d9a6eb0 ti: ffff9d5b7d9f4000 task.ti: ffff9d5b7d9f4000
RIP: 0010:[<ffffffff925265ea>]  [<ffffffff925265ea>] multi_cpu_stop+0x4a/0x110
RSP: 0000:ffff9d5b7d9f7d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff9d5c7fc98b00 RCX: dead000000000200
RDX: ffff9d5c7fcd4030 RSI: 0000000000000282 RDI: ffff9d5ac8b87ac0
RBP: ffff9d5b7d9f7dc0 R08: ffff9d5ac8b87a90 R09: 0000000000000001
R10: 000000000000b50b R11: 0000000000000001 R12: ffffffff00000000
R13: ffff9d5b7d9f7d18 R14: ffff9d5b7da55800 R15: 0000000200000009
FS:  0000000000000000(0000) GS:ffff9d5c7fcc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c001252000 CR3: 000000019a00e000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff925265a0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff925268a9>] cpu_stopper_thread+0x99/0x150
[<ffffffff92b1291c>] ? __schedule+0x41c/0xa20
[<ffffffff92b0842a>] ? queued_spin_lock_slowpath+0xb/0xf
[<ffffffff924c35e4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff924c34a0>] ? lg_double_unlock+0x40/0x40
[<ffffffff924bae31>] kthread+0xd1/0xe0
[<ffffffff924bad60>] ? insert_kthread_work+0x40/0x40
[<ffffffff92b1f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff924bad60>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#22 stuck for 23s! [migration/22:120]
Modules linked in: tcp_diag inet_diag veth vxlan ip6_udp_tunnel udp_tunnel xt_set ip_set_hash_ipportnet ip_set_bitmap_port ip_set_hash_ipportip ip_set_hash_ipport ip_set dummy ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 xt_comment xt_mark nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter symap_custom_3_10_0_862_el7_x86_64(POE) devlink symev_custom_3_10_0_862_el7_x86_64(OE) nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nf_conntrack overlay(T) vmw_vsock_vmci_transport vsock sunrpc xfs libcrc32c ppdev vmw_balloon joydev pcspkr sg vmw_vmci
i2c_piix4 shpchp nfit parport_pc parport libnvdimm ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci ata_piix libahci drm libata serio_raw vmw_pvscsi vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 22 PID: 120 Comm: migration/22 Kdump: loaded Tainted: P           OEL ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8b0fe9928000 ti: ffff8b0fe9924000 task.ti: ffff8b0fe9924000
RIP: 0010:[<ffffffffa3f265ea>]  [<ffffffffa3f265ea>] multi_cpu_stop+0x4a/0x110
RSP: 0000:ffff8b0fe9927d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff8b0f3fa18b00 RCX: dead000000000200
RDX: ffff8b1f3f494030 RSI: 0000000000000282 RDI: ffff8b0ca02afac0
RBP: ffff8b0fe9927dc0 R08: ffff8b0ca02afa90 R09: 0000000000000000
R10: 000000000000b432 R11: 0000000000000001 R12: 0000000000000000
R13: 0000000000018b00 R14: ffff8b0fe99a0000 R15: 0000000200000016
FS:  0000000000000000(0000) GS:ffff8b1f3f480000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f03fd1dcbd0 CR3: 0000000cea80e000 CR4: 00000000000007e0
Call Trace:
[<ffffffffa3f265a0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffffa3f268a9>] cpu_stopper_thread+0x99/0x150
[<ffffffffa451291c>] ? __schedule+0x41c/0xa20
[<ffffffffa450842a>] ? queued_spin_lock_slowpath+0xb/0xf
[<ffffffffa3ec35e4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffffa3ec34a0>] ? lg_double_unlock+0x40/0x40
[<ffffffffa3ebae31>] kthread+0xd1/0xe0
[<ffffffffa3ebad60>] ? insert_kthread_work+0x40/0x40
[<ffffffffa451f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa3ebad60>] ? insert_kthread_work+0x40/0x40
Code: 66 90 66 90 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#72 stuck for 22s! [migration/72:370]
Modules linked in: tcp_lp fuse parastor(OE) dlm(OE) kfnccli(OE) knal(OE) ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ext4 mbcache jbd2 rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_uverbs(OE) ib_umad(OE) mlx5_fpga_tools(OE) mlx5_ib(OE) mlx5_core(OE) mlxfw(OE) mlx4_en(OE) dm_mirror dm_region_hash dm_log sr_mod cdrom iTCO_wdt iTCO_vendor_support skx_edac edac_core coretemp dm_service_time intel_rapl iosf_mbi kvm_intel kvm irqbypass uas crc32_pclmul usb_storage ghash_clmulni_intel sg aesni_intel lrw gf128mul glue_helper ablk_helper joydev cryptd mei_me mei pcspkr shpchp i2c_i801 lpc_ich ipmi_ssif wmi ipmi_si ipmi_devintf ipmi_msghandler nfit libnvdimm acpi_power_meter dm_multipath dm_mod nfsd auth_rpcgss nfs_acl lockd knem(OE) grace sunrpc
ip_tables mlx4_ib(OE) ib_core(OE) xfs libcrc32c sd_mod crc32c_intel lpfc ast i2c_algo_bit drm_kms_helper crc_t10dif crct10dif_generic syscopyarea sysfillrect crct10dif_pclmul sysimgblt fb_sys_fops scsi_transport_fc ttm i40e scsi_tgt drm ahci crct10dif_common mlx4_core(OE) megaraid_sas libahci devlink libata mlx_compat(OE) ptp pps_core i2c_core
CPU: 72 PID: 370 Comm: migration/72 Tainted: G        W  OEL ------------   3.10.0-693.el7.x86_64 #1
Hardware name: Sugon I840-G30/80P48-US, BIOS 0THSY016 04/16/2018
task: ffff88c0a6528fd0 ti: ffff88c0a6534000 task.ti: ffff88c0a6534000
RIP: 0010:[<ffffffff8111680a>]  [<ffffffff8111680a>] multi_cpu_stop+0x4a/0x100
RSP: 0000:ffff88c0a6537d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff88ff7da16cc0 RCX: dead000000000200
RDX: ffff88ff7da0ffb0 RSI: 0000000000000286 RDI: ffff8893eb4a7b70
RBP: ffff88c0a6537dc0 R08: ffff8893eb4a7b40 R09: 0000000000000001
R10: 000000000000b455 R11: 0000000000000001 R12: 0000000000000000
R13: ffff88c0a6537dec R14: ffff88c0ffc08000 R15: ffff88c0a6297c08
FS:  0000000000000000(0000) GS:ffff88ff7da00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fbf65d2a030 CR3: 00000079a943a000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
ffff88ff7da0ffa8 ffff8893eb4a7b70 ffff88ff7da0ffa0 ffff8893eb4a7b98
ffffffff811167c0 ffff88c0a6537e90 ffffffff81116ab7 ffff88c0a6537fd8
ffff88ff7da0ffb0 0000000000000000 0000000000000000 ffff88ff7da16cc0
Call Trace:
[<ffffffff811167c0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff81116ab7>] cpu_stopper_thread+0x97/0x150
[<ffffffff816a8f8d>] ? __schedule+0x39d/0x8b0
[<ffffffff810b909f>] smpboot_thread_fn+0x12f/0x180
[<ffffffff810b8f70>] ? lg_double_unlock+0x40/0x40
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 49 89 c5 48 8b 47 18 48 85 c0 0f 84 ab 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [migration/3:24]
Modules linked in: vhost_net vhost macvtap macvlan ebt_arp tun nfsv3 nfs_acl nfs lockd grace fscache bnx2fc cnic uio fcoe libfcoe libfc scsi_transport_fc ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink openvswitch ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ib_isert iscsi_target_mod ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ucm dm_mirror dm_region_hash dm_log rpcrdma sunrpc sb_edac rdma_ucm ib_uverbs intel_powerclamp coretemp ib_iser intel_rapl rdma_cm
iosf_mbi iw_cm libiscsi kvm_intel ib_umad ib_ipoib kvm scsi_transport_iscsi ib_cm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw mlx4_ib dm_service_time ipmi_si gf128mul ipmi_devintf glue_helper iTCO_wdt ablk_helper iTCO_vendor_support ib_core cryptd sg pcspkr joydev ipmi_msghandler hpilo hpwdt acpi_power_meter wmi ioatdma lpc_ich shpchp pcc_cpufreq dca dm_multipath dm_mod ip_tables xfs libcrc32c raid1 sd_mod crc_t10dif crct10dif_generic mlx4_en mgag200 i2c_algo_bit ptp drm_kms_helper pps_core syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci libahci drm mlx4_core crct10dif_pclmul libata mpt2sas crct10dif_common crc32c_intel serio_raw i2c_core raid_class devlink scsi_transport_sas 8021q garp mrp bridge stp llc bonding
CPU: 3 PID: 24 Comm: migration/3 Kdump: loaded Tainted: G        W    L ------------   3.10.0-862.14.4.el7.x86_64 #1
Hardware name: HP ProLiant SL230s Gen8   /, BIOS P75 05/24/2019
task: ffff91b42904dee0 ti: ffff91b429084000 task.ti: ffff91b429084000
RIP: 0010:[<ffffffff92f298ba>]  [<ffffffff92f298ba>] multi_cpu_stop+0x4a/0x110
RSP: 0018:ffff91b429087d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff91c2bf918b40 RCX: dead000000000200
RDX: ffff91c2bf6d4070 RSI: 0000000000000286 RDI: ffff91c29aa2b660
RBP: ffff91b429087dc0 R08: ffff91c29aa2b600 R09: 0000000000000001
R10: 000000000000b652 R11: 0000000000000001 R12: ffff91b429087d20
R13: ffffffff92eddf88 R14: ffff91b429087d40 R15: ffff91ca2cefeeb0
FS:  0000000000000000(0000) GS:ffff91c2bf6c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7692bb6000 CR3: 000000145a20e000 CR4: 00000000000627e0
Call Trace:
[<ffffffff92f29870>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff92f29b79>] cpu_stopper_thread+0x99/0x150
[<ffffffff9351890c>] ? __schedule+0x41c/0xa20
[<ffffffff92ec6774>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff92ec6630>] ? lg_double_unlock+0x40/0x40
[<ffffffff92ebdf21>] kthread+0xd1/0xe0
[<ffffffff92ebde50>] ? insert_kthread_work+0x40/0x40
[<ffffffff935255f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff92ebde50>] ? insert_kthread_work+0x40/0x40
Code: 66 90 66 90 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [migration/1:14]
Modules linked in: vhost_net vhost macvtap macvlan ebt_arp tun geneve ip6_udp_tunnel udp_tunnel binfmt_misc vfat fat isofs xfs fuse ixgbevf bnx2fc cnic uio fcoe libfcoe libfc scsi_transport_fc nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack openvswitch ip_set nfnetlink ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter softdog ib_isert iscsi_target_mod ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ucm iTCO_wdt iTCO_vendor_support
intel_powerclamp coretemp kvm_intel kvm irqbypass pcspkr rpcrdma rdma_ucm ib_uverbs ib_umad ib_iser ib_ipoib rdma_cm ipmi_si i2c_i801 iw_cm ipmi_devintf lpc_ich ipmi_msghandler ib_cm tpm_infineon libiscsi sg i7core_edac acpi_power_meter acpi_cpufreq bridge bonding ip_tables ext4 mbcache jbd2 dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c sd_mod crc_t10dif sr_mod crct10dif_generic cdrom mlx4_ib ib_core mlx4_en 8021q garp mrp stp llc mgag200 drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops crct10dif_pclmul ttm crct10dif_common crc32_pclmul crc32c_intel ata_generic pata_acpi ghash_clmulni_intel aesni_intel drm lrw gf128mul glue_helper ablk_helper cryptd ata_piix igb libata drm_panel_orientation_quirks scsi_transport_iscsi i2c_algo_bit mlx4_core ixgbe mpt3sas
raid_class scsi_transport_sas megaraid_sas dca ptp devlink pps_core mdio dm_multipath sunrpc dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 14 Comm: migration/1 Kdump: loaded Tainted: G        W I    ------------   3.10.0-957.12.2.el7.x86_64 #1
Hardware name: FUJITSU                          PRIMERGY RX300 S6             /D2619, BIOS 6.00 Rev. 1.13.2619.N1           01/19/2012
task: ffff989e304bd140 ti: ffff989e3050c000 task.ti: ffff989e3050c000
RIP: 0010:[<ffffffffb1b301ea>]  [<ffffffffb1b301ea>] multi_cpu_stop+0x4a/0x110
RSP: 0000:ffff989e3050fd98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff98aeffcdab80 RCX: dead000000000200
RDX: ffff98a5dbc55ff0 RSI: 0000000000000282 RDI: ffff98a5567ebab0
RBP: ffff989e3050fdc0 R08: ffff98a5567eba50 R09: 0000000000000001
R10: 000000000000b861 R11: 0000000000000001 R12: 0000000000000000
R13: 000000000001ab80 R14: ffff989e30768c00 R15: 0000000200000001
FS:  0000000000000000(0000) GS:ffff98a5dbc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8994035900 CR3: 000000088c114000 CR4: 00000000000207e0
Call Trace:
[<ffffffffb1b301a0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffffb1b304a9>] cpu_stopper_thread+0x99/0x150
[<ffffffffb21689ba>] ? __schedule+0x42a/0x860
[<ffffffffb1aca6b4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffffb1aca570>] ? lg_double_unlock+0x40/0x40
[<ffffffffb1ac1d21>] kthread+0xd1/0xe0
[<ffffffffb1ac1c50>] ? insert_kthread_work+0x40/0x40
[<ffffffffb2175c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb1ac1c50>] ? insert_kthread_work+0x40/0x40
Code: 66 90 66 90 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#62 stuck for 23s! [migration/62:322]
Modules linked in: binfmt_misc nvidia_uvm(OE) tcp_lp fuse 8021q garp mrp xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter ip6_tables nfsv3 nfs_acl mpt3sas mpt2sas raid_class scsi_transport_sas mptctl mptbase rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod vfat fat nvidia_drm(POE) nvidia_modeset(POE) raid456 async_raid6_recov async_memcpy async_pq nvidia(POE) raid6_pq async_xor xor async_tx edac_mce_amd kvm_amd snd_hda_codec_hdmi kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel snd_hda_codec_realtek
lrw gf128mul glue_helper snd_hda_codec_generic ablk_helper cryptd eeepc_wmi asus_wmi sparse_keymap rfkill snd_hda_intel video snd_hda_codec pcspkr drm_kms_helper snd_hda_core syscopyarea snd_hwdep sysfillrect snd_seq sysimgblt fb_sys_fops snd_seq_device drm snd_pcm k10temp i2c_piix4 sg snd_timer drm_panel_orientation_quirks snd ipmi_devintf ccp soundcore ipmi_msghandler pinctrl_amd i2c_designware_platform i2c_designware_core gpio_amdpt pcc_cpufreq acpi_cpufreq ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ahci crct10dif_pclmul crct10dif_common crc32c_intel igb libahci serio_raw mxm_wmi libata nvme megaraid_sas(OE) ptp nvme_core pps_core dca i2c_algo_bit sdhci_acpi iosf_mbi sdhci mmc_core wmi
CPU: 62 PID: 322 Comm: migration/62 Kdump: loaded Tainted: P           OEL ------------   3.10.0-1062.1.1.el7.x86_64 #1
Hardware name: System manufacturer System Product Name/PRIME X399-A, BIOS 1002 02/15/2019
task: ffff8f28e8a18000 ti: ffff8f28e8a20000 task.ti: ffff8f28e8a20000
RIP: 0010:[<ffffffff8ef33aba>]  [<ffffffff8ef33aba>] multi_cpu_stop+0x4a/0x110
RSP: 0000:ffff8f28e8a23d98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff8f28e82c8000 RCX: dead000000000200
RDX: ffff8f47bd796010 RSI: 0000000000000286 RDI: ffff8f27b998faa0
RBP: ffff8f28e8a23dc0 R08: ffff8f27b998fa70 R09: 0000000000000001
R10: 000000000000b41c R11: 0000000000000001 R12: 0000000000000000
R13: 000000000001ac40 R14: ffff8f28e80d8000 R15: 000000020000003e
FS:  00007fc6be029740(0000) GS:ffff8f47bd780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fff1d10cb68 CR3: 000000001c6ba000 CR4: 00000000003407e0
Call Trace:
[<ffffffff8ef33a70>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff8ef33d79>] cpu_stopper_thread+0x99/0x150
[<ffffffff8f57ec88>] ? __schedule+0x448/0x9c0
[<ffffffff8eecdb04>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff8eecd9c0>] ? lg_double_unlock+0x40/0x40
[<ffffffff8eec50d1>] kthread+0xd1/0xe0
[<ffffffff8eec5000>] ? insert_kthread_work+0x40/0x40
[<ffffffff8f58cd24>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffff8eec5000>] ? insert_kthread_work+0x40/0x40
Code: 66 90 66 90 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#5 stuck for 23s! [migration/5:35]
Modules linked in: act_police cls_u32 sch_ingress cls_fw sch_sfq sch_htb ebt_arp ebtable_nat vhost_net vhost macvtap macvlan tun fuse ebtable_filter ebtables ip6table_filter ip6_tables scsi_transport_iscsi xt_physdev br_netfilter ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_multiport xt_conntrack nf_conntrack libcrc32c iptable_filter dm_mirror dm_region_hash dm_log iTCO_wdt iTCO_vendor_support mxm_wmi dcdbas sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper pcspkr cryptd dm_service_time lpc_ich joydev ipmi_si mei_me mei ipmi_devintf sg ipmi_msghandler wmi acpi_power_meter dm_multipath dm_mod pcc_cpufreq 8021q garp mrp bridge stp llc bonding cbsensor(OE) nfsd auth_rpcgss
nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic mgag200 drm_kms_helper ahci syscopyarea sysfillrect sysimgblt ixgbe libahci fb_sys_fops mdio igb ttm ptp drm crct10dif_pclmul pps_core crct10dif_common megaraid_sas libata crc32c_intel drm_panel_orientation_quirks dca i2c_algo_bit
CPU: 5 PID: 35 Comm: migration/5 Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R730/072T6D, BIOS 2.3.4 11/08/2016
task: ffff8e1c3446d230 ti: ffff8e1c3449c000 task.ti: ffff8e1c3449c000
RIP: 0010:[<ffffffff96b3549e>]  [<ffffffff96b3549e>] multi_cpu_stop+0x8e/0x110
RSP: 0000:ffff8e1c3449fd98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff8e1c3403b400 RCX: dead000000000200
RDX: ffff8e239f096070 RSI: 0000000000000286 RDI: ffff8e1356987aa0
RBP: ffff8e1c3449fdc0 R08: ffff8e1356987a40 R09: 0000000000000001
R10: ffff8e239f080000 R11: 00000000000003db R12: ffff8e1c3449fd20
R13: ffff8e22636c3150 R14: ffffffff96ad7770 R15: ffff8e1c3449fd00
FS:  0000000000000000(0000) GS:ffff8e239f080000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f161c0008c0 CR3: 0000000c00c10000 CR4: 00000000003627e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff96b35410>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff96b35719>] cpu_stopper_thread+0x99/0x150
[<ffffffff971805a2>] ? __schedule+0x402/0x840
[<ffffffff96acec24>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff96aceae0>] ? lg_double_unlock+0x40/0x40
[<ffffffff96ac61f1>] kthread+0xd1/0xe0
[<ffffffff96ac6120>] ? insert_kthread_work+0x40/0x40
[<ffffffff9718dd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff96ac6120>] ? insert_kthread_work+0x40/0x40
Code: 41 ff 4c 24 24 0f 94 c0 84 c0 0f 1f 00 74 17 41 8b 44 24 20 41 8b 54 24 10 83 c0 01 41 89 54 24 24 41 89 44 24 20 83 fb 04 74 0a <89> d8 eb b6 66 0f 1f 44 00 00 4c 89 ef 57 9d 0f 1f 44 00 00 5b 

NMI watchdog: BUG: soft lockup - CPU#13 stuck for 22s! [migration/13:74]
Modules linked in: mmfs26(OE) mmfslinux(OE) tracedev(OE) overlay(T) squashfs loop binfmt_misc nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache 8021q garp mrp xt_multiport xt_comment ip6table_raw iptable_raw iptable_security iptable_mangle iptable_nat nf_nat_ipv4 nf_nat ip6t_REJECT nf_reject_ipv6 nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ip_tables ip_set nfnetlink bridge stp llc sunrpc dm_mirror dm_region_hash dm_log dm_mod iTCO_wdt iTCO_vendor_support mxm_wmi ext4 mbcache jbd2 sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm irqbypass crc32_pclmul ghash_clmulni_intel cryptd pcspkr joydev sg mei_me mei lpc_ich i2c_i801 ioatdma
ipmi_si ipmi_devintf ipmi_msghandler wmi acpi_power_meter acpi_pad xfs libcrc32c sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops mlx5_core ttm igb ahci drm mlxfw devlink libahci crct10dif_pclmul crct10dif_common ptp crc32c_intel libata pps_core drm_panel_orientation_quirks nvme dca nvme_core i2c_algo_bit [last unloaded: tracedev]
CPU: 13 PID: 74 Comm: migration/13 Kdump: loaded Tainted: G           OE  ------------ T 3.10.0-957.12.2.el7.x86_64 #1
Hardware name: Supermicro SYS-6018R-TDW/X10DDW-i, BIOS 3.0a 03/01/2018
task: ffff8ea1e6421040 ti: ffff8ea1e6428000 task.ti: ffff8ea1e6428000
RIP: 0010:[<ffffffff881301ea>]  [<ffffffff881301ea>] multi_cpu_stop+0x4a/0x110
RSP: 0000:ffff8ea1e642bd98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff8ea1e62a8800 RCX: dead000000000200
RDX: ffff8ee03f755ff0 RSI: 0000000000000282 RDI: ffff8ecca5beb780
RBP: ffff8ea1e642bdc0 R08: ffff8ecca5beb720 R09: 0000000000000001
R10: 000000000000bfe7 R11: 0000000000000001 R12: ffffffff00000000
R13: ffff8ea1e642bd18 R14: ffff8ea1e6273400 R15: 000000020000000d
FS:  0000000000000000(0000) GS:ffff8ee03f740000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f6d05e959e0 CR3: 0000006a07a10000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff881301a0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff881304a9>] cpu_stopper_thread+0x99/0x150
[<ffffffff887689ba>] ? __schedule+0x42a/0x860
[<ffffffff880ca6b4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff880ca570>] ? lg_double_unlock+0x40/0x40
[<ffffffff880c1d21>] kthread+0xd1/0xe0
[<ffffffff880c1c50>] ? insert_kthread_work+0x40/0x40
[<ffffffff88775c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff880c1c50>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 49 89 c5 48 8b 47 18 48 85 c0 0f 84 b3 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84 

NMI watchdog: BUG: soft lockup - CPU#25 stuck for 22s! [migration/25:134]
Modules linked in: vfat fat uas usb_storage mpt3sas mpt2sas raid_class scsi_transport_sas mptctl mptbase ipmi_si dell_rbu tcp_diag inet_diag vhost_net vhost macvtap macvlan ebt_arp tun rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache bnx2i libiscsi bnx2fc cnic uio fcoe libfcoe libfc vport_geneve geneve ip6_udp_tunnel udp_tunnel ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack openvswitch ip_set nfnetlink ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter dcdbas iTCO_wdt iTCO_vendor_support sb_edac
edac_core intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass pcspkr sg mei_me mei lpc_ich shpchp ipmi_devintf ipmi_msghandler acpi_power_meter nfsd bridge bonding auth_rpcgss nfs_acl lockd grace ip_tables ext4 mbcache jbd2 dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio dm_service_time sd_mod crc_t10dif crct10dif_generic mxm_wmi qla2xxx scsi_transport_iscsi crct10dif_pclmul crct10dif_common crc32_pclmul crc32c_intel mgag200 ghash_clmulni_intel i2c_algo_bit aesni_intel drm_kms_helper 8021q lrw gf128mul garp glue_helper bnx2x stp ablk_helper llc syscopyarea cryptd mrp sysfillrect sysimgblt fb_sys_fops ttm dm_multipath drm scsi_transport_fc ahci tg3 libahci megaraid_sas libata scsi_tgt i2c_core ptp pps_core mdio libcrc32c wmi sunrpc dm_mirror dm_region_hash dm_log
dm_mod [last unloaded: ipmi_si]
CPU: 25 PID: 134 Comm: migration/25 Tainted: G             L ------------   3.10.0-693.17.1.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.5.5 08/16/2017
task: ffff8820d2d6dee0 ti: ffff8820d2d9c000 task.ti: ffff8820d2d9c000
RIP: 0010:[<ffffffff811186ea>]  [<ffffffff811186ea>] multi_cpu_stop+0x4a/0x100
RSP: 0018:ffff8820d2d9fd98  EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffff881ffeed8a00 RCX: dead000000000200
RDX: ffff883ffe113fb0 RSI: 0000000000000286 RDI: ffff883551b1b680
RBP: ffff8820d2d9fdc0 R08: ffff883551b1b650 R09: 0000000000000001
R10: 000000000000ba8e R11: 0000000000000001 R12: ffff8820d2d9fd20
R13: ffffffff810d22f8 R14: ffff8820d2d9fd40 R15: ffff8836f9334f10
FS:  0000000000000000(0000) GS:ffff883ffe100000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055e28ab8c000 CR3: 00000000019fa000 CR4: 00000000003627e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff811186a0>] ? cpu_stop_should_run+0x50/0x50
[<ffffffff81118997>] cpu_stopper_thread+0x97/0x150
[<ffffffff816ab2f4>] ? __schedule+0x424/0x9b0
[<ffffffff810bae1f>] smpboot_thread_fn+0x12f/0x180
[<ffffffff810bacf0>] ? lg_double_unlock+0x40/0x40
[<ffffffff810b270f>] kthread+0xcf/0xe0
[<ffffffff810b2640>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b8798>] ret_from_fork+0x58/0x90
[<ffffffff810b2640>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 49 89 c5 48 8b 47 18 48 85 c0 0f 84 ab 00 00 00 0f a3 18 19 db 85 db 41 0f 95 c6 45 31 ff 31 c0 0f 1f 44 00 00 f3 90 <41> 8b 5c 24 20 39 c3 74 5d 83 fb 02 74 68 83 fb 03 75 05 45 84