NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [kworker/1:2:9515]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg joydev virtio_balloon i2c_piix4 pcspkr ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi virtio_net virtio_scsi crct10dif_pclmul crct10dif_common crc32c_intel bochs_drm drm_kms_helper ata_piix syscopyarea sysfillrect sysimgblt fb_sys_fops ttm floppy drm serio_raw libata virtio_pci drm_panel_orientation_quirks virtio_ring
virtio
CPU: 1 PID: 9515 Comm: kworker/1:2 Kdump: loaded Tainted: G             L ------------   3.10.0-957.21.3.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014
Workqueue: events __net_random_once_deferred
task: ffff8aeafd2eb0c0 ti: ffff8af08fecc000 task.ti: ffff8af08fecc000
RIP: 0010:[<ffffffff88711a8a>]  [<ffffffff88711a8a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8af08fecfc88  EFLAGS: 00000202
RAX: 0000000000000007 RBX: 00000000000000fc RCX: ffff8af0bfddfba0
RDX: 0000000000000007 RSI: 0000000000000008 RDI: 0000000000000000
RBP: ffff8af08fecfcc0 R08: ffff8aea753a7800 R09: ffffffff88975e39
R10: ffff8af0bfc5f160 R11: ffffe2169e729600 R12: 0000000000000292
R13: ffff8af08fecfc38 R14: 000000000001ab80 R15: ffffffff8881d6da
FS:  0000000000000000(0000) GS:ffff8af0bfc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa2b0d31000 CR3: 000000077a226000 CR4: 0000000000760ee0
PKRU: 00000000
Call Trace:
[<ffffffff88cd94e2>] ? cookie_hash+0x22/0x110
[<ffffffff88632f70>] ? setup_data_read+0xd0/0xd0
[<ffffffff88cd94e3>] ? cookie_hash+0x23/0x110
[<ffffffff88711b4d>] on_each_cpu+0x2d/0x60
[<ffffffff88cd94e2>] ? cookie_hash+0x22/0x110
[<ffffffff886337c4>] text_poke_bp+0x94/0xf0
[<ffffffff88630588>] arch_jump_label_transform+0x68/0xb0
[<ffffffff887b39af>] __jump_label_update+0x5f/0xa0
[<ffffffff887b3a8d>] jump_label_update+0x9d/0xb0
[<ffffffff887b3d5d>] __static_key_slow_dec+0x6d/0xb0
[<ffffffff887b3dc2>] static_key_slow_dec+0x22/0x50
[<ffffffff88c54343>] __net_random_once_deferred+0x23/0x30
[<ffffffff886b9ebf>] process_one_work+0x17f/0x440
[<ffffffff886baf56>] worker_thread+0x126/0x3c0
[<ffffffff886bae30>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff886c1da1>] kthread+0xd1/0xe0
[<ffffffff886c1cd0>] ? insert_kthread_work+0x40/0x40
[<ffffffff88d75c24>] ret_from_fork_nospec_begin+0xe/0x21
[<ffffffff886c1cd0>] ? insert_kthread_work+0x40/0x40
Code: 48 63 35 3e 83 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 bc 34 89 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 0d 83 c4 00 eb b7 0f b6 4d cc 4c 89 

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/2:0:33143]
Modules linked in: vmw_vsock_vmci_transport vsock vfat fat sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev sg pcspkr tpm_crb parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx crct10dif_pclmul crct10dif_common crc32c_intel drm_kms_helper syscopyarea sysfillrect sysimgblt e1000e fb_sys_fops mptsas serio_raw ttm scsi_transport_sas ahci mptscsih libahci drm ptp mptbase pps_core ata_piix libata drm_panel_orientation_quirks nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 33143 Comm: kworker/2:0 Kdump: loaded Tainted: G        W    L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.17369862.B64.2012240522 12/24/2020
Workqueue: events __net_random_once_deferred
task: ffffa082cede5140 ti: ffffa083cd910000 task.ti: ffffa083cd910000
RIP: 0010:[<ffffffff9a51173a>]  [<ffffffff9a51173a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffffa083cd913c88  EFLAGS: 00000202
RAX: 000000000000000e RBX: 00000000000000fc RCX: ffffa085dd9a04b8
RDX: 000000000000000e RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffffa083cd913cc0 R08: ffffa07f3450cc00 R09: ffffffff9a7755c9
R10: ffffa085dd69f160 R11: ffffef45a01e8e00 R12: 0000000000000292
R13: ffffa083cd913c38 R14: 0000000000000400 R15: 0000000000000c00
FS:  0000000000000000(0000) GS:ffffa085dd680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4dea7faf40 CR3: 000000054e810000 CR4: 00000000001607e0
Call Trace:
[<ffffffff9aad8162>] ? cookie_hash+0x22/0x110
[<ffffffff9a432f70>] ? setup_data_read+0xd0/0xd0
[<ffffffff9aad8163>] ? cookie_hash+0x23/0x110
[<ffffffff9a5117fd>] on_each_cpu+0x2d/0x60
[<ffffffff9aad8162>] ? cookie_hash+0x22/0x110
[<ffffffff9a43379a>] text_poke_bp+0x6a/0xf0
[<ffffffff9a430588>] arch_jump_label_transform+0x68/0xb0
[<ffffffff9a5b33ef>] __jump_label_update+0x5f/0xa0
[<ffffffff9a5b34cd>] jump_label_update+0x9d/0xb0
[<ffffffff9a5b379d>] __static_key_slow_dec+0x6d/0xb0
[<ffffffff9a5b3802>] static_key_slow_dec+0x22/0x50
[<ffffffff9aa532c3>] __net_random_once_deferred+0x23/0x30
[<ffffffff9a4b9d4f>] process_one_work+0x17f/0x440
[<ffffffff9a4bade6>] worker_thread+0x126/0x3c0
[<ffffffff9a4bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff9a4c1c31>] kthread+0xd1/0xe0
[<ffffffff9a4c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffff9ab74c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9a4c1b60>] ? insert_kthread_work+0x40/0x40
Code: 48 63 35 4e 83 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 b9 14 9b f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 1d 83 c4 00 eb b7 0f b6 4d cc 4c 89 

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [kworker/3:3:1263]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event crc32_pclmul snd_ens1371 snd_rawmidi ghash_clmulni_intel snd_ac97_codec ac97_bus ppdev snd_seq snd_seq_device aesni_intel snd_pcm lrw vmw_balloon gf128mul glue_helper ablk_helper cryptd joydev snd_timer pcspkr snd soundcore
sg vmw_vmci i2c_piix4 parport_pc parport sch_fq_codel ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx nfit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops libnvdimm ttm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel drm libata mptspi scsi_transport_spi e1000 serio_raw mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 1263 Comm: kworker/3:3 Kdump: loaded Not tainted 3.10.0-1160.88.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
Workqueue: events __net_random_once_deferred
task: ffff95b93201c200 ti: ffff95b932e80000 task.ti: ffff95b932e80000
RIP: 0010:[<ffffffff8331e1ca>]  [<ffffffff8331e1ca>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff95b932e83c88  EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00000000000000fc RCX: ffff95b939620650
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff95b932e83cc0 R08: ffff95b936663800 R09: ffffffff8359c669
R10: ffff95b9396df160 R11: ffffd1fb42fd6e00 R12: 0000000000000292
R13: ffff95b932e83c38 R14: 0000000000000717 R15: 0000000000000400
FS:  0000000000000000(0000) GS:ffff95b9396c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fece8d21000 CR3: 00000000b09a8000 CR4: 0000000000360fe0
Call Trace:
[<ffffffff83876712>] ? __skb_get_hash_symmetric+0x22/0x1b0
[<ffffffff832355c0>] ? setup_data_read+0xd0/0xd0
[<ffffffff83876713>] ? __skb_get_hash_symmetric+0x23/0x1b0
[<ffffffff8331e28d>] on_each_cpu+0x2d/0x60
[<ffffffff83876712>] ? __skb_get_hash_symmetric+0x22/0x1b0
[<ffffffff8323617a>] text_poke_bp+0x6a/0xf0
[<ffffffff832328f8>] arch_jump_label_transform+0x68/0xb0
[<ffffffff833c5e6f>] __jump_label_update+0x5f/0xa0
[<ffffffff833c5f4d>] jump_label_update+0x9d/0xb0
[<ffffffff833c623d>] __static_key_slow_dec+0x7d/0xc0
[<ffffffff833c62a2>] static_key_slow_dec+0x22/0x50
[<ffffffff83899fb3>] __net_random_once_deferred+0x23/0x40
[<ffffffff832c32ef>] process_one_work+0x17f/0x440
[<ffffffff832c4436>] worker_thread+0x126/0x3c0
[<ffffffff832c4310>] ? manage_workers.isra.26+0x2b0/0x2b0
[<ffffffff832cb621>] kthread+0xd1/0xe0
[<ffffffff832cb550>] ? insert_kthread_work+0x40/0x40
[<ffffffff839c51dd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff832cb550>] ? insert_kthread_work+0x40/0x40
Code: 48 63 35 7e 18 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 00 19 f5 83 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 4d 18 c4 00 eb b7 0f b6 4d cc 4c 89 

NMI watchdog: BUG: soft lockup - CPU#16 stuck for 21s! [kworker/16:1:771]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg pcspkr joydev i2c_piix4 vmw_vmci parport_pc parport binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic
pata_acpi sd_mod vmwgfx crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm crct10dif_pclmul libahci ata_piix crct10dif_common nfit crc32c_intel libata libnvdimm serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 16 PID: 771 Comm: kworker/16:1 Kdump: loaded Tainted: G             L ------------   3.10.0-1160.6.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/28/2017
Workqueue: events __net_random_once_deferred
task: ffff98494feb1080 ti: ffff98494fd1c000 task.ti: ffff98494fd1c000
RIP: 0010:[<ffffffff84f16c58>]  [<ffffffff84f16c58>] smp_call_function_many+0x208/0x270
RSP: 0018:ffff98494fd1fc88  EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00000000000000fc RCX: ffff984955620858
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff98494fd1fcc0 R08: ffff984079f86c00 R09: ffffffff85185fd9
R10: ffff984955a1f160 R11: ffffee44c5a3ea00 R12: 0000000000000292
R13: ffff98494fd1fc38 R14: 0000000000000100 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff984955a00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f94572325b0 CR3: 000000015e796000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 00000000
Call Trace:
[<ffffffff854f5d22>] ? cookie_hash+0x22/0x110
[<ffffffff84e34260>] ? setup_data_read+0xd0/0xd0
[<ffffffff854f5d23>] ? cookie_hash+0x23/0x110
[<ffffffff84f16d1d>] on_each_cpu+0x2d/0x60
[<ffffffff854f5d22>] ? cookie_hash+0x22/0x110
[<ffffffff84e34a8a>] text_poke_bp+0x6a/0xf0
[<ffffffff84e316a8>] arch_jump_label_transform+0x68/0xb0
[<ffffffff84fbaecf>] __jump_label_update+0x5f/0xa0
[<ffffffff84fbafad>] jump_label_update+0x9d/0xb0
[<ffffffff84fbb27d>] __static_key_slow_dec+0x6d/0xb0
[<ffffffff84fbb2e2>] static_key_slow_dec+0x22/0x50
[<ffffffff8546efc3>] __net_random_once_deferred+0x23/0x30
[<ffffffff84ebdc4f>] process_one_work+0x17f/0x440
[<ffffffff84ebed66>] worker_thread+0x126/0x3c0
[<ffffffff84ebec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff84ec5c21>] kthread+0xd1/0xe0
[<ffffffff84ec5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffff85594df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff84ec5b50>] ? insert_kthread_work+0x40/0x40
Code: 28 00 48 63 35 ce 88 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 b5 85 f6 41 20 01 74 cd 0f 1f 44 00 00 <f3> 90 f6 41 20 01 75 f8 48 63 35 9d 88 c4 00 eb b7 0f b6 4d cc 

NMI watchdog: BUG: soft lockup - CPU#4 stuck for 67s! [kworker/4:0:30]
Modules linked in: vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event snd_ens1371 iosf_mbi snd_rawmidi crc32_pclmul snd_ac97_codec ghash_clmulni_intel ac97_bus btusb snd_seq btrtl btbcm ppdev btintel snd_seq_device bluetooth vmw_balloon snd_pcm aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_timer snd joydev pcspkr rfkill sg soundcore vmw_vmci i2c_piix4 parport_pc parport binfmt_misc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul libata crct10dif_common crc32c_intel mptspi nfit scsi_transport_spi serio_raw mptscsih libnvdimm e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 4 PID: 30 Comm: kworker/4:0 Kdump: loaded Tainted: G             L ------------   3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
Workqueue: events __net_random_once_deferred
task: ffff95c93418a0e0 ti: ffff95c934194000 task.ti: ffff95c934194000
RIP: 0010:[<ffffffffb5b1760a>]  [<ffffffffb5b1760a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff95c934197c88  EFLAGS: 00000202
RAX: 0000000000000006 RBX: 00000000000000fc RCX: ffff95cfdd7a0678
RDX: 0000000000000006 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff95c934197cc0 R08: ffff95c93455c400 R09: ffffffffb5d85099
R10: ffff95cfdd71f160 R11: ffffe13ba05c8e00 R12: 0000000000000292
R13: ffff95c934197c38 R14: ffff95c934197bf8 R15: 0000000000000292
FS:  0000000000000000(0000) GS:ffff95cfdd700000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007efd2a3e7000 CR3: 000000081d766000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffb6048aa5>] ? net_secret_init+0x5/0x30
[<ffffffffb5a34260>] ? setup_data_read+0xd0/0xd0
[<ffffffffb6048aa6>] ? net_secret_init+0x6/0x30
[<ffffffffb5b176cd>] on_each_cpu+0x2d/0x60
[<ffffffffb6048aa5>] ? net_secret_init+0x5/0x30
[<ffffffffb5a34ab4>] text_poke_bp+0x94/0xf0
[<ffffffffb5a316a8>] arch_jump_label_transform+0x68/0xb0
[<ffffffffb5bbb61f>] __jump_label_update+0x5f/0xa0
[<ffffffffb5bbb6fd>] jump_label_update+0x9d/0xb0
[<ffffffffb5bbb9cd>] __static_key_slow_dec+0x6d/0xb0
[<ffffffffb5bbba32>] static_key_slow_dec+0x22/0x50
[<ffffffffb606de53>] __net_random_once_deferred+0x23/0x30
[<ffffffffb5abe6bf>] process_one_work+0x17f/0x440
[<ffffffffb5abf7d6>] worker_thread+0x126/0x3c0
[<ffffffffb5abf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffb5ac6691>] kthread+0xd1/0xe0
[<ffffffffb5ac65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb6192d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb5ac65c0>] ? insert_kthread_work+0x40/0x40
Code: 48 63 35 1e 7b c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 0f 75 b6 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ed 7a c4 00 eb b7 0f b6 4d cc 4c 89 

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/2:0:86220]
INFO: rcu_sched detected stalls on CPUs/tasks: { 15} 
Modules linked in:
tcp_lp xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi sb_edac snd_ac97_codec coretemp ac97_bus snd_seq snd_seq_device iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw snd_pcm gf128mul glue_helper ablk_helper ppdev snd_timer cryptd vmw_balloon snd
soundcore pcspkr joydev vmw_vmci sg i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common crc32c_intel libata mptspi scsi_transport_spi e1000 mptscsih serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 86220 Comm: kworker/2:0 Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events __net_random_once_deferred
task: ffff9af49e7ae300 ti: ffff9af852380000 task.ti: ffff9af852380000
RIP: 0010:[<ffffffffbcb16c0a>]  [<ffffffffbcb16c0a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9af852383c88  EFLAGS: 00000202
RAX: 000000000000000f RBX: 00000000000000fc RCX: ffff9b037d9e0628
RDX: 000000000000000f RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff9af852383cc0 R08: ffff9af4e4344000 R09: ffffffffbcd85f99
R10: ffff9b037d69f160 R11: ffffda7dfe803400 R12: 0000000000000292
R13: ffff9af852383c38 R14: 0000000000000414 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff9b037d680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000022034f401000 CR3: 000000098f010000 CR4: 00000000001607e0
Call Trace:
[<ffffffffbd09ad9c>] ? update_or_create_fnhe+0x3c/0x2d0
[<ffffffffbca34260>] ? setup_data_read+0xd0/0xd0
[<ffffffffbd09ad9d>] ? update_or_create_fnhe+0x3d/0x2d0
[<ffffffffbcb16ccd>] on_each_cpu+0x2d/0x60
[<ffffffffbd09ad9c>] ? update_or_create_fnhe+0x3c/0x2d0
[<ffffffffbca34a8a>] text_poke_bp+0x6a/0xf0
[<ffffffffbca316a8>] arch_jump_label_transform+0x68/0xb0
[<ffffffffbcbbae8f>] __jump_label_update+0x5f/0xa0
[<ffffffffbcbbaf6d>] jump_label_update+0x9d/0xb0
[<ffffffffbcbbb23d>] __static_key_slow_dec+0x6d/0xb0
[<ffffffffbcbbb2a2>] static_key_slow_dec+0x22/0x50
[<ffffffffbd06ef63>] __net_random_once_deferred+0x23/0x30
[<ffffffffbcabdc4f>] process_one_work+0x17f/0x440
[<ffffffffbcabed66>] worker_thread+0x126/0x3c0
[<ffffffffbcabec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffbcac5c21>] kthread+0xd1/0xe0
[<ffffffffbcac5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffffbd193df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffbcac5b50>] ? insert_kthread_work+0x40/0x40
Code: 48 63 35 1e 89 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 75 bd f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ed 88 c4 00 eb b7 0f b6 4d cc 4c 89 

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [atop:6469]
Modules linked in: ipmi_devintf ipmi_msghandler ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter dm_mirror dm_region_hash ext4 dm_log dm_mod mbcache jbd2 ppdev crc32_pclmul ghash_clmulni_intel aesni_intel parport_pc sg lrw gf128mul glue_helper ablk_helper virtio_balloon cryptd parport i2c_piix4 pcspkr joydev ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net
net_failover virtio_blk failover cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata crct10dif_pclmul crct10dif_common serio_raw crc32c_intel virtio_pci floppy virtio_ring virtio drm_panel_orientation_quirks
CPU: 3 PID: 6469 Comm: atop Kdump: loaded Tainted: G             L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 1.11.0-2.el7 04/01/2014
task: ffff944e82b641c0 ti: ffff944f750ec000 task.ti: ffff944f750ec000
RIP: 0010:[<ffffffffaf916f72>]  [<ffffffffaf916f72>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff944f750efd30  EFLAGS: 00000202
RAX: 0000000000000008 RBX: ffff944f750efd00 RCX: 0000000000000038
RDX: 00000000000000ff RSI: 0000000000000008 RDI: 0000000000000286
RBP: ffff944f750efd80 R08: ffffffffb00136c0 R09: 0000000000000000
R10: 0000000000000024 R11: 0000000000000246 R12: ffff944f750efd50
R13: ffffffffafa58f78 R14: ffff944f750efca0 R15: ffff944e82b641c0
FS:  00007f960bd65740(0000) GS:ffff944fffcc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [kworker/5:2:22297]
Modules linked in: ipmi_devintf ipmi_msghandler ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter dm_mirror dm_region_hash ext4 dm_log dm_mod mbcache jbd2 ppdev crc32_pclmul ghash_clmulni_intel aesni_intel parport_pc sg lrw gf128mul glue_helper ablk_helper virtio_balloon cryptd parport i2c_piix4 pcspkr joydev ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net
net_failover virtio_blk failover cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata crct10dif_pclmul crct10dif_common serio_raw crc32c_intel virtio_pci floppy virtio_ring virtio drm_panel_orientation_quirks
CPU: 5 PID: 22297 Comm: kworker/5:2 Kdump: loaded Tainted: G             L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 1.11.0-2.el7 04/01/2014
Workqueue: events __net_random_once_deferred
task: ffff944c2d18d230 ti: ffff944ea2048000 task.ti: ffff944ea2048000
RIP: 0010:[<ffffffffaf91761a>]  [<ffffffffaf91761a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff944ea204bc88  EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00000000000000fc RCX: ffff944fffc20650
RDX: 0000000000000000 RSI: 0000000000000008 RDI: 0000000000000000
RBP: ffff944ea204bcc0 R08: ffff944d3a321800 R09: ffffffffafb851b9
R10: ffff944fffd5f160 R11: fffff30741c82e00 R12: 0000000000000292
R13: 0000000000000018 R14: ffff944ea204bbf8 R15: 0000000000000292
FS:  0000000000000000(0000) GS:ffff944fffd40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000596dc38 CR3: 0000000033210000 CR4: 0000000000760fe0
PKRU: 00000000
Call Trace:
[<ffffffffafe9e8fb>] ? ipqhashfn+0x1b/0xb0
[<ffffffffaf834260>] ? setup_data_read+0xd0/0xd0
[<ffffffffafe9e8fc>] ? ipqhashfn+0x1c/0xb0
[<ffffffffaf9176dd>] on_each_cpu+0x2d/0x60
[<ffffffffafe9e8fb>] ? ipqhashfn+0x1b/0xb0
[<ffffffffaf834a8a>] text_poke_bp+0x6a/0xf0
[<ffffffffaf8316a8>] arch_jump_label_transform+0x68/0xb0
[<ffffffffaf9bb6cf>] __jump_label_update+0x5f/0xa0
[<ffffffffaf9bb7ad>] jump_label_update+0x9d/0xb0
[<ffffffffaf9bba7d>] __static_key_slow_dec+0x6d/0xb0
[<ffffffffaf9bbae2>] static_key_slow_dec+0x22/0x50
[<ffffffffafe6de53>] __net_random_once_deferred+0x23/0x30
[<ffffffffaf8be6bf>] process_one_work+0x17f/0x440
[<ffffffffaf8bf7d6>] worker_thread+0x126/0x3c0
[<ffffffffaf8bf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffaf8c6691>] kthread+0xd1/0xe0
[<ffffffffaf8c65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffaff92d1d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffaf8c65c0>] ? insert_kthread_work+0x40/0x40
Code: 48 63 35 ce 7b c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 10 55 b0 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 7b c4 00 eb b7 0f b6 4d cc 4c 89 

NMI watchdog: BUG: soft lockup - CPU#8 stuck for 23s! [kworker/8:1:203]
Modules linked in: xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge devlink ebtable_filter ebtables ip6table_filter ip6_tables ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_CHECKSUM iptable_mangle iptable_security iptable_raw iptable_filter iTCO_wdt iTCO_vendor_support vfat fat sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic joydev snd_hda_intel pcspkr snd_hda_codec snd_hda_core snd_hwdep sg i2c_i801 snd_seq snd_seq_device snd_pcm snd_timer snd ioatdma lpc_ich soundcore dca ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic nouveau mxm_wmi wmi video i2c_algo_bit drm_kms_helper crct10dif_pclmul crct10dif_common crc32_pclmul
crc32c_intel syscopyarea ghash_clmulni_intel sysfillrect sysimgblt fb_sys_fops ttm aesni_intel ahci lrw gf128mul glue_helper ablk_helper cryptd 8021q drm libahci serio_raw garp mrp stp llc libata r8169 mii scsi_transport_iscsi drm_panel_orientation_quirks sunrpc dm_mirror dm_region_hash dm_log dm_mod
CPU: 8 PID: 203 Comm: kworker/8:1 Kdump: loaded Not tainted 3.10.0-957.el7.x86_64 #1
Hardware name: To be filled by O.E.M. To be filled by O.E.M./Intel X79, BIOS 4.6.5 12/17/2019
Workqueue: events __net_random_once_deferred
task: ffff8e9384571040 ti: ffff8e9383808000 task.ti: ffff8e9383808000
RIP: 0010:[<ffffffffbaf1173a>]  [<ffffffffbaf1173a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8e938380bc88  EFLAGS: 00000202
RAX: 0000000000000019 RBX: 0000002000000008 RCX: ffff8e938f4605c0
RDX: 0000000000000019 RSI: 0000000000000020 RDI: 0000000000000000
RBP: ffff8e938380bcc0 R08: ffff8e74d2e75c00 R09: ffffffffbb1755c9
R10: ffff8e938f01f160 R11: ffffe04057018200 R12: 000000fcbb17551f
R13: 0000000000000296 R14: 0000000000000296 R15: ffff8e938380bc38
FS:  0000000000000000(0000) GS:ffff8e938f000000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc0737d3000 CR3: 00000014e8e10000 CR4: 00000000000607e0
Call Trace:
[<ffffffffbb47eb4b>] ? find_exception+0x1b/0xc0
[<ffffffffbae32f70>] ? setup_data_read+0xd0/0xd0
[<ffffffffbb47eb4c>] ? find_exception+0x1c/0xc0
[<ffffffffbaf117fd>] on_each_cpu+0x2d/0x60
[<ffffffffbb47eb4b>] ? find_exception+0x1b/0xc0
[<ffffffffbae3379a>] text_poke_bp+0x6a/0xf0
[<ffffffffbae30588>] arch_jump_label_transform+0x68/0xb0
[<ffffffffbafb33ef>] __jump_label_update+0x5f/0xa0
[<ffffffffbafb34cd>] jump_label_update+0x9d/0xb0
[<ffffffffbafb379d>] __static_key_slow_dec+0x6d/0xb0
[<ffffffffbafb3802>] static_key_slow_dec+0x22/0x50
[<ffffffffbb4532c3>] __net_random_once_deferred+0x23/0x30
[<ffffffffbaeb9d4f>] process_one_work+0x17f/0x440
[<ffffffffbaebade6>] worker_thread+0x126/0x3c0
[<ffffffffbaebacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffffbaec1c31>] kthread+0xd1/0xe0
[<ffffffffbaec1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffffbb574c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffbaec1b60>] ? insert_kthread_work+0x40/0x40
Code: 48 63 35 4e 83 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 b9 b4 bb f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 1d 83 c4 00 eb b7 0f b6 4d cc 4c 89 

NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [kworker/6:1:43161]
Modules linked in: rfcomm bnep btusb btrtl btbcm btintel bluetooth rfkill binfmt_misc tcp_lp nls_utf8 isofs fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul sg glue_helper pcspkr ppdev ablk_helper joydev cryptd vmw_balloon parport_pc parport
vmw_vmci i2c_piix4 sch_fq_codel ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit mptspi ata_piix scsi_transport_spi libnvdimm drm crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw mptscsih e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 6 PID: 43161 Comm: kworker/6:1 Kdump: loaded Not tainted 3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
Workqueue: events __net_random_once_deferred
task: ffff881cb46a41c0 ti: ffff881bf4800000 task.ti: ffff881bf4800000
RIP: 0010:[<ffffffffaff1760a>]  [<ffffffffaff1760a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff881bf4803c88  EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00000000000000fc RCX: ffff881cb96206c8
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff881bf4803cc0 R08: ffff881cb7664400 R09: ffffffffb0185099
R10: ffff881cb979f160 R11: ffffdff741007a00 R12: 0000000000000292
R13: ffff881bf4803c38 R14: 0000000000000300 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff881cb9780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4d140d3d54 CR3: 00000000b3bac000 CR4: 00000000003607e0
Call Trace:
[<ffffffffb04493d1>] ? flow_hash_from_keys+0x11/0x250
[<ffffffffafe34260>] ? setup_data_read+0xd0/0xd0
[<ffffffffb04493d2>] ? flow_hash_from_keys+0x12/0x250
[<ffffffffaff176cd>] on_each_cpu+0x2d/0x60
[<ffffffffb04493d1>] ? flow_hash_from_keys+0x11/0x250
[<ffffffffafe34a8a>] text_poke_bp+0x6a/0xf0
[<ffffffffafe316a8>] arch_jump_label_transform+0x68/0xb0
[<ffffffffaffbb61f>] __jump_label_update+0x5f/0xa0
[<ffffffffaffbb6fd>] jump_label_update+0x9d/0xb0
[<ffffffffaffbb9cd>] __static_key_slow_dec+0x6d/0xb0
[<ffffffffaffbba32>] static_key_slow_dec+0x22/0x50
[<ffffffffb046de53>] __net_random_once_deferred+0x23/0x30
[<ffffffffafebe6bf>] process_one_work+0x17f/0x440
[<ffffffffafebf7d6>] worker_thread+0x126/0x3c0
[<ffffffffafebf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffafec6691>] kthread+0xd1/0xe0
[<ffffffffafec65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb0592d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffafec65c0>] ? insert_kthread_work+0x40/0x40
Code: 48 63 35 1e 7b c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 0f b5 b0 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ed 7a c4 00 eb b7 0f b6 4d cc 4c 89