NMI watchdog: BUG: soft lockup - CPU#5 stuck for 21s! [ksoftirqd/5:34]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc nfit libnvdimm coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr vmw_vmci parport_pc sg parport i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw pata_acpi vmwgfx drm_kms_helper floppy syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi mptscsih drm
mptbase ata_piix libata vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 34 Comm: ksoftirqd/5 Kdump: loaded Not tainted 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff921a79c75140 ti: ffff921a79c94000 task.ti: ffff921a79c94000
RIP: 0010:[<ffffffff9e61b338>]  [<ffffffff9e61b338>] __slab_free+0xa8/0x2f0
RSP: 0018:ffff921a79c97cc0  EFLAGS: 00010246
RAX: 0000000000000000 RBX: ffff921a79c97c60 RCX: 00000001002a002a
RDX: ffff921d1f24f840 RSI: ffff921d1f24f840 RDI: ffff921a7fc03a00
RBP: ffff921a79c97d68 R08: 0000000000000001 R09: ffffffff9e658ef6
R10: ffff921d3fd5f0c0 R11: ffffdcafd07c93c0 R12: ffff921a79c97c40
R13: ffffffffffffffff R14: ffff921a7b988d00 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff921d3fd40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f20c339ac70 CR3: 0000000435410000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9e658ef6>] ? __d_free+0x26/0x40
[<ffffffff9e61bc46>] kfree+0x106/0x140
[<ffffffff9e658ef6>] __d_free+0x26/0x40
[<ffffffff9e554940>] rcu_process_callbacks+0x1e0/0x580
[<ffffffff9e4a0f05>] __do_softirq+0xf5/0x280
[<ffffffff9e4a10c8>] run_ksoftirqd+0x38/0x50
[<ffffffff9e4ca5c4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff9e4ca480>] ? lg_double_unlock+0x40/0x40
[<ffffffff9e4c1c31>] kthread+0xd1/0xe0
[<ffffffff9e4c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffff9eb74c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9e4c1b60>] ? insert_kthread_work+0x40/0x40
Code: 5f fd ff ff 84 c0 0f 85 9f 00 00 00 4d 85 ed 0f 85 7b 01 00 00 49 63 47 20 48 8b 4b 18 4c 8b 63 10 48 8b 74 24 10 48 89 4c 24 48 <4c> 89 24 06 89 c8 c1 e8 18 41 89 c6 41 c0 ee 07 41 0f b6 c6 41 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [ksoftirqd/1:14]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr joydev sg vmw_vmci parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm ahci serio_raw libahci nfit libnvdimm ata_piix mptspi scsi_transport_spi libata
mptscsih mptbase e1000 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 14 Comm: ksoftirqd/1 Kdump: loaded Tainted: G             L ------------   3.10.0-1160.66.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff8f4ebaf80000 ti: ffff8f4ebaf3c000 task.ti: ffff8f4ebaf3c000
RIP: 0010:[<ffffffffa8466488>]  [<ffffffffa8466488>] __d_free+0x18/0x40
RSP: 0018:ffff8f4ebaf3fda0  EFLAGS: 00000296
RAX: ffffffffa8466470 RBX: ffff8f4ebaf80068 RCX: 00000001800c0002
RDX: ffff8f4de95318f0 RSI: ffffd21644f8fc80 RDI: ffff8f4de9531878
RBP: ffff8f4ebaf3fda8 R08: ffff8f4e7e3f37a0 R09: 00000001800c0002
R10: 000000007e3f3501 R11: ffff8f4e7e3f37a0 R12: ffff8f4ebaf80068
R13: ffff8f4f00000001 R14: ffff8f4f767db6c0 R15: ffff8f4ebfc00001
FS:  0000000000000000(0000) GS:ffff8f4f7fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007faab5ff5000 CR3: 000000020ab66000 CR4: 00000000003607e0
Call Trace:
[<ffffffffa835ab28>] rcu_process_callbacks+0x1d8/0x570
[<ffffffffa82a4d85>] __do_softirq+0xf5/0x280
[<ffffffffa82a4f48>] run_ksoftirqd+0x38/0x50
[<ffffffffa82ce9e4>] smpboot_thread_fn+0x144/0x1a0
[<ffffffffa82ce8a0>] ? lg_double_unlock+0x40/0x40
[<ffffffffa82c5f91>] kthread+0xd1/0xe0
[<ffffffffa82c5ec0>] ? insert_kthread_work+0x40/0x40
[<ffffffffa8999ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffa82c5ec0>] ? insert_kthread_work+0x40/0x40
Code: ff 5d 90 c3 0f 1f 44 00 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 53 48 8d 9f 50 ff ff ff 48 8b bf 78 ff ff ff <48> 8d 43 38 48 39 c7 74 05 e8 4a 05 fc ff 48 8b 3d fb f4 af 00 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ksoftirqd/0:6]
Modules linked in: veth nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM tun devlink overlay(T) xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_mark ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr
sg joydev parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom vmwgfx sd_mod crc_t10dif crct10dif_generic ata_generic drm_kms_helper pata_acpi ahci syscopyarea sysfillrect sysimgblt fb_sys_fops libahci ttm ata_piix nfit drm libnvdimm crct10dif_pclmul libata crct10dif_common vmw_pvscsi serio_raw crc32c_intel drm_panel_orientation_quirks vmxnet3
CPU: 0 PID: 6 Comm: ksoftirqd/0 Kdump: loaded Tainted: G             L ------------ T 3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9a32fa325230 ti: ffff9a32fa364000 task.ti: ffff9a32fa364000
RIP: 0010:[<ffffffffa5623ec5>]  [<ffffffffa5623ec5>] kfree+0x55/0x140
RSP: 0018:ffff9a32fa367d78  EFLAGS: 00010286
RAX: ffffe8f790b7cb00 RBX: ffff9a34bea6e300 RCX: 000000010015000a
RDX: 000065ce00000000 RSI: ffffe8f78cfa9b80 RDI: ffff9a35adf2c440
RBP: ffff9a32fa367d90 R08: ffff9a34bea6e300 R09: 000000010015000a
R10: 00000000bea6eb01 R11: ffff9a34bea6e300 R12: 0000000100000000
R13: ffff9a34bea6e300 R14: ffff9a35bfc1ac80 R15: ffffffffa5623c7d
FS:  0000000000000000(0000) GS:ffff9a35bfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000556831e0df20 CR3: 0000000429a10000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa5662b46>] __d_free+0x26/0x40
[<ffffffffa555a4f8>] rcu_process_callbacks+0x1d8/0x570
[<ffffffffa54a5435>] __do_softirq+0xf5/0x280
[<ffffffffa54a55f8>] run_ksoftirqd+0x38/0x50
[<ffffffffa54ced54>] smpboot_thread_fn+0x144/0x1a0
[<ffffffffa54cec10>] ? lg_double_unlock+0x40/0x40
[<ffffffffa54c6321>] kthread+0xd1/0xe0
[<ffffffffa54c6250>] ? insert_kthread_work+0x40/0x40
[<ffffffffa5b8dd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa54c6250>] ? insert_kthread_work+0x40/0x40
Code: 8b 15 70 41 9f 00 48 01 d8 72 0e 48 c7 c2 00 00 00 80 48 2b 15 0d 17 a2 00 48 01 d0 48 c1 e8 0c 48 c1 e0 06 48 03 05 eb 16 a2 00 <48> 8b 10 80 e6 80 0f 85 c8 00 00 00 49 89 c3 49 8b 03 a8 80 0f 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [ksoftirqd/1:14]
Modules linked in: binfmt_misc udp_diag tcp_diag inet_diag nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip6t_REJECT nf_reject_ipv6 nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr virtio_balloon parport_pc parport i2c_piix4 ip_tables ext4 mbcache jbd2 virtio_net virtio_blk cirrus drm_kms_helper ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm floppy ata_piix libata virtio_pci virtio_ring
virtio drm_panel_orientation_quirks
CPU: 1 PID: 14 Comm: ksoftirqd/1 Tainted: G             L ------------   3.10.0-957.10.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
task: ffff8f827c1a8000 ti: ffff8f827c1b0000 task.ti: ffff8f827c1b0000
RIP: 0010:[<ffffffff88a1bae6>]  [<ffffffff88a1bae6>] kmem_cache_free+0x56/0x200
RSP: 0018:ffff8f827c1b3d78  EFLAGS: 00010286
RAX: fffff9f1c122e700 RBX: 0000000100013d18 RCX: ffff8f827fd162a0
RDX: 0000707d80000000 RSI: ffff8f8248b9c3c0 RDI: ffff8f827d145d00
RBP: ffff8f827c1b3d90 R08: ffff8f827b6113c0 R09: ffffffff88a59575
R10: 000000007b611501 R11: fffff9f1c1ed8440 R12: ffff8f827b6113c0
R13: ffff8f820adc4000 R14: ffff8f820adc4000 R15: ffffffff88a1b821
FS:  0000000000000000(0000) GS:ffff8f827fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000a0f9d001 CR3: 0000000079492000 CR4: 00000000000406e0
Call Trace:
[<ffffffff88a59575>] __d_free+0x35/0x40
[<ffffffff88954c70>] rcu_process_callbacks+0x1e0/0x580
[<ffffffff888a0f45>] __do_softirq+0xf5/0x280
[<ffffffff888a1108>] run_ksoftirqd+0x38/0x50
[<ffffffff888ca604>] smpboot_thread_fn+0x144/0x1a0
[<ffffffff888ca4c0>] ? lg_double_unlock+0x40/0x40
[<ffffffff888c1c71>] kthread+0xd1/0xe0
[<ffffffff888c1ba0>] ? insert_kthread_work+0x40/0x40
[<ffffffff88f75c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff888c1ba0>] ? insert_kthread_work+0x40/0x40
Code: b8 00 00 00 80 4c 8b 4d 08 48 8b 15 45 c5 9f 00 48 01 d8 0f 83 a4 00 00 00 48 01 d0 48 c1 e8 0c 48 c1 e0 06 48 03 05 8a 96 a2 00 <48> 8b 10 80 e6 80 0f 85 59 01 00 00 49 89 c3 4c 8b 17 65 4c 03