NMI watchdog: BUG: soft lockup - CPU#9 stuck for 21s! [replication-502:31538]
Modules linked in: binfmt_misc vfat fat isofs ext4 mbcache jbd2 vxlan ip6_udp_tunnel udp_tunnel iptable_mangle xt_mark veth xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) vboxpci(OE) vboxnetadp(OE) vboxnetflt(OE) vboxdrv(OE) vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr nfit ppdev joydev vmw_balloon sg libnvdimm shpchp parport_pc parport vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod
vmwgfx crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw vmxnet3 i2c_core vmw_pvscsi floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 9 PID: 31538 Comm: replication-502 Tainted: G           OEL ------------ T 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff880b4ff54f10 ti: ffff880991a54000 task.ti: ffff880991a54000
RIP: 0010:[<ffffffff810fa232>]  [<ffffffff810fa232>] native_queued_spin_lock_slowpath+0x22/0x1e0
RSP: 0000:ffff880991a57d28  EFLAGS: 00000202
RAX: 0000000000000001 RBX: ffffffff810c0548 RCX: ffff880000000000
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffea001049ff30
RBP: ffff880991a57d28 R08: ffff88081d2bd950 R09: 0000000000000001
R10: 0000000000000001 R11: 0000000000000001 R12: ffffffff81050b5c
R13: ffff880991a57c98 R14: ffffffff8105a353 R15: ffff880991a57c88
FS:  00007fe907aad700(0000) GS:ffff88103fcc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055de535e7ea0 CR3: 000000081f662000 CR4: 00000000000407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff880991a57d38 ffffffff8169e5ff ffff880991a57d48 ffffffff816abb50
ffff880991a57e48 ffffffff811b9a44 000055de6c600000 ffff88081c688c80
0000000000000000 000055de7c5fffff 0000000000000000 000055de7c600000
Call Trace:
[<ffffffff8169e5ff>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffff816abb50>] _raw_spin_lock+0x20/0x30
[<ffffffff811b9a44>] change_protection_range+0x354/0x7e0
[<ffffffff811b9f35>] change_protection+0x65/0xa0
[<ffffffff811d298b>] change_prot_numa+0x1b/0x40
[<ffffffff810c9282>] task_numa_work+0x202/0x350
[<ffffffff810ad247>] task_work_run+0xa7/0xf0
[<ffffffff8102ab62>] do_notify_resume+0x92/0xb0
[<ffffffff816ac2fc>] retint_signal+0x48/0x8c
Code: 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 66 90 ba 01 00 00 00 8b 07 85 c0 75 0a f0 0f b1 17 85 c0 75 f2 5d c3 f3 90 <eb> ec 0f 1f 40 00 81 fe 00 01 00 00 66 90 0f 84 5c 01 00 00 41 

NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [mysqld:1862]
Modules linked in: binfmt_misc xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun arc4 md4 nls_utf8 cifs dns_resolver ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock ses enclosure scsi_transport_sas edac_core iosf_mbi crc32_pclmul ghash_clmulni_intel uas usb_storage aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd vmw_balloon joydev sg pcspkr vmw_vmci i2c_piix4
parport_pc shpchp parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod drm_kms_helper crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw vmxnet3 i2c_core vmw_pvscsi dm_mirror dm_region_hash dm_log dm_mod
CPU: 10 PID: 1862 Comm: mysqld Tainted: G             L ------------   3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff88003607dee0 ti: ffff8808233cc000 task.ti: ffff8808233cc000
RIP: 0010:[<ffffffff810fa232>]  [<ffffffff810fa232>] native_queued_spin_lock_slowpath+0x22/0x1e0
RSP: 0000:ffff8808233cfd28  EFLAGS: 00000202
RAX: 0000000000000001 RBX: ffff8808233cffd8 RCX: ffff880000000000
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffea0010b47ff0
RBP: ffff8808233cfd28 R08: ffff880806782f30 R09: 0000000000000001
R10: 000000000000b876 R11: 0000000000000001 R12: ffff8808233cffd8
R13: ffff88003607dee0 R14: ffffffff816a8f8d R15: ffff8808233cfcd8
FS:  00007fd8a7fff700(0000) GS:ffff88083fc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000002dddb04 CR3: 000000080eb05000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
ffff8808233cfd38 ffffffff8169e5ff ffff8808233cfd48 ffffffff816abb50
ffff8808233cfe48 ffffffff811b9a44 00007fd7a9600000 ffff880473bf3200
0000000000000000 00007fd7aacc5fff 0000000000000000 00007fd7aacc6000
Call Trace:
[<ffffffff8169e5ff>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffff816abb50>] _raw_spin_lock+0x20/0x30
[<ffffffff811b9a44>] change_protection_range+0x354/0x7e0
[<ffffffff811b9f35>] change_protection+0x65/0xa0
[<ffffffff811d298b>] change_prot_numa+0x1b/0x40
[<ffffffff810c9282>] task_numa_work+0x202/0x350
[<ffffffff810ad247>] task_work_run+0xa7/0xf0
[<ffffffff8102ab62>] do_notify_resume+0x92/0xb0
[<ffffffff816ac2fc>] retint_signal+0x48/0x8c
Code: 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 66 90 ba 01 00 00 00 8b 07 85 c0 75 0a f0 0f b1 17 85 c0 75 f2 5d c3 f3 90 <eb> ec 0f 1f 40 00 81 fe 00 01 00 00 66 90 0f 84 5c 01 00 00 41 

NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [fail2ban-server:1800]
Modules linked in: ebtable_filter ebtables ip6table_filter ip6_tables tun scsi_transport_iscsi ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat xt_physdev br_netfilter ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack xt_multiport iptable_filter softdog vmwgfx coretemp ttm drm_kms_helper joydev pcspkr syscopyarea sg sysfillrect vmw_balloon ppdev sysimgblt fb_sys_fops parport_pc parport drm i2c_piix4 shpchp i2c_core vmw_vmci nfsd auth_rpcgss nfs_acl lockd dm_multipath grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic pata_acpi crct10dif_common ata_piix crc32c_intel libata serio_raw e1000 vmw_pvscsi floppy dm_mirror dm_region_hash dm_log dm_mod 8021q garp mrp bridge stp llc bonding
CPU: 6 PID: 1800 Comm: fail2ban-server Tainted: G        W    L ------------   3.10.0-693.17.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 08/16/2013
task: ffff880237b44f10 ti: ffff8800bbae4000 task.ti: ffff8800bbae4000
RIP: 0010:[<ffffffff810fc122>]  [<ffffffff810fc122>] native_queued_spin_lock_slowpath+0x22/0x1e0
RSP: 0000:ffff8800bbae7d28  EFLAGS: 00000202
RAX: 0000000000000001 RBX: ffffffff816b9c1b RCX: ffff880000000000
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffea0008ffbf70
RBP: ffff8800bbae7d28 R08: ffff88023ff135f0 R09: 0000000000000001
R10: 0000000000000000 R11: ffff88013bd83da8 R12: ffffffff816b9bff
R13: ffffffff816b9c06 R14: ffffffff816b9c0d R15: ffffffff816b9c14
FS:  00007f44e0be1700(0000) GS:ffff88013bd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000001b61a58 CR3: 000000023332a000 CR4: 00000000000007e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff816a08df>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffff816adff0>] _raw_spin_lock+0x20/0x30
[<ffffffff811bbae4>] change_protection_range+0x354/0x7e0
[<ffffffff811bbfd5>] change_protection+0x65/0xa0
[<ffffffff811d4a9b>] change_prot_numa+0x1b/0x40
[<ffffffff810cb172>] task_numa_work+0x202/0x350
[<ffffffff810aefc7>] task_work_run+0xa7/0xf0
[<ffffffff8102ab52>] do_notify_resume+0x92/0xb0
[<ffffffff816af6ec>] retint_signal+0x48/0x8c
Code: 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 66 90 ba 01 00 00 00 8b 07 85 c0 75 0a f0 0f b1 17 85 c0 75 f2 5d c3 f3 90 <eb> ec 0f 1f 40 00 81 fe 00 01 00 00 66 90 0f 84 5c 01 00 00 41 

NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [exe:13558]
Modules linked in: xt_REDIRECT nf_nat_redirect ip_vs_rr xt_ipvs ip_vs xt_nat veth vxlan ip6_udp_tunnel udp_tunnel xt_mark nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter binfmt_misc overlay(T) vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi
crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmwgfx e1000 drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm floppy ata_piix mptspi libata scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 10 PID: 13558 Comm: exe Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff8b2915108000 ti: ffff8b26562f4000 task.ti: ffff8b26562f4000
RIP: 0010:[<ffffffff9ed11ffd>]  [<ffffffff9ed11ffd>] native_queued_spin_lock_slowpath+0x1d/0x200
RSP: 0018:ffff8b26562f7d20  EFLAGS: 00000293
RAX: 0000000000000001 RBX: 00000001f02ecaaa RCX: 0000000000000001
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffce849848e670
RBP: ffff8b26562f7d20 R08: ffff8b2600000000 R09: 0000000000000000
R10: ffff8b2a3ffda000 R11: 000000c000000000 R12: ffffffff9ecdf5b0
R13: ffff8b26562f7d18 R14: ffffffff9ecdd4d3 R15: ffff8b26562f7c88
FS:  00007f3f7affd700(0000) GS:ffff8b2e3fc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe960291008 CR3: 00000006f1d68000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9f35bf4b>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffff9f36a400>] _raw_spin_lock+0x20/0x30
[<ffffffff9edf36ab>] change_pte_range+0x15b/0x530
[<ffffffff9ede9156>] ? handle_pte_fault+0x316/0xd10
[<ffffffff9edf3e16>] change_protection+0x396/0x680
[<ffffffff9ee0f66b>] change_prot_numa+0x1b/0x40
[<ffffffff9ecdba52>] task_numa_work+0x202/0x360
[<ffffffff9ecbe79b>] task_work_run+0xbb/0xe0
[<ffffffff9ec2bc65>] do_notify_resume+0xa5/0xc0
[<ffffffff9f36b55c>] retint_signal+0x48/0x8c
Code: 47 fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 66 90 b9 01 00 00 00 8b 17 85 d2 74 0d 83 fa 03 74 08 f3 90 <8b> 17 85 d2 75 f3 89 d0 f0 0f b1 0f 39 c2 75 e3 5d 66 90 c3 0f 

NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [val_auto_daemon:20025]
Modules linked in: cmac arc4 md4 nls_utf8 cifs ccm rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter dgrp(OE) vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon joydev pcspkr parport_pc parport nfit libnvdimm sg vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect
 sysimgblt fb_sys_fops mptspi ttm scsi_transport_spi mptscsih e1000 ahci mptbase drm libahci serio_raw crct10dif_pclmul ata_piix crct10dif_common crc32c_intel drm_panel_orientation_quirks libata dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 20025 Comm: val_auto_daemon Kdump: loaded Tainted: G           OE  ------------ T 3.10.0-957.1.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff8b8367feb0c0 ti: ffff8b80ae48c000 task.ti: ffff8b80ae48c000
RIP: 0010:[<ffffffff951120dd>]  [<ffffffff951120dd>] native_queued_spin_lock_slowpath+0x1d/0x200
RSP: 0000:ffff8b80ae48fd20  EFLAGS: 00000293
RAX: 0000000000000001 RBX: ffffffff950de6bc RCX: 0000000000000001
RDX: 0000000000000001 RSI: 0000000000000001 RDI: fffffa117175c870
RBP: ffff8b80ae48fd20 R08: ffff8b7340000000 R09: 0000000000000000
R10: ffff8b7678dda1b0 R11: 0000000002200000 R12: ffff8b8367feb128
R13: 0001d7f2d2d79a72 R14: ffffffff950e011c R15: ffff8b80ae48fcb8
FS:  00007f4e932a2d00(0000) GS:ffff8b78ca140000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007faafffa3c80 CR3: 000000037436a000 CR4: 00000000000607e0
Call Trace:
 [<ffffffff9575bfcb>] queued_spin_lock_slowpath+0xb/0xf
 [<ffffffff9576a480>] _raw_spin_lock+0x20/0x30
 [<ffffffff951f391b>] change_pte_range+0x15b/0x530
 [<ffffffff951f4086>] change_protection+0x396/0x680
 [<ffffffff9520f8db>] change_prot_numa+0x1b/0x40
 [<ffffffff950dbaa2>] task_numa_work+0x202/0x360
 [<ffffffff950be79b>] task_work_run+0xbb/0xe0
 [<ffffffff9502bc65>] do_notify_resume+0xa5/0xc0
 [<ffffffff95775124>] int_signal+0x12/0x17
Code: 47 fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 66 90 b9 01 00 00 00 8b 17 85 d2 74 0d 83 fa 03 74 08 f3 90 <8b> 17 85 d2 75 f3 89 d0 f0 0f b1 0f 39 c2 75 e3 5d 66 90 c3 0f 

NMI watchdog: BUG: soft lockup - CPU#9 stuck for 22s! [kubelet:31018]
Modules linked in: xt_owner xt_REDIRECT nf_nat_redirect xt_multiport ipt_rpfilter iptable_raw ip_set_hash_ip ip_set_hash_net ipip tunnel4 ip_tunnel rpcsec_gss_krb5 veth auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache xt_set ip_set_hash_ipportnet ip_set_bitmap_port ip_set_hash_ipportip ip_set_hash_ipport dummy nf_tables ip_set ip_vs_sh ip_vs_wrr ip_vs_rr ip6t_MASQUERADE nf_nat_masquerade_ipv6 ip6table_filter ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6_tables xt_mark xt_comment iptable_mangle xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat xt_addrtype iptable_filter scini(POE) ip_vs nf_conntrack binfmt_misc vmw_vsock_vmci_transport vsock sunrpc ppdev vmw_balloon
sg parport_pc joydev parport pcspkr vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix mptspi scsi_transport_spi mptscsih drm libata crc32c_intel serio_raw mptbase vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod br_netfilter bridge stp llc overlay(T)
CPU: 9 PID: 31018 Comm: kubelet Tainted: P        W  OEL ------------ T 3.10.0-1160.108.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffffa05fe3a85280 ti: ffffa05fa9548000 task.ti: ffffa05fa9548000
RIP: 0010:[<ffffffffb7d1eb3d>]  [<ffffffffb7d1eb3d>] native_queued_spin_lock_slowpath+0x1d/0x200
RSP: 0000:ffffa05fa954bd20  EFLAGS: 00000293
RAX: 0000000000000001 RBX: ffffa05dfbda07f0 RCX: 0000000000000001
RDX: 0000000000000001 RSI: 0000000000000001 RDI: fffff0f3092ba9b0
RBP: ffffa05fa954bd20 R08: ffffa05cc0000000 R09: 0000000000000000
R10: ffffa05efac54510 R11: 000000c002400000 R12: ffffa05f7d538000
R13: ffffffffb7f9c7b9 R14: ffffa05fffc9f160 R15: fffff0f30aaffa00
FS:  00007ff2887f0700(0000) GS:ffffa05fffc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c0064a2a30 CR3: 000000033ad9a000 CR4: 00000000000007e0
Call Trace:
[<ffffffffb83ac21a>] queued_spin_lock_slowpath+0xb/0x13
[<ffffffffb83ba734>] _raw_spin_lock+0x24/0x30
[<ffffffffb7e0a03b>] change_pte_range+0x15b/0x550
[<ffffffffb7e0a7d0>] change_protection+0x3a0/0x680
[<ffffffffb7e278bb>] change_prot_numa+0x1b/0x40
[<ffffffffb7ce6096>] task_numa_work+0x216/0x370
[<ffffffffb7cc7f6b>] task_work_run+0xbb/0xe0
[<ffffffffb7c2dcfd>] do_notify_resume+0xad/0xd0
[<ffffffffb83c56f7>] int_signal+0x12/0x17
Code: 47 fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 66 90 b9 01 00 00 00 8b 17 85 d2 74 0d 83 fa 03 74 08 f3 90 <8b> 17 85 d2 75 f3 89 d0 f0 0f b1 0f 39 c2 75 e3 5d 66 90 c3 cc 

NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [kesl:29097]
Modules linked in: binfmt_misc xt_connmark xt_addrtype xt_TPROXY ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle xt_mark xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock coretemp ppdev crc32_pclmul vmw_balloon ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr parport_pc sg parport i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul mptspi crct10dif_common libata e1000 scsi_transport_spi crc32c_intel mptscsih serio_raw mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 6 PID: 29097 Comm: kesl Kdump: loaded Tainted: G             L ------------   3.10.0-1160.80.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff96ba39b0a100 ti: ffff96b8c0d4c000 task.ti: ffff96b8c0d4c000
RIP: 0010:[<ffffffffb451e97d>]  [<ffffffffb451e97d>] native_queued_spin_lock_slowpath+0x1d/0x200
RSP: 0018:ffff96b8c0d4fd20  EFLAGS: 00000293
RAX: 0000000000000001 RBX: ffff96ba39d1acc0 RCX: 0000000000000001
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffd7214f8ef9f0
RBP: ffff96b8c0d4fd20 R08: ffff96b700000000 R09: 0000000000000000
R10: ffff96bc44d3fcb0 R11: 00007ffa16600000 R12: ffff96b8c0d4fcb8
R13: ffffffffb44e84c9 R14: ffff96b8c0d4fcb8 R15: ffffffffb44ea05b
FS:  00007ff9ca87d700(0000) GS:ffff96ba39d00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007faddc000d00 CR3: 00000004b8a7c000 CR4: 00000000000007e0
Call Trace:
[<ffffffffb4bac21a>] queued_spin_lock_slowpath+0xb/0x13
[<ffffffffb4bba734>] _raw_spin_lock+0x24/0x30
[<ffffffffb4609c9b>] change_pte_range+0x15b/0x550
[<ffffffffb460a430>] change_protection+0x3a0/0x680
[<ffffffffb46274fb>] change_prot_numa+0x1b/0x40
[<ffffffffb44e5ef6>] task_numa_work+0x216/0x370
[<ffffffffb44c7e1b>] task_work_run+0xbb/0xe0
[<ffffffffb442dcfd>] do_notify_resume+0xad/0xd0
[<ffffffffb4bc56f7>] int_signal+0x12/0x17
Code: 47 fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 66 90 b9 01 00 00 00 8b 17 85 d2 74 0d 83 fa 03 74 08 f3 90 <8b> 17 85 d2 75 f3 89 d0 f0 0f b1 0f 39 c2 75 e3 5d 66 90 c3 cc 

NMI watchdog: BUG: soft lockup - CPU#10 stuck for 23s! [classify:71453]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod amd64_edac_mod edac_mce_amd kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr xfs libcrc32c joydev sg k10temp i2c_piix4 ipmi_si ipmi_devintf ipmi_msghandler pinctrl_amd i2c_designware_platform i2c_designware_core acpi_cpufreq sch_fq_codel binfmt_misc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel ast drm_kms_helper syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm ahci drm libahci libata igb megaraid_sas drm_panel_orientation_quirks nvme ptp pps_core nvme_core dca i2c_algo_bit nfit libnvdimm
CPU: 10 PID: 71453 Comm: classify Kdump: loaded Tainted: G             L ------------   3.10.0-1127.el7.x86_64 #1
Hardware name: Suma R6240A0/62DB32, BIOS SXWH042021 07/19/2021
task: ffff98a095b4e2a0 ti: ffff99a09bce8000 task.ti: ffff99a09bce8000
RIP: 0010:[<ffffffffbb118006>]  [<ffffffffbb118006>] native_queued_spin_lock_slowpath+0x156/0x200
RSP: 0018:ffff99a09bcebd20  EFLAGS: 00000202
RAX: 0000000000000101 RBX: ffffffffbb22ff61 RCX: 0000000000510000
RDX: 0000000000590101 RSI: 0000000000000101 RDI: ffffe7b8b553bfb0
RBP: ffff99a09bcebd20 R08: ffff991dce09b8c0 R09: 0000000000000000
R10: ffff999f830b81b0 R11: 00002ac19f600000 R12: 0000000000000001
R13: ffffe7b8646099a0 R14: ffffe7b864609980 R15: ffffffffbb1d25c2
FS:  00002ac91be52700(0000) GS:ffff991dce080000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00002ac447389e9c CR3: 0000015eeefcc000 CR4: 0000000000340fe0
Call Trace:
[<ffffffffbb77a004>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffffbb7886b0>] _raw_spin_lock+0x20/0x30
[<ffffffffbb1fd82b>] change_pte_range+0x15b/0x540
[<ffffffffbb1fdfa6>] change_protection+0x396/0x670
[<ffffffffbb1f5dbb>] ? handle_mm_fault+0xadb/0xfb0
[<ffffffffbb21a80b>] change_prot_numa+0x1b/0x40
[<ffffffffbb0e0952>] task_numa_work+0x212/0x370
[<ffffffffbb0c31cb>] task_work_run+0xbb/0xe0
[<ffffffffbb02cc65>] do_notify_resume+0xa5/0xc0
[<ffffffffbb78957c>] retint_signal+0x48/0x8c
Code: 8b 08 4d 85 c9 74 04 41 0f 18 09 8b 17 0f b7 c2 85 c0 74 21 83 f8 03 75 10 eb 1a 66 2e 0f 1f 84 00 00 00 00 00 85 c0 74 0c f3 90 <8b> 17 0f b7 c2 83 f8 03 75 f0 be 01 00 00 00 eb 15 66 0f 1f 84 

NMI watchdog: BUG: soft lockup - CPU#14 stuck for 21s! [java:16601]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13501(E) falcon_lsm_pinned_13109(E) falcon_lsm_pinned_13005(E) falcon_lsm_pinned_12905(E) binfmt_misc cmac arc4 md4 nls_utf8 cifs ccm dns_resolver ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_comment xt_mark iptable_filter iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_netlink nfnetlink iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi overlay(T) vmw_vsock_vmci_transport vsock falcon_lsm_pinned_12803(E) ext4 sb_edac mbcache iosf_mbi jbd2 crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper pcc_cpufreq cryptd ppdev vmw_balloon pcspkr joydev parport_pc parport vmw_vmci sg i2c_piix4
br_netfilter bridge stp llc nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nf_conntrack auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif ata_generic crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi scsi_transport_spi nfit crct10dif_pclmul libata crct10dif_common crc32c_intel mptscsih libnvdimm serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal]
CPU: 14 PID: 16601 Comm: java Kdump: loaded Tainted: P            EL ------------ T 3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff89132b90c1c0 ti: ffff8908ca314000 task.ti: ffff8908ca314000
RIP: 0010:[<ffffffff8311757d>]  [<ffffffff8311757d>] native_queued_spin_lock_slowpath+0x1d/0x200
RSP: 0000:ffff8908ca317d20  EFLAGS: 00000293
RAX: 0000000000000001 RBX: ffffffff837839be RCX: 0000000000000001
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffc4feb3eebab0
RBP: ffff8908ca317d20 R08: ffff88f3400003d8 R09: 0000000000000000
R10: ffff89006f597b00 R11: 0000000001a7b000 R12: ffff890b6466a6c0
R13: 0000000000000246 R14: 0000000000000001 R15: ffff89033fd9ac80
FS:  00007fbaca8d2700(0000) GS:ffff89033fd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c000634db0 CR3: 0000000a20d7e000 CR4: 00000000001607e0
Call Trace:
[<ffffffff837754ee>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffff83783b20>] _raw_spin_lock+0x20/0x30
[<ffffffff831fb6db>] change_pte_range+0x15b/0x540
[<ffffffff831fbe56>] change_protection+0x396/0x670
[<ffffffff8321864b>] change_prot_numa+0x1b/0x40
[<ffffffff830e04c2>] task_numa_work+0x212/0x370
[<ffffffff830c2e5b>] task_work_run+0xbb/0xe0
[<ffffffff8302cc65>] do_notify_resume+0xa5/0xc0
[<ffffffff8378457c>] retint_signal+0x48/0x8c
Code: 47 fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 66 90 b9 01 00 00 00 8b 17 85 d2 74 0d 83 fa 03 74 08 f3 90 <8b> 17 85 d2 75 f3 89 d0 f0 0f b1 0f 39 c2 75 e3 5d 66 90 c3 0f 

NMI watchdog: BUG: soft lockup - CPU#27 stuck for 22s! [java:2139]
Modules linked in: binfmt_misc dm_mirror dm_region_hash dm_log dm_mod dell_smbios dcdbas iTCO_wdt iTCO_vendor_support dell_wmi_descriptor skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm ipmi_ssif irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr sg lpc_ich i2c_i801 mei_me mei wmi ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic mgag200 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci crct10dif_pclmul crct10dif_common crc32c_intel libahci tg3 megaraid_sas libata ptp drm_panel_orientation_quirks pps_core nfit libnvdimm
CPU: 27 PID: 2139 Comm: java Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.59.1.el7.x86_64 #1
Hardware name:    /0PRWNC, BIOS 2.5.4 01/14/2020
task: ffffa0eb5aa33180 ti: ffffa0f354c74000 task.ti: ffffa0f354c74000
RIP: 0010:[<ffffffff86317aa2>]  [<ffffffff86317aa2>] native_queued_spin_lock_slowpath+0x122/0x200
RSP: 0000:ffffa0f354c77d20  EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffffffff8627ddd0 RCX: 0000000000d90000
RDX: ffffa0eb5e59b8c0 RSI: 0000000000e10101 RDI: fffffa1a81340070
RBP: ffffa0f354c77d20 R08: ffffa0f35d95b8c0 R09: 0000000000000000
R10: ffffa0eb5bec85e8 R11: 00007f8ff4000000 R12: ffffa0ebebab0400
R13: ffffffff86f5e300 R14: ffffa0ebebab0400 R15: 000000000000001b
FS:  00007f8ff3a2e700(0000) GS:ffffa0f35d940000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8ff3a2e710 CR3: 000000105d73e000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffff86980d73>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffff8698ed10>] _raw_spin_lock+0x20/0x30
[<ffffffff863fe12b>] change_pte_range+0x15b/0x540
[<ffffffff863fe8b0>] change_protection+0x3a0/0x680
[<ffffffff8641b1ab>] change_prot_numa+0x1b/0x40
[<ffffffff862dff02>] task_numa_work+0x212/0x370
[<ffffffff862c299b>] task_work_run+0xbb/0xe0
[<ffffffff8622cc65>] do_notify_resume+0xa5/0xc0
[<ffffffff8699057c>] retint_signal+0x48/0x8c
Code: 13 48 c1 ea 0d 48 98 83 e2 30 48 81 c2 c0 b8 01 00 48 03 14 c5 60 18 f5 86 4c 89 02 41 8b 40 08 85 c0 75 0f 0f 1f 44 00 00 f3 90 <41> 8b 40 08 85 c0 74 f6 4d 8b 08 4d 85 c9 74 04 41 0f 18 09 8b 

NMI watchdog: BUG: soft lockup - CPU#22 stuck for 21s! [java:11920]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter tcp_diag inet_diag vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd pcspkr sg joydev parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul mptspi crct10dif_common scsi_transport_spi crc32c_intel mptscsih
libata serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 22 PID: 11920 Comm: java Kdump: loaded Tainted: G             L ------------   3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/30/2013
task: ffff8da6159420e0 ti: ffff8da86dd7c000 task.ti: ffff8da86dd7c000
RIP: 0010:[<ffffffffa991732d>]  [<ffffffffa991732d>] native_queued_spin_lock_slowpath+0x1d/0x200
RSP: 0000:ffff8da86dd7fd20  EFLAGS: 00000293
RAX: 0000000000000001 RBX: ffff8da86dd7fcf8 RCX: 0000000000000001
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffdb9a84b7b1f0
RBP: ffff8da86dd7fd20 R08: ffff8da5c0000000 R09: 0000000000000000
R10: ffff8da625a0fbd8 R11: 00007f1cb8200000 R12: ffff8da615942148
R13: ffff8da8847690d8 R14: ffff8da629e1ac80 R15: ffffffffa98e29ec
FS:  00007f1bef8f8700(0000) GS:ffff8da629e00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000001000ccf18 CR3: 000000006537a000 CR4: 00000000000407e0
Call Trace:
[<ffffffffa9f7544a>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffffa9f83330>] _raw_spin_lock+0x20/0x30
[<ffffffffa99fbabb>] change_pte_range+0x15b/0x540
[<ffffffffa99fc236>] change_protection+0x396/0x670
[<ffffffffa98e0008>] ? __enqueue_entity+0x78/0x80
[<ffffffffa9a1851b>] change_prot_numa+0x1b/0x40
[<ffffffffa98e0382>] task_numa_work+0x212/0x370
[<ffffffffa98c2d2b>] task_work_run+0xbb/0xe0
[<ffffffffa982cc65>] do_notify_resume+0xa5/0xc0
[<ffffffffa9f8e23b>] int_signal+0x12/0x17
Code: 47 fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 66 90 b9 01 00 00 00 8b 17 85 d2 74 0d 83 fa 03 74 08 f3 90 <8b> 17 85 d2 75 f3 89 d0 f0 0f b1 0f 39 c2 75 e3 5d 66 90 c3 0f 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [java:1399]
Modules linked in: vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd nfit ppdev sg joydev pcspkr parport_pc vmw_vmci parport vmw_balloon libnvdimm i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix e1000 mptspi libata scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 1399 Comm: java Kdump: loaded Tainted: G             L ------------   3.10.0-957.10.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff9449ea3bb0c0 ti: ffff9449c5ed4000 task.ti: ffff9449c5ed4000
RIP: 0010:[<ffffffff9dd1211d>]  [<ffffffff9dd1211d>] native_queued_spin_lock_slowpath+0x1d/0x200
RSP: 0018:ffff9449c5ed7d20  EFLAGS: 00000293
RAX: 0000000000000001 RBX: ffff9449c5ed7cf8 RCX: 0000000000000001
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffe74fc844b370
RBP: ffff9449c5ed7d20 R08: ffff9445c0000000 R09: 0000000000000000
R10: ffff9449be7060d8 R11: 00007f445da00000 R12: ffff9449ea3bb128
R13: 00000006d4f22348 R14: ffffffff9dce015c R15: ffff9449c5ed7cb8
FS:  00007f445d9e9700(0000) GS:ffff9447f7c40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f31af51fa08 CR3: 0000000034eb4000 CR4: 00000000000407e0
Call Trace:
[<ffffffff9e35cfcb>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffff9e36b480>] _raw_spin_lock+0x20/0x30
[<ffffffff9ddf3b3b>] change_pte_range+0x15b/0x530
[<ffffffff9ddf42a6>] change_protection+0x396/0x680
[<ffffffff9de0fb7b>] change_prot_numa+0x1b/0x40
[<ffffffff9dcdbae2>] task_numa_work+0x202/0x360
[<ffffffff9dcbe7db>] task_work_run+0xbb/0xe0
[<ffffffff9dc2bc65>] do_notify_resume+0xa5/0xc0
[<ffffffff9e36c55c>] retint_signal+0x48/0x8c
Code: 47 fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 66 90 b9 01 00 00 00 8b 17 85 d2 74 0d 83 fa 03 74 08 f3 90 <8b> 17 85 d2 75 f3 89 d0 f0 0f b1 0f 39 c2 75 e3 5d 66 90 c3 0f