NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ib_pg_flush-1:2126]
Modules linked in: xt_owner ebtable_filter ebtables devlink ip6_tables iptable_filter binfmt_misc vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon pcspkr joydev sg parport_pc parport i2c_piix4 vmw_vmci auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod syscopyarea sysfillrect sysimgblt fb_sys_fops crc_t10dif ttm crct10dif_generic ata_piix drm nfit libata crct10dif_pclmul crct10dif_common crc32c_intel libnvdimm serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 2126 Comm: ib_pg_flush-1 Kdump: loaded Tainted: G        W      ------------ T 3.10.0-1160.92.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff99f091d0b180 ti: ffff99f05a2b0000 task.ti: ffff99f05a2b0000
RIP: 0010:[<ffffffff904d5502>]  [<ffffffff904d5502>] __raw_spin_unlock_irq+0x12/0x20
RSP: 0018:ffff99f05a2b3ec8  EFLAGS: 00000246
RAX: ffff99f05a2b0000 RBX: ffff99e17b8eb400 RCX: ffff99f091d0b180
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99f0ffc1acc0
RBP: ffff99f05a2b3ec8 R08: 00000000004fec05 R09: 0000000000000001
R10: 0000000000000001 R11: 0000000000000297 R12: ffff99f0ffc1acc0
R13: ffffffff904e8619 R14: ffff99f05a2b3e58 R15: ffff99f05a2b3e58
FS:  00007f92d48aa700(0000) GS:ffff99f0ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd04404ba28 CR3: 0000000fd18a8000 CR4: 00000000001607f0
Call Trace:
[<ffffffff90bb7c58>] __schedule+0x658/0x680
[<ffffffff904dff7c>] sys_sched_yield+0x6c/0xd0
[<ffffffff90bc562e>] tracesys+0xa6/0xcc
Code: c7 c7 38 5e e7 90 31 c0 48 89 e5 e8 39 61 6d 00 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <5d> c3 cc cc cc cc 0f 1f 84 00 00 00 00 00 48 63 ff 55 48 c7 c0 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [prometheus:20982]
Modules linked in: xt_multiport ipt_rpfilter xt_set iptable_raw ip_set_hash_ip ip_set_hash_net ip_set vxlan ip6_udp_tunnel udp_tunnel ip6t_MASQUERADE nf_nat_masquerade_ipv6 xt_mark ipt_REJECT nf_reject_ipv4 xt_comment ip6table_filter ip6table_mangle iptable_mangle ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables nf_tables veth xt_nat xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat xt_addrtype iptable_filter br_netfilter bridge stp llc overlay(T) ip_vs nf_conntrack vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 sb_edac snd_rawmidi snd_ac97_codec ac97_bus iosf_mbi snd_seq btusb btrtl crc32_pclmul snd_seq_device btbcm ghash_clmulni_intel btintel snd_pcm
bluetooth aesni_intel vmw_balloon ppdev lrw gf128mul glue_helper snd_timer ablk_helper snd rfkill joydev sg cryptd i2c_piix4 soundcore pcspkr vmw_vmci parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect crct10dif_pclmul sysimgblt crct10dif_common fb_sys_fops crc32c_intel ttm ata_piix libata drm nfit nvme serio_raw e1000 libnvdimm nvme_core drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod synosnap(OE)
CPU: 1 PID: 20982 Comm: prometheus Kdump: loaded Tainted: G        W  OEL ------------ T 3.10.0-1160.102.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff98789330d280 ti: ffff987748228000 task.ti: ffff987748228000
RIP: 0010:[<ffffffff8f2d5502>]  [<ffffffff8f2d5502>] __raw_spin_unlock_irq+0x12/0x20
RSP: 0018:ffff98774822bec8  EFLAGS: 00000246
RAX: ffff987748228000 RBX: ffff9878872aac00 RCX: ffff98789330d280
RDX: ffff987628305a00 RSI: 0000000000000000 RDI: ffff987e1d65acc0
RBP: ffff98774822bec8 R08: 000000007fffffff R09: 0000000000000001
R10: 0000000000000001 R11: 0000000000000202 R12: ffff987e1d65acc0
R13: ffffffff8f2e8699 R14: ffff98774822be58 R15: ffff98774822be58
FS:  000000c000100090(0000) GS:ffff987e1d640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3fec0174c8 CR3: 0000000148032000 CR4: 00000000003607e0
Call Trace:
[<ffffffff8f9b7c58>] __schedule+0x658/0x680
[<ffffffff8f2dff7c>] sys_sched_yield+0x6c/0xd0
[<ffffffff8f9c539a>] system_call_fastpath+0x25/0x2a
Code: c7 c7 00 5f c7 8f 31 c0 48 89 e5 e8 39 61 6d 00 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <5d> c3 cc cc cc cc 0f 1f 84 00 00 00 00 00 48 63 ff 55 48 c7 c0 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [java:8974]
Modules linked in: tcp_lp ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw ppdev gf128mul glue_helper ablk_helper cryptd pcspkr vmw_balloon joydev sg parport_pc i2c_piix4 parport vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nfit mptspi crct10dif_pclmul crct10dif_common scsi_transport_spi ata_piix mptscsih libnvdimm crc32c_intel libata serio_raw mptbase vmxnet3 drm_panel_orientation_quirks fuse
CPU: 0 PID: 8974 Comm: java Kdump: loaded Not tainted 3.10.0-1160.71.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9f8676204200 ti: ffff9f86813f8000 task.ti: ffff9f86813f8000
RIP: 0010:[<ffffffff978cfa42>]  [<ffffffff978cfa42>] __raw_spin_unlock_irq+0x12/0x20
RSP: 0018:ffff9f86813fbef8  EFLAGS: 00000246
RAX: ffff9f86813f8000 RBX: ffff9f86ffc1ad40 RCX: ffff9f8676204200
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff9f86ffc1acc0
RBP: ffff9f86813fbef8 R08: 00000000f70e1678 R09: 0000000000000001
R10: 0000000000000001 R11: 0000000000000000 R12: ffff9f86ffc1acc0
R13: ffffffff978e2409 R14: ffff9f86813fbe88 R15: ffff9f86813fbe88
FS:  0000000000000000(0000) GS:ffff9f86ffc00000(0063) knlGS:0000000050adbb40
CS:  0010 DS: 002b ES: 002b CR0: 0000000080050033
CR2: 00000000f6648ed8 CR3: 00000000b94ea000 CR4: 00000000001607f0
Call Trace:
[<ffffffff97f8c3a8>] __schedule+0x658/0x680
[<ffffffff978da1cc>] sys_sched_yield+0x6c/0xd0
[<ffffffff97f9def7>] sysenter_dispatch+0xd/0x2b
Code: c7 c7 58 52 27 98 31 c0 48 89 e5 e8 c2 07 6b 00 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <5d> c3 66 90 66 2e 0f 1f 84 00 00 00 00 00 48 63 ff 55 48 c7 c0 

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 34s! [firefox:4598]
Modules linked in: tcp_lp nls_utf8 isofs vboxsf(OE) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink binfmt_misc ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device crc32_pclmul ghash_clmulni_intel snd_pcm joydev ppdev aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_timer sg pcspkr snd vboxguest(OE) video parport_pc i2c_piix4 parport
soundcore ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper ahci syscopyarea sysfillrect sysimgblt fb_sys_fops libahci ata_piix ttm crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw drm e1000 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 4598 Comm: firefox Kdump: loaded Tainted: G           OE  ------------   3.10.0-1160.81.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff9022e98d1080 ti: ffff9022c10a4000 task.ti: ffff9022c10a4000
RIP: 0010:[<ffffffff864d53b2>]  [<ffffffff864d53b2>] __raw_spin_unlock_irq+0x12/0x20
RSP: 0018:ffff9022c10a7ec8  EFLAGS: 00010246
RAX: 0000000000000001 RBX: ffff90237fd1ad40 RCX: ffff9022e98d1080
RDX: ffff90237fd1ad40 RSI: 0000000000000000 RDI: ffff90237fd1acc0
RBP: ffff9022c10a7ec8 R08: 00000000d3a3f03d R09: 0000000000000001
R10: 0000000000000002 R11: 0000000000000202 R12: ffff90237fd1acc0
R13: ffffffff864e84c9 R14: ffff9022c10a7e58 R15: ffffffff864ea05b
FS:  00007fc6c6f09780(0000) GS:ffff90237fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000005bd9e6f0318 CR3: 000000006b03c000 CR4: 00000000000206e0
Call Trace:
[<ffffffff86bb7c58>] __schedule+0x658/0x680
[<ffffffff864dfe2c>] sys_sched_yield+0x6c/0xd0
[<ffffffff86bc539a>] system_call_fastpath+0x25/0x2a
Code: c7 c7 30 5c e7 86 31 c0 48 89 e5 e8 89 62 6d 00 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 e8 7f 90 04 00 66 90 fb 66 0f 1f 44 00 00 <5d> c3 cc cc cc cc 0f 1f 84 00 00 00 00 00 48 63 ff 55 48 c7 c0 

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 50s! [java:2434]
Modules linked in: xt_nat veth ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver tun nfs lockd grace binfmt_misc fscache overlay(T) nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev sg
vmw_balloon joydev pcspkr parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c vmwgfx sd_mod crc_t10dif sr_mod cdrom crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt ata_generic fb_sys_fops pata_acpi ttm drm crct10dif_pclmul crct10dif_common ata_piix libata crc32c_intel serio_raw e1000 drm_panel_orientation_quirks vmw_pvscsi floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 2434 Comm: java Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-1160.59.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 10/22/2013
task: ffff91456c633180 ti: ffff9141fa5e8000 task.ti: ffff9141fa5e8000
RIP: 0010:[<ffffffff9d4cf90f>]  [<ffffffff9d4cf90f>] __raw_spin_unlock_irq+0xf/0x20
RSP: 0018:ffff9141fa5ebec8  EFLAGS: 00000246
RAX: ffff9141fa5e8000 RBX: ffff91456e68fe00 RCX: ffff91456c633180
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff91457fd1acc0
RBP: ffff9141fa5ebec8 R08: 000000000040b1e9 R09: 0000000000000001
R10: 0000000000000001 R11: 0000000000000206 R12: ffff91457fd1acc0
R13: ffffffff9d4e22d9 R14: ffff9141fa5ebe58 R15: ffff9141fa5ebe58
FS:  00007ff113afa700(0000) GS:ffff91457fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055bb62fa4738 CR3: 000000042e5de000 CR4: 00000000000007e0
Call Trace:
[<ffffffff9db8c398>] __schedule+0x658/0x680
[<ffffffff9d4da09c>] sys_sched_yield+0x6c/0xd0
[<ffffffff9db99f92>] system_call_fastpath+0x25/0x2a
[<ffffffff9db99ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: 90 55 48 c7 c7 f8 51 e7 9d 31 c0 48 89 e5 e8 e2 08 6b 00 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 c6 07 00 66 66 66 90 fb 66 66 90 <66> 66 90 5d c3 66 90 66 2e 0f 1f 84 00 00 00 00 00 48 63 ff 55 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [mysqld:29296]
Modules linked in: binfmt_misc veth tcp_lp rfcomm ebtable_filter devlink ebtables target_core_mod openvswitch nf_nat_ipv6 ip6t_REJECT nf_reject_ipv6 nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables bnep ipt_REJECT nf_reject_ipv4 xt_conntrack xt_multiport iptable_filter xt_comment ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_CHECKSUM iptable_mangle vmw_vsock_vmci_transport vsock sunrpc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio snd_seq_midi snd_seq_midi_event ext4 mbcache jbd2 snd_ens1371 snd_rawmidi snd_ac97_codec iosf_mbi ppdev ac97_bus crc32_pclmul snd_seq snd_seq_device ghash_clmulni_intel loop btusb snd_pcm aesni_intel btrtl btbcm btintel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon
bluetooth snd_timer snd pcspkr rfkill joydev soundcore i2c_piix4 sg vmw_vmci parport_pc parport br_netfilter bridge stp llc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea crct10dif_pclmul sysfillrect sysimgblt crct10dif_common fb_sys_fops crc32c_intel ata_piix ttm mptspi drm scsi_transport_spi nfit libata serio_raw mptscsih libnvdimm e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 29296 Comm: mysqld Kdump: loaded Tainted: G             L ------------   3.10.0-1160.49.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff99e325c94200 ti: ffff99e221eb8000 task.ti: ffff99e221eb8000
RIP: 0010:[<ffffffffa30cf912>]  [<ffffffffa30cf912>] __raw_spin_unlock_irq+0x12/0x20
RSP: 0018:ffff99e221ebbec8  EFLAGS: 00000246
RAX: ffff99e221eb8000 RBX: ffff99e3bc45ad40 RCX: ffff99e325c94200
RDX: ffff99e3bc45ad40 RSI: 0000000000000000 RDI: ffff99e3bc45acc0
RBP: ffff99e221ebbec8 R08: 0000000000000000 R09: 0000000000000001
R10: 0000000000000002 R11: 0000000000000202 R12: ffff99e3bc45acc0
R13: ffffffffa30e22d9 R14: ffff99e221ebbe58 R15: ffffffffa307dfe9
FS:  00007febceffd700(0000) GS:ffff99e3bc440000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa2d3ba5000 CR3: 0000000043afc000 CR4: 0000000000360fe0
Call Trace:
[<ffffffffa3789128>] __schedule+0x658/0x680
[<ffffffffa30da09c>] sys_sched_yield+0x6c/0xd0
[<ffffffffa3795f92>] system_call_fastpath+0x25/0x2a
Code: c7 c7 c8 4c a7 a3 31 c0 48 89 e5 e8 62 d8 6a 00 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <5d> c3 66 90 66 2e 0f 1f 84 00 00 00 00 00 48 63 ff 55 48 c7 c0