NMI watchdog: BUG: soft lockup - CPU#3 stuck for 21s! [java:25752]
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [vmtoolsd:854]
Modules linked in: xt_statistic tcp_lp nls_utf8 isofs ip6t_MASQUERADE nf_nat_masquerade_ipv6 ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle vxlan ip6_udp_tunnel udp_tunnel xt_physdev xt_NFLOG nfnetlink_log xt_limit xt_mark xt_multiport xt_comment ip_set veth xt_nat nf_conntrack_netlink xt_addrtype xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache overlay(T) br_netfilter bridge stp llc vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus iosf_mbi snd_seq
crc32_pclmul snd_seq_device ghash_clmulni_intel snd_pcm aesni_intel lrw gf128mul snd_timer snd soundcore glue_helper ablk_helper cryptd vmw_balloon ppdev pcspkr sg joydev parport_pc parport i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix nfit crct10dif_pclmul crct10dif_common crc32c_intel libnvdimm libata mptspi scsi_transport_spi e1000 mptscsih serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 854 Comm: vmtoolsd Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-1160.118.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff8c2b9ac9b180 ti: ffff8c23b54c0000 task.ti: ffff8c23b54c0000
RIP: 0010:[<ffffffff828de890>]  [<ffffffff828de890>] nr_context_switches+0x40/0x70
RSP: 0018:ffff8c23b54c3d28  EFLAGS: 00000202
RAX: ffff8c2b9f100000 RBX: ffff8c2a4ee83ec0 RCX: 000000000000006c
RDX: 000000000000006c RSI: 0000000000000080 RDI: 0000000000000040
RBP: ffff8c23b54c3d40 R08: ffffffff8355e6e8 R09: 3020302030203020
R10: 3020302030203020 R11: 3020302030203020 R12: ffffffff4c0a0008
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 21s! [kworker/u256:1:42119]
R13: 0000000000001188 R14: ffff8c25612301c8 R15: 0000000000000005
FS:  00007fc943ab8780(0000) GS:ffff8c2b9d600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc943acd000 CR3: 000000081ad72000 CR4: 00000000007607f0
PKRU: 55555554
Call Trace:
[<ffffffff82ae25bc>] show_stat+0x68c/0x740
[<ffffffff82a858a8>] seq_read+0x138/0x460
[<ffffffff82ad79a0>] proc_reg_read+0x40/0x80
[<ffffffff82a5bbef>] vfs_read+0x9f/0x170
[<ffffffff82a5ca65>] SyS_read+0x55/0xd0
[<ffffffff82fc539a>] system_call_fastpath+0x25/0x2a

NMI watchdog: BUG: soft lockup - CPU#9 stuck for 21s! [ora_gen1_ecpay:3115]
Modules linked in: veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter overlay(T) mfe_aac_100717845(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc ext4 iosf_mbi mbcache jbd2 crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd vmw_balloon pcspkr sg joydev parport_pc parport i2c_piix4 vmw_vmci binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt sd_mod fb_sys_fops ttm crc_t10dif crct10dif_generic
ahci drm nfit ata_piix libahci crct10dif_pclmul libnvdimm crct10dif_common crc32c_intel libata serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 9 PID: 3115 Comm: ora_gen1_ecpay Tainted: G           OEL ------------ T 3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9eabdefe3180 ti: ffff9eabcf3e8000 task.ti: ffff9eabcf3e8000
RIP: 0010:[<ffffffff8a6d8a8b>]  [<ffffffff8a6d8a8b>] nr_iowait+0x3b/0x70
RSP: 0018:ffff9eabcf3ebd28  EFLAGS: 00010286
RAX: ffff9eb496d5acc0 RBX: ffff9eb1c4b75680 RCX: 000000000000001d
RDX: 000000000000005d RSI: 0000000000000080 RDI: 0000000000000040
RBP: ffff9eabcf3ebd40 R08: ffffffff8b35e2c8 R09: 3020302030203020
R10: 3020302030203020 R11: 3020302030203020 R12: ffffffff4c0a0008
R13: 0000000000001383 R14: ffff9eb1556c03cd R15: 0000000000000005
FS:  00007f7b1493c700(0000) GS:ffff9eb495840000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7b1253b000 CR3: 000000014f7a8000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffff8a8d1a64>] show_stat+0x674/0x730
[<ffffffff8a8767b0>] seq_read+0x130/0x440
[<ffffffff8a8c7200>] proc_reg_read+0x40/0x80
[<ffffffff8a84dc6f>] vfs_read+0x9f/0x170
[<ffffffff8a84eaef>] SyS_read+0x7f/0xf0
[<ffffffff8ad95f92>] system_call_fastpath+0x25/0x2a
Code: ff ff ff ff 48 89 e5 41 55 4c 8b 2d 40 a8 73 00 41 54 49 c7 c4 c0 ac 01 00 53 31 db eb 17 66 90 4c 89 e0 48 03 04 d5 a0 15 35 8b <48> 63 80 d8 08 00 00 48 01 c3 83 c2 01 4c 89 ef 48 63 d2 e8 7d 

NMI watchdog: BUG: soft lockup - CPU#11 stuck for 21s! [vmtoolsd:3115]
Modules linked in: tcp_diag inet_diag knem(OE) uio_pci_generic uio vfio_pci vfio_iommu_type1 vfio irqbypass cuse fuse ipmi_devintf ipmi_msghandler talpa_vfshook(OE) talpa_pedconnector(OE) talpa_pedevice(OE) talpa_vcdevice(OE) talpa_core(OE) talpa_linux(OE) talpa_syscallhook(OE) vmw_vsock_vmci_transport vsock ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_filter crc32_pclmul ppdev ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr vmw_vmci sg i2c_piix4 joydev shpchp parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix libata serio_raw nfit libnvdimm vmxnet3 i2c_core vmw_pvscsi dm_mirror dm_region_hash dm_log dm_mod [last unloaded: mst_pciconf]
CPU: 11 PID: 3115 Comm: vmtoolsd Tainted: G           OEL ------------   3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffffa02df8f16eb0 ti: ffffa02dedee4000 task.ti: ffffa02dedee4000
RIP: 0010:[<ffffffffac5407b8>]  [<ffffffffac5407b8>] kstat_irqs+0x58/0x90
RSP: 0018:ffffa02dedee7d28  EFLAGS: 00000283
RAX: ffffa02dfe700000 RBX: ffffa01e31f88fc0 RCX: 0000000000000044
RDX: 0000000000000044 RSI: 0000000000000080 RDI: 0000000000000040
RBP: ffffa02dedee7d40 R08: 000000000001fbe4 R09: 000000000000fff7
R10: 0000000000000000 R11: ffffa02dedee7be6 R12: ffffffff4c0a0008
R13: 000000000000146f R14: ffffa02c322f02e1 R15: 0000000000000005
FS:  00007f4ada527880(0000) GS:ffffa02dfd8c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4ada4e2000 CR3: 00000010341e8000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffffac69ab72>] show_stat+0x5e2/0x6c0
[<ffffffffac641410>] seq_read+0x110/0x3f0
[<ffffffffac6906b0>] proc_reg_read+0x40/0x80
[<ffffffffac61ab3f>] vfs_read+0x9f/0x170
[<ffffffffac61ba0f>] SyS_read+0x7f/0xf0
[<ffffffffacb1f7d5>] system_call_fastpath+0x1c/0x21
Code: 35 12 2d c0 00 4c 8b 2d b7 24 6d 00 31 db ba ff ff ff ff eb 1a 66 0f 1f 44 00 00 48 63 c8 4d 8b 44 24 48 48 8b 04 cd a0 53 13 ad <41> 03 1c 00 83 c2 01 4c 89 ef 48 63 d2 e8 36 f4 21 00 48 63 35 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [vmtoolsd:1003]
Modules linked in: tcp_lp xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 sb_edac snd_rawmidi snd_ac97_codec coretemp ac97_bus iosf_mbi crc32_pclmul snd_seq ghash_clmulni_intel snd_seq_device aesni_intel lrw snd_pcm gf128mul glue_helper snd_timer ablk_helper cryptd snd
ppdev vmw_balloon soundcore pcspkr joydev sg i2c_piix4 vmw_vmci parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common crc32c_intel mptspi scsi_transport_spi libata mptscsih e1000 serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 1003 Comm: vmtoolsd Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff88f6de7a5280 ti: ffff88f6ca7bc000 task.ti: ffff88f6ca7bc000
RIP: 0010:[<ffffffff8422edaa>]  [<ffffffff8422edaa>] arch_irq_stat_cpu+0x8a/0xa0
RSP: 0018:ffff88f6ca7bfd48  EFLAGS: 00010246
RAX: 0000000000000000 RBX: ffffffff00000015 RCX: 0000000000010f58
RDX: ffff8905bf100000 RSI: 0000000000000000 RDI: 0000000000000000
RBP: ffff88f6ca7bfe40 R08: ffffffff84f5e108 R09: ffff88f6d8fddda4
R10: 0000000000000002 R11: 0000000000000293 R12: 0000000000000001
R13: fffeefff00000000 R14: ffffffffca7bfcb8 R15: ffffffff84471bb4
FS:  00007f16511a6780(0000) GS:ffff8905bd600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f16511bb000 CR3: 000000010d784000 CR4: 00000000001607f0
Call Trace:
[<ffffffff844d119e>] ? show_stat+0x1ee/0x730
[<ffffffff84476500>] seq_read+0x130/0x440
[<ffffffff844c6dc0>] proc_reg_read+0x40/0x80
[<ffffffff8444d9bf>] vfs_read+0x9f/0x170
[<ffffffff8444e83f>] SyS_read+0x7f/0xf0
[<ffffffff84993f92>] system_call_fastpath+0x25/0x2a
Code: 28 5d 48 01 f7 8b 74 11 30 48 01 f7 8b 74 11 34 48 8d 0c 37 48 01 c8 48 c7 c1 58 10 01 00 8b 0c 11 48 01 c8 48 c7 c1 58 0f 01 00 <8b> 14 11 48 01 d0 c3 0f 1f 44 00 00 66 2e 0f 1f 84 00 00 00 00 
[<ffffffff84594983>] copy_page+0x23/0xe0

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [irqbalance:684]
Modules linked in: nls_utf8 isofs fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock intel_powerclamp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd pcspkr nfit vmw_balloon sg libnvdimm parport_pc parport vmw_vmci shpchp i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace
sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops serio_raw ttm drm mptspi scsi_transport_spi mptscsih ata_piix i2c_core e1000 mptbase libata fjes dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 684 Comm: irqbalance Not tainted 3.10.0-514.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff880036490fb0 ti: ffff88000016c000 task.ti: ffff88000016c000
RIP: 0010:[<ffffffff810c2d8b>]  [<ffffffff810c2d8b>] nr_iowait+0x3b/0x70
RSP: 0018:ffff88000016fd50  EFLAGS: 00010282
RAX: ffff88003dd96c40 RBX: 0000000000104fff RCX: 000000000000001e
RDX: 000000000000005e RSI: 0000000000000080 RDI: 0000000000000040
RBP: ffff88000016fd68 R08: ffffffff81ae2348 R09: ffff88003c000000
R10: 0000000000000000 R11: ffff88000016fc0e R12: 000000000011f193
R13: ffffffff4c0a0008 R14: 000000000000107e R15: ffff880037e280d2
FS:  00007fe9f45e4780(0000) GS:ffff88003c6c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fff5050fff8 CR3: 000000003849c000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
00000000000005a8 0000000000104fff 0000000000000000 ffff88000016fe68
ffffffff8127598e ffff88000016fdc8 ffff880015a05900 000000005ff40415
000000000000fa80 00000000000fe6f7 0000000000104fff 0000000000000000
Call Trace:
[<ffffffff8127598e>] show_stat+0x5fe/0x6c0
[<ffffffff812223ea>] seq_read+0xfa/0x3a0
[<ffffffff8126b5fd>] proc_reg_read+0x3d/0x80
[<ffffffff811fdf9e>] vfs_read+0x9e/0x170
[<ffffffff811feb6f>] SyS_read+0x7f/0xe0
[<ffffffff816965c9>] system_call_fastpath+0x16/0x1b
Code: ff ff ff ff 48 89 e5 41 55 4c 8b 2d 20 c7 5e 00 41 54 49 c7 c4 40 6c 01 00 53 31 db eb 17 66 90 4c 89 e0 48 03 04 d5 40 57 ad 81 <48> 63 80 c8 08 00 00 48 01 c3 83 c2 01 4c 89 ef 48 63 d2 e8 bd 

NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [irqbalance:885]
Modules linked in: binfmt_misc veth tcp_lp nls_utf8 isofs nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd pcspkr joydev sg vmw_balloon
parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif ata_generic crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ahci ata_piix mptspi crc32c_intel libahci scsi_transport_spi mptscsih serio_raw libata mptbase vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 4 PID: 885 Comm: irqbalance Kdump: loaded Tainted: G               ------------ T 3.10.0-1160.6.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff998bfc35d280 ti: ffff998bf4760000 task.ti: ffff998bf4760000
RIP: 0010:[<ffffffff91e2edaa>]  [<ffffffff91e2edaa>] arch_irq_stat_cpu+0x8a/0xa0
RSP: 0018:ffff998bf4763d48  EFLAGS: 00010246
RAX: 0000000000000000 RBX: ffff998c72fb5140 RCX: 0000000000010f58
RDX: ffff99aa3f400000 RSI: 0000000000000000 RDI: 0000000000000000
RBP: ffff998bf4763e40 R08: ffffffff92b5e108 R09: ffff998c7179c424
R10: 0000000000000001 R11: 0000000000000246 R12: 00007f07a50ac000
R13: 0000000000000000 R14: 0000000000000000 R15: ffff998be5b6d7a0
FS:  00007f07a5090780(0000) GS:ffff99aa3d700000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f62294c8000 CR3: 00000001fcba8000 CR4: 00000000001607e0
Call Trace:
[<ffffffff920d11de>] ? show_stat+0x1ee/0x730
[<ffffffff92076540>] seq_read+0x130/0x440
[<ffffffff920c6e00>] proc_reg_read+0x40/0x80
[<ffffffff9204d9ff>] vfs_read+0x9f/0x170
[<ffffffff9204e87f>] SyS_read+0x7f/0xf0
[<ffffffff92594f92>] system_call_fastpath+0x25/0x2a
Code: 28 5d 48 01 f7 8b 74 11 30 48 01 f7 8b 74 11 34 48 8d 0c 37 48 01 c8 48 c7 c1 58 10 01 00 8b 0c 11 48 01 c8 48 c7 c1 58 0f 01 00 <8b> 14 11 48 01 d0 c3 0f 1f 44 00 00 66 2e 0f 1f 84 00 00 00 00 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 24s! [irqbalance:5647]
Modules linked in: fuse xt_CHECKSUM xt_set xt_multiport ipt_MASQUERADE nf_nat_masquerade_ipv4 tun ip_set_hash_ip devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc coretemp crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper ablk_helper cryptd snd_seq_midi vmw_balloon snd_seq_midi_event pcspkr snd_ens1371 snd_rawmidi snd_ac97_codec joydev ac97_bus
snd_seq snd_seq_device snd_pcm snd_timer snd soundcore sg floppy parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw pata_acpi nfit vmwgfx libnvdimm e1000 drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi scsi_transport_spi mptscsih libata mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 5647 Comm: irqbalance Kdump: loaded Tainted: G             L ------------   3.10.0-957.5.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff8b9c747e9040 ti: ffff8b9c7a634000 task.ti: ffff8b9c7a634000
RIP: 0010:[<ffffffffba22dc9d>]  [<ffffffffba22dc9d>] arch_irq_stat_cpu+0x1d/0xa0
RSP: 0018:ffff8b9c7a637d40  EFLAGS: 00010246
RAX: 0000000000000000 RBX: ffff8b9bf5816a40 RCX: 000000000001a1c0
RDX: ffff8b9c7c300000 RSI: 000000000001a1c0 RDI: 000000000000003c
RBP: ffff8b9c7a637d40 R08: ffffffffbaf58660 R09: ffff8b9c77b7fe64
R10: 0000000000000001 R11: 0000000000000246 R12: 00007f78927a7000
R13: 0000000000000000 R14: 0000000000000000 R15: ffff8b9bf5a5d0e0
FS:  00007f7892786780(0000) GS:ffff8b9c7b440000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f78927a7000 CR3: 00000000b3772000 CR4: 00000000000007e0
Call Trace:
[<ffffffffba4c28ab>] show_stat+0x1eb/0x6c0
[<ffffffffba468e70>] seq_read+0x130/0x440
[<ffffffffba4b8570>] proc_reg_read+0x40/0x80
[<ffffffffba4414bf>] vfs_read+0x9f/0x170
[<ffffffffba44237f>] SyS_read+0x7f/0xf0
[<ffffffffba974ddb>] system_call_fastpath+0x22/0x27
[<ffffffffba974d21>] ? system_call_after_swapgs+0xae/0x146
Code: a6 fd ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 89 ff 48 c7 c6 c0 a1 01 00 55 48 8b 14 fd 60 b9 f4 ba 48 89 f1 48 89 e5 <8b> 7c 11 08 8b 44 11 04 48 01 f8 8b 7c 11 0c 48 01 f8 8b 7c 11 

NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [zabbix_agentd:1328]
Modules linked in: tcp_diag inet_diag ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon pcspkr sg vmw_vmci joydev shpchp i2c_piix4 parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel mptspi ata_piix scsi_transport_spi libata mptscsih serio_raw mptbase vmxnet3 i2c_core
CPU: 11 PID: 1328 Comm: zabbix_agentd Tainted: G             L ------------   3.10.0-693.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff880815edbf40 ti: ffff880812f30000 task.ti: ffff880812f30000
RIP: 0010:[<ffffffff811345f8>]  [<ffffffff811345f8>] kstat_irqs+0x58/0x90
RSP: 0018:ffff880812f33d28  EFLAGS: 00010283
RAX: ffff88081e680000 RBX: ffff88003564d100 RCX: 0000000000000042
RDX: 0000000000000042 RSI: 0000000000000080 RDI: 0000000000000040
RBP: ffff880812f33d40 R08: 0000000000022960 R09: ffff88017f800000
R10: 0000000000000000 R11: ffff880812f33be6 R12: ffffffff4c0a0008
R13: 000000000000137d R14: ffff880813b863d3 R15: 0000000000000005
FS:  00007fe873584840(0000) GS:ffff88081d8c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe8735c1000 CR3: 0000000815696000 CR4: 00000000001607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8127fa92>] show_stat+0x5e2/0x6c0
[<ffffffff8122b1b0>] seq_read+0x110/0x3e0
[<ffffffff812756b0>] proc_reg_read+0x40/0x80
[<ffffffff812054ef>] vfs_read+0x9f/0x170
[<ffffffff812063bf>] SyS_read+0x7f/0xe0
[<ffffffff816c0715>] system_call_fastpath+0x1c/0x21
Code: 35 92 ab 9f 00 4c 8b 2d f7 7d 5a 00 31 db ba ff ff ff ff eb 1a 66 0f 1f 44 00 00 48 63 c8 4d 8b 44 24 48 48 8b 04 cd a0 10 b2 81 <41> 03 1c 00 83 c2 01 4c 89 ef 48 63 d2 e8 e6 89 20 00 48 63 35 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 31s! [vmtoolsd:750]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel snd_seq_midi snd_seq_midi_event lrw gf128mul glue_helper ablk_helper cryptd snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer ppdev snd vmw_balloon soundcore pcspkr nfit sg joydev libnvdimm parport_pc parport vmw_vmci shpchp i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm mptspi serio_raw scsi_transport_spi e1000 mptscsih ata_piix libata i2c_core mptbase dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 750 Comm: vmtoolsd Tainted: G        W    L ------------   3.10.0-862.14.4.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff9eb7613f4f10 ti: ffff9eb76171c000 task.ti: ffff9eb76171c000
RIP: 0010:[<ffffffffb4943aec>]  [<ffffffffb4943aec>] kstat_irqs+0x5c/0x90
RSP: 0018:ffff9eb76171fd28  EFLAGS: 00000246
RAX: ffff9eb76f4c0000 RBX: ffff9eb3fb427d40 RCX: 000000000000007b
RDX: 000000000000007b RSI: 0000000000000080 RDI: 0000000000000040
RBP: ffff9eb76171fd40 R08: 0000000000020cbc R09: 000000000000fff7
R10: 0000000000000000 R11: ffff9eb76171fbe6 R12: ffffffff4c0a0008
R13: 0000000000000fbd R14: ffff9eb75fb12093 R15: 0000000000000005
FS:  00007f598c67a880(0000) GS:ffff9eb76d600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f598c634000 CR3: 0000000424212000 CR4: 00000000003607f0
Call Trace:
[<ffffffffb4a9f472>] show_stat+0x5e2/0x6c0
[<ffffffffb4a458e0>] seq_read+0x110/0x3f0
[<ffffffffb4a94e80>] proc_reg_read+0x40/0x80
[<ffffffffb4a1f0af>] vfs_read+0x9f/0x170
[<ffffffffb4a1ff7f>] SyS_read+0x7f/0xf0
[<ffffffffb4f2579b>] system_call_fastpath+0x22/0x27
Code: 00 4c 8b 2d c7 f2 6c 00 31 db ba ff ff ff ff eb 1a 66 0f 1f 44 00 00 48 63 c8 4d 8b 44 24 48 48 8b 04 cd a0 54 53 b5 41 03 1c 00 <83> c2 01 4c 89 ef 48 63 d2 e8 b6 0d 22 00 48 63 35 a3 fa bf 00 

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 21s! [irqbalance:959]
Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi
vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nfit crct10dif_pclmul ata_piix crct10dif_common libnvdimm crc32c_intel libata mptspi scsi_transport_spi serio_raw mptscsih vmxnet3 mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 959 Comm: irqbalance Not tainted 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/19/2018
task: ffff8d316555c1c0 ti: ffff8d2d76750000 task.ti: ffff8d2d76750000
RIP: 0010:[<ffffffffbd4d91ab>]  [<ffffffffbd4d91ab>] nr_context_switches+0x3b/0x70
RSP: 0018:ffff8d2d76753d28  EFLAGS: 00010287
RAX: ffff8d316e4c0000 RBX: ffff8d316e4e9d40 RCX: 000000000000003b
RDX: 000000000000003b RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff8d2d76753d40 R08: ffffffffbe15ddc0 R09: 3020302030203020
R10: 3020302030203020 R11: 3020302030203020 R12: ffffffff4c0a0008
R13: 00000000000014aa R14: ffff8d2df8dde2a6 R15: 0000000000000005
FS:  00007fab69318780(0000) GS:ffff8d316d680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fab69329000 CR3: 00000000366de000 CR4: 00000000001607e0
Call Trace:
[<ffffffffbd6d0bac>] show_stat+0x68c/0x730
[<ffffffffbd675a50>] seq_read+0x130/0x440
[<ffffffffbd6c6330>] proc_reg_read+0x40/0x80
[<ffffffffbd64d06f>] vfs_read+0x9f/0x170
[<ffffffffbd64dedf>] SyS_read+0x7f/0xf0
[<ffffffffbdb92ed2>] system_call_fastpath+0x25/0x2a
Code: ff ff 48 89 e5 41 55 4c 8b 2d 22 a0 73 00 41 54 49 c7 c4 c0 ac 01 00 53 31 db eb 14 0f 1f 40 00 48 63 c8 48 8b 04 cd a0 10 15 be <4a> 03 5c 20 78 83 c2 01 4c 89 ef 48 63 d2 e8 d2 2c 2c 00 48 63 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 24s! [irqbalance:917]
Modules linked in: vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod sb_edac coretemp ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci ata_piix libahci mptsas scsi_transport_sas libata crct10dif_pclmul mptscsih crct10dif_common mptbase crc32c_intel vmxnet3 serio_raw drm_panel_orientation_quirks
CPU: 0 PID: 917 Comm: irqbalance Kdump: loaded Tainted: G             L ------------   3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff925ad6a5a0e0 ti: ffff925adbec0000 task.ti: ffff925adbec0000
RIP: 0010:[<ffffffffa3ad05ee>]  [<ffffffffa3ad05ee>] show_stat+0x14e/0x730
RSP: 0018:ffff925adbec3d50  EFLAGS: 00010287
RAX: ffff925adf140000 RBX: 0000000000000001 RCX: 000000000000002d
RDX: 000000000000006d RSI: 0000000000000040 RDI: 000000000000006d
RBP: ffff925adbec3e40 R08: ffffffffa455dd08 R09: ffff925ada4d27e4
R10: 0000000000000001 R11: 0000000000000246 R12: ffff925ad9ef6400
R13: ffff925adbec3e40 R14: 00007faf0a1e3000 R15: 0000000000000000
FS:  00007faf0a1d0780(0000) GS:ffff925add600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007faf0a1e3000 CR3: 000000081bed6000 CR4: 00000000001607f0
Call Trace:
[<ffffffffa3a759a0>] seq_read+0x130/0x440
[<ffffffffa3ac62b0>] proc_reg_read+0x40/0x80
[<ffffffffa3a4cfbf>] vfs_read+0x9f/0x170
[<ffffffffa3a4de2f>] SyS_read+0x7f/0xf0
[<ffffffffa3f92ed2>] system_call_fastpath+0x25/0x2a
Code: 83 c6 01 49 63 d6 e8 c2 b7 0c 00 3b 05 30 eb a8 00 49 89 c4 89 45 90 0f 8d f9 00 00 00 4d 63 f4 44 89 e7 4a 8b 04 f5 e0 0f 55 a4 <49> 8b 0c 07 48 01 4d 80 4a 8b 4c 38 08 4a 8b 44 38 10 48 01 8d