NMI watchdog: BUG: soft lockup - CPU#0 stuck for 30s! [lsof:15546]
Modules linked in: tcp_lp tcp_diag inet_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc vfat fat ppdev sb_edac vmw_balloon iosf_mbi crc32_pclmul nfit ghash_clmulni_intel libnvdimm aesni_intel lrw gf128mul glue_helper ablk_helper vmw_vmci sg cryptd parport_pc joydev pcspkr i2c_piix4 parport sch_fq_codel binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix mptsas drm scsi_transport_sas libata
crct10dif_pclmul mptscsih crct10dif_common crc32c_intel e1000 serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 15546 Comm: lsof Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.0.B64.1704110547 04/11/2017
task: ffff93baa17e0000 ti: ffff93b3016dc000 task.ti: ffff93b3016dc000
RIP: 0010:[<ffffffffb0c284af>]  [<ffffffffb0c284af>] __kmalloc+0xdf/0x230
RSP: 0018:ffff93b72fa03a08  EFLAGS: 00000286
RAX: ffff93b7a6fc9d20 RBX: ffffffffc062f8dd RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff93b7a6fc9d80
RBP: ffff93b72fa03a48 R08: 000000000001f0c0 R09: 0000000000000000
R10: ffff93b7a6fc9d20 R11: ffffffffc0644300 R12: ffff93b72fa03978
R13: ffffffffb1196fba R14: ffff93b72fa03a48 R15: ffff93b35bdee6c0
FS:  00007f2a4bba9840(0000) GS:ffff93b72fa00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2a441dc14b CR3: 0000000006020000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [swapper/1:0]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache ipmi_devintf ipmi_msghandler ext4 mbcache jbd2 dm_mirror dm_region_hash dm_log dm_mod sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm snd_hda_codec_hdmi iTCO_wdt iTCO_vendor_support mei_wdt irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr i2c_i801 snd_hda_codec_realtek joydev snd_hda_codec_generic snd_usb_audio snd_usbmidi_lib snd_hda_intel snd_rawmidi snd_hda_codec snd_hda_core
snd_hwdep snd_seq lpc_ich snd_seq_device snd_pcm sg snd_timer mei_me snd mei soundcore nfsd nfs_acl lockd grace auth_rpcgss sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic nvidia_drm(POE) nvidia_modeset(POE) nvidia(POE) uas usb_storage drm_kms_helper isci ahci syscopyarea sysfillrect sysimgblt fb_sys_fops libsas libahci e1000e scsi_transport_sas ata_generic crct10dif_pclmul drm pata_acpi crct10dif_common crc32c_intel serio_raw libata ptp pps_core drm_panel_orientation_quirks wmi fuse
CPU: 1 PID: 0 Comm: swapper/1 Kdump: loaded Tainted: P           OEL ------------   3.10.0-1160.31.1.el7.x86_64 #1
Hardware name: LENOVO 4352G2G/LENOVO, BIOS A2KT30AUS 10/01/2013
task: ffff8f0cb307c200 ti: ffff8f0cb3098000 task.ti: ffff8f0cb3098000
RIP: 0010:[<ffffffffa482865c>]  [<ffffffffa482865c>] __kmalloc+0x6c/0x230
RSP: 0018:ffff8f2bffc43b08  EFLAGS: 00000286
RAX: 0000000000000220 RBX: ffffffffa469dae5 RCX: ffff8f2b44912ddc
RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000000000000008
RBP: ffff8f2bffc43b38 R08: ffff8f2bffc5f0c0 R09: ffffffffc0368f15
R10: ffff8f0cffc03a00 R11: ffff8f2b448ed0a0 R12: ffff8f2bffc43a78
R13: ffffffffa4d96fba R14: ffff8f2bffc43b38 R15: ffff8f2b44912dd8
FS:  0000000000000000(0000) GS:ffff8f2bffc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f969b1dbc60 CR3: 0000000d8d610000 CR4: 00000000001607e0
Call Trace:

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [swapper/0:0]
Modules linked in: nvidia_uvm(OE) fuse rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun binfmt_misc nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter dm_mirror dm_region_hash dm_log dm_mod nvidia_drm(POE) nvidia_modeset(POE) nvidia(POE) drm_kms_helper syscopyarea snd_hda_codec_analog snd_hda_codec_generic
sysfillrect sysimgblt snd_hda_codec_hdmi snd_hda_intel fb_sys_fops drm snd_hda_codec intel_powerclamp joydev coretemp snd_hda_core kvm_intel snd_hwdep snd_seq snd_seq_device kvm dell_wmi dell_smbios ipmi_devintf ipmi_msghandler snd_pcm sparse_keymap ppdev dcdbas gpio_ich irqbypass iTCO_wdt iTCO_vendor_support sg pcspkr snd_timer snd lpc_ich i7core_edac parport_pc edac_core i2c_i801 soundcore i2c_core parport shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 sd_mod sr_mod crc_t10dif crct10dif_generic cdrom crct10dif_common ahci libahci libata tg3 crc32c_intel serio_raw ptp pps_core wmi
CPU: 0 PID: 0 Comm: swapper/0 Tainted: P          IOEL ------------   3.10.0-693.11.6.el7.x86_64 #1
Hardware name: Dell Inc. Precision WorkStation T3500  /09KPNV, BIOS A11 04/20/2011
task: ffffffff81a02480 ti: ffffffff819ec000 task.ti: ffffffff819ec000
RIP: 0010:[<ffffffff811e2421>]  [<ffffffff811e2421>] __kmalloc+0xa1/0x230
RSP: 0018:ffff88030ae03a38  EFLAGS: 000002c2
RAX: ffff8802d06164c0 RBX: ffff88017fd16084 RCX: 000000000648191c
RDX: 000000000648191b RSI: 0000000000000000 RDI: 0000000000000007
RBP: ffff88030ae03a68 R08: 000000000001b900 R09: ffffffffc05ff88d
R10: ffff88017fc03b00 R11: ffffea000b4bed00 R12: ffff88030ae039a8
R13: ffffffff816b9d32 R14: ffff88030ae03a68 R15: ffff8802d0616b40
FS:  0000000000000000(0000) GS:ffff88030ae00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f93c18e741a CR3: 00000000019fa000 CR4: 00000000000007f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [kworker/u256:2:13685]
Modules linked in: binfmt_misc xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw vmw_balloon gf128mul sg glue_helper ablk_helper cryptd joydev pcspkr
parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi scsi_transport_spi ata_piix mptscsih crct10dif_pclmul crct10dif_common mptbase libata crc32c_intel serio_raw vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 13685 Comm: kworker/u256:2 Kdump: loaded Tainted: G             L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [watchdog/0:11]
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [gssproxy:873]
Workqueue: writeback bdi_writeback_workfn
Modules linked in:
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [vmtoolsd:852]
(flush-253:3)
binfmt_misc xt_CHECKSUM
Modules linked in:
ipt_MASQUERADE
binfmt_misc
nf_nat_masquerade_ipv4
xt_CHECKSUM
task: ffff9fc1219fe2a0 ti: ffff9fb944164000 task.ti: ffff9fb944164000
tun
ipt_MASQUERADE
devlink
RIP: 0010:[<ffffffff8e028279>] 
[<ffffffff8e028279>] __kmalloc+0x99/0x230