NMI watchdog: BUG: soft lockup - CPU#18 stuck for 30s! [php-fpm:568834]
Modules linked in: dattobd(OE) sfs(OE) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc nfit libnvdimm iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr vmw_balloon joydev sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom
crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm mptspi scsi_transport_spi mptscsih ahci vmxnet3 libahci mptbase drm_panel_orientation_quirks ata_piix libata dm_mirror dm_region_hash dm_log dm_mod [last unloaded: dattobd]
CPU: 18 PID: 568834 Comm: php-fpm Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff9866bb365140 ti: ffff986680034000 task.ti: ffff986680034000
RIP: 0010:[<ffffffffc013a1ae>]  [<ffffffffc013a1ae>] vmxnet3_rq_rx_complete+0xfe/0xef0 [vmxnet3]
RSP: 0018:ffff986ebfc03dc8  EFLAGS: 00010286
RAX: ffff986acb1c0000 RBX: 0000000000000086 RCX: 0000000000000000
RDX: 0000000000000004 RSI: 0000000000000000 RDI: 00000000000007fe
RBP: ffff986ebfc03e40 R08: 0000000000000030 R09: 0000000000000000
R10: ffff986acb1c3ff0 R11: ffff986c4ffb88c0 R12: ffff986ebfc03d38
R13: ffffffff8a375df2 R14: ffff986ebfc03e40 R15: ffff986c4ffb99b8
FS:  00007f8d5a547880(0000) GS:ffff986ebfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8d5a525000 CR3: 0000000105f4e000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 29s! [ksoftirqd/0:6]
Modules linked in: nfsv3 nfs_acl rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13402(E) vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr vmw_vmci i2c_piix4 parport_pc parport auth_rpcgss sunrpc ip_tables xfs libcrc32c ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic sg vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm ata_piix serio_raw libata vmw_pvscsi vmxnet3 nfit libnvdimm drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 6 Comm: ksoftirqd/0 Kdump: loaded Tainted: P            E  ------------   3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff8ca8f9355280 ti: ffff8ca8f974c000 task.ti: ffff8ca8f974c000
RIP: 0010:[<ffffffffc03f7e8e>]  [<ffffffffc03f7e8e>] vmxnet3_rq_rx_complete+0xfe/0xef0 [vmxnet3]
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 45s! [snmpd:1474]
Modules linked in: nfsv3 nfs_acl rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13402(E) vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr vmw_vmci i2c_piix4 parport_pc parport auth_rpcgss sunrpc ip_tables xfs libcrc32c ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic sg vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm ata_piix serio_raw libata vmw_pvscsi vmxnet3 nfit libnvdimm drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 1474 Comm: snmpd Kdump: loaded Tainted: P            E  ------------   3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff8ca8f5ff6300 ti: ffff8cab9e2bc000 task.ti: ffff8cab9e2bc000
RIP: 0010:[<ffffffffbaea4ad7>]  [<ffffffffbaea4ad7>] __do_softirq+0x97/0x280
RSP: 0000:ffff8cabbfd03f20  EFLAGS: 00000206
RAX: ffff8cab9e2bffd8 RBX: ffffffffbbe03fc2 RCX: 0000000000000001
RDX: 000000010d9a52ab RSI: ffff8cabbfd138d8 RDI: ffff8ca8f5ff6300
RBP: ffff8cabbfd03f80 R08: 00000000736e2033 R09: 75727265746e6920
R10: 00000000000009c6 R11: 3737343739373131 R12: ffff8cabbfd03e98
R13: ffffffffbb595fba R14: ffff8cabbfd03f80 R15: ffff8cab9e2bffd8
FS:  00007fec19bc6880(0000) GS:ffff8cabbfd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fec19bf6000 CR3: 000000042212c000 CR4: 00000000000607e0
Call Trace:

NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [autotune_bklog:9712]
Modules linked in: ip_vs_rr xt_ipvs ip_vs xt_REDIRECT nf_nat_redirect xt_nat veth vxlan ip6_udp_tunnel udp_tunnel xt_mark nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter overlay(T) ampnetworkflow(OE) ampfsm(OE) vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd vmw_balloon joydev sg pcspkr parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ttm sd_mod drm crc_t10dif crct10dif_generic ahci ata_piix nfit libahci crct10dif_pclmul libnvdimm crct10dif_common crc32c_intel libata serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 4 PID: 9712 Comm: autotune_bklog Kdump: loaded Tainted: G           OE  ------------ T 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8973faf620e0 ti: ffff8973f85ec000 task.ti: ffff8973f85ec000
RIP: 0010:[<ffffffffc00fbfe8>]  [<ffffffffc00fbfe8>] vmxnet3_rq_rx_complete+0x258/0xef0 [vmxnet3]
RSP: 0018:ffff89746d703de8  EFLAGS: 00010282
RAX: ffff8973fb67a600 RBX: ffff897466cd9700 RCX: 0000000000000002
RDX: 000000002b853f23 RSI: 00000003a9753540 RDI: ffff89746e8bc098
RBP: ffff89746d703e60 R08: 0000000000000000 R09: 0000000426cd9740
R10: ffff897459cfbd80 R11: ffff89746831c8c0 R12: ffff89746d703d58
R13: ffffffff9f193efa R14: ffff89746d703e60 R15: ffff89746831d7b8
FS:  00007fc1d2a5e700(0000) GS:ffff89746d700000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9ce80d8000 CR3: 00000000ba628000 CR4: 00000000003607e0
Call Trace:

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 28s! [splunkd:19321]
ata1.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen
ata1.00: cmd a0/00:00:00:08:00/00:00:00:00:00/a0 tag 0 pio 16392 in#012         Get event status notification 4a 01 00 00 10 00 00 00 08 00res 40/00:02:00:08:00/00:00:00:00:00/a0 Emask 0x4 (timeout)
ata1.00: status: { DRDY }
Modules linked in: CyProtectDrv(OE) microsoft_dependency_agent(POE) bluechannel(POE) sctp_diag sctp dccp_diag dccp unix_diag af_packet_diag netlink_diag rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache udp_diag tcp_diag inet_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod sb_edac edac_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg nfit libnvdimm parport_pc vmw_vmci parport shpchp i2c_piix4 nfsd auth_rpcgss
nfs_acl lockd grace sunrpc binfmt_misc ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops crct10dif_pclmul ttm crct10dif_common crc32c_intel serio_raw drm ata_piix libata mptspi scsi_transport_spi mptscsih vmxnet3 mptbase i2c_core floppy [last unloaded: CyProtectDrv]
CPU: 0 PID: 19321 Comm: splunkd Tainted: P           OEL ------------   3.10.0-693.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/19/2018
task: ffff8800ab9c0000 ti: ffff8801a4754000 task.ti: ffff8801a4754000
RIP: 0010:[<ffffffffc005883e>]  [<ffffffffc005883e>] vmxnet3_rq_rx_complete+0x2e/0xc30 [vmxnet3]
RSP: 0018:ffff88043fc03db0  EFLAGS: 00010282
RAX: 0000000000000000 RBX: ffff88017fd18000 RCX: 0000000000000001
RDX: 0000000000000040 RSI: ffff88042acb48c0 RDI: ffff88042acb50c0
RBP: ffff88043fc03e18 R08: ffff88042acb50e0 R09: ffff88043fc03da0
R10: 0000000000000000 R11: ffff88043fc03da8 R12: ffff88043fc03d28
R13: ffffffff816c1732 R14: ffff88043fc03e18 R15: ffff88042acb48c0
FS:  00007fc76b5ff700(0000) GS:ffff88043fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc5714b64f0 CR3: 00000001e9bb2000 CR4: 00000000001607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 258s! [kubelet:16194]
Modules linked in: xt_multiport iptable_raw ip_set_hash_ip ip_set_hash_net ipip tunnel4 ip_tunnel xt_CHECKSUM iptable_mangle ipt_REJECT nf_reject_ipv4 tun ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_conntrack ebtable_filter ebtables ip6table_filter ip6_tables devlink xt_addrtype xt_set xt_mark ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_bitmap_port ip_set_hash_ipport ip_set nfnetlink dummy xt_comment iptable_nat nf_nat_ipv4 nf_nat overlay(T) nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nf_conntrack iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg i2c_piix4 parport_pc parport vmw_vmci br_netfilter
bridge stp llc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi ata_piix crct10dif_pclmul crct10dif_common scsi_transport_spi crc32c_intel mptscsih libata serio_raw nfit mptbase libnvdimm vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 16194 Comm: kubelet Tainted: G        W    L ------------ T 3.10.0-957.27.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff96471df5b0c0 ti: ffff9647aebe8000 task.ti: ffff9647aebe8000
RIP: 0010:[<ffffffffc016e421>]  [<ffffffffc016e421>] vmxnet3_rq_rx_complete+0x371/0xef0 [vmxnet3]
RSP: 0000:ffff9647ffc43dc8  EFLAGS: 00010286
RAX: 00000000000004ff RBX: ffff9647ffc43d60 RCX: 0000000000000000
RDX: 0000000000000001 RSI: ffff9647e915d980 RDI: 0000000000000000
RBP: ffff9647ffc43e40 R08: ffff9647e770c200 R09: 0000000000000000
R10: 00000000e770c701 R11: ffff9647e915c8c0 R12: ffff9647ffc43d38
R13: ffffffffa4377df2 R14: ffff9647ffc43e40 R15: ffff9647e915d9b8
FS:  00007efbd4ff9700(0000) GS:ffff9647ffc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007efbf45f81f8 CR3: 0000000034422000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 38s! [kworker/1:1:14160]
Code: 56 41 55 41 89 f5 41 54 53 48 89 fb 48 83 ec 28 65 48 8b 04 25 28 00 00 00 48 89 45 d0 31 c0 48 8b 87 e8 00 00 00 48 85 c0 74 29 <0f> b7 48 1c 66 85 c9 74 20 
Modules linked in:
48 01 
xt_owner
c8 
tcp_diag
49 89 
inet_diag
c4 74 
ip6t_REJECT
18 49 
nf_reject_ipv6
83 
nf_log_ipv6
7c 24 
CPU: 5 PID: 8981 Comm: kworker/5:2 Kdump: loaded Tainted: G             L ------------   3.10.0-957.21.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
nf_log_ipv4 nf_log_common ip6table_filter nf_nat_ftp xt_REDIRECT nf_nat_redirect xt_conntrack nf_conntrack_ftp xt_LOG xt_limit xt_multiport iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 ip6table_mangle ip6table_raw ip6table_nat
Workqueue: events check_lifetime
task: ffff915c368c5140 ti: ffff915b12510000 task.ti: ffff915b12510000
nf_conntrack_ipv6 nf_defrag_ipv6
RIP: 0010:[<ffffffffc0360955>] 
[<ffffffffc0360955>] vmxnet3_rq_rx_complete+0x8a5/0xef0 [vmxnet3]
[<ffffffffb26c1da1>] kthread+0xd1/0xe0

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 28s! [kworker/3:2:36486]
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [sbis-daemon:46824]
Modules linked in: tcp_diag inet_diag vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr joydev sg vmw_vmci i2c_piix4 parport_pc parport nfsd nfs_acl lockd grace auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix libata serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 46824 Comm: sbis-daemon Kdump: loaded Tainted: G             L ------------   3.10.0-957.21.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff9f17aa192080 ti: ffff9f1a97ad0000 task.ti: ffff9f1a97ad0000
RIP: 0010:[<ffffffffc0452308>]  [<ffffffffc0452308>] vmxnet3_rq_rx_complete+0x258/0xef0 [vmxnet3]
RSP: 0000:ffff9f1aae603de8  EFLAGS: 00010282
RAX: ffff9f18f4ace800 RBX: ffff9f17822a8100 RCX: 0000000000000002
RDX: 0000000098c98c85 RSI: 0000000100ddd340 RDI: ffff9f1aae631098
RBP: ffff9f1aae603e60 R08: 0000000000000000 R09: 00000001022a8140
R10: ffff9f1aa22038d0 R11: ffff9f1aabaa88c0 R12: ffff9f1aae603d58
R13: ffffffffa5776df2 R14: ffff9f1aae603e60 R15: ffff9f1aabaa93b8
FS:  00007fb65e496700(0000) GS:ffff9f1aae600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb65c293000 CR3: 00000001285be000 CR4: 00000000000607f0
Call Trace: