NMI watchdog: BUG: soft lockup - CPU#1 stuck for 34s! [sshd:13596]
Modules linked in: nls_utf8 isofs tun devlink ip_set nfnetlink bridge stp llc vmw_vsock_vmci_transport vsock sunrpc crc32_pclmul ppdev ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw nfit e1000 libnvdimm ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata mptspi scsi_transport_spi drm_panel_orientation_quirks mptscsih mptbase dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
CPU: 1 PID: 13596 Comm: sshd Not tainted 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff91fcf3831040 ti: ffff91fce304c000 task.ti: ffff91fce304c000
RIP: 0010:[<ffffffffc05e5857>]  [<ffffffffc05e5857>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff91fce304f850  EFLAGS: 00000286
RAX: ffffa99b80303818 RBX: ffff91fce304f828 RCX: 0000000000000067
RDX: 0000000000000067 RSI: ffff91fcf52bda00 RDI: ffff91fcf9eb6000
RBP: ffff91fce304f8d0 R08: 0000000000000100 R09: 0000000022100000
R10: 0000000080000000 R11: 0000000000000000 R12: ffff91fce304f810
R13: 0000000000000001 R14: 0000000000000001 R15: ffff91fcfc61ab80
FS:  00007f95bd3648c0(0000) GS:ffff91fcfc640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005634926ea990 CR3: 000000001146e000 CR4: 00000000003607e0
Call Trace:
[<ffffffffbe438c66>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffffbe465cea>] sch_direct_xmit+0x11a/0x250
[<ffffffffbe43bbe1>] __dev_queue_xmit+0x491/0x650
[<ffffffffbe43bdb0>] dev_queue_xmit+0x10/0x20
[<ffffffffbe488736>] ip_finish_output+0x556/0x7b0
[<ffffffffbe488c93>] ip_output+0x73/0xe0
[<ffffffffbe486817>] ip_local_out_sk+0x37/0x40
[<ffffffffbe486bb4>] ip_queue_xmit+0x144/0x3c0
[<ffffffffbe4a0f64>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffffbe4a15d2>] tcp_write_xmit+0x172/0xd00
[<ffffffffbe4a23de>] __tcp_push_pending_frames+0x2e/0xc0
[<ffffffffbe49063c>] tcp_push+0xec/0x120
[<ffffffffbe494092>] tcp_sendmsg+0xd2/0xc60
[<ffffffffbe4bfeb9>] inet_sendmsg+0x69/0xb0
[<ffffffffbe41857d>] sock_aio_write+0x15d/0x180
[<ffffffffbe0405b3>] do_sync_write+0x93/0xe0
[<ffffffffbe0411a5>] vfs_write+0x1c5/0x1f0
[<ffffffffbdf026e0>] ? get_monotonic_boottime+0x50/0x100
[<ffffffffbe041ebf>] SyS_write+0x7f/0xf0
[<ffffffffbe574ddb>] system_call_fastpath+0x22/0x27
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [sshd:4431]
Modules linked in: tcp_lp fuse tun devlink bridge stp llc ip_set nfnetlink vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper snd_ens1371 cryptd snd_rawmidi snd_ac97_codec ppdev vmw_balloon ac97_bus snd_seq snd_seq_device joydev pcspkr snd_pcm snd_timer snd sg soundcore parport_pc parport vmw_vmci i2c_piix4 xfs libcrc32c sr_mod cdrom vmwgfx ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit ata_piix e1000 libnvdimm mptspi scsi_transport_spi mptscsih libata drm crct10dif_pclmul mptbase crct10dif_common crc32c_intel serio_raw drm_panel_orientation_quirks [last unloaded: ip_tables]
CPU: 0 PID: 4431 Comm: sshd Kdump: loaded Not tainted 3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff8b97e87641c0 ti: ffff8b978a33c000 task.ti: ffff8b978a33c000
RIP: 0010:[<ffffffffc02a8877>]  [<ffffffffc02a8877>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff8b978a33f830  EFLAGS: 00000286
RAX: ffff96ee80ac3818 RBX: ffff8b97fa61acc0 RCX: 00000000000000db
RDX: 00000000000000db RSI: ffff8b977633d400 RDI: ffff8b97f9c9e000
RBP: ffff8b978a33f8b0 R08: 0000000000000100 R09: 0000000022100000
R10: 0000000080000000 R11: 0000000000000000 R12: ffff8b978a33f7c8
R13: ffffffff872e2e89 R14: ffff8b978a33f7c8 R15: ffffffff872e69a1
FS:  00007f389bad68c0(0000) GS:ffff8b97fa600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f04cbe4c1de CR3: 000000004a160000 CR4: 00000000007607f0
PKRU: 55555554
Call Trace:
[<ffffffff87853386>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffff8788131a>] sch_direct_xmit+0x11a/0x250
[<ffffffff87856301>] __dev_queue_xmit+0x491/0x650
[<ffffffff878564d0>] dev_queue_xmit+0x10/0x20
[<ffffffff878a429b>] ip_finish_output+0x67b/0x8d0
[<ffffffff878a481b>] ip_output+0x7b/0xf0
[<ffffffff878a3c20>] ? __ip_append_data.isra.50+0xa60/0xa60
[<ffffffff878a2247>] ip_local_out_sk+0x37/0x40
[<ffffffff878a25e4>] ip_queue_xmit+0x144/0x3c0
[<ffffffff878bccc4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffff878bd34a>] tcp_write_xmit+0x18a/0xd40
[<ffffffff878be18e>] __tcp_push_pending_frames+0x2e/0xc0
[<ffffffff878ac23c>] tcp_push+0xec/0x120
[<ffffffff878afc82>] tcp_sendmsg+0xd2/0xc60
[<ffffffff872db9a2>] ? default_wake_function+0x12/0x20
[<ffffffff878dc379>] inet_sendmsg+0x69/0xb0
[<ffffffff8750b283>] ? selinux_socket_sendmsg+0x23/0x30
[<ffffffff8783257d>] sock_aio_write+0x15d/0x180
[<ffffffff8744c663>] do_sync_write+0x93/0xe0
[<ffffffff8744d255>] vfs_write+0x1c5/0x1f0
[<ffffffff87308450>] ? get_monotonic_boottime+0x50/0x100
[<ffffffff8744df1f>] SyS_write+0x7f/0xf0
[<ffffffff87992ed2>] system_call_fastpath+0x25/0x2a
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [sshd:23803]
Modules linked in: veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event intel_powerclamp iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi snd_ac97_codec aesni_intel lrw gf128mul glue_helper ablk_helper ac97_bus ppdev snd_seq cryptd snd_seq_device snd_pcm vmw_balloon snd_timer i2c_piix4 vmw_vmci snd pcspkr soundcore sg nfit libnvdimm shpchp parport_pc parport nfsd auth_rpcgss nfs_acl
lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw e1000 vmwgfx drm_kms_helper mptspi syscopyarea scsi_transport_spi sysfillrect mptscsih sysimgblt fb_sys_fops mptbase ttm drm ata_piix libata i2c_core fjes
CPU: 0 PID: 23803 Comm: sshd Tainted: G             L ------------ T 3.10.0-514.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff88023239af10 ti: ffff8801a27ec000 task.ti: ffff8801a27ec000
RIP: 0010:[<ffffffffa01b2d57>]  [<ffffffffa01b2d57>] e1000_xmit_frame+0x957/0x1040 [e1000]
RSP: 0018:ffff8801a27ef858  EFLAGS: 00000286
RAX: ffffc90000d03818 RBX: 000000019ef0dcc6 RCX: 000000000000001f
RDX: 000000000000001f RSI: ffff8800363b16c0 RDI: ffff88023fc40000
RBP: ffff8801a27ef8d8 R08: 0000000000000100 R09: 0000000022100000
R10: 6628063f00405af6 R11: 0000000000000000 R12: ffffffff8133aba3
R13: ffff8801a27ef820 R14: 0000000000000001 R15: 0000000000000202
FS:  00007f0ee2aca880(0000) GS:ffff880235600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f1da5fa28e0 CR3: 00000001e7f27000 CR4: 00000000003407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffffffff8155bf77 ffff88023606c098 0000001d8155e374 0000000900000000
000000002aed7000 ffff880100000000 ffffffff00000000 0000000100001000
ffff8801fbf5e6f8 ffff88023fc40000 ffff88023606c000 ffff88023fc40000
Call Trace:
[<ffffffff8155bf77>] ? kfree_skbmem+0x37/0x90
[<ffffffff8156edc1>] dev_hard_start_xmit+0x171/0x3b0
[<ffffffff81596424>] sch_direct_xmit+0x104/0x200
[<ffffffff815965d6>] __qdisc_run+0xb6/0x1d0
[<ffffffff815719d8>] __dev_queue_xmit+0x258/0x570
[<ffffffff81571d00>] dev_queue_xmit+0x10/0x20
[<ffffffff815b5716>] ip_finish_output+0x466/0x750
[<ffffffff815b6713>] ip_output+0x73/0xe0
[<ffffffff815b52b0>] ? ip_fragment.constprop.54+0x90/0x90
[<ffffffff815b43d1>] ip_local_out_sk+0x31/0x40
[<ffffffff815b4743>] ip_queue_xmit+0x143/0x3a0
[<ffffffff815cdeaf>] tcp_transmit_skb+0x4af/0x990
[<ffffffff815ce4ea>] tcp_write_xmit+0x15a/0xce0
[<ffffffff815cf2ee>] __tcp_push_pending_frames+0x2e/0xc0
[<ffffffff815bdbbc>] tcp_push+0xec/0x120
[<ffffffff815c1438>] tcp_sendmsg+0xc8/0xc20
[<ffffffff815ec6c4>] inet_sendmsg+0x64/0xb0
[<ffffffff812ab743>] ? selinux_socket_sendmsg+0x23/0x30
[<ffffffff81554407>] sock_aio_write+0x157/0x180
[<ffffffff81212951>] ? set_fd_set+0x21/0x30
[<ffffffff811fd8bd>] do_sync_write+0x8d/0xd0
[<ffffffff811fe225>] vfs_write+0x1b5/0x1e0
[<ffffffff811fec4f>] SyS_write+0x7f/0xe0
[<ffffffff816965c9>] system_call_fastpath+0x16/0x1b
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 30s! [sshd:65813]
Modules linked in: tcp_lp nls_utf8 isofs br_netfilter overlay(T) tun devlink bridge stp llc ip_set vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac snd_ens1371 iosf_mbi snd_rawmidi crc32_pclmul snd_ac97_codec ghash_clmulni_intel ac97_bus snd_seq ppdev snd_seq_device aesni_intel snd_pcm lrw gf128mul glue_helper ablk_helper snd_timer cryptd snd vmw_balloon soundcore joydev pcspkr sg vmw_vmci i2c_piix4 parport_pc parport xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common nfit crc32c_intel ata_piix libnvdimm libata mptspi scsi_transport_spi serio_raw e1000 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash
dm_log dm_mod fuse [last unloaded: ip_tables]
CPU: 0 PID: 65813 Comm: sshd Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.45.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff9c55a4460000 ti: ffff9c55260bc000 task.ti: ffff9c55260bc000
RIP: 0010:[<ffffffffc038a877>]  [<ffffffffc038a877>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff9c55260bf830  EFLAGS: 00000286
RAX: ffffad2101c03818 RBX: 0000000000000001 RCX: 00000000000000e7
RDX: 00000000000000e7 RSI: ffff9c562f0acc00 RDI: ffff9c562c064000
RBP: ffff9c55260bf8b0 R08: 0000000000000100 R09: 0000000022100000
R10: 0008d1b0fa290c00 R11: 0000000000000000 R12: 0000000000000202
R13: 00000003f7c508da R14: 00000001260bf7e0 R15: ffffffff9afb22b0
FS:  00007f5ecbca08c0(0000) GS:ffff9c562d600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fbb2e3019e5 CR3: 000000042bbac000 CR4: 00000000001607f0
Call Trace:
[<ffffffff9b255f96>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffff9b2840aa>] sch_direct_xmit+0x11a/0x250
[<ffffffff9b258f11>] __dev_queue_xmit+0x491/0x650
[<ffffffff9b2590e0>] dev_queue_xmit+0x10/0x20
[<ffffffff9b2a7c6b>] ip_finish_output+0x67b/0x8d0
[<ffffffff9b2a81eb>] ip_output+0x7b/0xf0
[<ffffffff9b2a75f0>] ? __ip_append_data.isra.50+0xa60/0xa60
[<ffffffff9b2a5c17>] ip_local_out_sk+0x37/0x40
[<ffffffff9b2a5fb4>] ip_queue_xmit+0x144/0x3c0
[<ffffffff9b2c06f4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffff9b2c0d7a>] tcp_write_xmit+0x18a/0xd40
[<ffffffff9b2c1bbe>] __tcp_push_pending_frames+0x2e/0xc0
[<ffffffff9b2afc0c>] tcp_push+0xec/0x120
[<ffffffff9b2b3652>] tcp_sendmsg+0xd2/0xc60
[<ffffffff9ae64640>] ? __pollwait+0xf0/0xf0
[<ffffffff9b2dfe09>] inet_sendmsg+0x69/0xb0
[<ffffffff9af0c943>] ? selinux_socket_sendmsg+0x23/0x30
[<ffffffff9b23557d>] sock_aio_write+0x15d/0x180
[<ffffffff9ae4daa3>] do_sync_write+0x93/0xe0
[<ffffffff9ae4e695>] vfs_write+0x1c5/0x1f0
[<ffffffff9ad08100>] ? get_monotonic_boottime+0x50/0x100
[<ffffffff9ae4f36f>] SyS_write+0x7f/0xf0
[<ffffffff9b395f92>] system_call_fastpath+0x25/0x2a
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [sshd:113212]
Modules linked in: veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel
vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg vmw_vmci soundcore i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi ata_piix libata sd_mod crc_t10dif crct10dif_generic e1000 vmwgfx drm_kms_helper syscopyarea mptspi sysfillrect scsi_transport_spi mptscsih sysimgblt mptbase fb_sys_fops ttm drm nfit libnvdimm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 113212 Comm: sshd Tainted: G             L ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff8ab38063c100 ti: ffff8ab28d944000 task.ti: ffff8ab28d944000
RIP: 0010:[<ffffffffc0437857>]  [<ffffffffc0437857>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff8ab28d947850  EFLAGS: 00000286
RAX: ffff9fb140f83818 RBX: 0000000000000001 RCX: 000000000000006f
RDX: 000000000000006f RSI: ffff8ab43fe97bc0 RDI: ffff8ab434f4e000
RBP: ffff8ab28d9478d0 R08: 0000000000000100 R09: 0000000022100000
R10: 09a406400040c342 R11: 0000000000000000 R12: 0000000000000202
R13: 00000001cdfa28da R14: 000000018063c100 R15: ffffffff969a04b0
FS:  00007f5f316788c0(0000) GS:ffff8ab435600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055c1fada0000 CR3: 000000009cace000 CR4: 00000000007607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffff96c38c66>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffff96c65cea>] sch_direct_xmit+0x11a/0x250
[<ffffffff96c3bbe1>] __dev_queue_xmit+0x491/0x650
[<ffffffff96c3bdb0>] dev_queue_xmit+0x10/0x20
[<ffffffff96c88736>] ip_finish_output+0x556/0x7b0
[<ffffffff96c88c93>] ip_output+0x73/0xe0
[<ffffffff96c881e0>] ? __ip_append_data.isra.51+0xa50/0xa50
[<ffffffff96c86817>] ip_local_out_sk+0x37/0x40
[<ffffffff96c86bb4>] ip_queue_xmit+0x144/0x3c0
[<ffffffff96ca0f64>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffff96ca15d2>] tcp_write_xmit+0x172/0xd00
[<ffffffff96ca23de>] __tcp_push_pending_frames+0x2e/0xc0
[<ffffffff96c9063c>] tcp_push+0xec/0x120
[<ffffffff96c94092>] tcp_sendmsg+0xd2/0xc60
[<ffffffff96856d70>] ? __pollwait+0xf0/0xf0
[<ffffffff96cbfeb9>] inet_sendmsg+0x69/0xb0
[<ffffffff96c1857d>] sock_aio_write+0x15d/0x180
[<ffffffff968405b3>] do_sync_write+0x93/0xe0
[<ffffffff968411a5>] vfs_write+0x1c5/0x1f0
[<ffffffff967026e0>] ? get_monotonic_boottime+0x50/0x100
[<ffffffff96841ebf>] SyS_write+0x7f/0xf0
[<ffffffff96d74ddb>] system_call_fastpath+0x22/0x27
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 31s! [sshd:19586]
Modules linked in: tcp_lp nls_utf8 isofs fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon snd_seq_midi snd_seq_midi_event joydev pcspkr snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq
snd_seq_device snd_pcm snd_timer snd soundcore sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmwgfx drm_kms_helper ata_generic pata_acpi syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi libata scsi_transport_spi e1000 nfit mptscsih mptbase libnvdimm drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 19586 Comm: sshd Not tainted 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff8b0e79275140 ti: ffff8b0e568cc000 task.ti: ffff8b0e568cc000
RIP: 0010:[<ffffffffc012c857>]  [<ffffffffc012c857>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff8b0e568cf810  EFLAGS: 00000286
RAX: ffffb669802c3818 RBX: ffff8b0e69d28810 RCX: 00000000000000b1
RDX: 00000000000000b1 RSI: ffff8b0e755ed180 RDI: ffff8b0e79e44000
RBP: ffff8b0e568cf890 R08: 0000000000000100 R09: 0000000022100000
R10: 0000000080000000 R11: 0000000000000000 R12: ffffffffc05f278d
R13: ffffffff92ce05ac R14: ffff8b0e568cf7c0 R15: 0000000000000001
FS:  00007fc74aa9e8c0(0000) GS:ffff8b0e7c600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f909a9dd000 CR3: 0000000010342000 CR4: 00000000001607f0
Call Trace:
[<ffffffff93221697>] ? kfree_skbmem+0x37/0x90
[<ffffffff93238c66>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffff93265cea>] sch_direct_xmit+0x11a/0x250
[<ffffffff9323bbe1>] __dev_queue_xmit+0x491/0x650
[<ffffffff9323bdb0>] dev_queue_xmit+0x10/0x20
[<ffffffff9324861d>] neigh_resolve_output+0x11d/0x220
[<ffffffff9328845c>] ip_finish_output+0x27c/0x7b0
[<ffffffff93288c93>] ip_output+0x73/0xe0
[<ffffffff932881e0>] ? __ip_append_data.isra.51+0xa50/0xa50
[<ffffffff93286817>] ip_local_out_sk+0x37/0x40
[<ffffffff93286bb4>] ip_queue_xmit+0x144/0x3c0
[<ffffffff932a0f64>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffff932a15d2>] tcp_write_xmit+0x172/0xd00
[<ffffffff932a23de>] __tcp_push_pending_frames+0x2e/0xc0
[<ffffffff9329063c>] tcp_push+0xec/0x120
[<ffffffff93294092>] tcp_sendmsg+0xd2/0xc60
[<ffffffff92e56d70>] ? __pollwait+0xf0/0xf0
[<ffffffff932bfeb9>] inet_sendmsg+0x69/0xb0
[<ffffffff92efc4d3>] ? selinux_socket_sendmsg+0x23/0x30
[<ffffffff9321857d>] sock_aio_write+0x15d/0x180
[<ffffffff92e405b3>] do_sync_write+0x93/0xe0
[<ffffffff92e411a5>] vfs_write+0x1c5/0x1f0
[<ffffffff92d026e0>] ? get_monotonic_boottime+0x50/0x100
[<ffffffff92e41ebf>] SyS_write+0x7f/0xf0
[<ffffffff93374ddb>] system_call_fastpath+0x22/0x27
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 56s! [sshd:2403]
Modules linked in: ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ppdev snd_ens1371 snd_rawmidi snd_ac97_codec crc32_pclmul ac97_bus snd_seq snd_seq_device ghash_clmulni_intel snd_pcm aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd pcspkr snd_timer snd sg vmw_vmci soundcore i2c_piix4 parport_pc parport shpchp ip_tables ext4 mbcache jbd2 sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmwgfx drm_kms_helper ata_piix syscopyarea sysfillrect libata sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi drm nfit mptscsih mptbase e1000 i2c_core libnvdimm fjes dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 2403 Comm: sshd Tainted: G             L ------------   3.10.0-514.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff8800b4e62f10 ti: ffff880134154000 task.ti: ffff880134154000
RIP: 0010:[<ffffffffa0087d57>]  [<ffffffffa0087d57>] e1000_xmit_frame+0x957/0x1040 [e1000]
RSP: 0018:ffff880134157868  EFLAGS: 00000286
RAX: ffffc900006c3818 RBX: 00000001357460da RCX: 000000000000006a
RDX: 000000000000006a RSI: ffff880035efa380 RDI: ffff8801351ba000
RBP: ffff8801341578e8 R08: 0000000000000100 R09: 0000000022100000
R10: 0000000000000000 R11: 0000000000000000 R12: ffffffff8133aba3
R13: ffff880134157830 R14: 0000000000000001 R15: 0000000000000202
FS:  00007f96a258c8c0(0000) GS:ffff8801396c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3f6f000420 CR3: 000000013383b000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff880132ef1900 ffff880136852098 00000068b0667080 0000000900000000
0000000034157800 ffffffff00000000 ffff880000000000 0000000100001000
ffff880134a04cf8 ffff8801351ba000 ffff880136852000 ffff8801351ba000
Call Trace:
[<ffffffff8156edc1>] dev_hard_start_xmit+0x171/0x3b0
[<ffffffff81596424>] sch_direct_xmit+0x104/0x200
[<ffffffff815719bc>] __dev_queue_xmit+0x23c/0x570
[<ffffffff81571d00>] dev_queue_xmit+0x10/0x20
[<ffffffff8157cb7b>] neigh_resolve_output+0x11b/0x220
[<ffffffff815b5510>] ip_finish_output+0x260/0x750
[<ffffffff815b6713>] ip_output+0x73/0xe0
[<ffffffff810b1361>] ? remove_wait_queue+0x31/0x40
[<ffffffff815b43d1>] ip_local_out_sk+0x31/0x40
[<ffffffff815b4743>] ip_queue_xmit+0x143/0x3a0
[<ffffffff815cdeaf>] tcp_transmit_skb+0x4af/0x990
[<ffffffff815ce4ea>] tcp_write_xmit+0x15a/0xce0
[<ffffffff815cf2ee>] __tcp_push_pending_frames+0x2e/0xc0
[<ffffffff815bdbbc>] tcp_push+0xec/0x120
[<ffffffff815c1438>] tcp_sendmsg+0xc8/0xc20
[<ffffffff815ec6c4>] inet_sendmsg+0x64/0xb0
[<ffffffff81554407>] sock_aio_write+0x157/0x180
[<ffffffff81212951>] ? set_fd_set+0x21/0x30
[<ffffffff811fd8bd>] do_sync_write+0x8d/0xd0
[<ffffffff811fe225>] vfs_write+0x1b5/0x1e0
[<ffffffff8109db76>] ? __set_current_blocked+0x36/0x80
[<ffffffff811fec4f>] SyS_write+0x7f/0xe0
[<ffffffff816965c9>] system_call_fastpath+0x16/0x1b
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 

NMI watchdog: BUG: soft lockup - CPU#13 stuck for 25s! [sshd:37278]
Modules linked in: tcp_lp nls_utf8 isofs xt_nat xt_CHECKSUM iptable_mangle veth xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 ipt_REJECT nf_reject_ipv4 nf_conntrack_netlink nfnetlink tun xt_addrtype iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink overlay(T) fuse vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec crc32_pclmul ac97_bus snd_seq snd_seq_device ghash_clmulni_intel ppdev snd_pcm vmw_balloon aesni_intel snd_timer lrw snd gf128mul soundcore glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic
ata_generic pata_acpi vmwgfx drm_kms_helper ata_piix syscopyarea mptspi sysfillrect nfit scsi_transport_spi sysimgblt e1000 fb_sys_fops libata mptscsih ttm mptbase drm libnvdimm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 13 PID: 37278 Comm: sshd Kdump: loaded Tainted: G             L ------------ T 3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff9223a8e220e0 ti: ffff9222017a0000 task.ti: ffff9222017a0000
RIP: 0010:[<ffffffffc0460877>]  [<ffffffffc0460877>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff9222017a3798  EFLAGS: 00000286
RAX: ffffa6aac31c3818 RBX: ffff9222017a3720 RCX: 0000000000000088
RDX: 0000000000000088 RSI: ffff9223aa6e7880 RDI: ffff921db50dc000
RBP: ffff9222017a3818 R08: 0000000000000100 R09: 0000000022100000
R10: 0000000000000000 R11: 0000000000000000 R12: ffff92228d1f4300
R13: 000000000000005a R14: ffff921c74ddea40 R15: ffff921c74ddea40
FS:  00007fa95cb9b8c0(0000) GS:ffff9223b3340000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f1930e3efe0 CR3: 00000002fa270000 CR4: 00000000003407e0
Call Trace:
[<ffffffff818376e7>] ? kfree_skbmem+0x37/0x90
[<ffffffff8184f346>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffff8187d0ca>] sch_direct_xmit+0x11a/0x250
[<ffffffff8187d28e>] __qdisc_run+0x8e/0x360
[<ffffffff818522d9>] __dev_queue_xmit+0x4a9/0x650
[<ffffffff812a48b7>] ? local_bh_enable+0x17/0x20
[<ffffffff81852490>] dev_queue_xmit+0x10/0x20
[<ffffffff8185effd>] neigh_resolve_output+0x11d/0x220
[<ffffffff818a059c>] ip_finish_output+0x27c/0x8d0
[<ffffffff818a0f1b>] ip_output+0x7b/0xf0
[<ffffffff818a0320>] ? __ip_append_data.isra.50+0xa60/0xa60
[<ffffffff8189e947>] ip_local_out_sk+0x37/0x40
[<ffffffff8189ece4>] ip_queue_xmit+0x144/0x3c0
[<ffffffff818b9394>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffff818b9a1a>] tcp_write_xmit+0x18a/0xd40
[<ffffffff818ba84e>] __tcp_push_pending_frames+0x2e/0xc0
[<ffffffff818a890c>] tcp_push+0xec/0x120
[<ffffffff818ac352>] tcp_sendmsg+0xd2/0xc60
[<ffffffff818d89c9>] inet_sendmsg+0x69/0xb0
[<ffffffff81507dc3>] ? selinux_socket_sendmsg+0x23/0x30
[<ffffffff8182e57d>] sock_aio_write+0x15d/0x180
[<ffffffff81449fa3>] do_sync_write+0x93/0xe0
[<ffffffff8144ab95>] vfs_write+0x1c5/0x1f0
[<ffffffff81307b00>] ? get_monotonic_boottime+0x50/0x100
[<ffffffff8144b8af>] SyS_write+0x7f/0xf0
[<ffffffff8198dede>] system_call_fastpath+0x25/0x2a
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 31s! [npc:1640]
Modules linked in: tcp_diag inet_diag binfmt_misc veth xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink overlay(T) vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 squashfs loop iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd pcspkr vmw_balloon joydev i2c_piix4 vmw_vmci sg vmxnet3 parport_pc parport ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common crc32c_intel drm_kms_helper syscopyarea sysfillrect
sysimgblt fb_sys_fops mptspi scsi_transport_spi ttm nfit ata_piix ahci libnvdimm mptscsih serio_raw libahci mptbase drm libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 1640 Comm: npc Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff943f6df1b180 ti: ffff943f6dd60000 task.ti: ffff943f6dd60000
RIP: 0010:[<ffffffffc04a244c>]  [<ffffffffc04a244c>] vmxnet3_xmit_frame+0xaec/0xfd0 [vmxnet3]
RSP: 0018:ffff943f6dd63820  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff943f6dd63858 RCX: 000000000000012c
RDX: ffffa5358063e600 RSI: 0000000000000283 RDI: 0000000000000283
RBP: ffff943f6dd638b0 R08: 0006000000006bc9 R09: 0000000000c8404a
R10: 010100007b3f3e00 R11: ffff943f7889b2b0 R12: ffffffff82335bc0
R13: ffff943f6dd63810 R14: 0000000000000010 R15: ffffffffc0727740
FS:  000000c00003ce90(0000) GS:ffff943ff96c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fcabeb6f000 CR3: 00000001352f4000 CR4: 00000000003607e0
Call Trace:
[<ffffffffc02fc761>] ? ipt_do_table+0x361/0x750 [ip_tables]
[<ffffffff8187edc6>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffff818add72>] sch_direct_xmit+0x122/0x250
[<ffffffff81881dd1>] __dev_queue_xmit+0x491/0x650
[<ffffffff81881fa0>] dev_queue_xmit+0x10/0x20
[<ffffffff818d260b>] ip_finish_output+0x67b/0x8d0
[<ffffffff818d2b9b>] ip_output+0x7b/0x100
[<ffffffff818d1f90>] ? __ip_append_data.isra.50+0xa60/0xa60
[<ffffffff818d0587>] ip_local_out_sk+0x37/0x40
[<ffffffff818d0924>] ip_queue_xmit+0x144/0x3d0
[<ffffffff818eb5f4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffff818ebc7a>] tcp_write_xmit+0x18a/0xd40
[<ffffffff818ecace>] __tcp_push_pending_frames+0x2e/0xd0
[<ffffffff818da7cc>] tcp_push+0xec/0x120
[<ffffffff818de272>] tcp_sendmsg+0xd2/0xc60
[<ffffffff812eaea9>] ? update_cfs_shares+0xa9/0x100
[<ffffffff8190b4e9>] inet_sendmsg+0x69/0xb0
[<ffffffff812dd239>] ? ttwu_do_wakeup+0x19/0xf0
[<ffffffff8185d675>] sock_aio_write+0x165/0x180
[<ffffffff8145b2b3>] do_sync_write+0x93/0xe0
[<ffffffff8145be85>] vfs_write+0x1c5/0x1f0
[<ffffffff8145cb35>] SyS_write+0x55/0xd0
[<ffffffff819c539a>] system_call_fastpath+0x25/0x2a
Code: ff c7 02 00 00 00 00 41 8b 94 24 e8 00 00 00 48 8b 4d d0 8d 14 d5 00 06 00 00 48 63 d2 48 03 91 b8 23 00 00 41 8b 4c 24 34 89 0a <e9> d0 f7 ff ff 0f 1f 80 00 00 00 00 48 c7 45 c8 00 40 00 00 41 

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 54s! [ssh:6465]
Modules linked in: xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_addrtype iptable_filter br_netfilter bridge stp llc nfsv3 nfs_acl rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache overlay(T) bochs_drm edac_mce_amd ttm drm_kms_helper syscopyarea sysfillrect sysimgblt aesni_intel fb_sys_fops lrw gf128mul glue_helper ablk_helper cryptd drm pcspkr joydev virtio_balloon floppy drm_panel_orientation_quirks i2c_piix4 auth_rpcgss sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic crct10dif_common sg ata_generic pata_acpi ata_piix virtio_console libata crc32c_intel serio_raw vmw_pvscsi virtio_pci vmxnet3 virtio_ring virtio dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 6465 Comm: ssh Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014
task: ffff8c43fae84200 ti: ffff8c4286810000 task.ti: ffff8c4286810000
RIP: 0010:[<ffffffffc03c644c>]  [<ffffffffc03c644c>] vmxnet3_xmit_frame+0xaec/0xfd0 [vmxnet3]
RSP: 0018:ffff8c4286813788  EFLAGS: 00000286
RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000091
RDX: ffffa67bc0e5c600 RSI: 0000000000000287 RDI: 0000000000000287
RBP: ffff8c4286813818 R08: 0000000000000090 R09: 0000000000a0405a
R10: ffff8c44bfd9f120 R11: ffff8c44b2464900 R12: ffffffffc08e63ff
R13: ffff8c4286813800 R14: 0000000000000170 R15: ffffffffbcd9c615
FS:  00007f191663a840(0000) GS:ffff8c44bfd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0593a33000 CR3: 00000000a00d6000 CR4: 00000000000007e0
Call Trace:
[<ffffffffbd066c7f>] ? kfree_skbmem+0x3f/0xa0
[<ffffffffbd07edc6>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffffbd0add72>] sch_direct_xmit+0x122/0x250
[<ffffffffbd0adf2e>] __qdisc_run+0x8e/0x360
[<ffffffffbd081b58>] __dev_queue_xmit+0x218/0x650
[<ffffffffbd081fa0>] dev_queue_xmit+0x10/0x20
[<ffffffffbd08f03d>] neigh_resolve_output+0x11d/0x220
[<ffffffffbd0d220c>] ip_finish_output+0x27c/0x8d0
[<ffffffffbd0d2b9b>] ip_output+0x7b/0x100
[<ffffffffbd0d1f90>] ? __ip_append_data.isra.50+0xa60/0xa60
[<ffffffffbd0d0587>] ip_local_out_sk+0x37/0x40
[<ffffffffbd0d0924>] ip_queue_xmit+0x144/0x3d0
[<ffffffffbd0eb5f4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffffbd0ebc7a>] tcp_write_xmit+0x18a/0xd40
[<ffffffffbd0ecace>] __tcp_push_pending_frames+0x2e/0xd0
[<ffffffffbd0da7cc>] tcp_push+0xec/0x120
[<ffffffffbd0de272>] tcp_sendmsg+0xd2/0xc60
[<ffffffffbd10b4e9>] inet_sendmsg+0x69/0xb0
[<ffffffffbcd1f913>] ? selinux_socket_sendmsg+0x23/0x30
[<ffffffffbd05d675>] sock_aio_write+0x165/0x180
[<ffffffffbcc5b2b3>] do_sync_write+0x93/0xe0
[<ffffffffbcc5be85>] vfs_write+0x1c5/0x1f0
[<ffffffffbcc5cb35>] SyS_write+0x55/0xd0
[<ffffffffbd1c539a>] system_call_fastpath+0x25/0x2a
Code: ff c7 02 00 00 00 00 41 8b 94 24 e8 00 00 00 48 8b 4d d0 8d 14 d5 00 06 00 00 48 63 d2 48 03 91 b8 23 00 00 41 8b 4c 24 34 89 0a <e9> d0 f7 ff ff 0f 1f 80 00 00 00 00 48 c7 45 c8 00 40 00 00 41 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [rsync:19706]
Modules linked in: binfmt_misc ip6table_filter ip6_tables iptable_filter tcp_diag udp_diag inet_diag vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 ppdev sb_edac coretemp vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod crc_t10dif crct10dif_generic ahci drm libahci crct10dif_pclmul crct10dif_common nfit crc32c_intel ata_piix libnvdimm serio_raw libata vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 19706 Comm: rsync Kdump: loaded Not tainted 3.10.0-1160.95.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff89108c481080 ti: ffff890ed60ac000 task.ti: ffff890ed60ac000
RIP: 0010:[<ffffffffc01c244c>]  [<ffffffffc01c244c>] vmxnet3_xmit_frame+0xaec/0xfd0 [vmxnet3]
RSP: 0018:ffff890ed60af820  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff890ed60af820 RCX: 000000000000001b
RDX: ffffb5090189e618 RSI: 0000000000000287 RDI: 0000000000000287
RBP: ffff890ed60af8b0 R08: 0000000101a14000 R09: 0000000015900036
R10: 0000000000000000 R11: ffff8911ec8881a0 R12: ffff890ed60af7a0
R13: ffff89108c481080 R14: ffff890f35f69a20 R15: 0000000000011220
FS:  00007f9bde2e5740(0000) GS:ffff8911ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f05f395e000 CR3: 000000042d232000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa427edc6>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffffa42add72>] sch_direct_xmit+0x122/0x250
[<ffffffffa4281dd1>] __dev_queue_xmit+0x491/0x650
[<ffffffffa4281fa0>] dev_queue_xmit+0x10/0x20
[<ffffffffa42d2523>] ip_finish_output+0x593/0x8d0
[<ffffffffa42d2b9b>] ip_output+0x7b/0x100
[<ffffffffa42d0542>] ? __ip_local_out_sk+0x102/0x110
[<ffffffffa42d0587>] ip_local_out_sk+0x37/0x40
[<ffffffffa42d0924>] ip_queue_xmit+0x144/0x3d0
[<ffffffffa42eb5f4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffffa42ebc7a>] tcp_write_xmit+0x18a/0xd40
[<ffffffffa42ecace>] __tcp_push_pending_frames+0x2e/0xd0
[<ffffffffa42da7cc>] tcp_push+0xec/0x120
[<ffffffffa42de272>] tcp_sendmsg+0xd2/0xc60
[<ffffffffa430b4e9>] inet_sendmsg+0x69/0xb0
[<ffffffffa425d675>] sock_aio_write+0x165/0x180
[<ffffffffa3e5b1f3>] do_sync_write+0x93/0xe0
[<ffffffffa3e5bdc5>] vfs_write+0x1c5/0x1f0
[<ffffffffa3e5ca75>] SyS_write+0x55/0xd0
[<ffffffffa43c539a>] system_call_fastpath+0x25/0x2a
Code: ff c7 02 00 00 00 00 41 8b 94 24 e8 00 00 00 48 8b 4d d0 8d 14 d5 00 06 00 00 48 63 d2 48 03 91 b8 23 00 00 41 8b 4c 24 34 89 0a <e9> d0 f7 ff ff 0f 1f 80 00 00 00 00 48 c7 45 c8 00 40 00 00 41 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [check_mk_agent:123155]
Modules linked in: binfmt_misc vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd pcspkr joydev vmw_balloon sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm ata_piix nfit serio_raw libata vmxnet3 libnvdimm vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 123155 Comm: check_mk_agent Tainted: G             L ------------   3.10.0-1160.92.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9151a8dee300 ti: ffff9151b8508000 task.ti: ffff9151b8508000
RIP: 0010:[<ffffffffc01da44c>]  [<ffffffffc01da44c>] vmxnet3_xmit_frame+0xaec/0xfd0 [vmxnet3]
RSP: 0018:ffff9151b850b7e0  EFLAGS: 00000286
RAX: 0000000000000000 RBX: 0000000000000038 RCX: 00000000000000f2
RDX: ffffb490c01d8600 RSI: 0000000000000283 RDI: 0000000000000283
RBP: ffff9151b850b870 R08: 0000000032303f87 R09: 0000000000c80044
R10: 0101000009c8e300 R11: ffff9151b7812f10 R12: ffffffffb89ec6d8
R13: ffff9151b850b770 R14: 0000000000000002 R15: ffffdee10089f6c0
FS:  00007f03d9407740(0000) GS:ffff9151bc600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f03d8ae8b90 CR3: 0000000009462000 CR4: 00000000001607f0
Call Trace:
[<ffffffffb8e7edc6>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffffb8eadd72>] sch_direct_xmit+0x122/0x250
[<ffffffffb8e81dd1>] __dev_queue_xmit+0x491/0x650
[<ffffffffb89ec6d8>] ? zone_statistics+0x88/0xb0
[<ffffffffb8e81fa0>] dev_queue_xmit+0x10/0x20
[<ffffffffb8e8f03d>] neigh_resolve_output+0x11d/0x220
[<ffffffffb8ed220c>] ip_finish_output+0x27c/0x8d0
[<ffffffffb8ed2b9b>] ip_output+0x7b/0x100
[<ffffffffb89d0e0a>] ? __rmqueue+0x8a/0x460
[<ffffffffb8ed0587>] ip_local_out_sk+0x37/0x40
[<ffffffffb8ed0924>] ip_queue_xmit+0x144/0x3d0
[<ffffffffb8eeb5f4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffffb8eebc7a>] tcp_write_xmit+0x18a/0xd40
[<ffffffffb8eecace>] __tcp_push_pending_frames+0x2e/0xd0
[<ffffffffb8eda7cc>] tcp_push+0xec/0x120
[<ffffffffb8ede272>] tcp_sendmsg+0xd2/0xc60
[<ffffffffb8a4bea2>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffffb8f0b4e9>] inet_sendmsg+0x69/0xb0
[<ffffffffb89fa15a>] ? __do_fault.isra.61+0x8a/0x100
[<ffffffffb8e5d675>] sock_aio_write+0x165/0x180
[<ffffffffb8a5b1f3>] do_sync_write+0x93/0xe0
[<ffffffffb8a5bdc5>] vfs_write+0x1c5/0x1f0
[<ffffffffb8a5ca75>] SyS_write+0x55/0xd0
[<ffffffffb8fc539a>] system_call_fastpath+0x25/0x2a
Code: ff c7 02 00 00 00 00 41 8b 94 24 e8 00 00 00 48 8b 4d d0 8d 14 d5 00 06 00 00 48 63 d2 48 03 91 b8 23 00 00 41 8b 4c 24 34 89 0a <e9> d0 f7 ff ff 0f 1f 80 00 00 00 00 48 c7 45 c8 00 40 00 00 41 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [openssl:33861]
Modules linked in: binfmt_misc ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon sg joydev pcspkr parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod syscopyarea crc_t10dif sysfillrect sysimgblt
fb_sys_fops crct10dif_generic ttm crct10dif_pclmul drm crct10dif_common crc32c_intel ata_piix nfit libata serio_raw libnvdimm vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 33861 Comm: openssl Kdump: loaded Tainted: G             L ------------   3.10.0-1160.92.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff8f2727c5c200 ti: ffff8f2736ff0000 task.ti: ffff8f2736ff0000
RIP: 0010:[<ffffffffc023144c>]  [<ffffffffc023144c>] vmxnet3_xmit_frame+0xaec/0xfd0 [vmxnet3]
RSP: 0018:ffff8f2736ff37e0  EFLAGS: 00000286
RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000166
RDX: ffffb169c035c600 RSI: 0000000000000287 RDI: 0000000000000287
RBP: ffff8f2736ff3870 R08: 0000000016a90000 R09: 0000000016a00042
R10: 0000000000000000 R11: ffff8f27366f1650 R12: ffffffff967ec6d8
R13: ffff8f2736ff3770 R14: ffff8f2736ff3810 R15: ffff8f2736ff3790
FS:  00007f8f9354c840(0000) GS:ffff8f273b600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f21002d6d70 CR3: 0000000078212000 CR4: 00000000001607f0
Call Trace:
[<ffffffff966b2883>] ? internal_add_timer+0x83/0xe0
[<ffffffff96c7edc6>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffff96cadd72>] sch_direct_xmit+0x122/0x250
[<ffffffff96c81dd1>] __dev_queue_xmit+0x491/0x650
[<ffffffffc06797de>] ? nf_nat_ipv4_fn+0x1de/0x230 [nf_nat_ipv4]
[<ffffffffc0688020>] ? iptable_nat_ipv4_fn+0x20/0x20 [iptable_nat]
[<ffffffff96c81fa0>] dev_queue_xmit+0x10/0x20
[<ffffffff96c8f03d>] neigh_resolve_output+0x11d/0x220
[<ffffffff96cd220c>] ip_finish_output+0x27c/0x8d0
[<ffffffff96cd2b9b>] ip_output+0x7b/0x100
[<ffffffff96cd1f90>] ? __ip_append_data.isra.50+0xa60/0xa60
[<ffffffff96cd0587>] ip_local_out_sk+0x37/0x40
[<ffffffff96cd0924>] ip_queue_xmit+0x144/0x3d0
[<ffffffff96ceb5f4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffff96cebc7a>] tcp_write_xmit+0x18a/0xd40
[<ffffffff96cecace>] __tcp_push_pending_frames+0x2e/0xd0
[<ffffffff96cda7cc>] tcp_push+0xec/0x120
[<ffffffff96cde272>] tcp_sendmsg+0xd2/0xc60
[<ffffffff96d0b4e9>] inet_sendmsg+0x69/0xb0
[<ffffffff9687a780>] ? touch_atime+0xb0/0x220
[<ffffffff96c5d675>] sock_aio_write+0x165/0x180
[<ffffffff9685b1f3>] do_sync_write+0x93/0xe0
[<ffffffff9685bdc5>] vfs_write+0x1c5/0x1f0
[<ffffffff9685ca75>] SyS_write+0x55/0xd0
[<ffffffff96dc539a>] system_call_fastpath+0x25/0x2a
Code: ff c7 02 00 00 00 00 41 8b 94 24 e8 00 00 00 48 8b 4d d0 8d 14 d5 00 06 00 00 48 63 d2 48 03 91 b8 23 00 00 41 8b 4c 24 34 89 0a <e9> d0 f7 ff ff 0f 1f 80 00 00 00 00 48 c7 45 c8 00 40 00 00 41 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [openssl:16172]
Modules linked in: binfmt_misc vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper vmw_balloon cryptd joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c vmwgfx drm_kms_helper sr_mod cdrom syscopyarea ata_generic pata_acpi sysfillrect sysimgblt fb_sys_fops ttm drm sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common ata_piix crc32c_intel nfit serio_raw libata vmxnet3 libnvdimm vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 16172 Comm: openssl Tainted: G             L ------------   3.10.0-1160.83.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/28/2020
task: ffff9a4d36bac200 ti: ffff9a4d27188000 task.ti: ffff9a4d27188000
RIP: 0010:[<ffffffffc02e744c>]  [<ffffffffc02e744c>] vmxnet3_xmit_frame+0xaec/0xfd0 [vmxnet3]
RSP: 0018:ffff9a4d2718b820  EFLAGS: 00000286
RAX: 0000000000000000 RBX: 0000000000000001 RCX: 000000000000018e
RDX: ffffb321801d8600 RSI: 0000000000000287 RDI: 0000000000000287
RBP: ffff9a4d2718b8b0 R08: 0000000017660000 R09: 0000000016a04042
R10: 0000000000000001 R11: ffff9a4d39eab8d0 R12: 0000000000000000
R13: 0000000300000001 R14: 0000000000000800 R15: ffffffffb9bd34df
FS:  00007fd8f045f840(0000) GS:ffff9a4d3c600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f58aff31000 CR3: 00000000399c6000 CR4: 00000000001607f0
Call Trace:
[<ffffffffba07edc6>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffffba0add72>] sch_direct_xmit+0x122/0x250
[<ffffffffba081dd1>] __dev_queue_xmit+0x491/0x650
[<ffffffffba081fa0>] dev_queue_xmit+0x10/0x20
[<ffffffffba0d2523>] ip_finish_output+0x593/0x8d0
[<ffffffffba0d2b9b>] ip_output+0x7b/0x100
[<ffffffffb9bd3dc4>] ? __alloc_pages_nodemask+0x184/0xbf0
[<ffffffffb9c4bb42>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffffba0d0587>] ip_local_out_sk+0x37/0x40
[<ffffffffba0d0924>] ip_queue_xmit+0x144/0x3d0
[<ffffffffba0eb5f4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffffba0ebc7a>] tcp_write_xmit+0x18a/0xd40
[<ffffffffba0ecace>] __tcp_push_pending_frames+0x2e/0xd0
[<ffffffffba0da7cc>] tcp_push+0xec/0x120
[<ffffffffba0de272>] tcp_sendmsg+0xd2/0xc60
[<ffffffffba10b4e9>] inet_sendmsg+0x69/0xb0
[<ffffffffb9c7a300>] ? touch_atime+0x120/0x220
[<ffffffffba05d675>] sock_aio_write+0x165/0x180
[<ffffffffb9c5ae73>] do_sync_write+0x93/0xe0
[<ffffffffb9c5ba45>] vfs_write+0x1c5/0x1f0
[<ffffffffb9c5c6f5>] SyS_write+0x55/0xd0
[<ffffffffba1c539a>] system_call_fastpath+0x25/0x2a
Code: ff c7 02 00 00 00 00 41 8b 94 24 e8 00 00 00 48 8b 4d d0 8d 14 d5 00 06 00 00 48 63 d2 48 03 91 b8 23 00 00 41 8b 4c 24 34 89 0a <e9> d0 f7 ff ff 0f 1f 80 00 00 00 00 48 c7 45 c8 00 40 00 00 41 

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 25s! [etcd:10171]
Modules linked in: tcp_diag inet_diag xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_nat_ipv4 nf_nat br_netfilter bridge stp llc rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache scsi_transport_iscsi overlay(T) vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr nfsd ip_vs auth_rpcgss nfs_acl lockd grace sunrpc nf_conntrack ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common crc32c_intel drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ttm serio_raw ata_piix drm mptspi scsi_transport_spi libata mptscsih vmxnet3 mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 10171 Comm: etcd Kdump: loaded Tainted: G             L ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff90f49769c100 ti: ffff90f48baf0000 task.ti: ffff90f48baf0000
RIP: 0010:[<ffffffff9f56a0f5>]  [<ffffffff9f56a0f5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff90f48baf3830  EFLAGS: 00000283
RAX: ffff90f48fb2ff10 RBX: ffff90f48baf37c8 RCX: 0000000000000000
RDX: ffff90ecb5e7f300 RSI: 0000000000000283 RDI: 0000000000000283
RBP: ffff90f48baf3830 R08: 0a0d000a0d31eb34 R09: 0000000000c80048
R10: 01010000d316eb00 R11: ffff90f48fb2ff10 R12: 0000000000000010
R13: ffffffffc06b58e7 R14: ffffffffffffffda R15: 000000000002c800
FS:  000000c0004d6790(0000) GS:ffff90f49d680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fdd92e701a8 CR3: 000000080f2ae000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc03c1b8f>] vmxnet3_xmit_frame+0xaaf/0xfd0 [vmxnet3]
[<ffffffff9f438c66>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffff9f465cea>] sch_direct_xmit+0x11a/0x250
[<ffffffff9f43bbe1>] __dev_queue_xmit+0x491/0x650
[<ffffffff9f43bdb0>] dev_queue_xmit+0x10/0x20
[<ffffffff9f488736>] ip_finish_output+0x556/0x7b0
[<ffffffff9f488c93>] ip_output+0x73/0xe0
[<ffffffff9f4881e0>] ? __ip_append_data.isra.51+0xa50/0xa50
[<ffffffff9f486817>] ip_local_out_sk+0x37/0x40
[<ffffffff9f486bb4>] ip_queue_xmit+0x144/0x3c0
[<ffffffff9f4a0f64>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffff9f4a15d2>] tcp_write_xmit+0x172/0xd00
[<ffffffff9f4a23de>] __tcp_push_pending_frames+0x2e/0xc0
[<ffffffff9f49063c>] tcp_push+0xec/0x120
[<ffffffff9f494092>] tcp_sendmsg+0xd2/0xc60
[<ffffffff9f486817>] ? ip_local_out_sk+0x37/0x40
[<ffffffff9f4bfeb9>] inet_sendmsg+0x69/0xb0
[<ffffffff9ef0258e>] ? getnstimeofday64+0xe/0x30
[<ffffffff9f41857d>] sock_aio_write+0x15d/0x180
[<ffffffff9f42ebf9>] ? secure_tcp_sequence_number+0x69/0x90
[<ffffffff9f0405b3>] do_sync_write+0x93/0xe0
[<ffffffff9f0411a5>] vfs_write+0x1c5/0x1f0
[<ffffffff9f041ebf>] SyS_write+0x7f/0xf0
[<ffffffff9f574ddb>] system_call_fastpath+0x22/0x27
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 29s! [master:1724]
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 29s! [nginx:1311]
Modules linked in: binfmt_misc tcp_diag inet_diag talpa_vfshook(OE) talpa_pedconnector(OE) talpa_pedevice(OE) talpa_vcdevice(OE) talpa_core(OE) talpa_linux(OE) talpa_syscallhook(OE) vmw_vsock_vmci_transport vsock nf_conntrack_ipv4 nf_defrag_ipv4 xt_owner xt_conntrack nf_conntrack xt_multiport iptable_filter sb_edac iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon joydev nfit pcspkr sg libnvdimm parport_pc parport i2c_piix4 vmw_vmci shpchp ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sd_mod crc_t10dif sysfillrect sysimgblt fb_sys_fops ttm crct10dif_generic drm ahci ata_piix libahci crct10dif_pclmul crct10dif_common crc32c_intel libata serio_raw vmxnet3 vmw_pvscsi i2c_core
dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 1311 Comm: nginx Kdump: loaded Tainted: G           OE  ------------   3.10.0-862.11.6.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff926839958fd0 ti: ffff926839aa8000 task.ti: ffff926839aa8000
RIP: 0010:[<ffffffffc010f96c>]  [<ffffffffc010f96c>] vmxnet3_xmit_frame+0xabc/0xfd0 [vmxnet3]
RSP: 0018:ffff926839aab850  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffffffffc04f37bd RCX: 00000000000001b9
RDX: ffffbcb700c5a600 RSI: 0000000000000287 RDI: 0000000000000287
RBP: ffff926839aab8e0 R08: 00000002286fb610 R09: 0000000016d04036
R10: 0000000000000001 R11: ffff9269aff87b80 R12: ffff9267fa9a6ef8
R13: ffff9267fa9a6ef8 R14: ffff926839aab7f8 R15: 0000000000000286
FS:  00007f12f3ac5880(0000) GS:ffff9269bfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc75ad26db8 CR3: 00000000b9abe000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8bdf02e6>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffff8be1bc0a>] sch_direct_xmit+0x11a/0x250
[<ffffffff8bdf31d1>] __dev_queue_xmit+0x4a1/0x660
[<ffffffff8bdf33a0>] dev_queue_xmit+0x10/0x20
[<ffffffff8be3c5d6>] ip_finish_output+0x546/0x7a0
[<ffffffff8be3cb33>] ip_output+0x73/0xe0
[<ffffffff8be3c090>] ? __ip_append_data.isra.50+0xa50/0xa50
[<ffffffff8be3a727>] ip_local_out_sk+0x37/0x40
[<ffffffff8be3aa93>] ip_queue_xmit+0x143/0x3a0
[<ffffffff8be54bc4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffff8be55232>] tcp_write_xmit+0x172/0xd00
[<ffffffff8be5603e>] __tcp_push_pending_frames+0x2e/0xc0
[<ffffffff8be442ec>] tcp_push+0xec/0x120
[<ffffffff8be47cd2>] tcp_sendmsg+0xd2/0xc80
[<ffffffff8be739a9>] inet_sendmsg+0x69/0xb0
[<ffffffff8be73b50>] ? inet_recvmsg+0x80/0xb0
[<ffffffff8bdd084d>] sock_aio_write+0x15d/0x180
[<ffffffff8ba1e6a3>] do_sync_write+0x93/0xe0
[<ffffffff8ba1f285>] vfs_write+0x1c5/0x1f0
[<ffffffff8ba1ffaf>] SyS_write+0x7f/0xf0
[<ffffffff8bf2579b>] system_call_fastpath+0x22/0x27

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 31s! [grafana-server:1912]
Modules linked in: tcp_lp btrfs raid6_pq xor vfat fat tcp_diag inet_diag ext4 mbcache jbd2 fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc uas coretemp usb_storage crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon
sg pcspkr joydev vmw_vmci parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm serio_raw crct10dif_pclmul crct10dif_common crc32c_intel drm mptspi ata_piix scsi_transport_spi mptscsih libata mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 1912 Comm: grafana-server Kdump: loaded Tainted: G             L ------------   3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
task: ffff9c85282ee2a0 ti: ffff9c8528368000 task.ti: ffff9c8528368000
RIP: 0010:[<ffffffffc04493dc>]  [<ffffffffc04493dc>] vmxnet3_xmit_frame+0xaec/0xfd0 [vmxnet3]
RSP: 0018:ffff9c852836b820  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff9c852836b878 RCX: 0000000000000125
RDX: ffffa9dc80644600 RSI: 0000000000000283 RDI: 0000000000000283
RBP: ffff9c852836b8b0 R08: b17822506fa8c056 R09: 0000000000c84061
R10: 0000450008c9d0e2 R11: ffff9c8532dd5240 R12: ffffffffc08c7c0d
R13: 0000002000000002 R14: ffffffff92e3def9 R15: ffffffff2836b788
FS:  00007f37ed9f8740(0000) GS:ffff9c85bfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3c2c65e000 CR3: 0000000135f0e000 CR4: 00000000000007f0
Call Trace:
[<ffffffff92e3b6f7>] ? kfree_skbmem+0x37/0x90
[<ffffffff92e53386>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffff92e8131a>] sch_direct_xmit+0x11a/0x250
[<ffffffff92e56301>] __dev_queue_xmit+0x491/0x650
[<ffffffff92e564d0>] dev_queue_xmit+0x10/0x20
[<ffffffff92ea429b>] ip_finish_output+0x67b/0x8d0
[<ffffffff92ea481b>] ip_output+0x7b/0xf0
[<ffffffff92ea3c20>] ? __ip_append_data.isra.50+0xa60/0xa60
[<ffffffff92ea2247>] ip_local_out_sk+0x37/0x40
[<ffffffff92ea25e4>] ip_queue_xmit+0x144/0x3c0
[<ffffffff92ebccc4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffff92ebd34a>] tcp_write_xmit+0x18a/0xd40
[<ffffffff92ebe18e>] __tcp_push_pending_frames+0x2e/0xc0
[<ffffffff92eac23c>] tcp_push+0xec/0x120
[<ffffffff92eafc82>] tcp_sendmsg+0xd2/0xc60
[<ffffffff92f85922>] ? __schedule+0x402/0x840
[<ffffffff92edc379>] inet_sendmsg+0x69/0xb0
[<ffffffff92b0b283>] ? selinux_socket_sendmsg+0x23/0x30
[<ffffffff92e3257d>] sock_aio_write+0x15d/0x180
[<ffffffff92a4c663>] do_sync_write+0x93/0xe0
[<ffffffff92a4d255>] vfs_write+0x1c5/0x1f0
[<ffffffff92f92e15>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff92a4df1f>] SyS_write+0x7f/0xf0
[<ffffffff92f92e15>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff92f92ed2>] system_call_fastpath+0x25/0x2a
[<ffffffff92f92e15>] ? system_call_after_swapgs+0xa2/0x13a
Code: ff c7 02 00 00 00 00 41 8b 94 24 e8 00 00 00 48 8b 4d d0 8d 14 d5 00 06 00 00 48 63 d2 48 03 91 b8 23 00 00 41 8b 4c 24 34 89 0a <e9> d0 f7 ff ff 0f 1f 80 00 00 00 00 48 c7 45 c8 00 40 00 00 41