Backtrace

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 27s! [kube-apiserver:3012]
Modules linked in: rbd libceph dns_resolver xt_multiport ipt_rpfilter ip_set_hash_ip ip_set_hash_net ipip tunnel4 ip_tunnel veth xt_set ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_bitmap_port ip_set_hash_ipport ip_set nf_tables(T) ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs dummy iptable_raw xt_CT ip6table_mangle ip6t_MASQUERADE nf_nat_masquerade_ipv6 ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 xt_comment xt_mark nf_conntrack_netlink nfnetlink xt_addrtype xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat xt_conntrack ipt_REJECT nf_reject_ipv4 tun ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel aesni_intel lrw
gf128mul glue_helper ablk_helper cryptd snd_ens1371 joydev pcspkr snd_rawmidi snd_ac97_codec ac97_bus snd_seq nfit snd_seq_device snd_pcm ppdev snd_timer snd sg soundcore libnvdimm parport_pc parport shpchp vmw_vmci i2c_piix4 overlay(T) br_netfilter bridge stp llc nfsd nf_conntrack_ipv4 auth_rpcgss nf_defrag_ipv4 nfs_acl lockd grace sunrpc nf_conntrack libcrc32c ip_tables ext4 mbcache jbd2 sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm ata_piix mptspi scsi_transport_spi libata mptscsih serio_raw e1000 mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 3012 Comm: kube-apiserver Tainted: G               ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff9848ade4eeb0 ti: ffff9849f7e48000 task.ti: ffff9849f7e48000
RIP: 0010:[<ffffffffa7feb1cb>]  [<ffffffffa7feb1cb>] dev_hard_start_xmit+0x2ab/0x3b0
RSP: 0018:ffff9849f7e4b8f0  EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffff984a37535098 RCX: 000000000000002b
RDX: 00000000b352e66b RSI: ffff9849c3d730c0 RDI: ffff98497c510000
RBP: ffff9849f7e4b958 R08: 0000000000000100 R09: 0000000026100000
R10: 0000000080000000 R11: 0000000000000000 R12: 0000000080a586e0
R13: ffffffffc040c837 R14: ffff9849f7e4b8e0 R15: 0000000000000618
FS:  000000c000100c90(0000) GS:ffff984a35680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fcd7c51c000 CR3: 00000001eae2a000 CR4: 00000000003407e0
Call Trace:
[<ffffffffa8016a2a>] sch_direct_xmit+0x11a/0x250
[<ffffffffa7fee051>] __dev_queue_xmit+0x4a1/0x660
[<ffffffffa7fee220>] dev_queue_xmit+0x10/0x20
[<ffffffffa8037416>] ip_finish_output+0x546/0x7a0
[<ffffffffa8037973>] ip_output+0x73/0xe0
[<ffffffffa8036ed0>] ? __ip_append_data.isra.50+0xa50/0xa50
[<ffffffffa8035567>] ip_local_out_sk+0x37/0x40
[<ffffffffa80358d3>] ip_queue_xmit+0x143/0x3a0
[<ffffffffa804f7b4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffffa804fe22>] tcp_write_xmit+0x172/0xd00
[<ffffffffa8050c2e>] __tcp_push_pending_frames+0x2e/0xc0
[<ffffffffa803f12c>] tcp_push+0xec/0x120
[<ffffffffa8042ae2>] tcp_sendmsg+0xd2/0xc80
[<ffffffffa806e5a9>] inet_sendmsg+0x69/0xb0
[<ffffffffa806e750>] ? inet_recvmsg+0x80/0xb0
[<ffffffffa7fcb84d>] sock_aio_write+0x15d/0x180
[<ffffffffa7c1a1f3>] do_sync_write+0x93/0xe0
[<ffffffffa7c1add5>] vfs_write+0x1c5/0x1f0
[<ffffffffa7c1baff>] SyS_write+0x7f/0xf0
[<ffffffffa811fa51>] tracesys+0x9d/0xc3
Code: 00 03 0f 84 98 00 00 00 0f b6 55 b7 31 db b8 10 00 00 00 84 d2 48 0f 45 5d a8 41 0f 44 c5 48 8b 55 98 89 02 48 89 d8 48 8b 55 d0 <65> 48 33 14 25 28 00 00 00 0f 85 c9 00 00 00 48 83 c4 40 5b 41