Info

Permalink
Function
e1000_xmit_frame
First occurrence
2021-03-01
Last occurrence
2026-07-06
State
NEW
Components
kernel
Quality
-46

Statistics

Operating system Count
CentOS 7 29
Architecture Count
x86_64 29
Related packages Count
kernel 29
 0:3.10.0-693.el7 10
 0:3.10.0-862.el7 8
 0:3.10.0-1160.el7 4
 0:3.10.0-957.el7 3
 0:3.10.0-1160.59.1.el7 2
 0:3.10.0-514.16.1.el7 1
 0:3.10.0-1160.76.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

Report backtrace


Complete report #582699
Frame # Function Binary Source or offset Line
1
e1000_xmit_frame
e1000 0xffffffffc034d877
Build id: 3.10.0-1160.59.1.el7.x86_64
0x7f7
2
dev_hard_start_xmit
vmlinux 0xffffffffaea58f96
Build id: 3.10.0-1160.59.1.el7.x86_64
0x246
3
sch_direct_xmit
vmlinux 0xffffffffaea870aa
Build id: 3.10.0-1160.59.1.el7.x86_64
0x11a
4
__dev_queue_xmit
vmlinux 0xffffffffaea5bf11
Build id: 3.10.0-1160.59.1.el7.x86_64
0x491
5
? nf_ct_deliver_cached_events
nf_conntrack 0xffffffffc0920804
Build id: 3.10.0-1160.59.1.el7.x86_64
0xb4
6
dev_queue_xmit
vmlinux 0xffffffffaea5c0e0
Build id: 3.10.0-1160.59.1.el7.x86_64
0x10
7
neigh_resolve_output
vmlinux 0xffffffffaea68e0d
Build id: 3.10.0-1160.59.1.el7.x86_64
0x11d
8
ip_finish_output
vmlinux 0xffffffffaeaaa86c
Build id: 3.10.0-1160.59.1.el7.x86_64
0x27c
9
ip_output
vmlinux 0xffffffffaeaab1eb
Build id: 3.10.0-1160.59.1.el7.x86_64
0x7b
10
? __ip_append_data.isra.50
vmlinux 0xffffffffaeaaa5f0
Build id: 3.10.0-1160.59.1.el7.x86_64
0xa60
11
ip_local_out_sk
vmlinux 0xffffffffaeaa8c17
Build id: 3.10.0-1160.59.1.el7.x86_64
0x37
12
ip_queue_xmit
vmlinux 0xffffffffaeaa8fb4
Build id: 3.10.0-1160.59.1.el7.x86_64
0x144
13
tcp_transmit_skb
vmlinux 0xffffffffaeac3734
Build id: 3.10.0-1160.59.1.el7.x86_64
0x4e4
14
tcp_connect
vmlinux 0xffffffffaeac53ed
Build id: 3.10.0-1160.59.1.el7.x86_64
0x71d
15
? getnstimeofday64
vmlinux 0xffffffffae507fae
Build id: 3.10.0-1160.59.1.el7.x86_64
0xe
16
? ktime_get_real
vmlinux 0xffffffffae508065
Build id: 3.10.0-1160.59.1.el7.x86_64
0x25
17
? secure_tcp_sequence_number
vmlinux 0xffffffffaea4eda9
Build id: 3.10.0-1160.59.1.el7.x86_64
0x69
18
tcp_v4_connect
vmlinux 0xffffffffaeaca4c5
Build id: 3.10.0-1160.59.1.el7.x86_64
0x345
19
__inet_stream_connect
vmlinux 0xffffffffaeae1bf3
Build id: 3.10.0-1160.59.1.el7.x86_64
0xc3
20
? kmem_cache_alloc_trace
vmlinux 0xffffffffae6293a6
Build id: 3.10.0-1160.59.1.el7.x86_64
0x1d6
21
inet_stream_connect
vmlinux 0xffffffffaeae1eb8
Build id: 3.10.0-1160.59.1.el7.x86_64
0x38
22
SYSC_connect
vmlinux 0xffffffffaea3996d
Build id: 3.10.0-1160.59.1.el7.x86_64
0xed
23
? selinux_file_fcntl
vmlinux 0xffffffffae70f6f2
Build id: 3.10.0-1160.59.1.el7.x86_64
0x62
24
SyS_connect
vmlinux 0xffffffffaea3b5be
Build id: 3.10.0-1160.59.1.el7.x86_64
0xe
25
system_call_fastpath
vmlinux 0xffffffffaeb99f92
Build id: 3.10.0-1160.59.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 44s! [nova-consoleaut:1605]
Modules linked in: tcp_lp nls_utf8 isofs rfcomm devlink ebtable_filter ebtables target_core_mod binfmt_misc nf_conntrack_netlink openvswitch nf_nat_ipv6 ip6t_REJECT nf_reject_ipv6 nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat xt_CHECKSUM iptable_mangle ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_comment xt_conntrack nf_conntrack bnep xt_multiport iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio snd_seq_midi snd_seq_midi_event ext4 iosf_mbi kvm_intel kvm mbcache jbd2 irqbypass loop crc32_pclmul ghash_clmulni_intel ppdev snd_ens1371 aesni_intel vmw_balloon snd_rawmidi snd_ac97_codec lrw btusb gf128mul ac97_bus glue_helper snd_seq
btrtl ablk_helper btbcm cryptd btintel snd_seq_device bluetooth snd_pcm sg snd_timer joydev rfkill pcspkr snd soundcore vmw_vmci i2c_piix4 parport_pc parport br_netfilter bridge stp llc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit drm libnvdimm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix serio_raw mptspi libata scsi_transport_spi e1000 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 1605 Comm: nova-consoleaut Kdump: loaded Not tainted 3.10.0-1160.59.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff9f9d75d74200 ti: ffff9f9ef1b6c000 task.ti: ffff9f9ef1b6c000
RIP: 0010:[<ffffffffc034d877>]  [<ffffffffc034d877>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff9f9ef1b6f960  EFLAGS: 00000286
RAX: ffffab6600d03818 RBX: 0000000000000001 RCX: 000000000000001b
RDX: 000000000000001b RSI: ffff9f9ef606f140 RDI: ffff9f9e3ae64000
RBP: ffff9f9ef1b6f9e0 R08: 0000000000000100 R09: 0000000022100000
R10: dde406400040c30b R11: 0000000000000000 R12: 0000000000000202
R13: 000000014aa5c4c6 R14: 00000001af504bc0 R15: ffffffffae7b22c0
FS:  00007f9dd436b740(0000) GS:ffff9f9ef56c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f13a469c2a8 CR3: 000000023147e000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffffaea58f96>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffffaea870aa>] sch_direct_xmit+0x11a/0x250
[<ffffffffaea5bf11>] __dev_queue_xmit+0x491/0x650
[<ffffffffc0920804>] ? nf_ct_deliver_cached_events+0xb4/0x110 [nf_conntrack]
[<ffffffffaea5c0e0>] dev_queue_xmit+0x10/0x20
[<ffffffffaea68e0d>] neigh_resolve_output+0x11d/0x220
[<ffffffffaeaaa86c>] ip_finish_output+0x27c/0x8d0
[<ffffffffaeaab1eb>] ip_output+0x7b/0xf0
[<ffffffffaeaaa5f0>] ? __ip_append_data.isra.50+0xa60/0xa60
[<ffffffffaeaa8c17>] ip_local_out_sk+0x37/0x40
[<ffffffffaeaa8fb4>] ip_queue_xmit+0x144/0x3c0
[<ffffffffaeac3734>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffffaeac53ed>] tcp_connect+0x71d/0xb60
[<ffffffffae507fae>] ? getnstimeofday64+0xe/0x30
[<ffffffffae508065>] ? ktime_get_real+0x25/0x70
[<ffffffffaea4eda9>] ? secure_tcp_sequence_number+0x69/0x90
[<ffffffffaeaca4c5>] tcp_v4_connect+0x345/0x4a0
[<ffffffffaeae1bf3>] __inet_stream_connect+0xc3/0x350
[<ffffffffae6293a6>] ? kmem_cache_alloc_trace+0x1d6/0x200
[<ffffffffaeae1eb8>] inet_stream_connect+0x38/0x50
[<ffffffffaea3996d>] SYSC_connect+0xed/0x130
[<ffffffffae70f6f2>] ? selinux_file_fcntl+0x62/0xa0
[<ffffffffaea3b5be>] SyS_connect+0xe/0x10
[<ffffffffaeb99f92>] system_call_fastpath+0x25/0x2a
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 
Complete report #514260
Frame # Function Binary Source or offset Line
1
e1000_xmit_frame
e1000 0xffffffffc02d7877
Build id: 3.10.0-1160.el7.x86_64
0x7f7
2
dev_hard_start_xmit
vmlinux 0xffffffffb1854386
Build id: 3.10.0-1160.el7.x86_64
0x246
3
sch_direct_xmit
vmlinux 0xffffffffb188242a
Build id: 3.10.0-1160.el7.x86_64
0x11a
4
__dev_queue_xmit
vmlinux 0xffffffffb1857301
Build id: 3.10.0-1160.el7.x86_64
0x491
5
dev_queue_xmit
vmlinux 0xffffffffb18574d0
Build id: 3.10.0-1160.el7.x86_64
0x10
6
ip_finish_output
vmlinux 0xffffffffb18a545b
Build id: 3.10.0-1160.el7.x86_64
0x67b
7
ip_output
vmlinux 0xffffffffb18a59db
Build id: 3.10.0-1160.el7.x86_64
0x7b
8
? __ip_append_data.isra.50
vmlinux 0xffffffffb18a4de0
Build id: 3.10.0-1160.el7.x86_64
0xa60
9
ip_local_out_sk
vmlinux 0xffffffffb18a3407
Build id: 3.10.0-1160.el7.x86_64
0x37
10
ip_queue_xmit
vmlinux 0xffffffffb18a37a4
Build id: 3.10.0-1160.el7.x86_64
0x144
11
tcp_transmit_skb
vmlinux 0xffffffffb18bde94
Build id: 3.10.0-1160.el7.x86_64
0x4e4
12
tcp_connect
vmlinux 0xffffffffb18bfb4d
Build id: 3.10.0-1160.el7.x86_64
0x71d
13
? getnstimeofday64
vmlinux 0xffffffffb130797e
Build id: 3.10.0-1160.el7.x86_64
0xe
14
? ktime_get_real
vmlinux 0xffffffffb1307a35
Build id: 3.10.0-1160.el7.x86_64
0x25
15
? secure_tcp_sequence_number
vmlinux 0xffffffffb1849d49
Build id: 3.10.0-1160.el7.x86_64
0x69
16
tcp_v4_connect
vmlinux 0xffffffffb18c4c25
Build id: 3.10.0-1160.el7.x86_64
0x345
17
__inet_stream_connect
vmlinux 0xffffffffb18dc333
Build id: 3.10.0-1160.el7.x86_64
0xc3
18
inet_stream_connect
vmlinux 0xffffffffb18dc5f8
Build id: 3.10.0-1160.el7.x86_64
0x38
19
generic_ip_connect
cifs 0xffffffffc0825d2c
Build id: 3.10.0-1160.el7.x86_64
0xdc
20
cifs_reconnect
cifs 0xffffffffc0827c93
Build id: 3.10.0-1160.el7.x86_64
0x2e3
21
cifs_readv_from_socket
cifs 0xffffffffc08281de
Build id: 3.10.0-1160.el7.x86_64
0x1ee
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 153s! [cifsd:3095]
Modules linked in: cmac arc4 md4 nls_utf8 cifs ccm dns_resolver ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw nfit gf128mul ppdev libnvdimm glue_helper ablk_helper sg vmw_balloon vmw_vmci cryptd pcspkr joydev i2c_piix4 parport_pc parport ip_tables xfs libcrc32c vmwgfx sr_mod cdrom sd_mod crc_t10dif
crct10dif_generic ata_generic pata_acpi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata e1000 crct10dif_pclmul mptspi crct10dif_common scsi_transport_spi crc32c_intel mptscsih mptbase serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 3095 Comm: cifsd Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff8af606646300 ti: ffff8af624900000 task.ti: ffff8af624900000
RIP: 0010:[<ffffffffc02d7877>]  [<ffffffffc02d7877>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff8af624903830  EFLAGS: 00000286
RAX: ffffad4a034c3818 RBX: 0000000000000001 RCX: 0000000000000093
RDX: 0000000000000093 RSI: ffff8af8245ff280 RDI: ffff8af35bf9a000
RBP: ffff8af6249038b0 R08: 0000000000000100 R09: 0000000022100000
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 153s! [tar:98230]
R10: 0000000080000000 R11: 0000000000000000 R12: 0000000000000202
R13: 0000000154b9890c R14: 0000000124903800 R15: ffffffffb15b1650
FS:  0000000000000000(0000) GS:ffff8af825640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007feee4472000 CR3: 0000000621918000 CR4: 00000000003607e0
Modules linked in: cmac arc4 md4 nls_utf8 cifs ccm dns_resolver ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw nfit gf128mul ppdev libnvdimm glue_helper ablk_helper sg vmw_balloon vmw_vmci cryptd pcspkr joydev i2c_piix4 parport_pc parport ip_tables xfs libcrc32c vmwgfx sr_mod cdrom sd_mod crc_t10dif
Call Trace:
[<ffffffffb1854386>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffffb188242a>] sch_direct_xmit+0x11a/0x250
[<ffffffffb1857301>] __dev_queue_xmit+0x491/0x650
[<ffffffffb18574d0>] dev_queue_xmit+0x10/0x20
[<ffffffffb18a545b>] ip_finish_output+0x67b/0x8d0
[<ffffffffb18a59db>] ip_output+0x7b/0xf0
[<ffffffffb18a4de0>] ? __ip_append_data.isra.50+0xa60/0xa60
[<ffffffffb18a3407>] ip_local_out_sk+0x37/0x40
[<ffffffffb18a37a4>] ip_queue_xmit+0x144/0x3c0
[<ffffffffb18bde94>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffffb18bfb4d>] tcp_connect+0x71d/0xb60
[<ffffffffb130797e>] ? getnstimeofday64+0xe/0x30
[<ffffffffb1307a35>] ? ktime_get_real+0x25/0x70
[<ffffffffb1849d49>] ? secure_tcp_sequence_number+0x69/0x90
[<ffffffffb18c4c25>] tcp_v4_connect+0x345/0x4a0
[<ffffffffb18dc333>] __inet_stream_connect+0xc3/0x350
[<ffffffffb18dc5f8>] inet_stream_connect+0x38/0x50
[<ffffffffc0825d2c>] generic_ip_connect+0xdc/0x4d0 [cifs]
[<ffffffffc0827c93>] cifs_reconnect+0x2e3/0x640 [cifs]
[<ffffffffc08281de>] cifs_readv_from_socket+0x1ee/0x370 [cifs]
Complete report #415687
Frame # Function Binary Source or offset Line
1
e1000_xmit_frame
e1000 0xffffffffc014e867
Build id: 3.10.0-862.el7.x86_64
0x7f7
2
dev_hard_start_xmit
vmlinux 0xffffffffb43eb166
Build id: 3.10.0-862.el7.x86_64
0x246
3
sch_direct_xmit
vmlinux 0xffffffffb4416a2a
Build id: 3.10.0-862.el7.x86_64
0x11a
4
__dev_queue_xmit
vmlinux 0xffffffffb43ee051
Build id: 3.10.0-862.el7.x86_64
0x4a1
5
dev_queue_xmit
vmlinux 0xffffffffb43ee220
Build id: 3.10.0-862.el7.x86_64
0x10
6
neigh_resolve_output
vmlinux 0xffffffffb43f9c5d
Build id: 3.10.0-862.el7.x86_64
0x11d
7
ip_finish_output
vmlinux 0xffffffffb443717c
Build id: 3.10.0-862.el7.x86_64
0x2ac
8
ip_output
vmlinux 0xffffffffb4437973
Build id: 3.10.0-862.el7.x86_64
0x73
9
? __ip_append_data.isra.50
vmlinux 0xffffffffb4436ed0
Build id: 3.10.0-862.el7.x86_64
0xa50
10
ip_local_out_sk
vmlinux 0xffffffffb4435567
Build id: 3.10.0-862.el7.x86_64
0x37
11
ip_queue_xmit
vmlinux 0xffffffffb44358d3
Build id: 3.10.0-862.el7.x86_64
0x143
12
tcp_transmit_skb
vmlinux 0xffffffffb444f7b4
Build id: 3.10.0-862.el7.x86_64
0x4e4
13
tcp_connect
vmlinux 0xffffffffb445134d
Build id: 3.10.0-862.el7.x86_64
0x64d
14
? ktime_get_real
vmlinux 0xffffffffb3ef8db5
Build id: 3.10.0-862.el7.x86_64
0x25
15
? secure_tcp_sequence_number
vmlinux 0xffffffffb43e15f9
Build id: 3.10.0-862.el7.x86_64
0x69
16
tcp_v4_connect
vmlinux 0xffffffffb4456018
Build id: 3.10.0-862.el7.x86_64
0x348
17
__inet_stream_connect
vmlinux 0xffffffffb446d353
Build id: 3.10.0-862.el7.x86_64
0xc3
18
? kmem_cache_alloc_trace
vmlinux 0xffffffffb3ff7606
Build id: 3.10.0-862.el7.x86_64
0x1d6
19
inet_stream_connect
vmlinux 0xffffffffb446d618
Build id: 3.10.0-862.el7.x86_64
0x38
20
SYSC_connect
vmlinux 0xffffffffb43cc93d
Build id: 3.10.0-862.el7.x86_64
0xed
21
? selinux_file_fcntl
vmlinux 0xffffffffb40d8392
Build id: 3.10.0-862.el7.x86_64
0x62
22
SyS_connect
vmlinux 0xffffffffb43ce3fe
Build id: 3.10.0-862.el7.x86_64
0xe
23
system_call_fastpath
vmlinux 0xffffffffb451f7d5
Build id: 3.10.0-862.el7.x86_64
0x1c
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 47s! [java:2661]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc ext4 snd_seq_midi snd_seq_midi_event mbcache jbd2 iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper ablk_helper cryptd snd_ens1371 snd_rawmidi snd_ac97_codec vmw_balloon ac97_bus snd_seq snd_seq_device snd_pcm pcspkr snd_timer joydev snd sg soundcore nfit libnvdimm parport_pc parport shpchp i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix libata mptspi serio_raw scsi_transport_spi e1000 mptscsih mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 2661 Comm: java Not tainted 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff97ba95c30000 ti: ffff97ba7babc000 task.ti: ffff97ba7babc000
RIP: 0010:[<ffffffffc014e867>]  [<ffffffffc014e867>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff97ba7babf980  EFLAGS: 00000286
RAX: ffffabf5803c3818 RBX: ffff97ba7babf910 RCX: 00000000000000b2
RDX: 00000000000000b2 RSI: ffff97ba754e9300 RDI: ffff97bab8bf0000
RBP: ffff97ba7babfa00 R08: 0000000000000100 R09: 0000000022100000
R10: 0000000080000000 R11: 0000000000000000 R12: 0000000000000246
R13: 000000000000000e R14: ffff97ba756d0000 R15: ffff97ba75982400
FS:  00007ff63bfff700(0000) GS:ffff97babb600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0f74341000 CR3: 0000000049dd2000 CR4: 00000000003607f0
Call Trace:
[<ffffffffb43eb166>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffffb4416a2a>] sch_direct_xmit+0x11a/0x250
[<ffffffffb43ee051>] __dev_queue_xmit+0x4a1/0x660
[<ffffffffb43ee220>] dev_queue_xmit+0x10/0x20
[<ffffffffb43f9c5d>] neigh_resolve_output+0x11d/0x220
[<ffffffffb443717c>] ip_finish_output+0x2ac/0x7a0
[<ffffffffb4437973>] ip_output+0x73/0xe0
[<ffffffffb4436ed0>] ? __ip_append_data.isra.50+0xa50/0xa50
[<ffffffffb4435567>] ip_local_out_sk+0x37/0x40
[<ffffffffb44358d3>] ip_queue_xmit+0x143/0x3a0
[<ffffffffb444f7b4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffffb445134d>] tcp_connect+0x64d/0xa10
[<ffffffffb3ef8db5>] ? ktime_get_real+0x25/0x70
[<ffffffffb43e15f9>] ? secure_tcp_sequence_number+0x69/0x90
[<ffffffffb4456018>] tcp_v4_connect+0x348/0x4a0
[<ffffffffb446d353>] __inet_stream_connect+0xc3/0x350
[<ffffffffb3ff7606>] ? kmem_cache_alloc_trace+0x1d6/0x200
[<ffffffffb446d618>] inet_stream_connect+0x38/0x50
[<ffffffffb43cc93d>] SYSC_connect+0xed/0x130
[<ffffffffb40d8392>] ? selinux_file_fcntl+0x62/0xa0
[<ffffffffb43ce3fe>] SyS_connect+0xe/0x10
[<ffffffffb451f7d5>] system_call_fastpath+0x1c/0x21
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 
Complete report #365970
Frame # Function Binary Source or offset Line
1
e1000_xmit_frame
e1000 0xffffffffc03a8877
Build id: 3.10.0-1160.el7.x86_64
0x7f7
2
dev_hard_start_xmit
vmlinux 0xffffffffb0e54386
Build id: 3.10.0-1160.el7.x86_64
0x246
3
sch_direct_xmit
vmlinux 0xffffffffb0e8242a
Build id: 3.10.0-1160.el7.x86_64
0x11a
4
__qdisc_run
vmlinux 0xffffffffb0e825ee
Build id: 3.10.0-1160.el7.x86_64
0x8e
5
__dev_queue_xmit
vmlinux 0xffffffffb0e57319
Build id: 3.10.0-1160.el7.x86_64
0x4a9
6
dev_queue_xmit
vmlinux 0xffffffffb0e574d0
Build id: 3.10.0-1160.el7.x86_64
0x10
7
ip_finish_output
vmlinux 0xffffffffb0ea545b
Build id: 3.10.0-1160.el7.x86_64
0x67b
8
ip_output
vmlinux 0xffffffffb0ea59db
Build id: 3.10.0-1160.el7.x86_64
0x7b
9
? __ip_append_data.isra.50
vmlinux 0xffffffffb0ea4de0
Build id: 3.10.0-1160.el7.x86_64
0xa60
10
ip_local_out_sk
vmlinux 0xffffffffb0ea3407
Build id: 3.10.0-1160.el7.x86_64
0x37
11
ip_queue_xmit
vmlinux 0xffffffffb0ea37a4
Build id: 3.10.0-1160.el7.x86_64
0x144
12
tcp_transmit_skb
vmlinux 0xffffffffb0ebde94
Build id: 3.10.0-1160.el7.x86_64
0x4e4
13
tcp_connect
vmlinux 0xffffffffb0ebfb4d
Build id: 3.10.0-1160.el7.x86_64
0x71d
14
? getnstimeofday64
vmlinux 0xffffffffb090797e
Build id: 3.10.0-1160.el7.x86_64
0xe
15
? ktime_get_real
vmlinux 0xffffffffb0907a35
Build id: 3.10.0-1160.el7.x86_64
0x25
16
? secure_tcp_sequence_number
vmlinux 0xffffffffb0e49d49
Build id: 3.10.0-1160.el7.x86_64
0x69
17
tcp_v4_connect
vmlinux 0xffffffffb0ec4c25
Build id: 3.10.0-1160.el7.x86_64
0x345
18
__inet_stream_connect
vmlinux 0xffffffffb0edc333
Build id: 3.10.0-1160.el7.x86_64
0xc3
19
? kmem_cache_alloc_trace
vmlinux 0xffffffffb0a289c6
Build id: 3.10.0-1160.el7.x86_64
0x1d6
20
inet_stream_connect
vmlinux 0xffffffffb0edc5f8
Build id: 3.10.0-1160.el7.x86_64
0x38
21
SYSC_connect
vmlinux 0xffffffffb0e3496d
Build id: 3.10.0-1160.el7.x86_64
0xed
22
? selinux_file_fcntl
vmlinux 0xffffffffb0b0eca2
Build id: 3.10.0-1160.el7.x86_64
0x62
23
SyS_connect
vmlinux 0xffffffffb0e365be
Build id: 3.10.0-1160.el7.x86_64
0xe
24
system_call_fastpath
vmlinux 0xffffffffb0f93f92
Build id: 3.10.0-1160.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [java:3417]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock bnep sunrpc snd_seq_midi snd_seq_midi_event ppdev edac_mce_amd crc32_pclmul ghash_clmulni_intel snd_ens1371 aesni_intel snd_rawmidi lrw gf128mul snd_ac97_codec glue_helper ablk_helper cryptd ac97_bus vmw_balloon snd_seq btusb btrtl snd_seq_device btbcm btintel bluetooth snd_pcm pcspkr joydev snd_timer snd rfkill soundcore sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul
crct10dif_common drm_kms_helper crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ttm serio_raw nfit libnvdimm drm ata_piix e1000 mptspi scsi_transport_spi libata mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 3417 Comm: java Kdump: loaded Not tainted 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff94d2cea10000 ti: ffff94d2f48ac000 task.ti: ffff94d2f48ac000
RIP: 0010:[<ffffffffc03a8877>]  [<ffffffffc03a8877>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff94d2f48af948  EFLAGS: 00000286
RAX: ffffaeb0c07c3818 RBX: 00000001000280da RCX: 0000000000000066
RDX: 0000000000000066 RSI: ffff94d2b6024580 RDI: ffff94d2f3230000
RBP: ffff94d2f48af9c8 R08: 0000000000000100 R09: 0000000022100000
R10: 0000000080000000 R11: 0000000000000000 R12: ffffffffc0600c00
R13: ffffffffffffffff R14: 0000000000000002 R15: 0000000000000030
FS:  00007f8e2e38c700(0000) GS:ffff94d2fb640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f14c8712d90 CR3: 0000000070e7c000 CR4: 00000000001407e0
Call Trace:
[<ffffffffb0e54386>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffffb0e8242a>] sch_direct_xmit+0x11a/0x250
[<ffffffffb0e825ee>] __qdisc_run+0x8e/0x360
[<ffffffffb0e57319>] __dev_queue_xmit+0x4a9/0x650
[<ffffffffb0e574d0>] dev_queue_xmit+0x10/0x20
[<ffffffffb0ea545b>] ip_finish_output+0x67b/0x8d0
[<ffffffffb0ea59db>] ip_output+0x7b/0xf0
[<ffffffffb0ea4de0>] ? __ip_append_data.isra.50+0xa60/0xa60
[<ffffffffb0ea3407>] ip_local_out_sk+0x37/0x40
[<ffffffffb0ea37a4>] ip_queue_xmit+0x144/0x3c0
[<ffffffffb0ebde94>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffffb0ebfb4d>] tcp_connect+0x71d/0xb60
[<ffffffffb090797e>] ? getnstimeofday64+0xe/0x30
[<ffffffffb0907a35>] ? ktime_get_real+0x25/0x70
[<ffffffffb0e49d49>] ? secure_tcp_sequence_number+0x69/0x90
[<ffffffffb0ec4c25>] tcp_v4_connect+0x345/0x4a0
[<ffffffffb0edc333>] __inet_stream_connect+0xc3/0x350
[<ffffffffb0a289c6>] ? kmem_cache_alloc_trace+0x1d6/0x200
[<ffffffffb0edc5f8>] inet_stream_connect+0x38/0x50
[<ffffffffb0e3496d>] SYSC_connect+0xed/0x130
[<ffffffffb0b0eca2>] ? selinux_file_fcntl+0x62/0xa0
[<ffffffffb0e365be>] SyS_connect+0xe/0x10
[<ffffffffb0f93f92>] system_call_fastpath+0x25/0x2a
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 
Complete report #264710
Frame # Function Binary Source or offset Line
1
e1000_xmit_frame
e1000 0xffffffffc0422857
Build id: 3.10.0-957.el7.x86_64
0x7f7
2
dev_hard_start_xmit
vmlinux 0xffffffff98238c66
Build id: 3.10.0-957.el7.x86_64
0x246
3
sch_direct_xmit
vmlinux 0xffffffff98265cea
Build id: 3.10.0-957.el7.x86_64
0x11a
4
__dev_queue_xmit
vmlinux 0xffffffff9823bbe1
Build id: 3.10.0-957.el7.x86_64
0x491
5
dev_queue_xmit
vmlinux 0xffffffff9823bdb0
Build id: 3.10.0-957.el7.x86_64
0x10
6
ip_finish_output
vmlinux 0xffffffff98288736
Build id: 3.10.0-957.el7.x86_64
0x556
7
ip_output
vmlinux 0xffffffff98288c93
Build id: 3.10.0-957.el7.x86_64
0x73
8
? __ip_append_data.isra.51
vmlinux 0xffffffff982881e0
Build id: 3.10.0-957.el7.x86_64
0xa50
9
ip_local_out_sk
vmlinux 0xffffffff98286817
Build id: 3.10.0-957.el7.x86_64
0x37
10
ip_queue_xmit
vmlinux 0xffffffff98286bb4
Build id: 3.10.0-957.el7.x86_64
0x144
11
tcp_transmit_skb
vmlinux 0xffffffff982a0f64
Build id: 3.10.0-957.el7.x86_64
0x4e4
12
tcp_connect
vmlinux 0xffffffff982a2aed
Build id: 3.10.0-957.el7.x86_64
0x63d
13
? getnstimeofday64
vmlinux 0xffffffff97d0258e
Build id: 3.10.0-957.el7.x86_64
0xe
14
? ktime_get_real
vmlinux 0xffffffff97d02645
Build id: 3.10.0-957.el7.x86_64
0x25
15
? secure_tcp_sequence_number
vmlinux 0xffffffff9822ebf9
Build id: 3.10.0-957.el7.x86_64
0x69
16
tcp_v4_connect
vmlinux 0xffffffff982a7b55
Build id: 3.10.0-957.el7.x86_64
0x345
17
__inet_stream_connect
vmlinux 0xffffffff982bec63
Build id: 3.10.0-957.el7.x86_64
0xc3
18
? kmem_cache_alloc_trace
vmlinux 0xffffffff97e1c676
Build id: 3.10.0-957.el7.x86_64
0x1d6
19
inet_stream_connect
vmlinux 0xffffffff982bef28
Build id: 3.10.0-957.el7.x86_64
0x38
20
SYSC_connect
vmlinux 0xffffffff9821996d
Build id: 3.10.0-957.el7.x86_64
0xed
21
? selinux_file_fcntl
vmlinux 0xffffffff97f01272
Build id: 3.10.0-957.el7.x86_64
0x62
22
SyS_connect
vmlinux 0xffffffff9821b5be
Build id: 3.10.0-957.el7.x86_64
0xe
23
system_call_fastpath
vmlinux 0xffffffff98374ddb
Build id: 3.10.0-957.el7.x86_64
0x22
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [java:9878]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer
snd sg soundcore parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_pclmul crct10dif_common crc32c_intel serio_raw e1000 ata_generic pata_acpi nfit libnvdimm vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix mptspi scsi_transport_spi drm mptscsih libata mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 9878 Comm: java Kdump: loaded Tainted: G             L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff928d51c21040 ti: ffff928d5efdc000 task.ti: ffff928d5efdc000
RIP: 0010:[<ffffffffc0422857>]  [<ffffffffc0422857>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff928d5efdf9b0  EFLAGS: 00000286
RAX: ffffaa3cc0443818 RBX: ffffffffc0795360 RCX: 00000000000000e3
RDX: 00000000000000e3 RSI: ffff928d348271c0 RDI: ffff928d78582000
RBP: ffff928d5efdfa30 R08: 0000000000000100 R09: 0000000022100000
R10: 0000000080000000 R11: 0000000000000000 R12: ffff928d5efdfa98
R13: ffff928d5efdfa10 R14: 000040005efdf980 R15: ffffffffc0763915
FS:  00007f443e97c700(0000) GS:ffff928d7b640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9e2cfbf008 CR3: 0000000077766000 CR4: 00000000003607e0
Call Trace:
[<ffffffff98238c66>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffff98265cea>] sch_direct_xmit+0x11a/0x250
[<ffffffff9823bbe1>] __dev_queue_xmit+0x491/0x650
[<ffffffff9823bdb0>] dev_queue_xmit+0x10/0x20
[<ffffffff98288736>] ip_finish_output+0x556/0x7b0
[<ffffffff98288c93>] ip_output+0x73/0xe0
[<ffffffff982881e0>] ? __ip_append_data.isra.51+0xa50/0xa50
[<ffffffff98286817>] ip_local_out_sk+0x37/0x40
[<ffffffff98286bb4>] ip_queue_xmit+0x144/0x3c0
[<ffffffff982a0f64>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffff982a2aed>] tcp_connect+0x63d/0xa20
[<ffffffff97d0258e>] ? getnstimeofday64+0xe/0x30
[<ffffffff97d02645>] ? ktime_get_real+0x25/0x70
[<ffffffff9822ebf9>] ? secure_tcp_sequence_number+0x69/0x90
[<ffffffff982a7b55>] tcp_v4_connect+0x345/0x4a0
[<ffffffff982bec63>] __inet_stream_connect+0xc3/0x350
[<ffffffff97e1c676>] ? kmem_cache_alloc_trace+0x1d6/0x200
[<ffffffff982bef28>] inet_stream_connect+0x38/0x50
[<ffffffff9821996d>] SYSC_connect+0xed/0x130
[<ffffffff97f01272>] ? selinux_file_fcntl+0x62/0xa0
[<ffffffff9821b5be>] SyS_connect+0xe/0x10
[<ffffffff98374ddb>] system_call_fastpath+0x22/0x27
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 
Complete report #894238
Frame # Function Binary Source or offset Line
1
e1000_xmit_frame
e1000 0xffffffffc01cc867
Build id: 3.10.0-862.el7.x86_64
0x7f7
2
dev_hard_start_xmit
vmlinux 0xffffffff8e5eb166
Build id: 3.10.0-862.el7.x86_64
0x246
3
sch_direct_xmit
vmlinux 0xffffffff8e616a2a
Build id: 3.10.0-862.el7.x86_64
0x11a
4
__dev_queue_xmit
vmlinux 0xffffffff8e5ee051
Build id: 3.10.0-862.el7.x86_64
0x4a1
5
dev_queue_xmit
vmlinux 0xffffffff8e5ee220
Build id: 3.10.0-862.el7.x86_64
0x10
6
ip_finish_output
vmlinux 0xffffffff8e637416
Build id: 3.10.0-862.el7.x86_64
0x546
7
ip_output
vmlinux 0xffffffff8e637973
Build id: 3.10.0-862.el7.x86_64
0x73
8
? __ip_append_data.isra.50
vmlinux 0xffffffff8e636ed0
Build id: 3.10.0-862.el7.x86_64
0xa50
9
ip_local_out_sk
vmlinux 0xffffffff8e635567
Build id: 3.10.0-862.el7.x86_64
0x37
10
ip_queue_xmit
vmlinux 0xffffffff8e6358d3
Build id: 3.10.0-862.el7.x86_64
0x143
11
tcp_transmit_skb
vmlinux 0xffffffff8e64f7b4
Build id: 3.10.0-862.el7.x86_64
0x4e4
12
tcp_connect
vmlinux 0xffffffff8e65134d
Build id: 3.10.0-862.el7.x86_64
0x64d
13
? ktime_get_real
vmlinux 0xffffffff8e0f8db5
Build id: 3.10.0-862.el7.x86_64
0x25
14
? secure_tcp_sequence_number
vmlinux 0xffffffff8e5e15f9
Build id: 3.10.0-862.el7.x86_64
0x69
15
tcp_v4_connect
vmlinux 0xffffffff8e656018
Build id: 3.10.0-862.el7.x86_64
0x348
16
tcp_v6_connect
vmlinux 0xffffffff8e6d520a
Build id: 3.10.0-862.el7.x86_64
0x5ca
17
__inet_stream_connect
vmlinux 0xffffffff8e66d353
Build id: 3.10.0-862.el7.x86_64
0xc3
18
? __d_alloc
vmlinux 0xffffffff8e235635
Build id: 3.10.0-862.el7.x86_64
0x25
19
inet_stream_connect
vmlinux 0xffffffff8e66d618
Build id: 3.10.0-862.el7.x86_64
0x38
20
SYSC_connect
vmlinux 0xffffffff8e5cc93d
Build id: 3.10.0-862.el7.x86_64
0xed
21
? ipv6_setsockopt
vmlinux 0xffffffff8e6c25e3
Build id: 3.10.0-862.el7.x86_64
0x73
22
SyS_connect
vmlinux 0xffffffff8e5ce3fe
Build id: 3.10.0-862.el7.x86_64
0xe
23
system_call_fastpath
vmlinux 0xffffffff8e71f7d5
Build id: 3.10.0-862.el7.x86_64
0x1c
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 29s! [java:10432]
Modules linked in: binfmt_misc fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec crc32_pclmul ghash_clmulni_intel aesni_intel ac97_bus snd_seq lrw gf128mul snd_seq_device snd_pcm snd_timer glue_helper ablk_helper snd soundcore sg cryptd ppdev
vmw_balloon pcspkr nfit joydev libnvdimm parport_pc parport shpchp i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata mptspi crct10dif_pclmul crct10dif_common crc32c_intel scsi_transport_spi mptscsih e1000 mptbase serio_raw i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 10432 Comm: java Tainted: G             L ------------   3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff881b93309fa0 ti: ffff88198c244000 task.ti: ffff88198c244000
RIP: 0010:[<ffffffffc01cc867>]  [<ffffffffc01cc867>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff88198c2478f0  EFLAGS: 00000286
RAX: ffffb69f03203818 RBX: 0000000000000001 RCX: 00000000000000e5
RDX: 00000000000000e5 RSI: ffff881bcca36180 RDI: ffff88169a22c000
RBP: ffff88198c247970 R08: 0000000000000100 R09: 0000000022100000
R10: 0000000080000000 R11: 0000000000000000 R12: 0000000000000202
R13: 000000068bec54c6 R14: 000000018c2478c0 R15: ffffffff8e373e00
FS:  00007ff5deaf4700(0000) GS:ffff881bd0640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff6e35d31a8 CR3: 00000000b0148000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffff8e5eb166>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffff8e616a2a>] sch_direct_xmit+0x11a/0x250
[<ffffffff8e5ee051>] __dev_queue_xmit+0x4a1/0x660
[<ffffffff8e5ee220>] dev_queue_xmit+0x10/0x20
[<ffffffff8e637416>] ip_finish_output+0x546/0x7a0
[<ffffffff8e637973>] ip_output+0x73/0xe0
[<ffffffff8e636ed0>] ? __ip_append_data.isra.50+0xa50/0xa50
[<ffffffff8e635567>] ip_local_out_sk+0x37/0x40
[<ffffffff8e6358d3>] ip_queue_xmit+0x143/0x3a0
[<ffffffff8e64f7b4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffff8e65134d>] tcp_connect+0x64d/0xa10
[<ffffffff8e0f8db5>] ? ktime_get_real+0x25/0x70
[<ffffffff8e5e15f9>] ? secure_tcp_sequence_number+0x69/0x90
[<ffffffff8e656018>] tcp_v4_connect+0x348/0x4a0
[<ffffffff8e6d520a>] tcp_v6_connect+0x5ca/0x680
[<ffffffff8e66d353>] __inet_stream_connect+0xc3/0x350
[<ffffffff8e235635>] ? __d_alloc+0x25/0x180
[<ffffffff8e66d618>] inet_stream_connect+0x38/0x50
[<ffffffff8e5cc93d>] SYSC_connect+0xed/0x130
[<ffffffff8e6c25e3>] ? ipv6_setsockopt+0x73/0xd0
[<ffffffff8e5ce3fe>] SyS_connect+0xe/0x10
[<ffffffff8e71f7d5>] system_call_fastpath+0x1c/0x21
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 
Complete report #448628
Frame # Function Binary Source or offset Line
1
e1000_xmit_frame
e1000 0xffffffffc00e3ee7
Build id: 3.10.0-693.el7.x86_64
0x947
2
dev_hard_start_xmit
vmlinux 0xffffffff81586771
Build id: 3.10.0-693.el7.x86_64
0x171
3
sch_direct_xmit
vmlinux 0xffffffff815af50a
Build id: 3.10.0-693.el7.x86_64
0x11a
4
__dev_queue_xmit
vmlinux 0xffffffff81589566
Build id: 3.10.0-693.el7.x86_64
0x226
5
dev_queue_xmit
vmlinux 0xffffffff815898a0
Build id: 3.10.0-693.el7.x86_64
0x10
6
ip_finish_output
vmlinux 0xffffffff815cfd3e
Build id: 3.10.0-693.el7.x86_64
0x52e
7
ip_output
vmlinux 0xffffffff815d0293
Build id: 3.10.0-693.el7.x86_64
0x73
8
? __ip_append_data.isra.48
vmlinux 0xffffffff815cf810
Build id: 3.10.0-693.el7.x86_64
0xa00
9
ip_local_out_sk
vmlinux 0xffffffff815cdf31
Build id: 3.10.0-693.el7.x86_64
0x31
10
ip_queue_xmit
vmlinux 0xffffffff815ce2a3
Build id: 3.10.0-693.el7.x86_64
0x143
11
tcp_transmit_skb
vmlinux 0xffffffff815e7c0f
Build id: 3.10.0-693.el7.x86_64
0x4cf
12
tcp_connect
vmlinux 0xffffffff815e975d
Build id: 3.10.0-693.el7.x86_64
0x63d
13
? ktime_get_real
vmlinux 0xffffffff810eaa25
Build id: 3.10.0-693.el7.x86_64
0x25
14
? secure_tcp_sequence_number
vmlinux 0xffffffff8157dc09
Build id: 3.10.0-693.el7.x86_64
0x69
15
tcp_v4_connect
vmlinux 0xffffffff815ee488
Build id: 3.10.0-693.el7.x86_64
0x348
16
__inet_stream_connect
vmlinux 0xffffffff81605675
Build id: 3.10.0-693.el7.x86_64
0xb5
17
? tcp_assign_congestion_control
vmlinux 0xffffffff815f25c3
Build id: 3.10.0-693.el7.x86_64
0x43
18
inet_stream_connect
vmlinux 0xffffffff81605928
Build id: 3.10.0-693.el7.x86_64
0x38
19
SYSC_connect
vmlinux 0xffffffff8156a497
Build id: 3.10.0-693.el7.x86_64
0xe7
20
? sock_alloc_file
vmlinux 0xffffffff81567340
Build id: 3.10.0-693.el7.x86_64
0xa0
21
? set_close_on_exec
vmlinux 0xffffffff81220483
Build id: 3.10.0-693.el7.x86_64
0x33
22
SyS_connect
vmlinux 0xffffffff8156b29e
Build id: 3.10.0-693.el7.x86_64
0xe
23
system_call_fastpath
vmlinux 0xffffffff816b4fc9
Build id: 3.10.0-693.el7.x86_64
0x16
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 107s! [monit:1810]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event coretemp iosf_mbi ppdev kvm_intel snd_ens1371 kvm snd_rawmidi snd_ac97_codec irqbypass ac97_bus crc32_pclmul ghash_clmulni_intel snd_seq snd_seq_device snd_pcm cryptd vmw_balloon snd_timer snd soundcore pcspkr sg joydev parport_pc parport shpchp vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic crct10dif_pclmul
crct10dif_common vmwgfx drm_kms_helper crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ttm pata_acpi drm serio_raw mptspi scsi_transport_spi mptscsih e1000 mptbase ata_piix libata i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: i2c_dev]
CPU: 0 PID: 1810 Comm: monit Tainted: G        W    L ------------   3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/20/2014
task: ffff8801e4a68000 ti: ffff8801d7f98000 task.ti: ffff8801d7f98000
RIP: 0010:[<ffffffffc00e3ee7>]  [<ffffffffc00e3ee7>] e1000_xmit_frame+0x947/0x1040 [e1000]
RSP: 0018:ffff8801d7f9ba10  EFLAGS: 00000286
RAX: ffffc90000d03818 RBX: 0000000000000202 RCX: 0000000000000019
RDX: 0000000000000019 RSI: ffff8801e74e62c0 RDI: ffff8801f4900000
RBP: ffff8801d7f9ba90 R08: 0000000000000100 R09: 0000000022100000
R10: a6c206400040bef5 R11: 0000000000000000 R12: 00000001c06c1fbc
R13: ffffffff813492f0 R14: ffff8801d7f9b9d8 R15: 0000000000000202
FS:  00007fd322564780(0000) GS:ffff8801eb800000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd322584000 CR3: 000000018fe46000 CR4: 00000000000407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff8801d7f9bac0 ffff8801ec3ac098 000000177d00a8c0 0000000900000000
0000000000022a00 0000000000000000 0006600700000000 0000000100001000
ffff8801de2658f8 ffff8801f4900000 ffff8801ec3ac000 ffff8801f4900000
Call Trace:
[<ffffffff81586771>] dev_hard_start_xmit+0x171/0x3b0
[<ffffffff815af50a>] sch_direct_xmit+0x11a/0x240
[<ffffffff81589566>] __dev_queue_xmit+0x226/0x550
[<ffffffff815898a0>] dev_queue_xmit+0x10/0x20
[<ffffffff815cfd3e>] ip_finish_output+0x52e/0x780
[<ffffffff815d0293>] ip_output+0x73/0xe0
[<ffffffff815cf810>] ? __ip_append_data.isra.48+0xa00/0xa00
[<ffffffff815cdf31>] ip_local_out_sk+0x31/0x40
[<ffffffff815ce2a3>] ip_queue_xmit+0x143/0x3a0
[<ffffffff815e7c0f>] tcp_transmit_skb+0x4cf/0x9b0
[<ffffffff815e975d>] tcp_connect+0x63d/0x9f0
[<ffffffff810eaa25>] ? ktime_get_real+0x25/0x70
[<ffffffff8157dc09>] ? secure_tcp_sequence_number+0x69/0x90
[<ffffffff815ee488>] tcp_v4_connect+0x348/0x4a0
[<ffffffff81605675>] __inet_stream_connect+0xb5/0x330
[<ffffffff815f25c3>] ? tcp_assign_congestion_control+0x43/0x170
[<ffffffff81605928>] inet_stream_connect+0x38/0x50
[<ffffffff8156a497>] SYSC_connect+0xe7/0x120
[<ffffffff81567340>] ? sock_alloc_file+0xa0/0x140
[<ffffffff81220483>] ? set_close_on_exec+0x33/0x70
[<ffffffff8156b29e>] SyS_connect+0xe/0x10
[<ffffffff816b4fc9>] system_call_fastpath+0x16/0x1b
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 
Complete report #190032
Frame # Function Binary Source or offset Line
1
e1000_xmit_frame
e1000 0xffffffffa00b0d57
Build id: 3.10.0-514.16.1.el7.x86_64
0x957
2
dev_hard_start_xmit
vmlinux 0xffffffff8156f911
Build id: 3.10.0-514.16.1.el7.x86_64
0x171
3
sch_direct_xmit
vmlinux 0xffffffff81596f84
Build id: 3.10.0-514.16.1.el7.x86_64
0x104
4
__dev_queue_xmit
vmlinux 0xffffffff8157250c
Build id: 3.10.0-514.16.1.el7.x86_64
0x23c
5
dev_queue_xmit
vmlinux 0xffffffff81572850
Build id: 3.10.0-514.16.1.el7.x86_64
0x10
6
ip_finish_output
vmlinux 0xffffffff815b6286
Build id: 3.10.0-514.16.1.el7.x86_64
0x466
7
ip_output
vmlinux 0xffffffff815b7283
Build id: 3.10.0-514.16.1.el7.x86_64
0x73
8
? ip_fragment.constprop.54
vmlinux 0xffffffff815b5e20
Build id: 3.10.0-514.16.1.el7.x86_64
0x90
9
ip_local_out_sk
vmlinux 0xffffffff815b4f41
Build id: 3.10.0-514.16.1.el7.x86_64
0x31
10
ip_queue_xmit
vmlinux 0xffffffff815b52b3
Build id: 3.10.0-514.16.1.el7.x86_64
0x143
11
tcp_transmit_skb
vmlinux 0xffffffff815cea3f
Build id: 3.10.0-514.16.1.el7.x86_64
0x4af
12
tcp_connect
vmlinux 0xffffffff815d058d
Build id: 3.10.0-514.16.1.el7.x86_64
0x63d
13
? ktime_get_real
vmlinux 0xffffffff810eaff5
Build id: 3.10.0-514.16.1.el7.x86_64
0x25
14
? secure_tcp_sequence_number
vmlinux 0xffffffff81568b79
Build id: 3.10.0-514.16.1.el7.x86_64
0x69
15
tcp_v4_connect
vmlinux 0xffffffff815d5276
Build id: 3.10.0-514.16.1.el7.x86_64
0x376
16
__inet_stream_connect
vmlinux 0xffffffff815ec085
Build id: 3.10.0-514.16.1.el7.x86_64
0xb5
17
? tcp_assign_congestion_control
vmlinux 0xffffffff815d9413
Build id: 3.10.0-514.16.1.el7.x86_64
0x43
18
inet_stream_connect
vmlinux 0xffffffff815ec338
Build id: 3.10.0-514.16.1.el7.x86_64
0x38
19
SYSC_connect
vmlinux 0xffffffff81555ae7
Build id: 3.10.0-514.16.1.el7.x86_64
0xe7
20
SyS_connect
vmlinux 0xffffffff815568ee
Build id: 3.10.0-514.16.1.el7.x86_64
0xe
21
system_call_fastpath
vmlinux 0xffffffff81697189
Build id: 3.10.0-514.16.1.el7.x86_64
0x16
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 56s! [/usr/local/clou:84154]
Modules linked in: tcp_diag inet_diag fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event intel_powerclamp coretemp snd_ens1371 snd_rawmidi iosf_mbi snd_ac97_codec ac97_bus crc32_pclmul ghash_clmulni_intel snd_seq aesni_intel snd_seq_device snd_pcm lrw snd_timer
gf128mul glue_helper snd ablk_helper ppdev nfit cryptd soundcore i2c_piix4 vmw_balloon pcspkr vmw_vmci libnvdimm sg parport_pc parport shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common crc32c_intel drm_kms_helper syscopyarea sysfillrect ata_piix mptspi sysimgblt fb_sys_fops scsi_transport_spi ttm serio_raw libata mptscsih e1000 drm mptbase i2c_core fjes
CPU: 0 PID: 84154 Comm: /usr/local/clou Tainted: G             L ------------   3.10.0-514.16.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff8801957dde20 ti: ffff88022a774000 task.ti: ffff88022a774000
RIP: 0010:[<ffffffffa00b0d57>]  [<ffffffffa00b0d57>] e1000_xmit_frame+0x957/0x1040 [e1000]
RSP: 0018:ffff88022a7779f0  EFLAGS: 00000286
RAX: ffffc90000cc3818 RBX: 0000000000000202 RCX: 000000000000009d
RDX: 000000000000009d RSI: ffff880035cd74c0 RDI: ffff88023f918000
RBP: ffff88022a777a70 R08: 0000000000000100 R09: 0000000022100000
R10: c3ae06400040f89e R11: 0000000000000000 R12: 00000001a05d9f7c
R13: ffffffff8133b2c3 R14: ffff88022a7779b8 R15: 0000000000000001
FS:  00007fe0ac80a700(0000) GS:ffff880235600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb6e650b1a8 CR3: 00000001e2fe9000 CR4: 00000000001407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff88022a777aa0 ffff8802360ed098 0000009bdd0aa8c0 0000000900000000
0000000000023a00 0000000000000000 0006bb0100000000 0000000100001000
ffff8800bb23a8f8 ffff88023f918000 ffff8802360ed000 ffff88023f918000
Call Trace:
[<ffffffff8156f911>] dev_hard_start_xmit+0x171/0x3b0
[<ffffffff81596f84>] sch_direct_xmit+0x104/0x200
[<ffffffff8157250c>] __dev_queue_xmit+0x23c/0x570
[<ffffffff81572850>] dev_queue_xmit+0x10/0x20
[<ffffffff815b6286>] ip_finish_output+0x466/0x750
[<ffffffff815b7283>] ip_output+0x73/0xe0
[<ffffffff815b5e20>] ? ip_fragment.constprop.54+0x90/0x90
[<ffffffff815b4f41>] ip_local_out_sk+0x31/0x40
[<ffffffff815b52b3>] ip_queue_xmit+0x143/0x3a0
[<ffffffff815cea3f>] tcp_transmit_skb+0x4af/0x990
[<ffffffff815d058d>] tcp_connect+0x63d/0x9f0
[<ffffffff810eaff5>] ? ktime_get_real+0x25/0x70
[<ffffffff81568b79>] ? secure_tcp_sequence_number+0x69/0x90
[<ffffffff815d5276>] tcp_v4_connect+0x376/0x4e0
[<ffffffff815ec085>] __inet_stream_connect+0xb5/0x330
[<ffffffff815d9413>] ? tcp_assign_congestion_control+0x43/0x170
[<ffffffff815ec338>] inet_stream_connect+0x38/0x50
[<ffffffff81555ae7>] SYSC_connect+0xe7/0x120
[<ffffffff815568ee>] SyS_connect+0xe/0x10
[<ffffffff81697189>] system_call_fastpath+0x16/0x1b
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 
Complete report #189068
Frame # Function Binary Source or offset Line
1
e1000_xmit_frame
e1000 0xffffffffc014c867
Build id: 3.10.0-862.el7.x86_64
0x7f7
2
dev_hard_start_xmit
vmlinux 0xffffffff819eb166
Build id: 3.10.0-862.el7.x86_64
0x246
3
sch_direct_xmit
vmlinux 0xffffffff81a16a2a
Build id: 3.10.0-862.el7.x86_64
0x11a
4
__qdisc_run
vmlinux 0xffffffff81a16bee
Build id: 3.10.0-862.el7.x86_64
0x8e
5
__dev_queue_xmit
vmlinux 0xffffffff819ee069
Build id: 3.10.0-862.el7.x86_64
0x4b9
6
dev_queue_xmit
vmlinux 0xffffffff819ee220
Build id: 3.10.0-862.el7.x86_64
0x10
7
ip_finish_output
vmlinux 0xffffffff81a37416
Build id: 3.10.0-862.el7.x86_64
0x546
8
ip_output
vmlinux 0xffffffff81a37973
Build id: 3.10.0-862.el7.x86_64
0x73
9
? __ip_append_data.isra.50
vmlinux 0xffffffff81a36ed0
Build id: 3.10.0-862.el7.x86_64
0xa50
10
ip_local_out_sk
vmlinux 0xffffffff81a35567
Build id: 3.10.0-862.el7.x86_64
0x37
11
ip_queue_xmit
vmlinux 0xffffffff81a358d3
Build id: 3.10.0-862.el7.x86_64
0x143
12
tcp_transmit_skb
vmlinux 0xffffffff81a4f7b4
Build id: 3.10.0-862.el7.x86_64
0x4e4
13
tcp_connect
vmlinux 0xffffffff81a5134d
Build id: 3.10.0-862.el7.x86_64
0x64d
14
? ktime_get_real
vmlinux 0xffffffff814f8db5
Build id: 3.10.0-862.el7.x86_64
0x25
15
? secure_tcp_sequence_number
vmlinux 0xffffffff819e15f9
Build id: 3.10.0-862.el7.x86_64
0x69
16
tcp_v4_connect
vmlinux 0xffffffff81a56018
Build id: 3.10.0-862.el7.x86_64
0x348
17
__inet_stream_connect
vmlinux 0xffffffff81a6d353
Build id: 3.10.0-862.el7.x86_64
0xc3
18
? tcp_assign_congestion_control
vmlinux 0xffffffff81a5a2f3
Build id: 3.10.0-862.el7.x86_64
0x43
19
inet_stream_connect
vmlinux 0xffffffff81a6d618
Build id: 3.10.0-862.el7.x86_64
0x38
20
SYSC_connect
vmlinux 0xffffffff819cc93d
Build id: 3.10.0-862.el7.x86_64
0xed
21
? sock_alloc_file
vmlinux 0xffffffff819ca340
Build id: 3.10.0-862.el7.x86_64
0xa0
22
SyS_connect
vmlinux 0xffffffff819ce3fe
Build id: 3.10.0-862.el7.x86_64
0xe
23
system_call_fastpath
vmlinux 0xffffffff81b1f7d5
Build id: 3.10.0-862.el7.x86_64
0x1c
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 34s! [kubelet:4049]
Modules linked in: xt_set xt_multiport iptable_raw ip_set_hash_ip ip_set_hash_net ip_set veth nf_conntrack_netlink nfnetlink xt_nat xt_statistic ip_vs_sh ip_vs_wrr ip_vs_rr rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache ip_vs ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 xt_comment xt_mark xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink overlay(T) vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul snd_ens1371 snd_rawmidi ghash_clmulni_intel snd_ac97_codec ac97_bus aesni_intel snd_seq lrw snd_seq_device
ppdev gf128mul snd_pcm glue_helper ablk_helper vmw_balloon cryptd pcspkr joydev snd_timer snd nfit soundcore sg vmw_vmci libnvdimm i2c_piix4 parport_pc parport shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix crct10dif_pclmul mptspi crct10dif_common drm scsi_transport_spi mptscsih crc32c_intel serio_raw mptbase libata e1000 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 4049 Comm: kubelet Kdump: loaded Tainted: G             L ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff9eabd86dcf10 ti: ffff9eaa61eec000 task.ti: ffff9eaa61eec000
RIP: 0010:[<ffffffffc014c867>]  [<ffffffffc014c867>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff9eaa61eef968  EFLAGS: 00000286
RAX: ffffc08401c43818 RBX: 00000000000000a7 RCX: 000000000000007b
RDX: 000000000000007b RSI: ffff9ea9f5d7e840 RDI: ffff9eab3b64a000
RBP: ffff9eaa61eef9e8 R08: 0000000000000100 R09: 0000000022100000
R10: 0000000080000000 R11: 0000000000000000 R12: 00000001f079a0ce
R13: 00000001b02a18c0 R14: ffffffff81773e00 R15: ffff9eaa61eef920
FS:  00007f3a56ffd700(0000) GS:ffff9eac1cc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2eb2c820d0 CR3: 0000000240b1a000 CR4: 00000000003607e0
Call Trace:
[<ffffffff819eb166>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffff81a16a2a>] sch_direct_xmit+0x11a/0x250
[<ffffffff81a16bee>] __qdisc_run+0x8e/0x360
[<ffffffff819ee069>] __dev_queue_xmit+0x4b9/0x660
[<ffffffff819ee220>] dev_queue_xmit+0x10/0x20
[<ffffffff81a37416>] ip_finish_output+0x546/0x7a0
[<ffffffff81a37973>] ip_output+0x73/0xe0
[<ffffffff81a36ed0>] ? __ip_append_data.isra.50+0xa50/0xa50
[<ffffffff81a35567>] ip_local_out_sk+0x37/0x40
[<ffffffff81a358d3>] ip_queue_xmit+0x143/0x3a0
[<ffffffff81a4f7b4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffff81a5134d>] tcp_connect+0x64d/0xa10
[<ffffffff814f8db5>] ? ktime_get_real+0x25/0x70
[<ffffffff819e15f9>] ? secure_tcp_sequence_number+0x69/0x90
[<ffffffff81a56018>] tcp_v4_connect+0x348/0x4a0
[<ffffffff81a6d353>] __inet_stream_connect+0xc3/0x350
[<ffffffff81a5a2f3>] ? tcp_assign_congestion_control+0x43/0x170
[<ffffffff81a6d618>] inet_stream_connect+0x38/0x50
[<ffffffff819cc93d>] SYSC_connect+0xed/0x130
[<ffffffff819ca340>] ? sock_alloc_file+0xa0/0x140
[<ffffffff819ce3fe>] SyS_connect+0xe/0x10
[<ffffffff81b1f7d5>] system_call_fastpath+0x1c/0x21
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00 
Complete report #80821
Frame # Function Binary Source or offset Line
1
e1000_xmit_frame
e1000 0xffffffffc0089ee7
Build id: 3.10.0-693.el7.x86_64
0x947
2
dev_hard_start_xmit
vmlinux 0xffffffff81586771
Build id: 3.10.0-693.el7.x86_64
0x171
3
sch_direct_xmit
vmlinux 0xffffffff815af50a
Build id: 3.10.0-693.el7.x86_64
0x11a
4
__dev_queue_xmit
vmlinux 0xffffffff81589566
Build id: 3.10.0-693.el7.x86_64
0x226
5
dev_queue_xmit
vmlinux 0xffffffff815898a0
Build id: 3.10.0-693.el7.x86_64
0x10
6
ip_finish_output
vmlinux 0xffffffff815cfd3e
Build id: 3.10.0-693.el7.x86_64
0x52e
7
ip_output
vmlinux 0xffffffff815d0293
Build id: 3.10.0-693.el7.x86_64
0x73
8
? __ip_append_data.isra.48
vmlinux 0xffffffff815cf810
Build id: 3.10.0-693.el7.x86_64
0xa00
9
ip_local_out_sk
vmlinux 0xffffffff815cdf31
Build id: 3.10.0-693.el7.x86_64
0x31
10
ip_queue_xmit
vmlinux 0xffffffff815ce2a3
Build id: 3.10.0-693.el7.x86_64
0x143
11
tcp_transmit_skb
vmlinux 0xffffffff815e7c0f
Build id: 3.10.0-693.el7.x86_64
0x4cf
12
tcp_connect
vmlinux 0xffffffff815e975d
Build id: 3.10.0-693.el7.x86_64
0x63d
13
? ktime_get_real
vmlinux 0xffffffff810eaa25
Build id: 3.10.0-693.el7.x86_64
0x25
14
? secure_tcp_sequence_number
vmlinux 0xffffffff8157dc09
Build id: 3.10.0-693.el7.x86_64
0x69
15
tcp_v4_connect
vmlinux 0xffffffff815ee488
Build id: 3.10.0-693.el7.x86_64
0x348
16
__inet_stream_connect
vmlinux 0xffffffff81605675
Build id: 3.10.0-693.el7.x86_64
0xb5
17
? tcp_assign_congestion_control
vmlinux 0xffffffff815f25c3
Build id: 3.10.0-693.el7.x86_64
0x43
18
inet_stream_connect
vmlinux 0xffffffff81605928
Build id: 3.10.0-693.el7.x86_64
0x38
19
SYSC_connect
vmlinux 0xffffffff8156a497
Build id: 3.10.0-693.el7.x86_64
0xe7
20
SyS_connect
vmlinux 0xffffffff8156b29e
Build id: 3.10.0-693.el7.x86_64
0xe
21
system_call_fastpath
vmlinux 0xffffffff816b4fc9
Build id: 3.10.0-693.el7.x86_64
0x16
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [nslcd:1071]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nls_utf8 isofs ext4 mbcache jbd2 pcspkr sg ppdev joydev shpchp parport_pc parport i2c_piix4 virtio_balloon nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod cdrom crct10dif_generic crct10dif_common ata_generic pata_acpi virtio_scsi bochs_drm drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata e1000 serio_raw virtio_pci virtio_ring virtio i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 1071 Comm: nslcd Tainted: G             L ------------   3.10.0-693.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.10.2-0-g5f4c7b1-prebuilt.qemu-project.org 04/01/2014
task: ffff8800b60c0fd0 ti: ffff880134f48000 task.ti: ffff880134f48000
RIP: 0010:[<ffffffffc0089ee7>]  [<ffffffffc0089ee7>] e1000_xmit_frame+0x947/0x1040 [e1000]
RSP: 0018:ffff880134f4ba10  EFLAGS: 00000286
RAX: ffffc90000783818 RBX: 0000000000000202 RCX: 0000000000000015
RDX: 0000000000000015 RSI: ffff880035e97940 RDI: ffff8801387de000
RBP: ffff880134f4ba90 R08: 0000000000000100 R09: 0000000022100000
R10: 56aa064000404c77 R11: 0000000000000000 R12: 00000001c0530fbc
R13: ffffffff813492f0 R14: ffff880134f4b9d8 R15: 0000000000000202
FS:  00007f6b4531e700(0000) GS:ffff88013fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000002652000 CR3: 00000000b292f000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff880134f4bac0 ffff880139563098 000000130d03030a 0000000900000000
000000000002d000 0000000000000000 0006850100000000 0000000100001000
ffff8801280206f8 ffff8801387de000 ffff880139563000 ffff8801387de000
Call Trace:
[<ffffffff81586771>] dev_hard_start_xmit+0x171/0x3b0
[<ffffffff815af50a>] sch_direct_xmit+0x11a/0x240
[<ffffffff81589566>] __dev_queue_xmit+0x226/0x550
[<ffffffff815898a0>] dev_queue_xmit+0x10/0x20
[<ffffffff815cfd3e>] ip_finish_output+0x52e/0x780
[<ffffffff815d0293>] ip_output+0x73/0xe0
[<ffffffff815cf810>] ? __ip_append_data.isra.48+0xa00/0xa00
[<ffffffff815cdf31>] ip_local_out_sk+0x31/0x40
[<ffffffff815ce2a3>] ip_queue_xmit+0x143/0x3a0
[<ffffffff815e7c0f>] tcp_transmit_skb+0x4cf/0x9b0
[<ffffffff815e975d>] tcp_connect+0x63d/0x9f0
[<ffffffff810eaa25>] ? ktime_get_real+0x25/0x70
[<ffffffff8157dc09>] ? secure_tcp_sequence_number+0x69/0x90
[<ffffffff815ee488>] tcp_v4_connect+0x348/0x4a0
[<ffffffff81605675>] __inet_stream_connect+0xb5/0x330
[<ffffffff815f25c3>] ? tcp_assign_congestion_control+0x43/0x170
[<ffffffff81605928>] inet_stream_connect+0x38/0x50
[<ffffffff8156a497>] SYSC_connect+0xe7/0x120
[<ffffffff8156b29e>] SyS_connect+0xe/0x10
[<ffffffff816b4fc9>] system_call_fastpath+0x16/0x1b
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00