ABRT Analytics - Problem #829274 - kernel in e1000_xmit

Info

Permalink
Function: e1000_xmit_frame
First occurrence: 2021-08-31
Last occurrence: 2024-04-25
State: NEW
Components: kernel
Quality: -75

Statistics

Operating system	Count
CentOS 7	21

Architecture	Count
x86_64	21


Related packages	Count
kernel	21
0:3.10.0-1127.el7	14
0:3.10.0-1160.41.1.el7	3
0:3.10.0-1160.el7	2
0:3.10.0-1160.62.1.el7	1
0:3.10.0-862.el7	1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

Complete report #371303

Frame #	Function	Binary	Source or offset	Line
1	e1000_xmit_frame	e1000	0xffffffffc00f4877 Build id: 3.10.0-1160.41.1.el7.x86_64	0x7f7
2	dev_hard_start_xmit	vmlinux	0xffffffffaea55f96 Build id: 3.10.0-1160.41.1.el7.x86_64	0x246
3	sch_direct_xmit	vmlinux	0xffffffffaea840aa Build id: 3.10.0-1160.41.1.el7.x86_64	0x11a
4	__dev_queue_xmit	vmlinux	0xffffffffaea58f11 Build id: 3.10.0-1160.41.1.el7.x86_64	0x491
5	dev_queue_xmit	vmlinux	0xffffffffaea590e0 Build id: 3.10.0-1160.41.1.el7.x86_64	0x10
6	ip_finish_output	vmlinux	0xffffffffaeaa7c6b Build id: 3.10.0-1160.41.1.el7.x86_64	0x67b
7	ip_output	vmlinux	0xffffffffaeaa81eb Build id: 3.10.0-1160.41.1.el7.x86_64	0x7b
8	? __ip_append_data.isra.50	vmlinux	0xffffffffaeaa75f0 Build id: 3.10.0-1160.41.1.el7.x86_64	0xa60
9	ip_local_out_sk	vmlinux	0xffffffffaeaa5c17 Build id: 3.10.0-1160.41.1.el7.x86_64	0x37
10	ip_queue_xmit	vmlinux	0xffffffffaeaa5fb4 Build id: 3.10.0-1160.41.1.el7.x86_64	0x144
11	tcp_transmit_skb	vmlinux	0xffffffffaeac06f4 Build id: 3.10.0-1160.41.1.el7.x86_64	0x4e4
12	tcp_send_ack	vmlinux	0xffffffffaeac290f Build id: 3.10.0-1160.41.1.el7.x86_64	0x11f
13	tcp_send_delayed_ack	vmlinux	0xffffffffaeac3d55 Build id: 3.10.0-1160.41.1.el7.x86_64	0xa5
14	__tcp_ack_snd_check	vmlinux	0xffffffffaeab6f57 Build id: 3.10.0-1160.41.1.el7.x86_64	0x87
15	tcp_rcv_established	vmlinux	0xffffffffaeabcfb7 Build id: 3.10.0-1160.41.1.el7.x86_64	0x267
16	tcp_v4_do_rcv	vmlinux	0xffffffffaeac800a Build id: 3.10.0-1160.41.1.el7.x86_64	0x10a
17	release_sock	vmlinux	0xffffffffaea3b996 Build id: 3.10.0-1160.41.1.el7.x86_64	0xa6
18	tcp_sendpage	vmlinux	0xffffffffaeab309d Build id: 3.10.0-1160.41.1.el7.x86_64	0xdd
19	inet_sendpage	vmlinux	0xffffffffaeadfec0 Build id: 3.10.0-1160.41.1.el7.x86_64	0x70
20	kernel_sendpage	vmlinux	0xffffffffaea353de Build id: 3.10.0-1160.41.1.el7.x86_64	0x1e
21	svc_send_common	sunrpc	0xffffffffc046a5fa Build id: 3.10.0-1160.41.1.el7.x86_64	0x6a
22	svc_sendto	sunrpc	0xffffffffc046a760 Build id: 3.10.0-1160.41.1.el7.x86_64	0x70
23	? nfsd4_put_session_locked	nfsd	0xffffffffc04ce997 Build id: 3.10.0-1160.41.1.el7.x86_64	0x57
24	? nfsd4_put_session	nfsd	0xffffffffc04cea25 Build id: 3.10.0-1160.41.1.el7.x86_64	0x55
25	? nfsd4_sequence_done	nfsd	0xffffffffc04d1a48 Build id: 3.10.0-1160.41.1.el7.x86_64	0xf8
26	? groups_free	vmlinux	0xffffffffae4cdf44 Build id: 3.10.0-1160.41.1.el7.x86_64	0x54
27	svc_tcp_sendto	sunrpc	0xffffffffc046a932 Build id: 3.10.0-1160.41.1.el7.x86_64	0x32
28	svc_send	sunrpc	0xffffffffc0478aec Build id: 3.10.0-1160.41.1.el7.x86_64	0x12c
29	svc_process	sunrpc	0xffffffffc0467d1f Build id: 3.10.0-1160.41.1.el7.x86_64	0xff
30	nfsd	nfsd	0xffffffffc04ac16f Build id: 3.10.0-1160.41.1.el7.x86_64	0xdf
31	? nfsd_destroy	nfsd	0xffffffffc04ac090 Build id: 3.10.0-1160.41.1.el7.x86_64	0x80
32	kthread	vmlinux	0xffffffffae4c5e61 Build id: 3.10.0-1160.41.1.el7.x86_64	0xd1
33	? insert_kthread_work	vmlinux	0xffffffffae4c5d90 Build id: 3.10.0-1160.41.1.el7.x86_64	0x40
34	ret_from_fork_nospec_begin	vmlinux	0xffffffffaeb95df7 Build id: 3.10.0-1160.41.1.el7.x86_64	0x21
35	? insert_kthread_work	vmlinux	0xffffffffae4c5d90 Build id: 3.10.0-1160.41.1.el7.x86_64	0x40

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [nfsd:1234]
Modules linked in: lp tcp_lp rpcsec_gss_krb5 xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi ppdev crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus vmw_balloon snd_seq aesni_intel
lrw gf128mul glue_helper ablk_helper cryptd snd_seq_device snd_pcm joydev pcspkr sg snd_timer snd soundcore vmw_vmci i2c_piix4 parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper nfit syscopyarea sysfillrect sysimgblt crct10dif_pclmul crct10dif_common libnvdimm fb_sys_fops ttm crc32c_intel ata_piix mptspi libata scsi_transport_spi mptscsih drm e1000 serio_raw mptbase drm_panel_orientation_quirks fuse
CPU: 1 PID: 1234 Comm: nfsd Kdump: loaded Tainted: G             L ------------   3.10.0-1160.41.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff93382ca5c200 ti: ffff93382b12c000 task.ti: ffff93382b12c000
RIP: 0010:[<ffffffffc00f4877>]  [<ffffffffc00f4877>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff93382b12f780  EFLAGS: 00000286
RAX: ffffb79ec0703818 RBX: ffff93382f3b1ad0 RCX: 000000000000007c
RDX: 000000000000007c RSI: ffff9337b5e37100 RDI: ffff9338b4648000
RBP: ffff93382b12f800 R08: 0000000000000100 R09: 0000000022100000
R10: 0000000080000000 R11: 0000000000000000 R12: ffffffffc06d2fad
R13: ffff93382b12f7c0 R14: ffffffffc06d2fad R15: ffff93382b12f7e0
FS:  0000000000000000(0000) GS:ffff9338b9640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00003340229c13f8 CR3: 00000000b79b4000 CR4: 00000000003607e0
Call Trace:
[<ffffffffaea55f96>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffffaea840aa>] sch_direct_xmit+0x11a/0x250
[<ffffffffaea58f11>] __dev_queue_xmit+0x491/0x650
[<ffffffffaea590e0>] dev_queue_xmit+0x10/0x20
[<ffffffffaeaa7c6b>] ip_finish_output+0x67b/0x8d0
[<ffffffffaeaa81eb>] ip_output+0x7b/0xf0
[<ffffffffaeaa75f0>] ? __ip_append_data.isra.50+0xa60/0xa60
[<ffffffffaeaa5c17>] ip_local_out_sk+0x37/0x40
[<ffffffffaeaa5fb4>] ip_queue_xmit+0x144/0x3c0
[<ffffffffaeac06f4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffffaeac290f>] tcp_send_ack+0x11f/0x170
[<ffffffffaeac3d55>] tcp_send_delayed_ack+0xa5/0x130
[<ffffffffaeab6f57>] __tcp_ack_snd_check+0x87/0x90
[<ffffffffaeabcfb7>] tcp_rcv_established+0x267/0x7a0
[<ffffffffaeac800a>] tcp_v4_do_rcv+0x10a/0x350
[<ffffffffaea3b996>] release_sock+0xa6/0x180
[<ffffffffaeab309d>] tcp_sendpage+0xdd/0x5c0
[<ffffffffaeadfec0>] inet_sendpage+0x70/0xe0
[<ffffffffaea353de>] kernel_sendpage+0x1e/0x30
[<ffffffffc046a5fa>] svc_send_common+0x6a/0x160 [sunrpc]
[<ffffffffc046a760>] svc_sendto+0x70/0x1d0 [sunrpc]
[<ffffffffc04ce997>] ? nfsd4_put_session_locked+0x57/0x90 [nfsd]
[<ffffffffc04cea25>] ? nfsd4_put_session+0x55/0x70 [nfsd]
[<ffffffffc04d1a48>] ? nfsd4_sequence_done+0xf8/0x250 [nfsd]
[<ffffffffae4cdf44>] ? groups_free+0x54/0x60
[<ffffffffc046a932>] svc_tcp_sendto+0x32/0x90 [sunrpc]
[<ffffffffc0478aec>] svc_send+0x12c/0x150 [sunrpc]
[<ffffffffc0467d1f>] svc_process+0xff/0x110 [sunrpc]
[<ffffffffc04ac16f>] nfsd+0xdf/0x150 [nfsd]
[<ffffffffc04ac090>] ? nfsd_destroy+0x80/0x80 [nfsd]
[<ffffffffae4c5e61>] kthread+0xd1/0xe0
[<ffffffffae4c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffffaeb95df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffae4c5d90>] ? insert_kthread_work+0x40/0x40
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00

Complete report #239740

Frame #	Function	Binary	Source or offset	Line
1	e1000_xmit_frame	e1000	0xffffffffc0415867 Build id: 3.10.0-862.el7.x86_64	0x7f7
2	dev_hard_start_xmit	vmlinux	0xffffffffbbdeb166 Build id: 3.10.0-862.el7.x86_64	0x246
3	sch_direct_xmit	vmlinux	0xffffffffbbe16a2a Build id: 3.10.0-862.el7.x86_64	0x11a
4	__dev_queue_xmit	vmlinux	0xffffffffbbdee051 Build id: 3.10.0-862.el7.x86_64	0x4a1
5	dev_queue_xmit	vmlinux	0xffffffffbbdee220 Build id: 3.10.0-862.el7.x86_64	0x10
6	ip_finish_output	vmlinux	0xffffffffbbe37416 Build id: 3.10.0-862.el7.x86_64	0x546
7	ip_output	vmlinux	0xffffffffbbe37973 Build id: 3.10.0-862.el7.x86_64	0x73
8	? __ip_append_data.isra.50	vmlinux	0xffffffffbbe36ed0 Build id: 3.10.0-862.el7.x86_64	0xa50
9	ip_local_out_sk	vmlinux	0xffffffffbbe35567 Build id: 3.10.0-862.el7.x86_64	0x37
10	ip_queue_xmit	vmlinux	0xffffffffbbe358d3 Build id: 3.10.0-862.el7.x86_64	0x143
11	tcp_transmit_skb	vmlinux	0xffffffffbbe4f7b4 Build id: 3.10.0-862.el7.x86_64	0x4e4
12	tcp_write_xmit	vmlinux	0xffffffffbbe4fe22 Build id: 3.10.0-862.el7.x86_64	0x172
13	__tcp_push_pending_frames	vmlinux	0xffffffffbbe50c2e Build id: 3.10.0-862.el7.x86_64	0x2e
14	tcp_push	vmlinux	0xffffffffbbe3f12c Build id: 3.10.0-862.el7.x86_64	0xec
15	tcp_sendpage	vmlinux	0xffffffffbbe42977 Build id: 3.10.0-862.el7.x86_64	0x527
16	inet_sendpage	vmlinux	0xffffffffbbe6e660 Build id: 3.10.0-862.el7.x86_64	0x70
17	kernel_sendpage	vmlinux	0xffffffffbbdcb3de Build id: 3.10.0-862.el7.x86_64	0x1e
18	svc_send_common	sunrpc	0xffffffffc07085ea Build id: 3.10.0-862.el7.x86_64	0x6a
19	svc_sendto	sunrpc	0xffffffffc0708750 Build id: 3.10.0-862.el7.x86_64	0x70
20	? nfsd4_put_session_locked	nfsd	0xffffffffc0794ce7 Build id: 3.10.0-862.el7.x86_64	0x57
21	? nfsd4_put_session	nfsd	0xffffffffc0794d75 Build id: 3.10.0-862.el7.x86_64	0x55
22	? nfsd4_sequence_done	nfsd	0xffffffffc0797b18 Build id: 3.10.0-862.el7.x86_64	0xf8
23	? auth_domain_put	sunrpc	0xffffffffc0708be9 Build id: 3.10.0-862.el7.x86_64	0x19
24	svc_tcp_sendto	sunrpc	0xffffffffc0708922 Build id: 3.10.0-862.el7.x86_64	0x32
25	svc_send	sunrpc	0xffffffffc07169dc Build id: 3.10.0-862.el7.x86_64	0xfc
26	svc_process	sunrpc	0xffffffffc0705c1f Build id: 3.10.0-862.el7.x86_64	0x10f
27	nfsd	nfsd	0xffffffffc0771eef Build id: 3.10.0-862.el7.x86_64	0xdf
28	? nfsd_destroy	nfsd	0xffffffffc0771e10 Build id: 3.10.0-862.el7.x86_64	0x80
29	kthread	vmlinux	0xffffffffbb8bae31 Build id: 3.10.0-862.el7.x86_64	0xd1
30	? finish_task_switch	vmlinux	0xffffffffbb8c9667 Build id: 3.10.0-862.el7.x86_64	0x57
31	? insert_kthread_work	vmlinux	0xffffffffbb8bad60 Build id: 3.10.0-862.el7.x86_64	0x40
32	ret_from_fork_nospec_begin	vmlinux	0xffffffffbbf1f637 Build id: 3.10.0-862.el7.x86_64	0x21
33	? insert_kthread_work	vmlinux	0xffffffffbb8bad60 Build id: 3.10.0-862.el7.x86_64	0x40

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 21s! [nfsd:1974]
Modules linked in: rpcsec_gss_krb5 tcp_lp fuse veth xt_set xt_multiport iptable_raw ip_set_hash_ip ip_set_hash_net ip_set nf_conntrack_netlink tcp_diag nfnetlink inet_diag xt_statistic xt_nat ip_vs_sh ip_vs_wrr ip_vs_rr ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 xt_comment xt_mark xt_addrtype xt_CHECKSUM iptable_mangle br_netfilter ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge ip_vs stp llc nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink cfg80211 rfkill vmw_vsock_vmci_transport vsock overlay(T) snd_seq_midi snd_seq_midi_event iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ppdev ghash_clmulni_intel aesni_intel lrw snd_ens1371 gf128mul
vmw_balloon glue_helper snd_rawmidi ablk_helper cryptd snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm joydev pcspkr snd_timer nfit snd sg vmw_vmci soundcore libnvdimm i2c_piix4 shpchp parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix mptspi scsi_transport_spi libata e1000 mptscsih serio_raw mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 1974 Comm: nfsd Kdump: loaded Tainted: G             L ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff9b9762213f40 ti: ffff9b9791620000 task.ti: ffff9b9791620000
RIP: 0010:[<ffffffffc0415867>]  [<ffffffffc0415867>] e1000_xmit_frame+0x7f7/0x1120 [e1000]
RSP: 0018:ffff9b9791623830  EFLAGS: 00000286
RAX: ffffa79983483818 RBX: 0000000000000001 RCX: 000000000000005c
RDX: 000000000000005c RSI: ffff9b943d7c8780 RDI: ffff9b97a4d6a000
RBP: ffff9b97916238b0 R08: 0000000000000100 R09: 0000000022100000
R10: 000000001d000000 R11: 0000000000000000 R12: 0000000000000202
R13: 00000004d672a000 R14: 0000000100000007 R15: ffffffffbbb73e00
FS:  0000000000000000(0000) GS:ffff9b97a5680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c002355000 CR3: 00000006193ca000 CR4: 00000000003607e0
Call Trace:
[<ffffffffbbdeb166>] dev_hard_start_xmit+0x246/0x3b0
[<ffffffffbbe16a2a>] sch_direct_xmit+0x11a/0x250
[<ffffffffbbdee051>] __dev_queue_xmit+0x4a1/0x660
[<ffffffffbbdee220>] dev_queue_xmit+0x10/0x20
[<ffffffffbbe37416>] ip_finish_output+0x546/0x7a0
[<ffffffffbbe37973>] ip_output+0x73/0xe0
[<ffffffffbbe36ed0>] ? __ip_append_data.isra.50+0xa50/0xa50
[<ffffffffbbe35567>] ip_local_out_sk+0x37/0x40
[<ffffffffbbe358d3>] ip_queue_xmit+0x143/0x3a0
[<ffffffffbbe4f7b4>] tcp_transmit_skb+0x4e4/0x9e0
[<ffffffffbbe4fe22>] tcp_write_xmit+0x172/0xd00
[<ffffffffbbe50c2e>] __tcp_push_pending_frames+0x2e/0xc0
[<ffffffffbbe3f12c>] tcp_push+0xec/0x120
[<ffffffffbbe42977>] tcp_sendpage+0x527/0x5c0
[<ffffffffbbe6e660>] inet_sendpage+0x70/0xe0
[<ffffffffbbdcb3de>] kernel_sendpage+0x1e/0x30
[<ffffffffc07085ea>] svc_send_common+0x6a/0x160 [sunrpc]
[<ffffffffc0708750>] svc_sendto+0x70/0x1d0 [sunrpc]
[<ffffffffc0794ce7>] ? nfsd4_put_session_locked+0x57/0x90 [nfsd]
[<ffffffffc0794d75>] ? nfsd4_put_session+0x55/0x70 [nfsd]
[<ffffffffc0797b18>] ? nfsd4_sequence_done+0xf8/0x250 [nfsd]
[<ffffffffc0708be9>] ? auth_domain_put+0x19/0x70 [sunrpc]
[<ffffffffc0708922>] svc_tcp_sendto+0x32/0x90 [sunrpc]
[<ffffffffc07169dc>] svc_send+0xfc/0x150 [sunrpc]
[<ffffffffc0705c1f>] svc_process+0x10f/0x190 [sunrpc]
[<ffffffffc0771eef>] nfsd+0xdf/0x150 [nfsd]
[<ffffffffc0771e10>] ? nfsd_destroy+0x80/0x80 [nfsd]
[<ffffffffbb8bae31>] kthread+0xd1/0xe0
[<ffffffffbb8c9667>] ? finish_task_switch+0x57/0x170
[<ffffffffbb8bad60>] ? insert_kthread_work+0x40/0x40
[<ffffffffbbf1f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffbb8bad60>] ? insert_kthread_work+0x40/0x40
Code: 00 00 20 74 10 48 8b 83 00 03 00 00 f6 80 98 00 00 00 03 74 16 48 8b 5d c8 41 0f b7 47 2a 41 8b 57 18 48 03 83 90 0c 00 00 89 10 <48> 83 c4 58 31 c0 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 84 00