Info

Permalink
Function
__build_skb
First occurrence
2020-09-22
Last occurrence
2026-01-11
State
NEW
Components
kernel
Quality
-2

Statistics

Operating system Count
CentOS 7 1,335
Architecture Count
x86_64 1,335
Related packages Count
kernel 1,322
 0:3.10.0-957.21.3.el7 113
 0:3.10.0-1062.9.1.el7 104
 0:3.10.0-1160.49.1.el7 103
 0:3.10.0-1160.el7 90
 0:3.10.0-1160.108.1.el7 71
 0:3.10.0-693.el7 69
 0:3.10.0-957.5.1.el7 42
 0:3.10.0-862.el7 41
 0:3.10.0-957.el7 40
 0:3.10.0-1127.19.1.el7 36
 0:3.10.0-1062.1.2.el7 35
 0:3.10.0-1160.11.1.el7 30
 0:3.10.0-693.5.2.el7 30
 0:3.10.0-1127.el7 27
 0:3.10.0-1160.53.1.el7 25
 0:3.10.0-1062.el7 24
 0:3.10.0-957.27.2.el7 23
 0:3.10.0-1062.4.1.el7 18
 0:3.10.0-1160.15.2.el7 17
 0:3.10.0-1160.36.2.el7 17
 0:3.10.0-1127.18.2.el7 16
 0:3.10.0-1160.90.1.el7 16
 0:3.10.0-1062.18.1.el7 15
 0:3.10.0-1160.71.1.el7 15
 0:3.10.0-957.10.1.el7 15
 0:3.10.0-1160.66.1.el7 14
 0:3.10.0-514.el7 14
 0:3.10.0-1160.25.1.el7 13
 0:3.10.0-693.2.2.el7 13
 0:3.10.0-1160.45.1.el7 12
 0:3.10.0-1160.62.1.el7 12
 0:3.10.0-1160.119.1.el7 11
 0:3.10.0-1160.31.1.el7 11
 0:3.10.0-1160.76.1.el7 10
 0:3.10.0-514.26.2.el7 10
 0:3.10.0-1160.114.2.el7 9
 0:3.10.0-1160.92.1.el7 9
 0:3.10.0-1160.81.1.el7 8
 0:3.10.0-1160.95.1.el7 8
 0:3.10.0-693.21.1.el7 8
 0:3.10.0-1062.1.1.el7 7
 0:3.10.0-1062.12.1.el7 7
 0:3.10.0-1160.21.1.el7 6
 0:3.10.0-1160.42.2.el7 6
 0:3.10.0-1160.6.1.el7 6
 0:3.10.0-1160.99.1.el7 6
 0:3.10.0-514.10.2.el7 6
 0:3.10.0-862.14.4.el7 6
 0:3.10.0-957.12.1.el7 6
 0:3.10.0-957.1.3.el7 6
 0:3.10.0-1160.59.1.el7 5
 0:3.10.0-1160.88.1.el7 5
 0:3.10.0-514.2.2.el7 5
 0:3.10.0-1127.13.1.el7 4
 0:3.10.0-514.16.1.el7 4
 0:3.10.0-862.11.6.el7 4
 0:3.10.0-862.2.3.el7 4
 0:3.10.0-957.12.2.el7 4
 0:3.10.0-1160.102.1.el7 3
 0:3.10.0-1160.24.1.el7 3
 0:3.10.0-862.3.2.el7 3
 0:3.10.0-1127.10.1.el7 2
 0:3.10.0-1127.8.2.el7 2
 0:3.10.0-1160.80.1.el7 2
 0:3.10.0-1160.83.1.el7 2
 0:3.10.0-514.21.1.el7 2
 0:3.10.0-514.21.2.el7 2
 0:3.10.0-514.6.1.el7 2
 0:3.10.0-1160.41.1.el7 2
 0:3.10.0-1160.105.1.el7 1
 0:3.10.0-1160.118.1.el7 1
 0:3.10.0-1160.2.2.el7 1
 0:3.10.0-693.11.1.el7 1
 0:3.10.0-957.21.2.el7 1
 0:3.10.0-862.9.1.el7 1
kernel-lt 12
 0:4.4.60-1.el7.elrepo 7
 0:4.4.15-1.el7.elrepo 5
kernel-ml 1
 0:4.5.2-1.el7.elrepo 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #189
Frame # Function Binary Source or offset Line
1
__build_skb
vmlinux 0xffffffff8156274b
Build id: 3.10.0-514.el7.x86_64
0xdb
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [postmaster:32710]
Modules linked in: fuse uinput xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter snd_hda_codec_generic iosf_mbi crc32_pclmul snd_hda_intel ghash_clmulni_intel aesni_intel snd_hda_codec lrw gf128mul glue_helper ablk_helper snd_hda_core snd_hwdep snd_seq ppdev snd_seq_device cryptd snd_pcm snd_timer snd pcspkr parport_pc virtio_balloon parport sg i2c_piix4 soundcore nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_console virtio_blk virtio_net qxl drm_kms_helper crct10dif_pclmul syscopyarea crct10dif_common sysfillrect
crc32c_intel sysimgblt ata_piix fb_sys_fops serio_raw ttm drm virtio_pci virtio_ring virtio libata i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 32710 Comm: postmaster Tainted: G             L ------------   3.10.0-514.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
task: ffff880091f0af10 ti: ffff880068ca0000 task.ti: ffff880068ca0000
RIP: 0010:[<ffffffff8156274b>]  [<ffffffff8156274b>] __build_skb+0xdb/0x1b0
RSP: 0018:ffff880239d03db8  EFLAGS: 00010286
RAX: 00000000ffffffff RBX: 0000000000000300 RCX: 00000000ffffffff
RDX: ffff88020bea1700 RSI: 00000000000000c0 RDI: ffff8801cd7b2ec0
RBP: ffff880239d03dc8 R08: 0000000000019b00 R09: 0000000000000000
R10: ffff880239d19b00 R11: ffffea00082fa840 R12: ffff880239d03d28
R13: ffffffff8169721d R14: ffff880239d03dc8 R15: 0000000000000300
FS:  00007fa2f5dd6740(0000) GS:ffff880239d00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000007d929002 CR3: 0000000045d79000 CR4: 00000000000406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff88022ca30000 0000000000000200 ffff880239d03e00 ffffffff81562951
ffffea0000131b00 ffffea0000131b00 ffff88022caf4c00 ffff880004c6c000
ffff88022ca308c0 ffff880239d03e48 ffffffffa01521d7 0000000099600376
Call Trace:
Complete report #798565
Frame # Function Binary Source or offset Line
1
__build_skb
vmlinux 0xffffffff9fbdb79b
Build id: 3.10.0-862.9.1.el7.x86_64
0xdb
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 23s! [db2sysc:7561]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_15604(E) falcon_lsm_pinned_15508(E) falcon_lsm_pinned_15402(E) falcon_lsm_pinned_15309(E) falcon_lsm_pinned_15110(E) falcon_lsm_pinned_15003(E) falcon_lsm_pinned_14812(E) falcon_lsm_pinned_14810(E) falcon_lsm_pinned_14713(E) falcon_lsm_pinned_14712(E) falcon_lsm_pinned_14604(E) falcon_lsm_pinned_14504(E) falcon_lsm_pinned_14306(E) falcon_lsm_pinned_14203(E) falcon_lsm_pinned_14006(E) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink falcon_lsm_pinned_13804(E) vmw_vsock_vmci_transport
vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr joydev i2c_piix4 vmw_vmci sg nfit shpchp libnvdimm parport_pc parport nfsd nfs_acl lockd auth_rpcgss grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common crc32c_intel libata mptspi serio_raw scsi_transport_spi mptscsih e1000 mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal]
CPU: 7 PID: 7561 Comm: db2sysc Tainted: P        W   EL ------------   3.10.0-862.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9eb27d2abf40 ti: ffff9eaef4478000 task.ti: ffff9eaef4478000
RIP: 0010:[<ffffffff9fbdb79b>]  [<ffffffff9fbdb79b>] __build_skb+0xdb/0x1b0
RSP: 0000:ffff9eb2e1dc3d60  EFLAGS: 00010286
RAX: 00000000ffffffff RBX: ffff9eb2d0ae7260 RCX: 00000000ffffffff
RDX: ffff9eb026c67e00 RSI: 00000000000000c0 RDI: ffff9eaf52005ec0
RBP: ffff9eb2e1dc3d70 R08: 000000000001bb00 R09: 0000000000000000
R10: 0000000000000001 R11: ffffd5b7427f6380 R12: ffff9eb2e1dc3cd8
R13: ffffffff9fd217b2 R14: ffff9eb2e1dc3d70 R15: 0000000000000300
FS:  00007f5caa3fe700(0000) GS:ffff9eb2e1dc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa7ea3ece00 CR3: 00000000b9fa4000 CR4: 00000000001607e0
Call Trace:
Complete report #16496
Frame # Function Binary Source or offset Line
1
__build_skb
vmlinux 0xffffffff82241d2b
Build id: 3.10.0-1127.19.1.el7.x86_64
0xdb
NMI watchdog: BUG: soft lockup - CPU#65 stuck for 23s! [khungtaskd:413]
Modules linked in: tcp_lp fuse veeamsnap(OE) veth binfmt_misc nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter nls_utf8 cifs ccm dns_resolver overlay(T) vmw_vsock_vmci_transport vsock ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg vmw_vmci i2c_piix4 parport_pc parport nfsd nfs_acl lockd grace auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci nfit ata_piix libahci drm crct10dif_pclmul libnvdimm crct10dif_common libata crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 65 PID: 413 Comm: khungtaskd Kdump: loaded Tainted: G           OEL ------------ T 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/28/2017
task: ffff9bfe42d29070 ti: ffff9bfe42aec000 task.ti: ffff9bfe42aec000
RIP: 0010:[<ffffffff82241d2b>]  [<ffffffff82241d2b>] __build_skb+0xdb/0x1b0
NMI watchdog: BUG: soft lockup - CPU#23 stuck for 23s! [migration/23:124]
Modules linked in:
RSP: 0018:ffff9c1d82243d90  EFLAGS: 00010282
RAX: 00000000ffffffff RBX: ffff9c1d7d9d64a0 RCX: 00000000ffffffff
RDX: ffff9bfed4c57300 RSI: 0000000000000640 RDI: ffff9c1118168e40
RBP: ffff9c1d82243da0 R08: 000000000001f120 R09: 0000000000000000
R10: ffff9c1d6f5a41d0 R11: ffff9c1d7d9d48c0 R12: ffff9c1d82243d08
R13: ffffffff82393efa R14: ffff9c1d82243da0 R15: 0000000000000880
FS:  0000000000000000(0000) GS:ffff9c1d82240000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000560aad504000 CR3: 000000075570a000 CR4: 00000000007607e0
DR0: 00000000006050d4 DR1: 00007fffffffe8b0 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600
PKRU: 00000000
Call Trace:
Complete report #338105
Frame # Function Binary Source or offset Line
1
__build_skb
vmlinux 0xffffffff8363dd0b
Build id: 3.10.0-1062.18.1.el7.x86_64
0xdb
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 21s! [kcs-created:19724]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_12905(E) binfmt_misc cmac arc4 md4 nls_utf8 cifs ccm dns_resolver ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_comment xt_mark iptable_filter iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_netlink nfnetlink iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi overlay(T) vmw_vsock_vmci_transport vsock falcon_lsm_pinned_12803(E) ext4 sb_edac mbcache iosf_mbi jbd2 crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper pcc_cpufreq cryptd ppdev vmw_balloon pcspkr joydev parport_pc parport vmw_vmci sg i2c_piix4 br_netfilter bridge stp llc nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr
ip_vs_rr ip_vs nf_conntrack auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif ata_generic crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi scsi_transport_spi nfit crct10dif_pclmul libata crct10dif_common crc32c_intel mptscsih libnvdimm serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal]
CPU: 6 PID: 19724 Comm: kcs-created Kdump: loaded Tainted: P            EL ------------ T 3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8911da16c1c0 ti: ffff89038fd70000 task.ti: ffff89038fd70000
RIP: 0010:[<ffffffff8363dd0b>]  [<ffffffff8363dd0b>] __build_skb+0xdb/0x1b0
RSP: 0018:ffff89033fb83d90  EFLAGS: 00010286
RAX: 00000000ffffffff RBX: ffff89033fb9f120 RCX: 00000000ffffffff
RDX: ffff8911d96e7a00 RSI: 0000000000000640 RDI: ffff88fbe1bed1c0
RBP: ffff89033fb83da0 R08: 0000000000000000 R09: 0000000000000000
R10: ffff89132db0bbe8 R11: ffff89033bc1c8c0 R12: ffff89033fb83d08
R13: ffffffff8378eefa R14: ffff89033fb83da0 R15: 0000000000000880
FS:  0000000000000000(0000) GS:ffff89033fb80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2673ee9878 CR3: 0000000169810000 CR4: 00000000001607e0
Call Trace:
Complete report #320619
Frame # Function Binary Source or offset Line
1
__build_skb
vmlinux 0xffffffff9cc41d2b
Build id: 3.10.0-1127.19.1.el7.x86_64
0xdb
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 21s! [swapper/7:0]
Modules linked in: tcp_lp fuse xt_nat veth nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc pcspkr ppdev joydev vmw_balloon coretemp sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif crct10dif_generic cdrom crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata crc32c_intel mptspi scsi_transport_spi mptscsih serio_raw mptbase vmxnet3 drm_panel_orientation_quirks
floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 7 PID: 0 Comm: swapper/7 Kdump: loaded Tainted: G    B        L ------------ T 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 10/22/2013
task: ffff8c04b9cc3150 ti: ffff8c04b9cd4000 task.ti: ffff8c04b9cd4000
RIP: 0010:[<ffffffff9cc41d2b>]  [<ffffffff9cc41d2b>] __build_skb+0xdb/0x1b0
RSP: 0018:ffff8c076e7c3d90  EFLAGS: 00010282
RAX: 00000000ffffffff RBX: ffff8c076932e4a0 RCX: 00000000ffffffff
RDX: ffff8c04ea35d500 RSI: 0000000000000640 RDI: ffff8c0473d54a40
RBP: ffff8c076e7c3da0 R08: 000000000001f120 R09: 0000000000000000
R10: ffff8c076d255af0 R11: ffff8c076932c8c0 R12: ffff8c076e7c3d08
R13: ffffffff9cd93efa R14: ffff8c076e7c3da0 R15: 0000000000000880
FS:  0000000000000000(0000) GS:ffff8c076e7c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4674dec000 CR3: 00000000a77f8000 CR4: 00000000000007e0
Call Trace:
Complete report #45401
Frame # Function Binary Source or offset Line
1
__build_skb
vmlinux 0xffffffffa7e3dd0b
Build id: 3.10.0-1062.9.1.el7.x86_64
0xdb
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 24s! [httpd:4101]
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 35s! [mysqld:4143]
Modules linked in: binfmt_misc talpa_vfshook(OE) talpa_pedconnector(OE) talpa_vcdevice(OE) talpa_core(OE) talpa_linux(OE) talpa_syscallhook(OE) tcp_diag inet_diag ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 ip6table_filter nf_log_ipv4 nf_log_common nf_nat_ftp xt_REDIRECT nf_nat_redirect xt_conntrack nf_conntrack_ftp xt_LOG xt_limit talpa_pedevice(OE) xt_multiport iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 ip6table_mangle ip6table_raw ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 nf_nat nf_conntrack ip6_tables iptable_mangle iptable_raw ipt_REJECT nf_reject_ipv4 iptable_filter sb_edac coretemp iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc vmw_vmci parport i2c_piix4 tcp_htcp
ip_tables xfs libcrc32c sd_mod sr_mod vmwgfx crc_t10dif cdrom crct10dif_generic drm_kms_helper ata_generic pata_acpi syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel serio_raw libata e1000 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: talpa_syscallhook]
CPU: 4 PID: 4143 Comm: mysqld Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff910a1e2fa0e0 ti: ffff9107ed670000 task.ti: ffff9107ed670000
RIP: 0010:[<ffffffffa7e3dd0b>]  [<ffffffffa7e3dd0b>] __build_skb+0xdb/0x1b0
RSP: 0018:ffff910a3fd03d60  EFLAGS: 00010286
RAX: 00000000ffffffff RBX: ffff910a2e637260 RCX: 00000000ffffffff
RDX: ffff9108a6aaaf00 RSI: 0000000000000100 RDI: ffff91061471bec0
RBP: ffff910a3fd03d70 R08: 000000000001f120 R09: 0000000000000000
R10: ffff91061471c062 R11: ffffffffa8513a40 R12: ffff910a3fd03cd8
R13: ffffffffa7f8eefa R14: ffff910a3fd03d70 R15: 0000000000000340
FS:  00007fc717e14700(0000) GS:ffff910a3fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0751a5f390 CR3: 0000000316d92000 CR4: 00000000000407e0
Call Trace:
Complete report #20529
Frame # Function Binary Source or offset Line
1
__build_skb
vmlinux 0xffffffff82227b0b
Build id: 3.10.0-957.1.3.el7.x86_64
0xdb
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [labmedica_hub.c:10280]
Modules linked in: bnep nfnetlink_queue nfnetlink_log nfnetlink bluetooth rfkill tcp_diag inet_diag cmac arc4 md4 nls_utf8 cifs ccm tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables dgrp(OE) devlink iptable_filter rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache vmw_vsock_vmci_transport vsock sb_edac ppdev iosf_mbi crc32_pclmul vmw_balloon ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg nfit parport_pc parport i2c_piix4 vmw_vmci libnvdimm nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sd_mod crc_t10dif
crct10dif_generic sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci crct10dif_pclmul crct10dif_common crc32c_intel ata_piix serio_raw mptspi drm libahci scsi_transport_spi mptscsih e1000 libata mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: dsa_filter]
CPU: 5 PID: 10280 Comm: labmedica_hub.c Kdump: loaded Tainted: P           OEL ------------   3.10.0-957.1.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9010411630c0 ti: ffff900ea354c000 task.ti: ffff900ea354c000
RIP: 0010:[<ffffffff82227b0b>]  [<ffffffff82227b0b>] __build_skb+0xdb/0x1b0
RSP: 0018:ffff901e7f343d00  EFLAGS: 00010282
RAX: 00000000ffffffff RBX: ffff901e7f343ca8 RCX: 00000000ffffffff
RDX: ffff90105579da00 RSI: 0000000000000640 RDI: ffff900ebf3f2c40
RBP: ffff901e7f343d10 R08: 000000000001f120 R09: 0000000000000000
R10: ffff901e7f35f120 R11: ffffd73bc755e700 R12: ffff901e7f343c78
R13: ffffffff82375df2 R14: ffff901e7f343d10 R15: 0000000000000880
FS:  0000000000000000(0000) GS:ffff901e7f340000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa3365541a0 CR3: 0000000511f5c000 CR4: 00000000000607e0
Call Trace:
Complete report #4975
Frame # Function Binary Source or offset Line
1
__build_skb
vmlinux 0xffffffff9643dd0b
Build id: 3.10.0-1062.9.1.el7.x86_64
0xdb
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [kworker/0:2:5544]
Modules linked in: secvm2(POE) secfs2(POE) nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 ppdev vmw_balloon coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg pcspkr joydev parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm mptspi
scsi_transport_spi crct10dif_pclmul libata crct10dif_common mptscsih crc32c_intel serio_raw mptbase e1000 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 5544 Comm: kworker/0:2 Kdump: loaded Tainted: P        W  OEL ------------ T 3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
Workqueue: events e1000_reset_task [e1000]
task: ffff9479d9a662a0 ti: ffff94784afa8000 task.ti: ffff94784afa8000
RIP: 0010:[<ffffffff9643dd0b>]  [<ffffffff9643dd0b>] __build_skb+0xdb/0x1b0
RSP: 0018:ffff9479ffc03cf8  EFLAGS: 00010282
RAX: 00000000ffffffff RBX: ffff9479ee5ff260 RCX: 00000000ffffffff
RDX: ffff947786187e00 RSI: 0000000000000080 RDI: ffff9477861af080
RBP: ffff9479ffc03d08 R08: 000000000001f120 R09: 0000000000000000
R10: 0000000000023ebc R11: 0000000000000001 R12: ffff9479ffc03c68
R13: ffffffff9658eefa R14: ffff9479ffc03d08 R15: 00000000000002c0
FS:  0000000000000000(0000) GS:ffff9479ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff059d52f90 CR3: 0000000298810000 CR4: 00000000000007f0
Call Trace:
Complete report #7085
Frame # Function Binary Source or offset Line
1
__build_skb
vmlinux 0xffffffff8158115b
Build id: 3.10.0-693.21.1.el7.x86_64
0xdb
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [oracle:26092]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr joydev sg i2c_piix4 parport_pc parport vmw_vmci shpchp binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi libata scsi_transport_spi mptscsih crct10dif_pclmul crct10dif_common
crc32c_intel serio_raw mptbase vmxnet3 i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 6 PID: 26092 Comm: oracle Tainted: G        W    L ------------   3.10.0-693.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff88020e348fd0 ti: ffff880032b04000 task.ti: ffff880032b04000
RIP: 0010:[<ffffffff8158115b>]  [<ffffffff8158115b>] __build_skb+0xdb/0x1b0
RSP: 0000:ffff88083d403dc0  EFLAGS: 00010286
RAX: 00000000ffffffff RBX: ffff88083d403e08 RCX: 00000000ffffffff
RDX: ffff88077cd50900 RSI: 0000000000000640 RDI: ffff880092a7fec0
RBP: ffff88083d403dd0 R08: 000000000001b9c0 R09: 0000000000000000
R10: ffffea00024a9e40 R11: 0000000000000001 R12: ffff88083d403d38
R13: ffffffff816c1732 R14: ffff88083d403dd0 R15: 0000000000000880
FS:  00007f130d7cb740(0000) GS:ffff88083d400000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000bb5e7a0 CR3: 000000003f1f6000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace: