| Operating system | Count |
|---|---|
| CentOS 7 | 29 |
| Architecture | Count |
|---|---|
| x86_64 | 29 |
| Related packages | Count |
|---|---|
| kernel | 29 |
Packages names with count less than the total count of reports are most probably not the cause of the problem.
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
build_skb
|
vmlinux |
0xffffffff814ea81c
Build id: 3.10.0-229.14.1.el7.x86_64 |
0xfc |
BUG: soft lockup - CPU#8 stuck for 29s! [php:62506] Modules linked in: binfmt_misc ebtable_filter ebtables ip6table_filter ip6_tables tun bridge stp llc dahdi(OF) crc_ccitt fuse netatop(OF) xt_CHECKSUM iptable_mangle xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_addrtype iptable_nat nf_nat_ipv4 nf_nat nf_log_ipv4 nf_log_common xt_LOG ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 xt_recent xt_multiport xt_mark xt_conntrack nf_conntrack iptable_filter ext4 mbcache jbd2 coretemp snd_ens1371 snd_rawmidi snd_ac97_codec crc32_pclmul ac97_bus ghash_clmulni_intel snd_seq snd_seq_device ppdev aesni_intel snd_pcm lrw gf128mul vmw_balloon glue_helper ablk_helper snd_timer cryptd snd ahci pcspkr soundcore libahci sg vmw_vmci shpchp i2c_piix4 parport_pc parport nfsd auth_rpcgss nfs_acl lockd sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx mptspi drm_kms_helper scsi_transport_spi ttm crct10dif_pclmul crct10dif_common crc32c_intel drm mptscsih serio_raw ata_piix mptbase e1000 libata i2c_core dm_mirror dm_region_hash dm_log dm_mod CPU: 8 PID: 62506 Comm: php Tainted: GF O-------------- 3.10.0-229.14.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015 task: ffff8802b2fb16c0 ti: ffff88016be6c000 task.ti: ffff88016be6c000 RIP: 0010:[<ffffffff814ea81c>] [<ffffffff814ea81c>] build_skb+0xfc/0x1d0 RSP: 0018:ffff880332703cc8 EFLAGS: 00010202 RAX: 00000000ffffffff RBX: 0000000000000000 RCX: 00000000ffffffff RDX: ffff88032b5a5f00 RSI: 0000000000000640 RDI: ffff88014b8e8640 RBP: ffff880332703ce0 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000070 R11: ffffea000c96bf00 R12: ffff880332703c38 R13: ffffffff81614fdd R14: ffff880332703ce0 R15: ffff88014b8e8000 FS: 00007f773b756840(0000) GS:ffff880332700000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f8a2eaa7000 CR3: 000000002359f000 CR4: 00000000001407e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Stack: 0000000000000780 ffff88032a8ee000 ffff88014b8e8000 ffff880332703d08 ffffffff814ed1e9 ffffc9000a2fe250 00000000000000b7 0000000000000000 ffff880332703d68 ffffffffa00b4069 ffff880332703d48 ffff88032a8ee000 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
build_skb
|
vmlinux |
0xffffffff81517e4c
Build id: 3.10.0-327.el7.x86_64 |
0xfc |
BUG: soft lockup - CPU#1 stuck for 243s! [conn18258:9063] BUG: soft lockup - CPU#2 stuck for 242s! [ftdc:3524] Modules linked in: iptable_filter ip_tables binfmt_misc gsch(OE) redirfs(OE) dsa_filter(POE) ip_set nfnetlink bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop vmw_vsock_vmci_transport vsock sunrpc coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon sg pcspkr parport_pc shpchp parport vmw_vmci i2c_piix4 xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic mptsas crct10dif_pclmul crct10dif_common scsi_transport_sas vmwgfx drm_kms_helper ttm mptscsih crc32c_intel ata_piix drm serio_raw mptbase vmxnet3 i2c_core libata dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables] CPU: 2 PID: 3524 Comm: ftdc Tainted: P OEL ------------ 3.10.0-327.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 task: ffff880066c12280 ti: ffff8801041bc000 task.ti: ffff8801041bc000 RIP: 0010:[<ffffffff81517e4c>] [<ffffffff81517e4c>] build_skb+0xfc/0x1d0 RSP: 0018:ffff88043fd03d50 EFLAGS: 00010202 RAX: 00000000ffffffff RBX: 0000000000000000 RCX: 00000000ffffffff RDX: ffff880011878e00 RSI: 0000000000000640 RDI: ffff88004739fec0 RBP: ffff88043fd03d68 R08: 0000000000000000 R09: 0000000000000000 R10: 00000000000000e4 R11: 0000000000000000 R12: ffff88043fd03cc8 R13: ffffffff8164655d R14: ffff88043fd03d68 R15: ffff88004739f880 FS: 00007fc6d3910700(0000) GS:ffff88043fd00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fc6df8fb000 CR3: 00000001f1a8d000 CR4: 00000000001407e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Stack: 0000000000000780 ffff88004739f880 ffff88042345d010 ffff88043fd03d88 ffffffff8151a883 ffff880424cc0000 ffff880426ee8c18 ffff88043fd03da0 ffffffff8151a8eb ffff880424cc1538 ffff88043fd03e20 ffffffffa009e85e Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
build_skb
|
vmlinux |
0xffffffffad7da81d
Build id: 3.10.0-862.el7.x86_64 |
0x6d |
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [java:19662] Modules linked in: xt_CHECKSUM iptable_mangle ipt_REJECT nf_reject_ipv4 ipt_MASQUERADE tun nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 ebtable_filter nf_defrag_ipv4 ebtables nf_nat_ipv4 xt_addrtype xt_conntrack nf_nat nf_conntrack ip6table_filter ip6_tables br_netfilter iptable_filter bridge stp llc devlink vmw_vsock_vmci_transport vsock overlay(T) sunrpc coretemp kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd vmw_balloon joydev pcspkr vmw_vmci sg i2c_piix4 floppy parport_pc parport shpchp ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi ata_piix scsi_transport_spi drm crct10dif_pclmul crct10dif_common libata mptscsih crc32c_intel e1000 serio_raw mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod CPU: 6 PID: 19662 Comm: java Kdump: loaded Tainted: G W L ------------ T 3.10.0-862.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 task: ffff8d851aefaf70 ti: ffff8d8101ed4000 task.ti: ffff8d8101ed4000 RIP: 0010:[<ffffffffad7da81d>] [<ffffffffad7da81d>] build_skb+0x6d/0xa0 RSP: 0000:ffff8d861ef83d20 EFLAGS: 00010286 RAX: 0000728180000000 RBX: ffff8d832bbd0c00 RCX: 00000000ffffffff RDX: ffff8d832bbd1100 RSI: 0000000000000640 RDI: ffffe0e35de9d6c0 RBP: ffff8d861ef83d38 R08: 000000000001bac0 R09: 0000000000000000 R10: 000000000002040c R11: 0000000000000001 R12: ffff8d861ef83c98 R13: ffffffffad9207f2 R14: ffff8d861ef83d38 R15: ffff8d832bbd1100 FS: 00007ff5e2fed700(0000) GS:ffff8d861ef80000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f94c4deb000 CR3: 000000020074a000 CR4: 00000000000007e0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
build_skb
|
vmlinux |
0xffffffff8151832c
Build id: 3.10.0-327.18.2.el7.x86_64 |
0xfc |
BUG: soft lockup - CPU#0 stuck for 21s! [rtkit-daemon:633] Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun ip6t_rpfilter ipt_REJECT ip6t_REJECT xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr vmw_balloon sg parport_pc vmw_vmci shpchp parport i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel vmwgfx serio_raw drm_kms_helper mptspi ttm scsi_transport_spi mptscsih ata_piix mptbase vmxnet3 drm i2c_core libata floppy dm_mirror dm_region_hash dm_log dm_mod CPU: 0 PID: 633 Comm: rtkit-daemon Tainted: G L ------------ 3.10.0-327.18.2.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014 task: ffff88022e379700 ti: ffff8800bb8e4000 task.ti: ffff8800bb8e4000 RIP: 0010:[<ffffffff8151832c>] [<ffffffff8151832c>] build_skb+0xfc/0x1d0 RSP: 0000:ffff88023fc03d70 EFLAGS: 00010202 RAX: 00000000ffffffff RBX: ffff88023fc03d50 RCX: 00000000ffffffff RDX: ffff8800bb8a2000 RSI: 0000000000000640 RDI: ffff8801a7ecefc0 RBP: ffff88023fc03d88 R08: 00000000000175e0 R09: 0000000000000000 R10: ffff88023265f480 R11: ffff880035f008c0 R12: ffff88023fc03ce8 R13: ffffffff81646e1d R14: ffff88023fc03d88 R15: ffff8801a7ece980 FS: 00007fcaa688c700(0000) GS:ffff88023fc00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f6ad99c5000 CR3: 00000000bb8b1000 CR4: 00000000000407f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Stack: 0000000000000780 ffff8801a7ece980 ffff880233751480 ffff88023fc03da8 ffffffff8151ad63 ffff880035f00000 ffff8802337546c0 ffff88023fc03dc0 ffffffff8151adcb ffff880035f011b8 ffff88023fc03e40 ffffffffa012f85e Call Trace: