| Operating system | Count |
|---|---|
| CentOS 7 | 120 |
| Architecture | Count |
|---|---|
| x86_64 | 120 |
| Related packages | Count |
|---|---|
| kernel | 120 |
Packages names with count less than the total count of reports are most probably not the cause of the problem.
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__skb_clone
|
vmlinux |
0xffffffff98441b9c
Build id: 3.10.0-1160.76.1.el7.x86_64 |
0xec |
NMI watchdog: BUG: soft lockup - CPU#14 stuck for 22s! [kworker/14:1:4164] Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ppdev nfit libnvdimm parport_pc iosf_mbi parport i2c_piix4 pcspkr ip_tables xfs libcrc32c nouveau 8021q garp mxm_wmi mrp wmi stp llc video i2c_algo_bit drm_kms_helper crct10dif_pclmul crct10dif_common syscopyarea crc32_pclmul sysfillrect crc32c_intel sysimgblt fb_sys_fops ghash_clmulni_intel ttm aesni_intel nvme lrw gf128mul drm glue_helper scsi_transport_iscsi ablk_helper ena nvme_core cryptd serio_raw drm_panel_orientation_quirks sunrpc dm_mirror dm_region_hash dm_log dm_mod fuse CPU: 14 PID: 4164 Comm: kworker/14:1 Kdump: loaded Tainted: G W L ------------ 3.10.0-1160.76.1.el7.x86_64 #1 Hardware name: Amazon EC2 g4dn.4xlarge/, BIOS 1.0 10/16/2017 Workqueue: xfs-sync/nvme0n1p1 xfs_log_worker [xfs] task: ffff8e753f4f4200 ti: ffff8e74e3f60000 task.ti: ffff8e74e3f60000 RIP: 0010:[<ffffffff98441b9c>] [<ffffffff98441b9c>] __skb_clone+0xec/0x150 RSP: 0018:ffff8e754d583690 EFLAGS: 00000246 RAX: ffff8e75450f5cce RBX: 0100000000000000 RCX: 000000ce00dc00f0 RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff8e754879fb00 RBP: ffff8e754d5836a0 R08: 0000000000000000 R09: 0000000000000000 R10: 0000001000000000 R11: ffff8e753d880000 R12: ffff8e754d583608 R13: ffffffff9859afba R14: ffff8e754d5836a0 R15: ffff8e754879fb00 FS: 0000000000000000(0000) GS:ffff8e754d580000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fd06dc789e5 CR3: 0000000fc7446000 CR4: 00000000007606e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 PKRU: 00000000 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__skb_clone
|
vmlinux |
0xffffffffaea3bbd4
Build id: 3.10.0-1127.el7.x86_64 |
0x114 |
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [kworker/4:3:1488] Modules linked in: gsch(OE) redirfs(OE) ext4 mbcache jbd2 vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper joydev pcspkr cryptd sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops sd_mod ttm crc_t10dif ahci crct10dif_generic ata_piix libahci nfit drm libnvdimm crct10dif_pclmul libata crct10dif_common serio_raw crc32c_intel vmw_pvscsi vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod [last unloaded: redirfs] CPU: 4 PID: 1488 Comm: kworker/4:3 Tainted: G OE ------------ 3.10.0-1127.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018 Workqueue: xfs-cil/dm-2 xlog_cil_push_work [xfs] task: ffff8df7a6a18000 ti: ffff8df798c7c000 task.ti: ffff8df798c7c000 RIP: 0010:[<ffffffffaea3bbd4>] [<ffffffffaea3bbd4>] __skb_clone+0x114/0x150 RSP: 0018:ffff8df9b7d03c58 EFLAGS: 00010282 RAX: ffff8df7974dac40 RBX: ffff8df9b7d15f80 RCX: 00000040004e004e RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff8df8c8098800 RBP: ffff8df9b7d03c68 R08: 0000000000000000 R09: 0000000000000001 R10: 0000000000000000 R11: ffff8dfbb34808c0 R12: ffff8df9b7d03bc8 R13: ffffffffaeb93efa R14: ffff8df9b7d03c68 R15: ffff8df8c8098800 FS: 0000000000000000(0000) GS:ffff8df9b7d00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f4ed009ac10 CR3: 0000000093610000 CR4: 00000000001607e0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__skb_clone
|
vmlinux |
0xffffffffa6821df4
Build id: 3.10.0-957.5.1.el7.x86_64 |
0x114 |
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [kworker/0:1:25462] Modules linked in: nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg parport_pc vmw_vmci parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi serio_raw crct10dif_pclmul crct10dif_common crc32c_intel vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm vmw_pvscsi ata_piix drm libata vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod CPU: 0 PID: 25462 Comm: kworker/0:1 Kdump: loaded Tainted: G L ------------ 3.10.0-957.5.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 Workqueue: events fb_flashcursor task: ffff8d7cb87e1040 ti: ffff8d7e293a8000 task.ti: ffff8d7e293a8000 RIP: 0010:[<ffffffffa6821df4>] [<ffffffffa6821df4>] __skb_clone+0x114/0x150 RSP: 0000:ffff8d7e3fc03c60 EFLAGS: 00010286 RAX: ffff8d7cb8016fc0 RBX: 00000000ffffffff RCX: 00000040004e004e RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff8d7c3672e100 RBP: ffff8d7e3fc03c70 R08: 0000000000000000 R09: 0000000000000001 R10: 0000000000000000 R11: ffff8d7c358388c0 R12: ffff8d7e3fc03bd8 R13: ffffffffa6975df2 R14: ffff8d7e3fc03c70 R15: ffff8d7c3672e100 FS: 0000000000000000(0000) GS:ffff8d7e3fc00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000000448d70 CR3: 0000000229af6000 CR4: 00000000003607f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
__skb_clone
|
vmlinux |
0xffffffffb8435bc4
Build id: 3.10.0-1062.4.1.el7.x86_64 |
0x114 |
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [abrtd:2387] Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13109(E) falcon_lsm_pinned_13005(E) nls_utf8 isofs fuse rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache devlink binfmt_misc falcon_lsm_pinned_12905(E) ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel snd_hda_codec_generic lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel joydev snd_hda_codec virtio_balloon snd_hda_core sg snd_hwdep snd_seq parport_pc snd_seq_device parport snd_pcm snd_timer snd pcspkr i2c_piix4 soundcore auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_blk cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata serio_raw crct10dif_pclmul crct10dif_common virtio_pci crc32c_intel floppy virtio_ring virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal] CPU: 1 PID: 2387 Comm: abrtd Kdump: loaded Tainted: P EL ------------ 3.10.0-1062.4.1.el7.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 task: ffffa0d711aa9070 ti: ffffa0d71474c000 task.ti: ffffa0d71474c000 RIP: 0010:[<ffffffffb8435bc4>] [<ffffffffb8435bc4>] __skb_clone+0x114/0x150 RSP: 0000:ffffa0d71f043a80 EFLAGS: 00010286 RAX: ffffa0d6e16cdec0 RBX: ffffa0d5377ef000 RCX: 000000ce00dc00f0 RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffa0d5377ef000 RBP: ffffa0d71f043a90 R08: 0000000000000000 R09: 0000000000000000 R10: 0000841800000000 R11: ffffa0d71965b000 R12: ffffa0d71f0439f8 R13: ffffffffb858cefa R14: ffffa0d71f043a90 R15: ffffa0d5377ef000 FS: 00007f64cd572900(0000) GS:ffffa0d71f040000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000043cd5001 CR3: 0000002f597c4000 CR4: 00000000001606e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: