| Operating system | Count |
|---|---|
| CentOS 7 | 20 |
| Architecture | Count |
|---|---|
| x86_64 | 20 |
| Related packages | Count |
|---|---|
| kernel | 20 |
Packages names with count less than the total count of reports are most probably not the cause of the problem.
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
copy_page_rep
|
vmlinux |
0xffffffff891953d5
Build id: 3.10.0-1160.71.1.el7.x86_64 |
0x5 |
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 3352s! [gnome-session-b:12381]
Modules linked in: tcp_lp xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vboxsf(OE) sunrpc joydev ppdev crc32_pclmul snd_intel8x0 ghash_clmulni_intel aesni_intel lrw snd_ac97_codec gf128mul ac97_bus glue_helper snd_seq ablk_helper cryptd snd_seq_device vboxguest(OE) snd_pcm sg snd_timer snd parport_pc soundcore parport i2c_piix4 video pcspkr ip_tables xfs libcrc32c
sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper e1000 syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci libahci drm crct10dif_pclmul crct10dif_common ata_piix libata crc32c_intel serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 12381 Comm: gnome-session-b Kdump: loaded Tainted: G OEL ------------ 3.10.0-1160.71.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff8af18fb5e300 ti: ffff8af1f0c80000 task.ti: ffff8af1f0c80000
INFO: rcu_sched detected stalls on CPUs/tasks:
RIP: 0010:[<ffffffff891953d5>] [<ffffffff891953d5>] copy_page_rep+0x5/0x10
RSP: 0000:ffff8af1f0c83d80 EFLAGS: 00010286
RAX: 0000000000000200 RBX: ffffffff88fee7fa RCX: 000000000000014e
RDX: fffff0858553c7c0 RSI: ffff8af2d4f1f590 RDI: ffff8af232fce590
RBP: ffff8af1f0c83de0 R08: 0000000000000001 R09: fffff0858553c7dc
R10: 0000000000004047 R11: ffff8af1cc176360 R12: ffffffffc03c3b1c
{} (detected by 2, t=1404227 jiffies, g=82470, c=82469, q=209)
All QSes seen, last rcu_sched kthread activity 1404227 (4448499666-4447095439), jiffies_till_next_fqs=3
R13: ffff8af1f0c83cf8 R14: 00000000000000a9 R15: ffff8af2aabacb00
FS: 00007fa0bc39ba40(0000) GS:ffff8af2d5480000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa0b0528108 CR3: 0000000070cdc000 CR4: 00000000000606e0
gnome-shell R running task 0 2605 2379 0x00000080
Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
copy_page_rep
|
vmlinux |
0xffffffff8af8e875
Build id: 3.10.0-1062.4.1.el7.x86_64 |
0x5 |
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 24s! [falcon-sensor:20254] Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(E) falcon_kal(E) falcon_lsm_pinned_18108(E) falcon_lsm_pinned_18003(E) falcon_lsm_pinned_17804(E) falcon_lsm_pinned_17607(E) uinput devlink binfmt_misc ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter iosf_mbi iTCO_wdt kvm_intel snd_hda_codec_generic iTCO_vendor_support snd_hda_intel kvm snd_hda_codec snd_hda_core qxl snd_hwdep irqbypass snd_seq crc32_pclmul ttm snd_seq_device ghash_clmulni_intel snd_pcm drm_kms_helper aesni_intel syscopyarea lrw sysfillrect gf128mul glue_helper sysimgblt joydev snd_timer ablk_helper fb_sys_fops snd cryptd pcspkr virtio_rng soundcore lpc_ich i2c_i801 drm virtio_balloon drm_panel_orientation_quirks auth_rpcgss sunrpc ip_tables xfs libcrc32c virtio_console virtio_net virtio_blk virtio_scsi ahci libahci crct10dif_pclmul crct10dif_common libata crc32c_intel virtio_pci serio_raw virtio_ring virtio dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal] CPU: 6 PID: 20254 Comm: falcon-sensor Kdump: loaded Tainted: P EL ------------ 3.10.0-1062.4.1.el7.x86_64 #1 Hardware name: Red Hat KVM/RHEL-AV, BIOS 1.16.0-4.module+el8.9.0+1408+7b966129 04/01/2014 task: ffff8ef7b8a0e2a0 ti: ffff8ef781b9c000 task.ti: ffff8ef781b9c000 RIP: 0010:[<ffffffff8af8e875>] [<ffffffff8af8e875>] copy_page_rep+0x5/0x10 RSP: 0018:ffff8ef781b9fd00 EFLAGS: 00010286 RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000200 RDX: 0000000000000000 RSI: ffff8ef4972ca000 RDI: ffff8ef4b5aca000 RBP: ffff8ef781b9fd48 R08: ffff8ef781b9c000 R09: 0000000000000001 R10: 0000000000000000 R11: 0000000000000000 R12: ffff8ef781b9ffd8 R13: ffff8ef781b9ffd8 R14: ffff8ef781b9ffd8 R15: ffff8ef7b8a0e2a0 FS: 00007fec791ff700(0000) GS:ffff8ef7bf180000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fec75c03a68 CR3: 0000002e84fdc000 CR4: 0000000000360ee0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
copy_page_rep
|
vmlinux |
0xffffffff8132ffa5
Build id: 3.10.0-693.11.1.el7.x86_64 |
0x5 |
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [khugepaged:32] Modules linked in: iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ip_tables tcp_lp uinput fuse tun bridge ebtable_filter ebtables ip6table_filter ip6_tables ipt_REJECT nf_reject_ipv4 xt_CHECKSUM sb_edac edac_core iosf_mbi ppdev i2c_piix4 joydev pcspkr parport_pc virtio_balloon parport nfsd auth_rpcgss nfs_acl lockd grace xfs libcrc32c 8021q garp stp llc mrp virtio_console virtio_net virtio_blk ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32_pclmul crc32c_intel ghash_clmulni_intel qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix scsi_transport_iscsi libata aesni_intel lrw gf128mul glue_helper ablk_helper cryptd serio_raw virtio_pci virtio_ring virtio i2c_core floppy sunrpc dm_mirror dm_region_hash dm_log dm_mod [last unloaded: nf_defrag_ipv4] CPU: 1 PID: 32 Comm: khugepaged Tainted: G L ------------ 3.10.0-693.11.1.el7.x86_64 #1 Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.10.2-1ubuntu1 04/01/2014 task: ffff88023fd96eb0 ti: ffff880233f98000 task.ti: ffff880233f98000 RIP: 0010:[<ffffffff8132ffa5>] [<ffffffff8132ffa5>] copy_page_rep+0x5/0x10 RSP: 0018:ffff880233f9bd80 EFLAGS: 00010286 RAX: ffff880233f9bfd8 RBX: ffffea0000000000 RCX: 0000000000000200 RDX: 000000000001a1b8 RSI: ffff880085d87000 RDI: ffff880165435000 RBP: ffff880233f9be38 R08: 0000000000000018 R09: a800085d86000000 R10: 57ffe1a27c176180 R11: 0000000000000000 R12: ffff880233f9bd30 R13: ffff88017fc3ac00 R14: 0000000000000001 R15: 0000000000000001 FS: 0000000000000000(0000) GS:ffff88023fd00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00000000027e1001 CR3: 0000000032635000 CR4: 00000000003407e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Stack: ffffffff811eb122 0000000229e2e067 00007fabcb400000 ffff8800339f1640 ffffea0002b6ec30 ffff8800adbb02c8 ffff880229e2e000 ffff880233f9be60 ffff880233f9bfd8 ffff88022c914538 ffff880233f9bfd8 00007fabcb200000 Call Trace: