| Operating system | Count |
|---|---|
| CentOS 7 | 77 |
| Architecture | Count |
|---|---|
| x86_64 | 77 |
| Related packages | Count |
|---|---|
| kernel | 77 |
Packages names with count less than the total count of reports are most probably not the cause of the problem.
No reports in the last 20 days.
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
copy_page
|
vmlinux |
0xffffffffb9395609
Build id: 3.10.0-1160.49.1.el7.x86_64 |
0x49 |
NMI watchdog: BUG: soft lockup - CPU#31 stuck for 22s! [khugepaged:197] Modules linked in: veth ipt_rpfilter xt_set xt_multiport iptable_raw ip_set_hash_ip ip_set_hash_net ip_set xt_statistic xt_nat xt_recent ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 xt_comment xt_mark nf_conntrack_netlink xt_addrtype br_netfilter binfmt_misc netfilter_edr(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink overlay(T) vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod sb_edac coretemp ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel joydev aesni_intel sg parport_pc lrw gf128mul glue_helper vmw_vmci ablk_helper parport cryptd i2c_piix4 pcspkr ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect ata_piix sysimgblt fb_sys_fops mptspi ttm scsi_transport_spi crct10dif_pclmul drm crct10dif_common mptscsih libata e1000 serio_raw crc32c_intel mptbase vmxnet3 drm_panel_orientation_quirks floppy fuse CPU: 31 PID: 197 Comm: khugepaged Kdump: loaded Tainted: G OEL ------------ T 3.10.0-1160.49.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015 task: ffffa10d6ea0b180 ti: ffffa10d6ea60000 task.ti: ffffa10d6ea60000 RIP: 0010:[<ffffffffb9395609>] [<ffffffffb9395609>] copy_page+0x49/0xe0 RSP: 0018:ffffa10d6ea63d70 EFLAGS: 00010206 RAX: 0000000000000000 RBX: ffffa10d6ea63d30 RCX: 000000000000003a RDX: 0000000000000000 RSI: ffffa10c51e9b000 RDI: ffffa10c4729b000 RBP: ffffa10d6ea63e38 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000001 R13: 0000000000000001 R14: 0000000000000001 R15: ffffa10d6ea0b180 FS: 0000000000000000(0000) GS:ffffa1197fdc0000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fe8164e2ff8 CR3: 000000055c810000 CR4: 00000000001607e0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
copy_page
|
vmlinux |
0xffffffff9695d6b3
Build id: 3.10.0-862.14.4.el7.x86_64 |
0x23 |
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [khugepaged:46] Modules linked in: fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel snd_seq_device snd_pcm lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon ppdev snd_timer snd soundcore pcspkr joydev nfit sg libnvdimm parport_pc parport vmw_vmci shpchp i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea crct10dif_pclmul crct10dif_common ata_piix sysfillrect sysimgblt fb_sys_fops ttm crc32c_intel mptspi scsi_transport_spi serio_raw libata drm mptscsih e1000 mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod CPU: 3 PID: 46 Comm: khugepaged Tainted: G L ------------ 3.10.0-862.14.4.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020 task: ffff9e730194af70 ti: ffff9e7301be4000 task.ti: ffff9e7301be4000 RIP: 0010:[<ffffffff9695d6b3>] [<ffffffff9695d6b3>] copy_page+0x23/0xe0 RSP: 0018:ffff9e7301be7d70 EFLAGS: 00010206 RAX: ffff9e7301be7fd8 RBX: ffff9e7301be7d30 RCX: 000000000000003a RDX: 80000007dc408867 RSI: ffff9e6cdc408000 RDI: ffff9e6c28585000 RBP: ffff9e7301be7e38 R08: 000000000000003c R09: 67a780dde4000000 R10: 9858590bfc377900 R11: 0000000000000000 R12: 0000000000000001 R13: 0000000000000001 R14: ffffd9e9e0377900 R15: ffff9e6677edde40 FS: 0000000000000000(0000) GS:ffff9e73056c0000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f1654aa1500 CR3: 000000067b60e000 CR4: 00000000003607e0 Call Trace:
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
copy_page
|
vmlinux |
0xffffffff813300a9
Build id: 3.10.0-693.el7.x86_64 |
0x49 |
| 2 | vmlinux |
0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64 |
0x17a |
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 302s! [bundle:2767]
INFO: rcu_sched detected stalls on CPUs/tasks: { 0}
Modules linked in: tcp_diag inet_diag tun cfg80211 rfkill ip_set nfnetlink bridge stp llc fuse ppdev vmw_balloon coretemp iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg joydev pcspkr parport_pc parport shpchp vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata mptspi scsi_transport_spi e1000 mptscsih crct10dif_pclmul crct10dif_common crc32c_intel mptbase serio_raw i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
(detected by 1, t=386275 jiffies, g=5502865, c=5502864, q=3893)
CPU: 2 PID: 2767 Comm: bundle Not tainted 3.10.0-693.el7.x86_64 #1
Task dump for CPU 0:
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/31/2013
task: ffff8800b7950fd0 ti: ffff8805f5770000 task.ti: ffff8805f5770000
kworker/0:2 R running task 0 56 2 0x00000000
RIP: 0010:[<ffffffff813300a9>] [<ffffffff813300a9>] copy_page+0x49/0xe0
RSP: 0000:ffff8805f5773d40 EFLAGS: 00010206
RAX: 0000000000000000 RBX: ffff8800b7950fd0 RCX: 000000000000003a
Workqueue: events sync_cmos_clock
RDX: 0000000000000000 RSI: ffff8804e3405000 RDI: ffff8804e1405000
RBP: ffff8805f5773d98 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: ffff8800b7950fd0
R13: ffffffff811f1aee R14: ffff8805f5773cf8 R15: ffff88017fc57000
FS: 00007f3316d4c780(0000) GS:ffff880626680000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f331518c0c8 CR3: 00000005f43e9000 CR4: 00000000001407e0
0000000060d61aca 000000001ddf7bca ffff880622523f40 ffff8806220ebfd8
00000000c3ae1cf5 ffff8806220ebe60 ffffffff810a881a 0000000026616560
0000000000000000 ffff880626616560 ffff880626af1fb0 ffff880622523f40
Call Trace:
[<ffffffff810a881a>] ? process_one_work+0x17a/0x440
| Frame # | Function | Binary | Source or offset | Line |
|---|---|---|---|---|
| 1 |
copy_page
|
vmlinux |
0xffffffff9a958a39
Build id: 3.10.0-862.2.3.el7.x86_64 |
0x49 |
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [sshd:18275] Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr joydev parport_pc nfit parport libnvdimm sg shpchp vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel libata serio_raw e1000 mptspi scsi_transport_spi mptscsih mptbase i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod CPU: 3 PID: 18275 Comm: sshd Kdump: loaded Tainted: G W L ------------ 3.10.0-862.2.3.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016 task: ffff9dea4be68000 ti: ffff9dea6ba4c000 task.ti: ffff9dea6ba4c000 NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [java:18114] RIP: 0010:[<ffffffff9a958a39>] [<ffffffff9a958a39>] copy_page+0x49/0xe0 NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [abrt-server:18272] RSP: 0000:ffff9dea6ba4fc50 EFLAGS: 00010206 RAX: 000000400000005e RBX: ffff9dea4be68000 RCX: 000000000000003a RDX: 0000000000000000 RSI: ffff9de8d5b19000 RDI: ffff9dea10554000 RBP: ffff9dea6ba4fcc8 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000000 R12: 00000000000200da R13: 0000000046593c03 R14: ffffffff9a9513b2 R15: ffff9dea6ba4fbc8 Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun FS: 0000000000000000(0000) GS:ffff9dea7fd80000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Modules linked in: xt_CHECKSUM ipt_MASQUERADE devlink ip6t_rpfilter nf_nat_masquerade_ipv4 ipt_REJECT tun nf_reject_ipv4 ip6t_REJECT CR2: 00007f58358dae10 CR3: 00000001906e4000 CR4: 00000000000607e0 devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv6 nf_reject_ipv4 ip6t_REJECT Call Trace: