Complete report #1033290
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
clear_page
|
vmlinux |
0xffffffffa5f94752
Build id: 3.10.0-1160.2.2.el7.x86_64
|
0x12
|
|
2
|
|
vmlinux |
0xffffffffa5dc81ef
Build id: 3.10.0-1160.2.2.el7.x86_64
|
0x36f
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffa5dc8aa6
Build id: 3.10.0-1160.2.2.el7.x86_64
|
0x166
|
|
4
|
alloc_pages_vma
|
vmlinux |
0xffffffffa5e1c269
Build id: 3.10.0-1160.2.2.el7.x86_64
|
0xa9
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [rpm:2252]
Modules linked in: nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink mgc(OE) lustre(OE) lmv(OE) mdc(OE) fid(OE) osc(OE) lov(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi vmw_vsock_vmci_transport vsock ext4 mbcache jbd2 sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr vmw_balloon joydev parport_pc vmw_vmci i2c_piix4 parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc
ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel libata serio_raw e1000 nfit libnvdimm vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse sg
CPU: 3 PID: 2252 Comm: rpm Kdump: loaded Tainted: G OEL ------------ 3.10.0-1160.2.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff99b349a7d280 ti: ffff99b2de2ec000 task.ti: ffff99b2de2ec000
RIP: 0010:[<ffffffffa5f94752>] [<ffffffffa5f94752>] clear_page+0x12/0x40
RSP: 0000:ffff99b2de2efbc0 EFLAGS: 00010216
RAX: 0000000000000000 RBX: 000000000000001e RCX: 000000000000003f
RDX: ffffffffa668e4c8 RSI: 0000000000000000 RDI: ffff99b26fd06000
RBP: ffff99b2de2efcd0 R08: ffffffffa668e4b7 R09: ffffe2a842bf41c0
R10: 000000000000312a R11: ffff99b349549438 R12: ffff99b2de2efb48
R13: ffffffffc040f7c0 R14: ffff99b3130bee48 R15: ffffe2a84873cb80
FS: 00007ffa1a3ba840(0000) GS:ffff99b3ffd80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000020c0000 CR3: 00000001bb056000 CR4: 00000000001607e0
Call Trace:
[<ffffffffa5dc81ef>] ? get_page_from_freelist+0x36f/0xac0
[<ffffffffa5dc8aa6>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffa5e1c269>] alloc_pages_vma+0xa9/0x200
Complete report #553200
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
clear_page
|
vmlinux |
0xffffffffa41901d2
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x12
|
|
2
|
|
vmlinux |
0xffffffffa3fc7acf
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x36f
|
|
3
|
|
vmlinux |
0xffffffffa3e2b621
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x151
|
|
4
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffa3fc8366
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0x166
|
|
5
|
alloc_pages_vma
|
vmlinux |
0xffffffffa401a0e9
Build id: 3.10.0-1062.18.1.el7.x86_64
|
0xa9
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [6_dirty_cpu_sch:2720]
Modules linked in: veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter overlay(T) sunrpc ppdev sg joydev virtio_balloon pcspkr parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic crct10dif_common ata_generic pata_acpi virtio_net virtio_console virtio_scsi bochs_drm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata serio_raw floppy virtio_pci drm_panel_orientation_quirks virtio_ring virtio dm_mirror dm_region_hash dm_log
dm_mod
CPU: 4 PID: 2720 Comm: 6_dirty_cpu_sch Tainted: G L ------------ T 3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.2-0-gf9626ccb91-prebuilt.qemu-project.org 04/01/2014
task: ffff9ebc1abea0e0 ti: ffff9ebc1d10c000 task.ti: ffff9ebc1d10c000
RIP: 0010:[<ffffffffa41901d2>] [<ffffffffa41901d2>] clear_page+0x12/0x40
RSP: 0000:ffff9ebc1d10fb90 EFLAGS: 00010216
RAX: 0000000000000000 RBX: 000000000001ac80 RCX: 000000000000003f
RDX: ffffffffa488b210 RSI: 0000000000000000 RDI: ffff9eb44cdb6000
RBP: ffff9ebc1d10fca0 R08: ffffffffa488b1ff R09: fffff84441336dc0
R10: 0000000000007996 R11: ffff9ebb6c230870 R12: 0000000200000004
R13: 0000000000000000 R14: ffff9eb57fd19000 R15: ffff9ebc1d10fbf4
FS: 00007f7124513700(0000) GS:ffff9ebc3fd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f70279df000 CR3: 0000000035346000 CR4: 00000000000006e0
Call Trace:
[<ffffffffa3fc7acf>] ? get_page_from_freelist+0x36f/0xaa0
[<ffffffffa3e2b621>] ? __switch_to+0x151/0x580
[<ffffffffa3fc8366>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffa401a0e9>] alloc_pages_vma+0xa9/0x200
Complete report #19649
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
clear_page
|
vmlinux |
0xffffffffb87843d2
Build id: 3.10.0-957.12.2.el7.x86_64
|
0x12
|
|
2
|
|
vmlinux |
0xffffffffb85c0972
Build id: 3.10.0-957.12.2.el7.x86_64
|
0x412
|
|
3
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffb85c1146
Build id: 3.10.0-957.12.2.el7.x86_64
|
0x176
|
|
4
|
alloc_pages_vma
|
vmlinux |
0xffffffffb8611715
Build id: 3.10.0-957.12.2.el7.x86_64
|
0xb5
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 30s! [graylog-sidecar:17409]
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 30s! [java:17379]
Modules linked in: ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack binfmt_misc ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac coretemp ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg parport_pc vmw_vmci i2c_piix4 parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel
serio_raw ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm vmxnet3 mptspi libata scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 17379 Comm: java Kdump: loaded Tainted: G L ------------ 3.10.0-957.12.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff9ec26c6f8000 ti: ffff9ed5f06c4000 task.ti: ffff9ed5f06c4000
RIP: 0010:[<ffffffffb87843d2>] [<ffffffffb87843d2>] clear_page+0x12/0x40
RSP: 0000:ffff9ed5f06c7b38 EFLAGS: 00010216
RAX: 0000000000000000 RBX: ffffffffb879524d RCX: 000000000000003f
RDX: ffffffffb8e8247a RSI: 0000000000000000 RDI: ffff9ec84b0dc000
RBP: ffff9ed5f06c7c48 R08: ffffffffb8e82469 R09: fffff463842c3740
R10: 00000000000050a3 R11: 00003ffffffff000 R12: 0000000000000000
R13: 0000000000000000 R14: 0000000000000029 R15: ffff9ed5f06c7bd0
FS: 00007fde388c8700(0000) GS:ffff9ed6cfd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fde29557000 CR3: 0000001dd5fdc000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffb85c0972>] ? get_page_from_freelist+0x412/0xa70
[<ffffffffb85c1146>] __alloc_pages_nodemask+0x176/0x420
[<ffffffffb8611715>] alloc_pages_vma+0xb5/0x200