Info

Permalink
Function
clear_page
First occurrence
2020-10-26
Last occurrence
2020-10-26
State
NEW
Components
kernel
Quality
-20

Statistics

Operating system Count
CentOS 7 18
Architecture Count
x86_64 18
Related packages Count
kernel 18
 0:3.10.0-1127.el7 6
 0:3.10.0-1160.el7 3
 0:3.10.0-1127.18.2.el7 2
 0:3.10.0-1127.13.1.el7 2
 0:3.10.0-1127.19.1.el7 1
 0:3.10.0-1160.21.1.el7 1
 0:3.10.0-1160.15.2.el7 1
 0:3.10.0-1160.11.1.el7 1
 0:3.10.0-1160.24.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

Report backtrace


Complete report #978989
Frame # Function Binary Source or offset Line
1
clear_page
vmlinux 0xffffffffa7794752
Build id: 3.10.0-1160.el7.x86_64
0x12
2
? get_page_from_freelist
vmlinux 0xffffffffa75c81ef
Build id: 3.10.0-1160.el7.x86_64
0x36f
3
? filemap_fault
vmlinux 0xffffffffa75c09ed
Build id: 3.10.0-1160.el7.x86_64
0x17d
4
? mem_cgroup_update_page_stat
vmlinux 0xffffffffa7640de6
Build id: 3.10.0-1160.el7.x86_64
0x16
5
__alloc_pages_nodemask
vmlinux 0xffffffffa75c8aa6
Build id: 3.10.0-1160.el7.x86_64
0x166
6
alloc_pages_vma
vmlinux 0xffffffffa761c269
Build id: 3.10.0-1160.el7.x86_64
0xa9
7
handle_mm_fault
vmlinux 0xffffffffa75f5ec7
Build id: 3.10.0-1160.el7.x86_64
0xcb7
8
__do_page_fault
vmlinux 0xffffffffa7b8e653
Build id: 3.10.0-1160.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffffa7b8e975
Build id: 3.10.0-1160.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffffa7b8a778
Build id: 3.10.0-1160.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#19 stuck for 24s! [sh:11676]
Modules linked in: xt_nat xt_addrtype xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod vfat fat xfs libcrc32c sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg parport_pc i2c_piix4
parport vmw_vmci ip_tables ext4 mbcache jbd2 ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops sd_mod ttm crc_t10dif crct10dif_generic ahci drm nfit ata_piix libahci libnvdimm crct10dif_pclmul libata crct10dif_common crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks fuse
CPU: 19 PID: 11676 Comm: sh Kdump: loaded Tainted: G             L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff9a3c2828e300 ti: ffff9a3579d74000 task.ti: ffff9a3579d74000
RIP: 0010:[<ffffffffa7794752>]  [<ffffffffa7794752>] clear_page+0x12/0x40
RSP: 0000:ffff9a3579d77bc0  EFLAGS: 00010216
RAX: 0000000000000000 RBX: 0000000000000030 RCX: 000000000000003f
RDX: ffffffffa7e8e488 RSI: 0000000000000000 RDI: ffff9a3a76ebe000
RBP: ffff9a3579d77cd0 R08: ffffffffa7e8e477 R09: ffffe16a77dbafc0
R10: 000000000000372d R11: ffff9a3c3b186ca8 R12: ffff9a3cbffda000
R13: 0000000000000000 R14: ffff9a3c3b186870 R15: 8000000f000001c1
FS:  0000000000000000(0000) GS:ffff9a3c9f480000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff71fabd0e8 CR3: 0000000c5ba12000 CR4: 00000000001607e0
Call Trace:
[<ffffffffa75c81ef>] ? get_page_from_freelist+0x36f/0xac0
[<ffffffffa75c09ed>] ? filemap_fault+0x17d/0x420
[<ffffffffa7640de6>] ? mem_cgroup_update_page_stat+0x16/0x50
[<ffffffffa75c8aa6>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffa761c269>] alloc_pages_vma+0xa9/0x200
[<ffffffffa75f5ec7>] handle_mm_fault+0xcb7/0xfb0
[<ffffffffa7b8e653>] __do_page_fault+0x213/0x500
[<ffffffffa7b8e975>] do_page_fault+0x35/0x90
[<ffffffffa7b8a778>] page_fault+0x28/0x30
Code: f3 48 ab c3 0f 1f 44 00 00 b9 00 10 00 00 31 c0 f3 aa c3 66 0f 1f 44 00 00 31 c0 b9 40 00 00 00 66 0f 1f 84 00 00 00 00 00 ff c9 <48> 89 07 48 89 47 08 48 89 47 10 48 89 47 18 48 89 47 20 48 89 
Complete report #1419381
Frame # Function Binary Source or offset Line
1
dump_stack
vmlinux 0xffffffffaef7ff85
Build id: 3.10.0-1127.el7.x86_64
0x19
2
bad_page.part.75
vmlinux 0xffffffffaef7ab40
Build id: 3.10.0-1127.el7.x86_64
0xdc
3
get_page_from_freelist
vmlinux 0xffffffffae9c89f5
Build id: 3.10.0-1127.el7.x86_64
0x785
4
? __vma_adjust
vmlinux 0xffffffffae9f9e23
Build id: 3.10.0-1127.el7.x86_64
0x263
5
__alloc_pages_nodemask
vmlinux 0xffffffffae9c8e76
Build id: 3.10.0-1127.el7.x86_64
0x166
6
? pagevec_lru_move_fn
vmlinux 0xffffffffae9cd29c
Build id: 3.10.0-1127.el7.x86_64
0x10c
7
alloc_pages_vma
vmlinux 0xffffffffaea1c2a9
Build id: 3.10.0-1127.el7.x86_64
0xa9
8
handle_mm_fault
vmlinux 0xffffffffae9f5f97
Build id: 3.10.0-1127.el7.x86_64
0xcb7
9
__do_page_fault
vmlinux 0xffffffffaef8d653
Build id: 3.10.0-1127.el7.x86_64
0x213
10
do_page_fault
vmlinux 0xffffffffaef8d975
Build id: 3.10.0-1127.el7.x86_64
0x35
11
page_fault
vmlinux 0xffffffffaef89778
Build id: 3.10.0-1127.el7.x86_64
0x28
BUG: Bad page state in process iptables  pfn:34ee59
page:fffff1a80d3b9640 count:0 mapcount:-32768 mapping:          (null) index:0x2
page flags: 0x2fffff00000000()
page dumped because: nonzero mapcount
Modules linked in: xt_physdev xt_NFLOG nfnetlink_log xt_limit xt_multiport xt_connmark veth vxlan ip6_udp_tunnel udp_tunnel ip6t_MASQUERADE nf_nat_masquerade_ipv6 nf_conntrack_netlink xt_statistic xt_nat xt_addrtype xt_nfacct xt_mark xt_comment ip6table_mangle nfnetlink_acct ip_set nf_tables_ipv6 nf_tables_ipv4 nft_chain_nat_ipv4 nft_compat nft_counter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 devlink ebtable_filter ebtables binfmt_misc tun nf_tables nfnetlink ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_filter ip6_tables iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_filter sunrpc ext4 mbcache jbd2 snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic intel_pmc_core
intel_powerclamp coretemp intel_rapl kvm_intel snd_hda_intel kvm iTCO_wdt iTCO_vendor_support ppdev snd_hda_codec snd_hda_core irqbypass snd_hwdep snd_seq crc32_pclmul snd_seq_device ghash_clmulni_intel snd_pcm aesni_intel lrw gf128mul glue_helper ablk_helper cryptd i2c_i801 pcspkr snd_timer snd sg soundcore mei_me mei parport_pc parport wmi pinctrl_sunrisepoint pinctrl_intel acpi_pad br_netfilter bridge stp llc overlay(T) ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic i915 i2c_algo_bit iosf_mbi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ahci drm libahci e1000e libata crct10dif_pclmul crct10dif_common crc32c_intel ptp serio_raw pps_core drm_panel_orientation_quirks video i2c_hid dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 14778 Comm: iptables Kdump: loaded Tainted: G    B          ------------ T 3.10.0-1127.el7.x86_64 #1
Hardware name: Gigabyte Technology Co., Ltd. Z270-HD3/Z270-HD3-CF, BIOS F5 04/07/2017
Call Trace:
[<ffffffffaef7ff85>] dump_stack+0x19/0x1b
[<ffffffffaef7ab40>] bad_page.part.75+0xdc/0xf9
[<ffffffffae9c89f5>] get_page_from_freelist+0x785/0xaa0
[<ffffffffae9f9e23>] ? __vma_adjust+0x263/0x850
[<ffffffffae9c8e76>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffae9cd29c>] ? pagevec_lru_move_fn+0x10c/0x130
[<ffffffffaea1c2a9>] alloc_pages_vma+0xa9/0x200
[<ffffffffae9f5f97>] handle_mm_fault+0xcb7/0xfb0
[<ffffffffaef8d653>] __do_page_fault+0x213/0x500
[<ffffffffaef8d975>] do_page_fault+0x35/0x90
[<ffffffffaef89778>] page_fault+0x28/0x30
Complete report #221608
Frame # Function Binary Source or offset Line
1
dump_stack
vmlinux 0xffffffffbd180faa
Build id: 3.10.0-1160.11.1.el7.x86_64
0x19
2
bad_page.part.75
vmlinux 0xffffffffbd17bb67
Build id: 3.10.0-1160.11.1.el7.x86_64
0xdc
3
get_page_from_freelist
vmlinux 0xffffffffbcbc87f5
Build id: 3.10.0-1160.11.1.el7.x86_64
0x7a5
4
? __vma_adjust
vmlinux 0xffffffffbcbf9f33
Build id: 3.10.0-1160.11.1.el7.x86_64
0x263
5
__alloc_pages_nodemask
vmlinux 0xffffffffbcbc8c76
Build id: 3.10.0-1160.11.1.el7.x86_64
0x166
6
alloc_pages_vma
vmlinux 0xffffffffbcc1c449
Build id: 3.10.0-1160.11.1.el7.x86_64
0xa9
7
handle_mm_fault
vmlinux 0xffffffffbcbf60a7
Build id: 3.10.0-1160.11.1.el7.x86_64
0xcb7
8
__do_page_fault
vmlinux 0xffffffffbd18e653
Build id: 3.10.0-1160.11.1.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffffbd18e975
Build id: 3.10.0-1160.11.1.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffffbd18a778
Build id: 3.10.0-1160.11.1.el7.x86_64
0x28
BUG: Bad page state in process java  pfn:2f9c5c
page:fffff9d90be71700 count:0 mapcount:0 mapping:0000800000000000 index:0x2
page flags: 0x2fffff00000000()
page dumped because: non-NULL mapping
Modules linked in: veth xt_nat xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc binfmt_misc overlay(T) vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod crc32_pclmul ppdev ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper sg joydev cryptd pcspkr vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod syscopyarea crc_t10dif sysfillrect crct10dif_generic sysimgblt fb_sys_fops ttm drm ahci nfit ata_piix libahci crct10dif_pclmul crct10dif_common libnvdimm libata crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks
fuse
CPU: 1 PID: 3146 Comm: java Kdump: loaded Tainted: G               ------------ T 3.10.0-1160.11.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/09/2019
Call Trace:
[<ffffffffbd180faa>] dump_stack+0x19/0x1b
[<ffffffffbd17bb67>] bad_page.part.75+0xdc/0xf9
[<ffffffffbcbc87f5>] get_page_from_freelist+0x7a5/0xac0
[<ffffffffbcbf9f33>] ? __vma_adjust+0x263/0x850
[<ffffffffbcbc8c76>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffbcc1c449>] alloc_pages_vma+0xa9/0x200
[<ffffffffbcbf60a7>] handle_mm_fault+0xcb7/0xfb0
[<ffffffffbd18e653>] __do_page_fault+0x213/0x500
[<ffffffffbd18e975>] do_page_fault+0x35/0x90
[<ffffffffbd18a778>] page_fault+0x28/0x30
Complete report #260280
Frame # Function Binary Source or offset Line
1
clear_page
vmlinux 0xffffffff8cb93872
Build id: 3.10.0-1127.el7.x86_64
0x12
2
? get_page_from_freelist
vmlinux 0xffffffff8c9c85df
Build id: 3.10.0-1127.el7.x86_64
0x36f
3
? enqueue_entity
vmlinux 0xffffffff8c8e708f
Build id: 3.10.0-1127.el7.x86_64
0x2ef
4
? check_preempt_wakeup
vmlinux 0xffffffff8c8e5fca
Build id: 3.10.0-1127.el7.x86_64
0x12a
5
__alloc_pages_nodemask
vmlinux 0xffffffff8c9c8e76
Build id: 3.10.0-1127.el7.x86_64
0x166
6
alloc_pages_vma
vmlinux 0xffffffff8ca1c2a9
Build id: 3.10.0-1127.el7.x86_64
0xa9
7
handle_mm_fault
vmlinux 0xffffffff8c9f5f97
Build id: 3.10.0-1127.el7.x86_64
0xcb7
8
__do_page_fault
vmlinux 0xffffffff8cf8d653
Build id: 3.10.0-1127.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffff8cf8d975
Build id: 3.10.0-1127.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffff8cf89778
Build id: 3.10.0-1127.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 35s! [java:1277]
Modules linked in: iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq ppdev snd_seq_device snd_pcm aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd snd_timer snd soundcore joydev sg pcspkr i2c_piix4 vmw_vmci parport_pc parport binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm serio_raw mptspi ata_piix scsi_transport_spi mptscsih e1000 libata mptbase nfit drm_panel_orientation_quirks
libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 1277 Comm: java Kdump: loaded Not tainted 3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff9658ee405230 ti: ffff9658f1f98000 task.ti: ffff9658f1f98000
RIP: 0010:[<ffffffff8cb93872>]  [<ffffffff8cb93872>] clear_page+0x12/0x40
RSP: 0000:ffff9658f1f9bbc0  EFLAGS: 00010216
RAX: 0000000000000000 RBX: 000000000000001e RCX: 000000000000003f
RDX: ffffffff8d28d260 RSI: 0000000000000000 RDI: ffff965730216000
RBP: ffff9658f1f9bcd0 R08: ffffffff8d28d24f R09: ffffc88701c085c0
R10: 0000000000003129 R11: ffff9658f3c07950 R12: ffff9658f1f9bb48
R13: ffffffff8c8e4eac R14: ffff9658f1f9bb60 R15: 0000018101c2f400
FS:  00007f4e473e7700(0000) GS:ffff9658f5640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4e473b8fe8 CR3: 0000000231f4a000 CR4: 00000000001607e0
Call Trace:
[<ffffffff8c9c85df>] ? get_page_from_freelist+0x36f/0xaa0
[<ffffffff8c8e708f>] ? enqueue_entity+0x2ef/0xbe0
[<ffffffff8c8e5fca>] ? check_preempt_wakeup+0x12a/0x220
[<ffffffff8c9c8e76>] __alloc_pages_nodemask+0x166/0x450
[<ffffffff8ca1c2a9>] alloc_pages_vma+0xa9/0x200
[<ffffffff8c9f5f97>] handle_mm_fault+0xcb7/0xfb0
[<ffffffff8cf8d653>] __do_page_fault+0x213/0x500
[<ffffffff8cf8d975>] do_page_fault+0x35/0x90
[<ffffffff8cf89778>] page_fault+0x28/0x30
Code: f3 48 ab c3 0f 1f 44 00 00 b9 00 10 00 00 31 c0 f3 aa c3 66 0f 1f 44 00 00 31 c0 b9 40 00 00 00 66 0f 1f 84 00 00 00 00 00 ff c9 <48> 89 07 48 89 47 08 48 89 47 10 48 89 47 18 48 89 47 20 48 89 
Complete report #132281
Frame # Function Binary Source or offset Line
1
clear_page
vmlinux 0xffffffffab994c32
Build id: 3.10.0-1160.15.2.el7.x86_64
0x12
2
? get_page_from_freelist
vmlinux 0xffffffffab7c835f
Build id: 3.10.0-1160.15.2.el7.x86_64
0x36f
3
? check_preempt_wakeup
vmlinux 0xffffffffab6e572a
Build id: 3.10.0-1160.15.2.el7.x86_64
0x12a
4
__alloc_pages_nodemask
vmlinux 0xffffffffab7c8c16
Build id: 3.10.0-1160.15.2.el7.x86_64
0x166
5
alloc_pages_vma
vmlinux 0xffffffffab81c449
Build id: 3.10.0-1160.15.2.el7.x86_64
0xa9
6
handle_mm_fault
vmlinux 0xffffffffab7f6047
Build id: 3.10.0-1160.15.2.el7.x86_64
0xcb7
7
? __schedule
vmlinux 0xffffffffabd87ae6
Build id: 3.10.0-1160.15.2.el7.x86_64
0x596
8
__do_page_fault
vmlinux 0xffffffffabd8f653
Build id: 3.10.0-1160.15.2.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffffabd8f975
Build id: 3.10.0-1160.15.2.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffffabd8b778
Build id: 3.10.0-1160.15.2.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 29s! [java:90481]
Modules linked in: rfcomm ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables talpa_vfshook(OE) talpa_pedconnector(OE) talpa_pedevice(OE) talpa_vcdevice(OE) talpa_core(OE) talpa_linux(OE) talpa_syscallhook(OE) iptable_filter bnep vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus iosf_mbi snd_seq btusb crc32_pclmul btrtl snd_seq_device btbcm snd_pcm btintel ghash_clmulni_intel
bluetooth snd_timer aesni_intel snd ppdev lrw gf128mul glue_helper ablk_helper cryptd rfkill soundcore vmw_balloon vmw_vmci sg joydev pcspkr i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea nfit e1000 sysfillrect sysimgblt fb_sys_fops libnvdimm ttm drm ata_piix mptspi libata scsi_transport_spi crct10dif_pclmul crct10dif_common mptscsih crc32c_intel mptbase serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 90481 Comm: java Kdump: loaded Tainted: G           OEL ------------   3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff8b7cf2fcc200 ti: ffff8b7bf2124000 task.ti: ffff8b7bf2124000
RIP: 0010:[<ffffffffab994c32>]  [<ffffffffab994c32>] clear_page+0x12/0x40
RSP: 0000:ffff8b7bf2127bc0  EFLAGS: 00010216
RAX: 0000000000000000 RBX: ffff8b7d5ffd9890 RCX: 000000000000003f
RDX: ffffffffac08e578 RSI: 0000000000000000 RDI: ffff8b7b6374d000
RBP: ffff8b7bf2127cd0 R08: ffffffffac08e567 R09: ffffdbdb028dd380
R10: 0000000000003255 R11: ffff8b7c353d51b8 R12: 0000000000000001
R13: ffffffffab6e460c R14: ffff8b7bf2127b60 R15: ffffffffab6e23c9
FS:  00007fb587dfd700(0000) GS:ffff8b7d53e80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000e0989000 CR3: 00000001feb20000 CR4: 00000000001607e0
Call Trace:
[<ffffffffab7c835f>] ? get_page_from_freelist+0x36f/0xac0
[<ffffffffab6e572a>] ? check_preempt_wakeup+0x12a/0x220
[<ffffffffab7c8c16>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffab81c449>] alloc_pages_vma+0xa9/0x200
[<ffffffffab7f6047>] handle_mm_fault+0xcb7/0xfb0
[<ffffffffabd87ae6>] ? __schedule+0x596/0x860
[<ffffffffabd8f653>] __do_page_fault+0x213/0x500
[<ffffffffabd8f975>] do_page_fault+0x35/0x90
[<ffffffffabd8b778>] page_fault+0x28/0x30
Code: f3 48 ab c3 0f 1f 44 00 00 b9 00 10 00 00 31 c0 f3 aa c3 66 0f 1f 44 00 00 31 c0 b9 40 00 00 00 66 0f 1f 84 00 00 00 00 00 ff c9 <48> 89 07 48 89 47 08 48 89 47 10 48 89 47 18 48 89 47 20 48 89 
Complete report #125473
Frame # Function Binary Source or offset Line
1
clear_page
vmlinux 0xffffffffb0394bd2
Build id: 3.10.0-1160.21.1.el7.x86_64
0x12
2
? get_page_from_freelist
vmlinux 0xffffffffb01c82ff
Build id: 3.10.0-1160.21.1.el7.x86_64
0x36f
3
? check_preempt_wakeup
vmlinux 0xffffffffb00e56ba
Build id: 3.10.0-1160.21.1.el7.x86_64
0x12a
4
__alloc_pages_nodemask
vmlinux 0xffffffffb01c8bb6
Build id: 3.10.0-1160.21.1.el7.x86_64
0x166
5
alloc_pages_vma
vmlinux 0xffffffffb021c3e9
Build id: 3.10.0-1160.21.1.el7.x86_64
0xa9
6
handle_mm_fault
vmlinux 0xffffffffb01f5fe7
Build id: 3.10.0-1160.21.1.el7.x86_64
0xcb7
7
__do_page_fault
vmlinux 0xffffffffb0790653
Build id: 3.10.0-1160.21.1.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffffb0790975
Build id: 3.10.0-1160.21.1.el7.x86_64
0x35
9
page_fault
vmlinux 0xffffffffb078c778
Build id: 3.10.0-1160.21.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [in:imjournal:1184]
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 31s! [java:10150]
Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd vmw_balloon sg pcspkr joydev parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif ata_generic crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops ttm drm mptspi scsi_transport_spi mptscsih crct10dif_pclmul ata_piix crct10dif_common libata nfit crc32c_intel mptbase serio_raw libnvdimm vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 10150 Comm: java Kdump: loaded Not tainted 3.10.0-1160.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff99f285df2100 ti: ffff99f285dfc000 task.ti: ffff99f285dfc000
RIP: 0010:[<ffffffffb0394bd2>]  [<ffffffffb0394bd2>] clear_page+0x12/0x40
RSP: 0000:ffff99f285dffbc0  EFLAGS: 00010216
RAX: 0000000000000000 RBX: ffff99f33ffda090 RCX: 000000000000003f
RDX: ffffffffb0a8e880 RSI: 0000000000000000 RDI: ffff99f26e9f2000
RBP: ffff99f285dffcd0 R08: ffffffffb0a8e86f R09: fffffe8305ba7cc0
R10: 0000000000003476 R11: ffff99f16a748798 R12: 0000000000000001
R13: ffffffffb00e459c R14: ffff99f285dffb60 R15: 0000000000000009
FS:  00007fcb802b0700(0000) GS:ffff99f33fd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fcb581d8000 CR3: 00000000879b6000 CR4: 00000000001607e0
Call Trace:
[<ffffffffb01c82ff>] ? get_page_from_freelist+0x36f/0xac0
[<ffffffffb00e56ba>] ? check_preempt_wakeup+0x12a/0x220
[<ffffffffb01c8bb6>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffb021c3e9>] alloc_pages_vma+0xa9/0x200
[<ffffffffb01f5fe7>] handle_mm_fault+0xcb7/0xfb0
[<ffffffffb0790653>] __do_page_fault+0x213/0x500
[<ffffffffb0790975>] do_page_fault+0x35/0x90
[<ffffffffb078c778>] page_fault+0x28/0x30
Complete report #21008
Frame # Function Binary Source or offset Line
1
clear_page
vmlinux 0xffffffffb8793972
Build id: 3.10.0-1127.19.1.el7.x86_64
0x12
2
? get_page_from_freelist
vmlinux 0xffffffffb85c868f
Build id: 3.10.0-1127.19.1.el7.x86_64
0x36f
3
? check_preempt_wakeup
vmlinux 0xffffffffb84e5fca
Build id: 3.10.0-1127.19.1.el7.x86_64
0x12a
4
__alloc_pages_nodemask
vmlinux 0xffffffffb85c8f26
Build id: 3.10.0-1127.19.1.el7.x86_64
0x166
5
alloc_pages_vma
vmlinux 0xffffffffb861c339
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa9
6
handle_mm_fault
vmlinux 0xffffffffb85f6017
Build id: 3.10.0-1127.19.1.el7.x86_64
0xcb7
7
__do_page_fault
vmlinux 0xffffffffb8b8d653
Build id: 3.10.0-1127.19.1.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffffb8b8d975
Build id: 3.10.0-1127.19.1.el7.x86_64
0x35
9
? error_swapgs
vmlinux 0xffffffffb8b89ac9
Build id: 3.10.0-1127.19.1.el7.x86_64
0xaa
10
page_fault
vmlinux 0xffffffffb8b89778
Build id: 3.10.0-1127.19.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 34s! [npm:9922]
Modules linked in: veth ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd sg vmw_balloon joydev pcspkr i2c_piix4 parport_pc parport vmw_vmci ip_tables xfs libcrc32c sr_mod
cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw mptspi scsi_transport_spi mptscsih vmxnet3 mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 9922 Comm: npm Kdump: loaded Tainted: G             L ------------ T 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
task: ffff9073baf21070 ti: ffff9075d6588000 task.ti: ffff9075d6588000
RIP: 0010:[<ffffffffb8793972>]  [<ffffffffb8793972>] clear_page+0x12/0x40
RSP: 0000:ffff9075d658bbc0  EFLAGS: 00010216
RAX: 0000000000000000 RBX: 000000000000001e RCX: 000000000000003f
RDX: ffffffffb8e8d5a0 RSI: 0000000000000000 RDI: ffff9076247ea000
RBP: ffff9075d658bcd0 R08: ffffffffb8e8d58f R09: ffffdc9dcc91fac0
R10: 00000000000043b5 R11: ffff9074005d4a20 R12: ffff9075d658bb48
R13: ffff9075d658bb38 R14: ffff9073baf21070 R15: ffff90747a292c00
FS:  00007f71f5781740(0000) GS:ffff90773fc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000011c17ddd000 CR3: 0000000109c52000 CR4: 00000000000407e0
Call Trace:
[<ffffffffb85c868f>] ? get_page_from_freelist+0x36f/0xaa0
[<ffffffffb84e5fca>] ? check_preempt_wakeup+0x12a/0x220
[<ffffffffb85c8f26>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffb861c339>] alloc_pages_vma+0xa9/0x200
[<ffffffffb85f6017>] handle_mm_fault+0xcb7/0xfb0
[<ffffffffb8b8d653>] __do_page_fault+0x213/0x500
[<ffffffffb8b8d975>] do_page_fault+0x35/0x90
[<ffffffffb8b89ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffb8b89778>] page_fault+0x28/0x30
Code: f3 48 ab c3 0f 1f 44 00 00 b9 00 10 00 00 31 c0 f3 aa c3 66 0f 1f 44 00 00 31 c0 b9 40 00 00 00 66 0f 1f 84 00 00 00 00 00 ff c9 <48> 89 07 48 89 47 08 48 89 47 10 48 89 47 18 48 89 47 20 48 89 
Complete report #914709
Frame # Function Binary Source or offset Line
1
clear_page
vmlinux 0xffffffff9c794752
Build id: 3.10.0-1160.el7.x86_64
0x12
2
? get_page_from_freelist
vmlinux 0xffffffff9c5c81ef
Build id: 3.10.0-1160.el7.x86_64
0x36f
3
? kmem_cache_free
vmlinux 0xffffffff9c626642
Build id: 3.10.0-1160.el7.x86_64
0x1e2
4
? __vma_adjust
vmlinux 0xffffffff9c5fa229
Build id: 3.10.0-1160.el7.x86_64
0x739
5
__alloc_pages_nodemask
vmlinux 0xffffffff9c5c8aa6
Build id: 3.10.0-1160.el7.x86_64
0x166
6
alloc_pages_vma
vmlinux 0xffffffff9c61c269
Build id: 3.10.0-1160.el7.x86_64
0xa9
7
handle_mm_fault
vmlinux 0xffffffff9c5f5ec7
Build id: 3.10.0-1160.el7.x86_64
0xcb7
8
__do_page_fault
vmlinux 0xffffffff9cb8e653
Build id: 3.10.0-1160.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffff9cb8e975
Build id: 3.10.0-1160.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffff9cb8a778
Build id: 3.10.0-1160.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [java:9245]
Modules linked in: vsock_diag tcp_diag udp_diag inet_diag unix_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event nls_utf8 isofs snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus sg snd_seq crc32_pclmul ppdev ghash_clmulni_intel snd_seq_device snd_pcm aesni_intel snd_timer lrw gf128mul glue_helper ablk_helper snd vmw_balloon soundcore cryptd joydev pcspkr parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul ata_piix drm crct10dif_common crc32c_intel mptspi scsi_transport_spi mptscsih libata serio_raw nfit e1000 libnvdimm mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 9245 Comm: java Kdump: loaded Tainted: G             L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9f3496b06300 ti: ffff9f33f6444000 task.ti: ffff9f33f6444000
RIP: 0010:[<ffffffff9c794752>]  [<ffffffff9c794752>] clear_page+0x12/0x40
RSP: 0000:ffff9f33f6447bc0  EFLAGS: 00010216
RAX: 0000000000000000 RBX: ffff9f33f6447bf0 RCX: 000000000000003f
RDX: ffffffff9ce8e488 RSI: 0000000000000000 RDI: ffff9f33b10df000
RBP: ffff9f33f6447cd0 R08: ffffffff9ce8e477 R09: ffffeda3c8c43800
R10: 00000000000043b2 R11: ffff9f3496beebd0 R12: ffff9f32ffc07b00
R13: 000000000040003f R14: 0000000000000000 R15: ffff9f34f251e7f8
FS:  00007f63ff8fc700(0000) GS:ffff9f35ad6c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f63ff8efa18 CR3: 000000037251e000 CR4: 00000000003607e0
Call Trace:
[<ffffffff9c5c81ef>] ? get_page_from_freelist+0x36f/0xac0
[<ffffffff9c626642>] ? kmem_cache_free+0x1e2/0x200
[<ffffffff9c5fa229>] ? __vma_adjust+0x739/0x850
[<ffffffff9c5c8aa6>] __alloc_pages_nodemask+0x166/0x450
[<ffffffff9c61c269>] alloc_pages_vma+0xa9/0x200
[<ffffffff9c5f5ec7>] handle_mm_fault+0xcb7/0xfb0
[<ffffffff9cb8e653>] __do_page_fault+0x213/0x500
[<ffffffff9cb8e975>] do_page_fault+0x35/0x90
[<ffffffff9cb8a778>] page_fault+0x28/0x30
Code: f3 48 ab c3 0f 1f 44 00 00 b9 00 10 00 00 31 c0 f3 aa c3 66 0f 1f 44 00 00 31 c0 b9 40 00 00 00 66 0f 1f 84 00 00 00 00 00 ff c9 <48> 89 07 48 89 47 08 48 89 47 10 48 89 47 18 48 89 47 20 48 89 
Complete report #396807
Frame # Function Binary Source or offset Line
1
clear_page
vmlinux 0xffffffffaf394d02
Build id: 3.10.0-1160.24.1.el7.x86_64
0x12
2
? get_page_from_freelist
vmlinux 0xffffffffaf1c840f
Build id: 3.10.0-1160.24.1.el7.x86_64
0x36f
3
? kmem_cache_free
vmlinux 0xffffffffaf2268f2
Build id: 3.10.0-1160.24.1.el7.x86_64
0x1e2
4
? __vma_adjust
vmlinux 0xffffffffaf1fa479
Build id: 3.10.0-1160.24.1.el7.x86_64
0x739
5
__alloc_pages_nodemask
vmlinux 0xffffffffaf1c8cc6
Build id: 3.10.0-1160.24.1.el7.x86_64
0x166
6
alloc_pages_vma
vmlinux 0xffffffffaf21c519
Build id: 3.10.0-1160.24.1.el7.x86_64
0xa9
7
handle_mm_fault
vmlinux 0xffffffffaf1f6117
Build id: 3.10.0-1160.24.1.el7.x86_64
0xcb7
8
__do_page_fault
vmlinux 0xffffffffaf790653
Build id: 3.10.0-1160.24.1.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffffaf790975
Build id: 3.10.0-1160.24.1.el7.x86_64
0x35
10
? error_swapgs
vmlinux 0xffffffffaf78cac9
Build id: 3.10.0-1160.24.1.el7.x86_64
0xaa
11
page_fault
vmlinux 0xffffffffaf78c778
Build id: 3.10.0-1160.24.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [2_scheduler:3856]
Modules linked in: veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper vmw_balloon ppdev cryptd sg pcspkr joydev parport_pc vmw_vmci i2c_piix4
parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sd_mod sysimgblt fb_sys_fops ttm crc_t10dif crct10dif_generic drm ata_piix libata crct10dif_pclmul crct10dif_common serio_raw crc32c_intel vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 3856 Comm: 2_scheduler Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.24.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff9fbdf67ae300 ti: ffff9fbd1c06c000 task.ti: ffff9fbd1c06c000
RIP: 0010:[<ffffffffaf394d02>]  [<ffffffffaf394d02>] clear_page+0x12/0x40
RSP: 0000:ffff9fbd1c06fbc0  EFLAGS: 00010216
RAX: 0000000000000000 RBX: ffff9fbd1c06fbf0 RCX: 000000000000003f
RDX: ffffffffafa8e8a0 RSI: 0000000000000000 RDI: ffff9fbd12768000
RBP: ffff9fbd1c06fcd0 R08: ffffffffafa8e88f R09: fffff210c249da40
R10: 000000000000b613 R11: ffff9fc3a3101cb0 R12: ffff9fbdcc3ad900
R13: ffff9fbdcc3ad900 R14: 000000000000004b R15: ffff9fc8c509ad40
FS:  00007f0a4efff700(0000) GS:ffff9fc8c5080000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0a43b02010 CR3: 0000000034eb8000 CR4: 00000000000007e0
Call Trace:
[<ffffffffaf1c840f>] ? get_page_from_freelist+0x36f/0xac0
[<ffffffffaf2268f2>] ? kmem_cache_free+0x1e2/0x200
[<ffffffffaf1fa479>] ? __vma_adjust+0x739/0x850
[<ffffffffaf1c8cc6>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffaf21c519>] alloc_pages_vma+0xa9/0x200
[<ffffffffaf1f6117>] handle_mm_fault+0xcb7/0xfb0
[<ffffffffaf790653>] __do_page_fault+0x213/0x500
[<ffffffffaf790975>] do_page_fault+0x35/0x90
[<ffffffffaf78cac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffaf78c778>] page_fault+0x28/0x30
Code: f3 48 ab c3 0f 1f 44 00 00 b9 00 10 00 00 31 c0 f3 aa c3 66 0f 1f 44 00 00 31 c0 b9 40 00 00 00 66 0f 1f 84 00 00 00 00 00 ff c9 <48> 89 07 48 89 47 08 48 89 47 10 48 89 47 18 48 89 47 20 48 89 
Complete report #166262
Frame # Function Binary Source or offset Line
1
clear_page
vmlinux 0xffffffffb8793932
Build id: 3.10.0-1127.18.2.el7.x86_64
0x12
2
? get_page_from_freelist
vmlinux 0xffffffffb85c868f
Build id: 3.10.0-1127.18.2.el7.x86_64
0x36f
3
? __vma_adjust
vmlinux 0xffffffffb85f9ea3
Build id: 3.10.0-1127.18.2.el7.x86_64
0x263
4
__alloc_pages_nodemask
vmlinux 0xffffffffb85c8f26
Build id: 3.10.0-1127.18.2.el7.x86_64
0x166
5
alloc_pages_vma
vmlinux 0xffffffffb861c339
Build id: 3.10.0-1127.18.2.el7.x86_64
0xa9
6
handle_mm_fault
vmlinux 0xffffffffb85f6017
Build id: 3.10.0-1127.18.2.el7.x86_64
0xcb7
7
__do_page_fault
vmlinux 0xffffffffb8b8d653
Build id: 3.10.0-1127.18.2.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffffb8b8d975
Build id: 3.10.0-1127.18.2.el7.x86_64
0x35
9
? error_swapgs
vmlinux 0xffffffffb8b89ac9
Build id: 3.10.0-1127.18.2.el7.x86_64
0xaa
10
page_fault
vmlinux 0xffffffffb8b89778
Build id: 3.10.0-1127.18.2.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 57s! [setroubleshootd:83115]
INFO: rcu_sched detected stalls on CPUs/tasks: { 5} 
Modules linked in:
fuse xt_CHECKSUM devlink tun ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_addrtype br_netfilter ip_vs ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock overlay(T) sunrpc sb_edac iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul sg ppdev glue_helper joydev vmxnet3 pcspkr ablk_helper cryptd parport_pc parport vmw_balloon vmw_vmci i2c_piix4 ip_tables
xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix nfit crct10dif_pclmul crct10dif_common drm crc32c_intel libata mptspi libnvdimm serio_raw scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 6 PID: 83115 Comm: setroubleshootd Kdump: loaded Tainted: G             L ------------ T 3.10.0-1127.18.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8f96a95ce2a0 ti: ffff8f982e244000 task.ti: ffff8f982e244000
RIP: 0010:[<ffffffffb8793932>]  [<ffffffffb8793932>] clear_page+0x12/0x40
RSP: 0000:ffff8f982e247bc0  EFLAGS: 00010216
RAX: 0000000000000000 RBX: ffff8f983ffd5890 RCX: 000000000000003f
RDX: ffffffffb8e8d638 RSI: 0000000000000000 RDI: ffff8f961db98000
RBP: ffff8f982e247cd0 R08: ffffffffb8e8d627 R09: fffff2968076e640
R10: 0000000000003148 R11: ffff8f97faba1cb0 R12: 0000000000000001
R13: ffff8f96bac2e0d8 R14: ffffffffb8b8d678 R15: ffff8f982e247b88
FS:  00007f2a0c5b4740(0000) GS:ffff8f9835780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f29fc73b024 CR3: 000000021468a000 CR4: 00000000000607e0
Call Trace:
[<ffffffffb85c868f>] ? get_page_from_freelist+0x36f/0xaa0
[<ffffffffb85f9ea3>] ? __vma_adjust+0x263/0x850
[<ffffffffb85c8f26>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffb861c339>] alloc_pages_vma+0xa9/0x200
[<ffffffffb85f6017>] handle_mm_fault+0xcb7/0xfb0
[<ffffffffb8b8d653>] __do_page_fault+0x213/0x500
[<ffffffffb8b8d975>] do_page_fault+0x35/0x90
[<ffffffffb8b89ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffb8b89778>] page_fault+0x28/0x30
Code: f3 48 ab c3 0f 1f 44 00 00 b9 00 10 00 00 31 c0 f3 aa c3 66 0f 1f 44 00 00 31 c0 b9 40 00 00 00 66 0f 1f 84 00 00 00 00 00 ff c9 <48> 89 07 48 89 47 08 48 89 47 10 48 89 47 18 48 89 47 20 48 89 
Complete report #19257
Frame # Function Binary Source or offset Line
1
clear_page
vmlinux 0xffffffff87d93932
Build id: 3.10.0-1127.13.1.el7.x86_64
0x12
2
? get_page_from_freelist
vmlinux 0xffffffff87bc863f
Build id: 3.10.0-1127.13.1.el7.x86_64
0x36f
3
? __vma_adjust
vmlinux 0xffffffff87bfa1ba
Build id: 3.10.0-1127.13.1.el7.x86_64
0x59a
4
__alloc_pages_nodemask
vmlinux 0xffffffff87bc8ed6
Build id: 3.10.0-1127.13.1.el7.x86_64
0x166
5
alloc_pages_vma
vmlinux 0xffffffff87c1c309
Build id: 3.10.0-1127.13.1.el7.x86_64
0xa9
6
handle_mm_fault
vmlinux 0xffffffff87bf5ff7
Build id: 3.10.0-1127.13.1.el7.x86_64
0xcb7
7
? mprotect_fixup
vmlinux 0xffffffff87bfe499
Build id: 3.10.0-1127.13.1.el7.x86_64
0x1b9
8
__do_page_fault
vmlinux 0xffffffff8818d653
Build id: 3.10.0-1127.13.1.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffff8818d975
Build id: 3.10.0-1127.13.1.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffff88189778
Build id: 3.10.0-1127.13.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#8 stuck for 42s! [gnome-shell:3697]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr ppdev joydev vmw_balloon sg parport_pc parport vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi ata_piix scsi_transport_spi mptscsih libata crct10dif_pclmul
crct10dif_common crc32c_intel mptbase e1000 serio_raw drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 8 PID: 3697 Comm: gnome-shell Kdump: loaded Tainted: G             L ------------   3.10.0-1127.13.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
task: ffff8bad0794c1c0 ti: ffff8bad43584000 task.ti: ffff8bad43584000
RIP: 0010:[<ffffffff87d93932>]  [<ffffffff87d93932>] clear_page+0x12/0x40
RSP: 0000:ffff8bad43587bc0  EFLAGS: 00010216
RAX: 0000000000000000 RBX: 00003c4c36f0a000 RCX: 000000000000003f
RDX: ffffffff8848d4f0 RSI: 0000000000000000 RDI: ffff8bb1a3ce8000
RBP: ffff8bad43587cd0 R08: ffffffff8848d4df R09: fffff681938f3a40
R10: 00000000000026cb R11: fffffffffffffff8 R12: ffff8bacd5350988
R13: 00003c4c36f0a000 R14: 00003c4c36f09fff R15: ffff8baccdf863c8
FS:  00007f642e9c1a80(0000) GS:ffff8badfb600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00003c4c36efb000 CR3: 000000000df86000 CR4: 00000000001607e0
Call Trace:
[<ffffffff87bc863f>] ? get_page_from_freelist+0x36f/0xaa0
[<ffffffff87bfa1ba>] ? __vma_adjust+0x59a/0x850
[<ffffffff87bc8ed6>] __alloc_pages_nodemask+0x166/0x450
[<ffffffff87c1c309>] alloc_pages_vma+0xa9/0x200
[<ffffffff87bf5ff7>] handle_mm_fault+0xcb7/0xfb0
[<ffffffff87bfe499>] ? mprotect_fixup+0x1b9/0x3a0
[<ffffffff8818d653>] __do_page_fault+0x213/0x500
[<ffffffff8818d975>] do_page_fault+0x35/0x90
[<ffffffff88189778>] page_fault+0x28/0x30
Code: f3 48 ab c3 0f 1f 44 00 00 b9 00 10 00 00 31 c0 f3 aa c3 66 0f 1f 44 00 00 31 c0 b9 40 00 00 00 66 0f 1f 84 00 00 00 00 00 ff c9 <48> 89 07 48 89 47 08 48 89 47 10 48 89 47 18 48 89 47 20 48 89 
Complete report #11331
Frame # Function Binary Source or offset Line
1
clear_page
vmlinux 0xffffffffb9193932
Build id: 3.10.0-1127.18.2.el7.x86_64
0x12
2
? get_page_from_freelist
vmlinux 0xffffffffb8fc868f
Build id: 3.10.0-1127.18.2.el7.x86_64
0x36f
3
? __vma_adjust
vmlinux 0xffffffffb8ff9ea3
Build id: 3.10.0-1127.18.2.el7.x86_64
0x263
4
__alloc_pages_nodemask
vmlinux 0xffffffffb8fc8f26
Build id: 3.10.0-1127.18.2.el7.x86_64
0x166
5
alloc_pages_vma
vmlinux 0xffffffffb901c339
Build id: 3.10.0-1127.18.2.el7.x86_64
0xa9
6
handle_mm_fault
vmlinux 0xffffffffb8ff6017
Build id: 3.10.0-1127.18.2.el7.x86_64
0xcb7
7
__do_page_fault
vmlinux 0xffffffffb958d653
Build id: 3.10.0-1127.18.2.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffffb958d975
Build id: 3.10.0-1127.18.2.el7.x86_64
0x35
9
page_fault
vmlinux 0xffffffffb9589778
Build id: 3.10.0-1127.18.2.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [grep:24104]
Modules linked in: veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter overlay(T) fuse vmw_vsock_vmci_transport vmw_vmci vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac ppdev iosf_mbi crc32_pclmul snd_ens1371 snd_rawmidi ghash_clmulni_intel snd_ac97_codec ac97_bus vmw_balloon snd_seq aesni_intel snd_seq_device snd_pcm lrw gf128mul glue_helper ablk_helper cryptd snd_timer pcspkr joydev snd soundcore sg i2c_piix4 parport_pc parport btrfs raid6_pq xor vfat fat ext4 mbcache jbd2 replicator(OE) binfmt_misc
ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea nfit sysfillrect sysimgblt fb_sys_fops ata_piix ttm libnvdimm libata drm crct10dif_pclmul crct10dif_common crc32c_intel mptspi scsi_transport_spi mptscsih mptbase e1000 serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 24104 Comm: grep Tainted: G           OEL ------------ T 3.10.0-1127.18.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff94181fdf8000 ti: ffff94194e11c000 task.ti: ffff94194e11c000
RIP: 0010:[<ffffffffb9193932>]  [<ffffffffb9193932>] clear_page+0x12/0x40
RSP: 0000:ffff94194e11fbc0  EFLAGS: 00010216
RAX: 0000000000000000 RBX: 0000000000000030 RCX: 000000000000003f
RDX: ffffffffb988d638 RSI: 0000000000000000 RDI: ffff941909a4e000
RBP: ffff94194e11fcd0 R08: ffffffffb988d627 R09: ffffcd30c62693c0
R10: 0000000000003386 R11: ffff941959fb56c8 R12: ffff9419bffd7000
R13: 0000000000000000 R14: 00007f250e2d6fff R15: ffff9419000001c1
FS:  0000000000000000(0000) GS:ffff9419b5600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f250eb0c000 CR3: 00000001f9778000 CR4: 00000000001607f0
Call Trace:
[<ffffffffb8fc868f>] ? get_page_from_freelist+0x36f/0xaa0
[<ffffffffb8ff9ea3>] ? __vma_adjust+0x263/0x850
[<ffffffffb8fc8f26>] __alloc_pages_nodemask+0x166/0x450
[<ffffffffb901c339>] alloc_pages_vma+0xa9/0x200
[<ffffffffb8ff6017>] handle_mm_fault+0xcb7/0xfb0
[<ffffffffb958d653>] __do_page_fault+0x213/0x500
[<ffffffffb958d975>] do_page_fault+0x35/0x90
[<ffffffffb9589778>] page_fault+0x28/0x30
Code: f3 48 ab c3 0f 1f 44 00 00 b9 00 10 00 00 31 c0 f3 aa c3 66 0f 1f 44 00 00 31 c0 b9 40 00 00 00 66 0f 1f 84 00 00 00 00 00 ff c9 <48> 89 07 48 89 47 08 48 89 47 10 48 89 47 18 48 89 47 20 48 89