Info

Permalink
Function
copy_page
First occurrence
2020-09-25
Last occurrence
2024-04-12
State
NEW
Components
kernel
Quality
-19

Statistics

Operating system Count
CentOS 7 227
Architecture Count
x86_64 227
Related packages Count
kernel 227
 0:3.10.0-1160.el7 22
 0:3.10.0-1127.19.1.el7 20
 0:3.10.0-1160.81.1.el7 20
 0:3.10.0-1160.76.1.el7 15
 0:3.10.0-957.el7 13
 0:3.10.0-1160.6.1.el7 12
 0:3.10.0-1160.53.1.el7 9
 0:3.10.0-862.2.3.el7 7
 0:3.10.0-1160.36.2.el7 7
 0:3.10.0-1160.25.1.el7 7
 0:3.10.0-1160.92.1.el7 7
 0:3.10.0-862.el7 6
 0:3.10.0-1160.83.1.el7 6
 0:3.10.0-957.21.3.el7 6
 0:3.10.0-957.1.3.el7 5
 0:3.10.0-1127.el7 4
 0:3.10.0-1160.88.1.el7 4
 0:3.10.0-1062.el7 4
 0:3.10.0-957.12.2.el7 3
 0:3.10.0-1127.13.1.el7 3
 0:3.10.0-1160.31.1.el7 3
 0:3.10.0-1160.45.1.el7 3
 0:3.10.0-1062.18.1.el7 3
 0:3.10.0-1127.10.1.el7 3
 0:3.10.0-1160.15.2.el7 3
 0:3.10.0-1160.11.1.el7 2
 0:3.10.0-1160.49.1.el7 2
 0:3.10.0-1160.66.1.el7 2
 0:3.10.0-1160.71.1.el7 2
 0:3.10.0-1160.62.1.el7 2
 0:3.10.0-1160.41.1.el7 2
 0:3.10.0-957.27.2.el7 2
 0:3.10.0-1062.1.1.el7 2
 0:3.10.0-1062.9.1.el7 2
 0:3.10.0-1062.12.1.el7 2
 0:3.10.0-957.12.1.el7 1
 0:3.10.0-1127.18.2.el7 1
 0:3.10.0-1160.108.1.el7 1
 0:3.10.0-1160.59.1.el7 1
 0:3.10.0-1160.118.1.el7 1
 0:3.10.0-1160.21.1.el7 1
 0:3.10.0-1160.42.2.el7 1
 0:3.10.0-1160.2.2.el7 1
 0:3.10.0-1160.90.1.el7 1
 0:3.10.0-1062.1.2.el7 1
 0:3.10.0-1160.80.1.el7 1
 0:3.10.0-1160.102.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #917351
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff83fab7c9
Build id: 3.10.0-1160.102.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff83dfb449
Build id: 3.10.0-1160.102.1.el7.x86_64
0x119
3
do_wp_page
vmlinux 0xffffffff83dfdb6b
Build id: 3.10.0-1160.102.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff83dc90fb
Build id: 3.10.0-1160.102.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff83dfa869
Build id: 3.10.0-1160.102.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff83e0228a
Build id: 3.10.0-1160.102.1.el7.x86_64
0xb3a
7
__do_page_fault
vmlinux 0xffffffff843bf7d3
Build id: 3.10.0-1160.102.1.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffff843bfb05
Build id: 3.10.0-1160.102.1.el7.x86_64
0x35
9
page_fault
vmlinux 0xffffffff843bb7b8
Build id: 3.10.0-1160.102.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 26s! [beam.smp:45652]
Modules linked in: binfmt_misc ipt_rpfilter xt_multiport xt_set iptable_raw ip_set_hash_ip ip_set_hash_net ip_set vxlan ip6_udp_tunnel udp_tunnel ipt_REJECT nf_reject_ipv4 ip6t_MASQUERADE nf_nat_masquerade_ipv6 xt_mark xt_comment ip6table_filter ip6table_mangle iptable_mangle ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables nf_tables veth xt_nat xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat xt_addrtype iptable_filter br_netfilter bridge stp llc overlay(T) ip_vs nf_conntrack vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi sb_edac snd_ac97_codec ac97_bus btusb btrtl ppdev iosf_mbi btbcm snd_seq crc32_pclmul btintel ghash_clmulni_intel
vmw_balloon snd_seq_device bluetooth snd_pcm aesni_intel lrw gf128mul glue_helper snd_timer ablk_helper cryptd snd joydev rfkill pcspkr sg soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul ata_piix crct10dif_common drm nfit crc32c_intel nvme libata e1000 serio_raw libnvdimm nvme_core drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod synosnap(OE)
CPU: 6 PID: 45652 Comm: beam.smp Kdump: loaded Tainted: G        W  OEL ------------ T 3.10.0-1160.102.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff96ef47b2c200 ti: ffff96f613d20000 task.ti: ffff96f613d20000
RIP: 0010:[<ffffffff83fab7c9>]  [<ffffffff83fab7c9>] copy_page+0x49/0xe0
RSP: 0000:ffff96f613d23cc0  EFLAGS: 00010206
RAX: 00007fa62b7c0460 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff96f49f7fd000 RDI: ffff96f17968e000
RBP: ffff96f613d23d38 R08: 0000000000000000 R09: 00007fa62b7c26e0
R10: 0000000000000000 R11: 0000000000000000 R12: 0000000080e9c157
R13: ffff96f613d23c80 R14: 0000000000000000 R15: ffff96efb49298a0
FS:  00007fa674697740(0000) GS:ffff96f65d780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa62b7aa1d0 CR3: 0000000609ea8000 CR4: 00000000003607e0
Call Trace:
[<ffffffff83dfb449>] ? wp_page_copy.isra.73+0x119/0x5d0
[<ffffffff83dfdb6b>] do_wp_page+0xfb/0x730
[<ffffffff83dc90fb>] ? unlock_page+0x2b/0x40
[<ffffffff83dfa869>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff83e0228a>] handle_mm_fault+0xb3a/0x1190
[<ffffffff843bf7d3>] __do_page_fault+0x213/0x510
[<ffffffff843bfb05>] do_page_fault+0x35/0x90
[<ffffffff843bb7b8>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #864169
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffbab90429
Build id: 3.10.0-1062.18.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffffba9ed000
Build id: 3.10.0-1062.18.1.el7.x86_64
0x120
3
? __wake_up
vmlinux 0xffffffffba8d3a33
Build id: 3.10.0-1062.18.1.el7.x86_64
0x13
4
do_wp_page
vmlinux 0xffffffffba9ef63b
Build id: 3.10.0-1062.18.1.el7.x86_64
0xfb
5
? unlock_page
vmlinux 0xffffffffba9bdbfb
Build id: 3.10.0-1062.18.1.el7.x86_64
0x2b
6
? do_read_fault.isra.63
vmlinux 0xffffffffba9ec459
Build id: 3.10.0-1062.18.1.el7.x86_64
0x139
7
handle_mm_fault
vmlinux 0xffffffffba9f3cd2
Build id: 3.10.0-1062.18.1.el7.x86_64
0xb22
8
__do_page_fault
vmlinux 0xffffffffbaf88653
Build id: 3.10.0-1062.18.1.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffffbaf88975
Build id: 3.10.0-1062.18.1.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffffbaf84778
Build id: 3.10.0-1062.18.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 28s! [s1-orchestrator:6489]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nls_utf8 cifs ccm dns_resolver ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac ppdev iosf_mbi crc32_pclmul vmw_balloon ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg pcspkr joydev parport_pc parport vmw_vmci i2c_piix4 binfmt_misc ip_tables xfs libcrc32c
sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit drm crct10dif_pclmul ata_piix crct10dif_common crc32c_intel serio_raw libnvdimm vmxnet3 libata vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 6489 Comm: s1-orchestrator Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9b3af8ba3150 ti: ffff9b37552a0000 task.ti: ffff9b37552a0000
RIP: 0010:[<ffffffffbab90429>]  [<ffffffffbab90429>] copy_page+0x49/0xe0
RSP: 0000:ffff9b37552a3cc0  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 6b5f6d7261736964 RSI: ffff9b3b0ea3e000 RDI: ffff9b3b60455000
RBP: ffff9b37552a3d38 R08: 6b5f7365626f7270 R09: 0000006f2e6e7265
R10: 0000000000000071 R11: 0000000000000000 R12: 000000003b8bd9aa
R13: ffffffffba9cc78c R14: ffff9b3b7ffd8000 R15: ffff9b3b7ffd9000
FS:  00007f8134444c40(0000) GS:ffff9b3b7fd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000632cce0 CR3: 000000036d2a8000 CR4: 00000000001607e0
Call Trace:
[<ffffffffba9ed000>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffffba8d3a33>] ? __wake_up+0x13/0x20
[<ffffffffba9ef63b>] do_wp_page+0xfb/0x720
[<ffffffffba9bdbfb>] ? unlock_page+0x2b/0x30
[<ffffffffba9ec459>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffffba9f3cd2>] handle_mm_fault+0xb22/0xfb0
[<ffffffffbaf88653>] __do_page_fault+0x213/0x500
[<ffffffffbaf88975>] do_page_fault+0x35/0x90
[<ffffffffbaf84778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #821290
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffbd783e79
Build id: 3.10.0-957.el7.x86_64
0x49
2
? wp_page_copy.isra.71
vmlinux 0xffffffffbd5e53d1
Build id: 3.10.0-957.el7.x86_64
0x121
3
do_wp_page
vmlinux 0xffffffffbd5e782b
Build id: 3.10.0-957.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffbd5b64fb
Build id: 3.10.0-957.el7.x86_64
0x2b
5
? do_read_fault.isra.61
vmlinux 0xffffffffbd5e4879
Build id: 3.10.0-957.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffffbd5e91bd
Build id: 3.10.0-957.el7.x86_64
0x37d
7
? do_proc_douintvec_conv
vmlinux 0xffffffffbd4a3380
Build id: 3.10.0-957.el7.x86_64
0x40
8
handle_mm_fault
vmlinux 0xffffffffbd5ebc6d
Build id: 3.10.0-957.el7.x86_64
0x39d
9
__do_page_fault
vmlinux 0xffffffffbdb6f5e3
Build id: 3.10.0-957.el7.x86_64
0x203
10
do_page_fault
vmlinux 0xffffffffbdb6f915
Build id: 3.10.0-957.el7.x86_64
0x35
11
page_fault
vmlinux 0xffffffffbdb6b758
Build id: 3.10.0-957.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [sshd:84309]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev snd_seq_midi snd_seq_midi_event vmw_balloon pcspkr joydev snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd soundcore sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel
serio_raw ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi e1000 scsi_transport_spi libata mptscsih mptbase drm_panel_orientation_quirks nfit libnvdimm
CPU: 0 PID: 84309 Comm: sshd Kdump: loaded Tainted: G             L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff967ef482a080 ti: ffff967e1efdc000 task.ti: ffff967e1efdc000
RIP: 0010:[<ffffffffbd783e79>]  [<ffffffffbd783e79>] copy_page+0x49/0xe0
RSP: 0000:ffff967e1efdfc48  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff967e4d964000 RDI: ffff967ee3c8c000
RBP: ffff967e1efdfcc0 R08: 000055fa66be08f0 R09: 000055fa66be07b0
R10: 0000000000000000 R11: 0000000000000000 R12: 00000000f10c278e
R13: ffff967e1efdfc18 R14: 0000000000000000 R15: ffff967efffd8000
FS:  00007fb3ecc5e8c0(0000) GS:ffff967ef9600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb3ea144190 CR3: 00000000618f6000 CR4: 00000000003607f0
Call Trace:
[<ffffffffbd5e53d1>] ? wp_page_copy.isra.71+0x121/0x560
[<ffffffffbd5e782b>] do_wp_page+0xfb/0x720
[<ffffffffbd5b64fb>] ? unlock_page+0x2b/0x30
[<ffffffffbd5e4879>] ? do_read_fault.isra.61+0x139/0x1b0
[<ffffffffbd5e91bd>] handle_pte_fault+0x37d/0xd10
[<ffffffffbd4a3380>] ? do_proc_douintvec_conv+0x40/0x40
[<ffffffffbd5ebc6d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffbdb6f5e3>] __do_page_fault+0x203/0x500
[<ffffffffbdb6f915>] do_page_fault+0x35/0x90
[<ffffffffbdb6b758>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #789985
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff9dd94f59
Build id: 3.10.0-1160.25.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff9dbef2d0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff9dbf190b
Build id: 3.10.0-1160.25.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff9dbbe20b
Build id: 3.10.0-1160.25.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff9dbee729
Build id: 3.10.0-1160.25.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff9dbf5f82
Build id: 3.10.0-1160.25.1.el7.x86_64
0xb22
7
__do_page_fault
vmlinux 0xffffffff9e190653
Build id: 3.10.0-1160.25.1.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffff9e190975
Build id: 3.10.0-1160.25.1.el7.x86_64
0x35
9
page_fault
vmlinux 0xffffffff9e18c778
Build id: 3.10.0-1160.25.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 21s! [ksmtuned:67004]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter mfe_aac_100713183(OE) vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd vmw_balloon pcspkr joydev sg parport_pc parport i2c_piix4 vmw_vmci binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper nfit syscopyarea sysfillrect sysimgblt fb_sys_fops ttm libnvdimm crct10dif_pclmul ata_piix crct10dif_common crc32c_intel ahci
drm libahci serio_raw libata vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: mfe_fileaccess_100713183]
CPU: 3 PID: 67004 Comm: ksmtuned Tainted: G           OEL ------------   3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff89d4e9dee300 ti: ffff89d2a505c000 task.ti: ffff89d2a505c000
RIP: 0010:[<ffffffff9dd94f59>]  [<ffffffff9dd94f59>] copy_page+0x49/0xe0
RSP: 0000:ffff89d2a505fcc0  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff89d2c7dc5000 RDI: ffff89d4c8002000
RBP: ffff89d2a505fd38 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: 0000000013a95611
R13: ffff89d2a505fc80 R14: ffff89d53ffda000 R15: ffff89d53ffdb000
FS:  00007f4ea4fcd740(0000) GS:ffff89d53d6c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000006eb7d8 CR3: 000000018015a000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffff9dbef2d0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff9dbf190b>] do_wp_page+0xfb/0x720
[<ffffffff9dbbe20b>] ? unlock_page+0x2b/0x30
[<ffffffff9dbee729>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff9dbf5f82>] handle_mm_fault+0xb22/0xfb0
[<ffffffff9e190653>] __do_page_fault+0x213/0x500
[<ffffffff9e190975>] do_page_fault+0x35/0x90
[<ffffffff9e18c778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #730645
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff8ffab189
Build id: 3.10.0-1160.83.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff8fdfb300
Build id: 3.10.0-1160.83.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff8fdfd9fb
Build id: 3.10.0-1160.83.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff8fdc8f6b
Build id: 3.10.0-1160.83.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff8fdfa739
Build id: 3.10.0-1160.83.1.el7.x86_64
0x139
6
? update_curr
vmlinux 0xffffffff8fce8bb4
Build id: 3.10.0-1160.83.1.el7.x86_64
0x164
7
handle_mm_fault
vmlinux 0xffffffff8fe02102
Build id: 3.10.0-1160.83.1.el7.x86_64
0xb22
8
__do_page_fault
vmlinux 0xffffffff903bf7d3
Build id: 3.10.0-1160.83.1.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffff903bfb05
Build id: 3.10.0-1160.83.1.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffff903bb7b8
Build id: 3.10.0-1160.83.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [bundle:37797]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec iosf_mbi crc32_pclmul ghash_clmulni_intel ac97_bus aesni_intel snd_seq lrw gf128mul glue_helper ablk_helper cryptd snd_seq_device snd_pcm snd_timer snd soundcore sg ppdev joydev pcspkr
i2c_piix4 vmw_vmci vmw_balloon parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nfit libnvdimm ata_piix libata crct10dif_pclmul crct10dif_common mptspi scsi_transport_spi crc32c_intel mptscsih e1000 mptbase serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 37797 Comm: bundle Kdump: loaded Tainted: G             L ------------   3.10.0-1160.83.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff95236669e300 ti: ffff9521a4c40000 task.ti: ffff9521a4c40000
RIP: 0010:[<ffffffff8ffab189>]  [<ffffffff8ffab189>] copy_page+0x49/0xe0
RSP: 0000:ffff9521a4c43cc0  EFLAGS: 00010206
RAX: 0000000900000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000001d00007f20 RSI: ffff9521fa29f000 RDI: ffff9521c44e2000
RBP: ffff9521a4c43d38 R08: 0000002100000021 R09: 0000000900000000
R10: 4b8661f000000020 R11: 0000002300007f20 R12: 00000000fb795801
R13: ffff9521a4c43c80 R14: 0000000000000000 R15: ffff9522fec0a160
FS:  00007f207594df80(0000) GS:ffff9523b5600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2050384d08 CR3: 000000009bba2000 CR4: 00000000003607f0
Call Trace:
[<ffffffff8fdfb300>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff8fdfd9fb>] do_wp_page+0xfb/0x730
[<ffffffff8fdc8f6b>] ? unlock_page+0x2b/0x40
[<ffffffff8fdfa739>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff8fce8bb4>] ? update_curr+0x164/0x1f0
[<ffffffff8fe02102>] handle_mm_fault+0xb22/0xfb0
[<ffffffff903bf7d3>] __do_page_fault+0x213/0x510
[<ffffffff903bfb05>] do_page_fault+0x35/0x90
[<ffffffff903bb7b8>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #653019
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffa8d846f9
Build id: 3.10.0-957.21.3.el7.x86_64
0x49
2
? wp_page_copy.isra.71
vmlinux 0xffffffffa8be59e1
Build id: 3.10.0-957.21.3.el7.x86_64
0x121
3
do_wp_page
vmlinux 0xffffffffa8be7e3b
Build id: 3.10.0-957.21.3.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffa8bb6abb
Build id: 3.10.0-957.21.3.el7.x86_64
0x2b
5
? do_read_fault.isra.61
vmlinux 0xffffffffa8be4e89
Build id: 3.10.0-957.21.3.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffffa8be97cd
Build id: 3.10.0-957.21.3.el7.x86_64
0x37d
7
handle_mm_fault
vmlinux 0xffffffffa8bec27d
Build id: 3.10.0-957.21.3.el7.x86_64
0x39d
8
__do_page_fault
vmlinux 0xffffffffa9170603
Build id: 3.10.0-957.21.3.el7.x86_64
0x203
9
do_page_fault
vmlinux 0xffffffffa9170925
Build id: 3.10.0-957.21.3.el7.x86_64
0x35
10
? error_swapgs
vmlinux 0xffffffffa916cab6
Build id: 3.10.0-957.21.3.el7.x86_64
0xa7
11
page_fault
vmlinux 0xffffffffa916c768
Build id: 3.10.0-957.21.3.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 38s! [systemd-cgroups:29540]
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 38s! [crond:29548]
Modules linked in: arc4 md4 xt_CHECKSUM iptable_mangle rpcsec_gss_krb5 nfsv4 ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nfs nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack fscache nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter nls_utf8 cifs ccm dns_resolver vmw_vsock_vmci_transport vsock ppdev vmw_balloon coretemp crc32_pclmul ghash_clmulni_intel ext4 aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev mbcache jbd2 pcspkr sg parport_pc parport vmw_vmci i2c_piix4 nfsd nfs_acl lockd auth_rpcgss grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_generic pata_acpi
vmwgfx floppy drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix vmxnet3 mptspi libata scsi_transport_spi mptscsih drm_panel_orientation_quirks mptbase involflt(POE) dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 29548 Comm: crond Kdump: loaded Tainted: P           OEL ------------   3.10.0-957.21.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff9b5e9b7c30c0 ti: ffff9b578f948000 task.ti: ffff9b578f948000
RIP: 0010:[<ffffffffa8d846f9>]  [<ffffffffa8d846f9>] copy_page+0x49/0xe0
RSP: 0000:ffff9b578f94bc48  EFLAGS: 00010206
RAX: 300e4a0586280e44 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 42100e42180e4220 RSI: ffff9b5d781f8000 RDI: ffff9b5b42dc0000
RBP: ffff9b578f94bcc0 R08: 0e0a51020b46080e R09: 42180e42200e4128
R10: 000b4b080e47100e R11: 000006ac0000001c R12: 000000001ef61509
R13: ffff9b578f94bc18 R14: 0000000000000000 R15: ffff9b5f3ffbe000
FS:  00007fb3857f3840(0000) GS:ffff9b5f3fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb37cf85ec8 CR3: 0000000021cf6000 CR4: 00000000000007f0
Call Trace:
[<ffffffffa8be59e1>] ? wp_page_copy.isra.71+0x121/0x560
[<ffffffffa8be7e3b>] do_wp_page+0xfb/0x720
[<ffffffffa8bb6abb>] ? unlock_page+0x2b/0x30
[<ffffffffa8be4e89>] ? do_read_fault.isra.61+0x139/0x1b0
[<ffffffffa8be97cd>] handle_pte_fault+0x37d/0xd10
[<ffffffffa8bec27d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffa9170603>] __do_page_fault+0x203/0x4f0
[<ffffffffa9170925>] do_page_fault+0x35/0x90
[<ffffffffa916cab6>] ? error_swapgs+0xa7/0xbd
[<ffffffffa916c768>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #645737
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff9d193bc9
Build id: 3.10.0-1127.19.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff9cfef1b0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff9cff17eb
Build id: 3.10.0-1127.19.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff9cfbe7ab
Build id: 3.10.0-1127.19.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff9cfee609
Build id: 3.10.0-1127.19.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff9cff5e82
Build id: 3.10.0-1127.19.1.el7.x86_64
0xb22
7
? do_mmap
vmlinux 0xffffffff9cffcb28
Build id: 3.10.0-1127.19.1.el7.x86_64
0x378
8
__do_page_fault
vmlinux 0xffffffff9d58d653
Build id: 3.10.0-1127.19.1.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffff9d58d975
Build id: 3.10.0-1127.19.1.el7.x86_64
0x35
10
? error_swapgs
vmlinux 0xffffffff9d589ac9
Build id: 3.10.0-1127.19.1.el7.x86_64
0xaa
11
page_fault
vmlinux 0xffffffff9d589778
Build id: 3.10.0-1127.19.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [sshd:8268]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink binfmt_misc vmw_vsock_vmci_transport vsock sunrpc coretemp pcspkr joydev sg ppdev crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper vmw_balloon cryptd parport_pc vmw_vmci parport i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata crct10dif_pclmul crct10dif_common crc32c_intel e1000 mptspi serio_raw scsi_transport_spi mptscsih
mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 8268 Comm: sshd Kdump: loaded Tainted: G        W    L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 06/22/2012
task: ffff9cf87252d230 ti: ffff9cf736c94000 task.ti: ffff9cf736c94000
RIP: 0010:[<ffffffff9d193bc9>]  [<ffffffff9d193bc9>] copy_page+0x49/0xe0
RSP: 0000:ffff9cf736c97cc0  EFLAGS: 00010206
RAX: 0e410286100e4100 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 080e41100e44180e RSI: ffff9cf86e860000 RDI: ffff9cf7169dc000
RBP: ffff9cf736c97d38 R08: 0000080400000024 R09: 00000088ffffd6e0
R10: 0e550283100e4100 R11: 41100e0a6b0207a0 R12: 00000000f3b59074
R13: ffffffff9cfc0eed R14: ffff9cf87ffd8000 R15: ffff9cf87ffd9000
FS:  0000000000000000(0000) GS:ffff9cf87fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f944f90de70 CR3: 00000002b3820000 CR4: 00000000000007f0
Call Trace:
[<ffffffff9cfef1b0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff9cff17eb>] do_wp_page+0xfb/0x720
[<ffffffff9cfbe7ab>] ? unlock_page+0x2b/0x30
[<ffffffff9cfee609>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff9cff5e82>] handle_mm_fault+0xb22/0xfb0
[<ffffffff9cffcb28>] ? do_mmap+0x378/0x530
[<ffffffff9d58d653>] __do_page_fault+0x213/0x500
[<ffffffff9d58d975>] do_page_fault+0x35/0x90
[<ffffffff9d589ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffff9d589778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #637171
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffa7f83e79
Build id: 3.10.0-957.el7.x86_64
0x49
2
? wp_page_copy.isra.71
vmlinux 0xffffffffa7de53d1
Build id: 3.10.0-957.el7.x86_64
0x121
3
do_wp_page
vmlinux 0xffffffffa7de782b
Build id: 3.10.0-957.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffa7db64fb
Build id: 3.10.0-957.el7.x86_64
0x2b
5
? __slab_free
vmlinux 0xffffffffa7e1b311
Build id: 3.10.0-957.el7.x86_64
0x81
6
handle_pte_fault
vmlinux 0xffffffffa7de91bd
Build id: 3.10.0-957.el7.x86_64
0x37d
7
? __slab_free
vmlinux 0xffffffffa7e1b311
Build id: 3.10.0-957.el7.x86_64
0x81
8
handle_mm_fault
vmlinux 0xffffffffa7debc6d
Build id: 3.10.0-957.el7.x86_64
0x39d
9
__do_page_fault
vmlinux 0xffffffffa836f5e3
Build id: 3.10.0-957.el7.x86_64
0x203
10
do_page_fault
vmlinux 0xffffffffa836f915
Build id: 3.10.0-957.el7.x86_64
0x35
11
page_fault
vmlinux 0xffffffffa836b758
Build id: 3.10.0-957.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 42s! [systemd-udevd:10107]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg snd_seq_midi snd_seq_midi_event parport_pc parport snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd soundcore i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod crct10dif_generic cdrom crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmwgfx ata_generic drm_kms_helper
pata_acpi syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi scsi_transport_spi e1000 mptscsih ata_piix libata mptbase nfit libnvdimm drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 10107 Comm: systemd-udevd Not tainted 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff9ba8eec0c100 ti: ffff9ba8eeefc000 task.ti: ffff9ba8eeefc000
RIP: 0010:[<ffffffffa7f83e79>]  [<ffffffffa7f83e79>] copy_page+0x49/0xe0
RSP: 0000:ffff9ba8eeeffc48  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 00005599979fff70 RSI: ffff9ba8f8ef8000 RDI: ffff9ba8e9ea0000
RBP: ffff9ba8eeeffcc0 R08: 000055999785cdf0 R09: 0000000000000000
R10: 0000000000000021 R11: 0000559997a13640 R12: 000000002f305ad8
R13: ffff9ba8eeeffc18 R14: 0000000000000000 R15: ffff9ba97ffda000
FS:  00007f0b662fd8c0(0000) GS:ffff9ba979640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005599978674d8 CR3: 00000000aef28000 CR4: 00000000003607e0
Call Trace:
[<ffffffffa7de53d1>] ? wp_page_copy.isra.71+0x121/0x560
[<ffffffffa7de782b>] do_wp_page+0xfb/0x720
[<ffffffffa7db64fb>] ? unlock_page+0x2b/0x30
[<ffffffffa7e1b311>] ? __slab_free+0x81/0x2f0
[<ffffffffa7de91bd>] handle_pte_fault+0x37d/0xd10
[<ffffffffa7e1b311>] ? __slab_free+0x81/0x2f0
[<ffffffffa7debc6d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffa836f5e3>] __do_page_fault+0x203/0x500
[<ffffffffa836f915>] do_page_fault+0x35/0x90
[<ffffffffa836b758>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #592367
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffb3b95409
Build id: 3.10.0-1160.76.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffffb39efa20
Build id: 3.10.0-1160.76.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffffb39f205b
Build id: 3.10.0-1160.76.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffb39be47b
Build id: 3.10.0-1160.76.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffffb39eee79
Build id: 3.10.0-1160.76.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffffb39f66d2
Build id: 3.10.0-1160.76.1.el7.x86_64
0xb22
7
__do_page_fault
vmlinux 0xffffffffb3f94653
Build id: 3.10.0-1160.76.1.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffffb3f94975
Build id: 3.10.0-1160.76.1.el7.x86_64
0x35
9
? error_swapgs
vmlinux 0xffffffffb3f90ac9
Build id: 3.10.0-1160.76.1.el7.x86_64
0xaa
10
page_fault
vmlinux 0xffffffffb3f90778
Build id: 3.10.0-1160.76.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [cortex-xdr-payl:20883]
Modules linked in: tcp_lp traps(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 ppdev crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg vmw_vmci i2c_piix4 parport_pc parport binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel libnvdimm serio_raw libata
vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: traps]
CPU: 0 PID: 20883 Comm: cortex-xdr-payl Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-1160.76.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/28/2020
task: ffff97565573a100 ti: ffff974cadb10000 task.ti: ffff974cadb10000
RIP: 0010:[<ffffffffb3b95409>]  [<ffffffffb3b95409>] copy_page+0x49/0xe0
RSP: 0000:ffff974cadb13cc0  EFLAGS: 00010206
RAX: 00007f4750000020 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 00000000000ab000 RSI: ffff97501fbb7000 RDI: ffff9753a47b0000
RBP: ffff974cadb13d38 R08: 00000000000ab000 R09: 0000000200000001
R10: 0000000000000000 R11: 0000000000000000 R12: 000000006c9582da
R13: ffffffffb39c0f0d R14: ffff974cadb13c90 R15: ffff974e0f2c0800
FS:  00007f475803d700(0000) GS:ffff975a3fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4750000898 CR3: 0000000208028000 CR4: 00000000000007f0
Call Trace:
[<ffffffffb39efa20>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffffb39f205b>] do_wp_page+0xfb/0x720
[<ffffffffb39be47b>] ? unlock_page+0x2b/0x30
[<ffffffffb39eee79>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffffb39f66d2>] handle_mm_fault+0xb22/0xfb0
[<ffffffffb3f94653>] __do_page_fault+0x213/0x500
[<ffffffffb3f94975>] do_page_fault+0x35/0x90
[<ffffffffb3f90ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffb3f90778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #591929
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffb57949a9
Build id: 3.10.0-1160.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffffb55ef080
Build id: 3.10.0-1160.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffffb55f16bb
Build id: 3.10.0-1160.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffb55bdf6b
Build id: 3.10.0-1160.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffffb55ee4d9
Build id: 3.10.0-1160.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffffb55f5d32
Build id: 3.10.0-1160.el7.x86_64
0xb22
7
? cp_new_stat
vmlinux 0xffffffffb5653915
Build id: 3.10.0-1160.el7.x86_64
0x165
8
__do_page_fault
vmlinux 0xffffffffb5b8e653
Build id: 3.10.0-1160.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffffb5b8e975
Build id: 3.10.0-1160.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffffb5b8a778
Build id: 3.10.0-1160.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [crond:65441]
Modules linked in: tcp_lp isofs xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 devlink tun arc4 md4 nls_utf8 cifs ccm dns_resolver ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm ppdev pcspkr iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw snd_timer
gf128mul snd vmw_balloon soundcore glue_helper ablk_helper cryptd joydev sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper nfit syscopyarea sysfillrect crct10dif_pclmul libnvdimm crct10dif_common sysimgblt crc32c_intel fb_sys_fops ttm ata_piix mptspi drm scsi_transport_spi mptscsih libata serio_raw mptbase e1000 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 65441 Comm: crond Kdump: loaded Tainted: G             L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff900b0dd78000 ti: ffff900a8988c000 task.ti: ffff900a8988c000
RIP: 0010:[<ffffffffb57949a9>]  [<ffffffffb57949a9>] copy_page+0x49/0xe0
RSP: 0000:ffff900a8988fcc0  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff900b294d8000 RDI: ffff900af23a0000
RBP: ffff900a8988fd38 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: 00000000aaaa5d6b
R13: ffffffffb55c09ed R14: ffff900b3ffd9800 R15: ffff900b3ffdb000
FS:  00007fe71caf6840(0000) GS:ffff900b3a600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005560b4106018 CR3: 00000000a58f0000 CR4: 00000000003607f0
Call Trace:
[<ffffffffb55ef080>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffffb55f16bb>] do_wp_page+0xfb/0x720
[<ffffffffb55bdf6b>] ? unlock_page+0x2b/0x30
[<ffffffffb55ee4d9>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffffb55f5d32>] handle_mm_fault+0xb22/0xfb0
[<ffffffffb5653915>] ? cp_new_stat+0x165/0x1a0
[<ffffffffb5b8e653>] __do_page_fault+0x213/0x500
[<ffffffffb5b8e975>] do_page_fault+0x35/0x90
[<ffffffffb5b8a778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #573158
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff90d83e79
Build id: 3.10.0-957.el7.x86_64
0x49
2
? wp_page_copy.isra.71
vmlinux 0xffffffff90be53d1
Build id: 3.10.0-957.el7.x86_64
0x121
3
do_wp_page
vmlinux 0xffffffff90be782b
Build id: 3.10.0-957.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff90bb64fb
Build id: 3.10.0-957.el7.x86_64
0x2b
5
? do_read_fault.isra.61
vmlinux 0xffffffff90be4879
Build id: 3.10.0-957.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffff90be91bd
Build id: 3.10.0-957.el7.x86_64
0x37d
7
? xfs_file_buffered_aio_read
xfs 0xffffffffc064f355
Build id: 3.10.0-957.el7.x86_64
0xa5
8
handle_mm_fault
vmlinux 0xffffffff90bebc6d
Build id: 3.10.0-957.el7.x86_64
0x39d
9
__do_page_fault
vmlinux 0xffffffff9116f5e3
Build id: 3.10.0-957.el7.x86_64
0x203
10
do_page_fault
vmlinux 0xffffffff9116f915
Build id: 3.10.0-957.el7.x86_64
0x35
11
page_fault
vmlinux 0xffffffff9116b758
Build id: 3.10.0-957.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [postmaster:16389]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev ext4 mbcache crc32_pclmul ghash_clmulni_intel jbd2 aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon joydev pcspkr e1000 nfit libnvdimm i2c_piix4 parport_pc parport sg vmw_vmci binfmt_misc ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod cdrom crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_generic pata_acpi vmwgfx floppy drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi ata_piix
scsi_transport_spi libata mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 16389 Comm: postmaster Kdump: loaded Tainted: G             L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff9e06d65c0000 ti: ffff9e0642a3c000 task.ti: ffff9e0642a3c000
RIP: 0010:[<ffffffff90d83e79>]  [<ffffffff90d83e79>] copy_page+0x49/0xe0
RSP: 0000:ffff9e0642a3fc48  EFLAGS: 00010206
RAX: 00007fc1578aae74 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 00007ffd23694ce0 RSI: ffff9e06f5c9f000 RDI: ffff9e06cc3b4000
RBP: ffff9e0642a3fcc0 R08: 00007ffd23694cc6 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000002 R12: 00000000549d74dc
R13: ffff9e0642a3fc18 R14: 0000000000000000 R15: ffff9e077ffd8000
FS:  00007fc158dba740(0000) GS:ffff9e077fc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc157aea1a0 CR3: 000000000a96a000 CR4: 00000000003607e0
Call Trace:
[<ffffffff90be53d1>] ? wp_page_copy.isra.71+0x121/0x560
[<ffffffff90be782b>] do_wp_page+0xfb/0x720
[<ffffffff90bb64fb>] ? unlock_page+0x2b/0x30
[<ffffffff90be4879>] ? do_read_fault.isra.61+0x139/0x1b0
[<ffffffff90be91bd>] handle_pte_fault+0x37d/0xd10
[<ffffffffc064f355>] ? xfs_file_buffered_aio_read+0xa5/0x110 [xfs]
[<ffffffff90bebc6d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff9116f5e3>] __do_page_fault+0x203/0x500
[<ffffffff9116f915>] do_page_fault+0x35/0x90
[<ffffffff9116b758>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #537119
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffa9d95409
Build id: 3.10.0-1160.76.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffffa9befa20
Build id: 3.10.0-1160.76.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffffa9bf205b
Build id: 3.10.0-1160.76.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffa9bbe47b
Build id: 3.10.0-1160.76.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffffa9beee79
Build id: 3.10.0-1160.76.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffffa9bf66d2
Build id: 3.10.0-1160.76.1.el7.x86_64
0xb22
7
__do_page_fault
vmlinux 0xffffffffaa194653
Build id: 3.10.0-1160.76.1.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffffaa194975
Build id: 3.10.0-1160.76.1.el7.x86_64
0x35
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 29s! [lfd - (child) c:36699]
Modules linked in: ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 nf_log_ipv4 nf_log_common ip6table_filter nf_nat_ftp xt_REDIRECT nf_nat_redirect xt_conntrack nf_conntrack_ftp xt_LOG xt_limit xt_multiport iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 ip6table_mangle ip6table_raw ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 nf_nat nf_conntrack ip6_tables iptable_mangle iptable_raw ipt_REJECT nf_reject_ipv4 iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul snd_ens1371 snd_rawmidi ghash_clmulni_intel snd_ac97_codec ac97_bus snd_seq aesni_intel ppdev lrw snd_seq_device gf128mul glue_helper vmw_balloon ablk_helper cryptd snd_pcm joydev pcspkr sg vmw_vmci snd_timer snd soundcore
i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata crct10dif_pclmul crct10dif_common crc32c_intel nfit libnvdimm serio_raw mptspi e1000 scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks fuse
CPU: 1 PID: 36699 Comm: lfd - (child) c Kdump: loaded Tainted: G             L ------------   3.10.0-1160.76.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff93f41f481080 ti: ffff93f3d69f8000 task.ti: ffff93f3d69f8000
RIP: 0010:[<ffffffffa9d95409>]  [<ffffffffa9d95409>] copy_page+0x49/0xe0
RSP: 0000:ffff93f3d69fbcc0  EFLAGS: 00010206
RAX: 0000000000000003 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000006873756c66 RSI: ffff93f2f1a63000 RDI: ffff93f39149f000
RBP: ffff93f3d69fbd38 R08: 0000000000000021 R09: 00007f7e5b8db700
R10: 00000000014da400 R11: 0000000000000020 R12: 000000007e1e35cb
R13: ffffffffa9bc0f0d R14: ffff93f3d69fbc90 R15: ffff93f3efb6ad00
FS:  00007f7e5ce01740(0000) GS:ffff93f424840000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000142c621 CR3: 00000001817fc000 CR4: 00000000001607e0
Call Trace:
[<ffffffffa9befa20>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffffa9bf205b>] do_wp_page+0xfb/0x720
[<ffffffffa9bbe47b>] ? unlock_page+0x2b/0x30
[<ffffffffa9beee79>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffffa9bf66d2>] handle_mm_fault+0xb22/0xfb0
[<ffffffffaa194653>] __do_page_fault+0x213/0x500
[<ffffffffaa194975>] do_page_fault+0x35/0x90
Complete report #470948
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff84f8e059
Build id: 3.10.0-1062.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff84deb4e0
Build id: 3.10.0-1062.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff84dedb1b
Build id: 3.10.0-1062.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff84dbbffb
Build id: 3.10.0-1062.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff84dea939
Build id: 3.10.0-1062.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffff84def4a5
Build id: 3.10.0-1062.el7.x86_64
0x3d5
7
handle_mm_fault
vmlinux 0xffffffff84df200d
Build id: 3.10.0-1062.el7.x86_64
0x39d
8
__do_page_fault
vmlinux 0xffffffff85386633
Build id: 3.10.0-1062.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffff85386955
Build id: 3.10.0-1062.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffff85382768
Build id: 3.10.0-1062.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [abrt-dump-oops:2204]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 ppdev aesni_intel lrw gf128mul snd_rawmidi glue_helper ablk_helper snd_ac97_codec btusb vmw_balloon btrtl btbcm cryptd btintel ac97_bus snd_seq bluetooth snd_seq_device snd_pcm snd_timer snd rfkill pcspkr soundcore joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif drm_kms_helper crct10dif_generic
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm ata_piix nfit mptspi libata serio_raw scsi_transport_spi e1000 libnvdimm mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 2204 Comm: abrt-dump-oops Tainted: G             L ------------   3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff903568ee5230 ti: ffff903568f00000 task.ti: ffff903568f00000
RIP: 0010:[<ffffffff84f8e059>]  [<ffffffff84f8e059>] copy_page+0x49/0xe0
RSP: 0000:ffff903568f03c38  EFLAGS: 00010206
RAX: 00000000000add60 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 000000000045cda0 RSI: ffff90354f476000 RDI: ffff90357d9e6000
RBP: ffff903568f03cb0 R08: 0000000000000000 R09: 00000000001580ac
R10: 0000000000000005 R11: 000ec1ff00000000 R12: 000000000ed42fa7
R13: ffff903568f03c08 R14: 0000000000000000 R15: ffff90357ffd9800
FS:  0000000000000000(0000) GS:ffff90357c600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2a097aae68 CR3: 000000001ccd2000 CR4: 00000000001607f0
Call Trace:
[<ffffffff84deb4e0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff84dedb1b>] do_wp_page+0xfb/0x720
[<ffffffff84dbbffb>] ? unlock_page+0x2b/0x30
[<ffffffff84dea939>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff84def4a5>] handle_pte_fault+0x3d5/0xe20
[<ffffffff84df200d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff85386633>] __do_page_fault+0x213/0x500
[<ffffffff85386955>] do_page_fault+0x35/0x90
[<ffffffff85382768>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [PLANE:33:plane-0] flip_done timed out
Complete report #412850
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffa15953e9
Build id: 3.10.0-1160.62.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffffa13ef9e0
Build id: 3.10.0-1160.62.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffffa13f201b
Build id: 3.10.0-1160.62.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffa13be44b
Build id: 3.10.0-1160.62.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffffa13eee39
Build id: 3.10.0-1160.62.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffffa13f6692
Build id: 3.10.0-1160.62.1.el7.x86_64
0xb22
7
? do_mmap
vmlinux 0xffffffffa13fd35c
Build id: 3.10.0-1160.62.1.el7.x86_64
0x39c
8
? mprotect_fixup
vmlinux 0xffffffffa13fed39
Build id: 3.10.0-1160.62.1.el7.x86_64
0x1b9
9
__do_page_fault
vmlinux 0xffffffffa1994653
Build id: 3.10.0-1160.62.1.el7.x86_64
0x213
10
do_page_fault
vmlinux 0xffffffffa1994975
Build id: 3.10.0-1160.62.1.el7.x86_64
0x35
11
? error_swapgs
vmlinux 0xffffffffa1990ac9
Build id: 3.10.0-1160.62.1.el7.x86_64
0xaa
12
page_fault
vmlinux 0xffffffffa1990778
Build id: 3.10.0-1160.62.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 71s! [crond:29338]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod coretemp crc32_pclmul ppdev vmw_balloon ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev sg pcspkr parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif drm_kms_helper crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ata_piix vmxnet3 crc32c_intel libata serio_raw vmw_pvscsi
drm_panel_orientation_quirks floppy fuse
CPU: 1 PID: 29338 Comm: crond Tainted: G             L ------------   3.10.0-1160.62.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
task: ffff96d1276a3180 ti: ffff96d05eea0000 task.ti: ffff96d05eea0000
RIP: 0010:[<ffffffffa15953e9>]  [<ffffffffa15953e9>] copy_page+0x49/0xe0
RSP: 0000:ffff96d05eea3cc0  EFLAGS: 00010206
RAX: 00007f15d7a51000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 00007f15d7cb1db8 RSI: ffff96d83049e000 RDI: ffff96d722e8e000
RBP: ffff96d05eea3d38 R08: 00007f15d8b06998 R09: 00007f15d8ae3990
R10: 00007f15d8ae2000 R11: 0000000000000000 R12: 000000004bd7644e
R13: ffffffffa13c0edd R14: ffff96d05eea3c90 R15: ffff96d3d9ae1e00
FS:  00007f15d8ade840(0000) GS:ffff96d864080000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f15d8ae28b4 CR3: 000000006d3fa000 CR4: 00000000000007e0
Call Trace:
[<ffffffffa13ef9e0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffffa13f201b>] do_wp_page+0xfb/0x720
[<ffffffffa13be44b>] ? unlock_page+0x2b/0x30
[<ffffffffa13eee39>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffffa13f6692>] handle_mm_fault+0xb22/0xfb0
[<ffffffffa13fd35c>] ? do_mmap+0x39c/0x590
[<ffffffffa13fed39>] ? mprotect_fixup+0x1b9/0x3a0
[<ffffffffa1994653>] __do_page_fault+0x213/0x500
[<ffffffffa1994975>] do_page_fault+0x35/0x90
[<ffffffffa1990ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffa1990778>] page_fault+0x28/0x30
Complete report #405246
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffba590269
Build id: 3.10.0-1062.12.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffffba3ed410
Build id: 3.10.0-1062.12.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffffba3efa4b
Build id: 3.10.0-1062.12.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffba3bd9bb
Build id: 3.10.0-1062.12.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffffba3ec869
Build id: 3.10.0-1062.12.1.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffffba3f13d5
Build id: 3.10.0-1062.12.1.el7.x86_64
0x3d5
7
? alloc_pages_current
vmlinux 0xffffffffba416ba8
Build id: 3.10.0-1062.12.1.el7.x86_64
0x98
8
handle_mm_fault
vmlinux 0xffffffffba3f3f3d
Build id: 3.10.0-1062.12.1.el7.x86_64
0x39d
9
__do_page_fault
vmlinux 0xffffffffba988653
Build id: 3.10.0-1062.12.1.el7.x86_64
0x213
10
do_page_fault
vmlinux 0xffffffffba988975
Build id: 3.10.0-1062.12.1.el7.x86_64
0x35
11
? error_swapgs
vmlinux 0xffffffffba984ac9
Build id: 3.10.0-1062.12.1.el7.x86_64
0xaa
12
page_fault
vmlinux 0xffffffffba984778
Build id: 3.10.0-1062.12.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 38s! [ksmtuned:23574]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac ext4 iosf_mbi ppdev crc32_pclmul ghash_clmulni_intel mbcache vmw_balloon aesni_intel jbd2 lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev parport_pc parport vmw_vmci sg i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nfit ata_piix libnvdimm crct10dif_pclmul crct10dif_common crc32c_intel
libata mptspi serio_raw scsi_transport_spi e1000 mptscsih mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 23574 Comm: ksmtuned Kdump: loaded Tainted: G             L ------------   3.10.0-1062.12.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8af5db319070 ti: ffff8af5ea170000 task.ti: ffff8af5ea170000
RIP: 0010:[<ffffffffba590269>]  [<ffffffffba590269>] copy_page+0x49/0xe0
RSP: 0000:ffff8af5ea173c38  EFLAGS: 00010206
RAX: 0000000000222a24 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 00000000016741b0 RSI: ffff8af543c8f000 RDI: ffff8af581960000
RBP: ffff8af5ea173cb0 R08: 0000000000002420 R09: 0000000000000000
R10: 0000000000000021 R11: 0000000001678c70 R12: 00000000a32bf6c3
R13: 0000000000000000 R14: ffff8af67a5f9a60 R15: 0000000000000001
FS:  00007f7ceee88740(0000) GS:ffff8af67fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000164e750 CR3: 0000000012276000 CR4: 00000000000407f0
Call Trace:
[<ffffffffba3ed410>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffffba3efa4b>] do_wp_page+0xfb/0x720
[<ffffffffba3bd9bb>] ? unlock_page+0x2b/0x30
[<ffffffffba3ec869>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffffba3f13d5>] handle_pte_fault+0x3d5/0xe20
[<ffffffffba416ba8>] ? alloc_pages_current+0x98/0x110
[<ffffffffba3f3f3d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffba988653>] __do_page_fault+0x213/0x500
[<ffffffffba988975>] do_page_fault+0x35/0x90
[<ffffffffba984ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffba984778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #370117
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff9e195609
Build id: 3.10.0-1160.53.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff9dfef9f0
Build id: 3.10.0-1160.53.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff9dff202b
Build id: 3.10.0-1160.53.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff9dfbe42b
Build id: 3.10.0-1160.53.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff9dfeee49
Build id: 3.10.0-1160.53.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff9dff66a2
Build id: 3.10.0-1160.53.1.el7.x86_64
0xb22
7
? __check_object_size
vmlinux 0xffffffff9e04b13a
Build id: 3.10.0-1160.53.1.el7.x86_64
0x1ca
8
__do_page_fault
vmlinux 0xffffffff9e590653
Build id: 3.10.0-1160.53.1.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffff9e590975
Build id: 3.10.0-1160.53.1.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffff9e58c778
Build id: 3.10.0-1160.53.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 24s! [ondot-pool-quer:30672]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg ppdev joydev pcspkr vmw_balloon i2c_piix4 vmw_vmci parport_pc parport binfmt_misc ip_tables xfs libcrc32c ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod syscopyarea sysfillrect sysimgblt fb_sys_fops crc_t10dif ttm crct10dif_generic drm nfit libnvdimm ata_piix ahci crct10dif_pclmul crct10dif_common e1000e crc32c_intel libahci serio_raw
libata drm_panel_orientation_quirks vmw_pvscsi ptp pps_core dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 30672 Comm: ondot-pool-quer Kdump: loaded Tainted: G             L ------------   3.10.0-1160.53.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/28/2017
task: ffff896d945ba100 ti: ffff896c23858000 task.ti: ffff896c23858000
RIP: 0010:[<ffffffff9e195609>]  [<ffffffff9e195609>] copy_page+0x49/0xe0
RSP: 0000:ffff896c2385bcc0  EFLAGS: 00010206
RAX: 00007fbd83b0d0b4 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 00007ffc75b5a060 RSI: ffff896d4b252000 RDI: ffff896d53abe000
RBP: ffff896c2385bd38 R08: 00007ffc75b5a05b R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000002 R12: 000000000df04911
R13: ffffffff9dfc0ead R14: ffff896c2385bc90 R15: ffff896e1f140400
FS:  00007fbd8437f740(0000) GS:ffff896f3fc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fbd83d4c490 CR3: 00000001ff5dc000 CR4: 00000000001607e0
Call Trace:
[<ffffffff9dfef9f0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff9dff202b>] do_wp_page+0xfb/0x720
[<ffffffff9dfbe42b>] ? unlock_page+0x2b/0x30
[<ffffffff9dfeee49>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff9dff66a2>] handle_mm_fault+0xb22/0xfb0
[<ffffffff9e04b13a>] ? __check_object_size+0x1ca/0x250
[<ffffffff9e590653>] __do_page_fault+0x213/0x500
[<ffffffff9e590975>] do_page_fault+0x35/0x90
[<ffffffff9e58c778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #326792
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff83993b89
Build id: 3.10.0-1127.13.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff837ef190
Build id: 3.10.0-1127.13.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff837f17cb
Build id: 3.10.0-1127.13.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff837be75b
Build id: 3.10.0-1127.13.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff837ee5e9
Build id: 3.10.0-1127.13.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff837f5e62
Build id: 3.10.0-1127.13.1.el7.x86_64
0xb22
7
? do_mmap
vmlinux 0xffffffff837fcb08
Build id: 3.10.0-1127.13.1.el7.x86_64
0x378
8
? mprotect_fixup
vmlinux 0xffffffff837fe499
Build id: 3.10.0-1127.13.1.el7.x86_64
0x1b9
9
__do_page_fault
vmlinux 0xffffffff83d8d653
Build id: 3.10.0-1127.13.1.el7.x86_64
0x213
10
do_page_fault
vmlinux 0xffffffff83d8d975
Build id: 3.10.0-1127.13.1.el7.x86_64
0x35
11
? error_swapgs
vmlinux 0xffffffff83d89ac9
Build id: 3.10.0-1127.13.1.el7.x86_64
0xaa
12
page_fault
vmlinux 0xffffffff83d89778
Build id: 3.10.0-1127.13.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [sendmail:22779]
Modules linked in: tcp_diag inet_diag talpa_vfshook(OE) talpa_pedconnector(OE) talpa_vcdevice(OE) talpa_core(OE) talpa_linux(OE) talpa_syscallhook(OE) ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 ip6table_filter nf_log_ipv4 nf_log_common nf_nat_ftp xt_REDIRECT nf_nat_redirect xt_conntrack nf_conntrack_ftp xt_LOG xt_limit xt_multiport iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 ip6table_mangle ip6table_raw ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 nf_nat nf_conntrack ip6_tables iptable_mangle iptable_raw ipt_REJECT nf_reject_ipv4 iptable_filter talpa_pedevice(OE) sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd vmw_balloon joydev sg pcspkr i2c_piix4 vmw_vmci parport_pc parport tcp_htcp ip_tables
xfs libcrc32c vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sr_mod cdrom sd_mod ata_generic crc_t10dif pata_acpi crct10dif_generic drm ata_piix crct10dif_pclmul crct10dif_common e1000 serio_raw crc32c_intel libata drm_panel_orientation_quirks vmw_pvscsi floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: talpa_syscallhook]
CPU: 2 PID: 22779 Comm: sendmail Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-1127.13.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff9396fbc5d230 ti: ffff939681ca8000 task.ti: ffff939681ca8000
RIP: 0010:[<ffffffff83993b89>]  [<ffffffff83993b89>] copy_page+0x49/0xe0
RSP: 0000:ffff939681cabcc0  EFLAGS: 00010206
RAX: 0000000000027ea0 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff93944cd43000 RDI: ffff93943f22f000
RBP: ffff939681cabd38 R08: 0000000000000000 R09: 0000000000000303
R10: 00000000000313d0 R11: 0000000000031420 R12: 000000008e3fd730
R13: ffffffff837c0e9d R14: ffff9397fffd2000 R15: ffff9397fffd3000
FS:  0000000000000000(0000) GS:ffff9397ffc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0c5eacfe60 CR3: 00000002b1b3c000 CR4: 00000000000407e0
Call Trace:
[<ffffffff837ef190>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff837f17cb>] do_wp_page+0xfb/0x720
[<ffffffff837be75b>] ? unlock_page+0x2b/0x30
[<ffffffff837ee5e9>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff837f5e62>] handle_mm_fault+0xb22/0xfb0
[<ffffffff837fcb08>] ? do_mmap+0x378/0x530
[<ffffffff837fe499>] ? mprotect_fixup+0x1b9/0x3a0
[<ffffffff83d8d653>] __do_page_fault+0x213/0x500
[<ffffffff83d8d975>] do_page_fault+0x35/0x90
[<ffffffff83d89ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffff83d89778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #326692
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffa7b90219
Build id: 3.10.0-1062.9.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffffa79ed3a0
Build id: 3.10.0-1062.9.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffffa79ef9db
Build id: 3.10.0-1062.9.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffa79bd99b
Build id: 3.10.0-1062.9.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffffa79ec7f9
Build id: 3.10.0-1062.9.1.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffffa79f1365
Build id: 3.10.0-1062.9.1.el7.x86_64
0x3d5
7
? alloc_pages_current
vmlinux 0xffffffffa7a16b28
Build id: 3.10.0-1062.9.1.el7.x86_64
0x98
8
handle_mm_fault
vmlinux 0xffffffffa79f3ecd
Build id: 3.10.0-1062.9.1.el7.x86_64
0x39d
9
? __enqueue_entity
vmlinux 0xffffffffa78e0008
Build id: 3.10.0-1062.9.1.el7.x86_64
0x78
10
__do_page_fault
vmlinux 0xffffffffa7f88653
Build id: 3.10.0-1062.9.1.el7.x86_64
0x213
11
do_page_fault
vmlinux 0xffffffffa7f88975
Build id: 3.10.0-1062.9.1.el7.x86_64
0x35
12
? error_swapgs
vmlinux 0xffffffffa7f84ac9
Build id: 3.10.0-1062.9.1.el7.x86_64
0xaa
13
page_fault
vmlinux 0xffffffffa7f84778
Build id: 3.10.0-1062.9.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 89s! [lfd - (child) c:5385]
Modules linked in: binfmt_misc talpa_vfshook(OE) talpa_pedconnector(OE) talpa_vcdevice(OE) talpa_core(OE) talpa_linux(OE) talpa_syscallhook(OE) tcp_diag inet_diag ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 ip6table_filter nf_log_ipv4 nf_log_common nf_nat_ftp xt_REDIRECT nf_nat_redirect xt_conntrack nf_conntrack_ftp xt_LOG xt_limit talpa_pedevice(OE) xt_multiport iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 ip6table_mangle ip6table_raw ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 nf_nat nf_conntrack ip6_tables iptable_mangle iptable_raw ipt_REJECT nf_reject_ipv4 iptable_filter sb_edac coretemp iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc vmw_vmci parport i2c_piix4 tcp_htcp
ip_tables xfs libcrc32c sd_mod sr_mod vmwgfx crc_t10dif cdrom crct10dif_generic drm_kms_helper ata_generic pata_acpi syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel serio_raw libata e1000 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: talpa_syscallhook]
CPU: 0 PID: 5385 Comm: lfd - (child) c Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff9106a881e2a0 ti: ffff910863730000 task.ti: ffff910863730000
RIP: 0010:[<ffffffffa7b90219>]  [<ffffffffa7b90219>] copy_page+0x49/0xe0
RSP: 0000:ffff910863733c38  EFLAGS: 00010206
RAX: 0000000001733bf0 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000880200000001 RSI: ffff9109ca536000 RDI: ffff91083ca18000
RBP: ffff910863733cb0 R08: 0000000001191e78 R09: 0000000001733010
R10: 0000880200000001 R11: 000000000118e510 R12: 00000000e0812d03
R13: 0000000000000000 R14: ffff91077e3bc9e0 R15: 0000000000000001
FS:  00007f5a79029740(0000) GS:ffff910a3fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000001733088 CR3: 00000002432a4000 CR4: 00000000000407f0
Call Trace:
[<ffffffffa79ed3a0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffffa79ef9db>] do_wp_page+0xfb/0x720
[<ffffffffa79bd99b>] ? unlock_page+0x2b/0x30
[<ffffffffa79ec7f9>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffffa79f1365>] handle_pte_fault+0x3d5/0xe20
[<ffffffffa7a16b28>] ? alloc_pages_current+0x98/0x110
[<ffffffffa79f3ecd>] handle_mm_fault+0x39d/0x9b0
[<ffffffffa78e0008>] ? __enqueue_entity+0x78/0x80
[<ffffffffa7f88653>] __do_page_fault+0x213/0x500
[<ffffffffa7f88975>] do_page_fault+0x35/0x90
[<ffffffffa7f84ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffa7f84778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #326468
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff8f58e059
Build id: 3.10.0-1062.1.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff8f3eb4e0
Build id: 3.10.0-1062.1.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff8f3edb1b
Build id: 3.10.0-1062.1.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff8f3bbffb
Build id: 3.10.0-1062.1.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff8f3ea939
Build id: 3.10.0-1062.1.1.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffff8f3ef4a5
Build id: 3.10.0-1062.1.1.el7.x86_64
0x3d5
7
? alloc_pages_current
vmlinux 0xffffffff8f414c68
Build id: 3.10.0-1062.1.1.el7.x86_64
0x98
8
handle_mm_fault
vmlinux 0xffffffff8f3f200d
Build id: 3.10.0-1062.1.1.el7.x86_64
0x39d
9
__do_page_fault
vmlinux 0xffffffff8f987653
Build id: 3.10.0-1062.1.1.el7.x86_64
0x213
10
do_page_fault
vmlinux 0xffffffff8f987975
Build id: 3.10.0-1062.1.1.el7.x86_64
0x35
11
page_fault
vmlinux 0xffffffff8f983778
Build id: 3.10.0-1062.1.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 73s! [ksmtuned:70162]
Modules linked in: tcp_lp nls_utf8 isofs xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun bridge stp llc devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter fuse vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon ppdev nfit libnvdimm joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif
crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common vmwgfx crc32c_intel drm_kms_helper serio_raw syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm e1000 libata mptspi scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 70162 Comm: ksmtuned Kdump: loaded Tainted: G             L ------------   3.10.0-1062.1.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff8912123241c0 ti: ffff89120c3b8000 task.ti: ffff89120c3b8000
RIP: 0010:[<ffffffff8f58e059>]  [<ffffffff8f58e059>] copy_page+0x49/0xe0
RSP: 0000:ffff89120c3bbc38  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000001ec7a10 RSI: ffff8911bb4aa000 RDI: ffff8911a1139000
RBP: ffff89120c3bbcb0 R08: 00000000000163f0 R09: 0000000000000000
R10: 0000000000000021 R11: 0000000001ee4130 R12: 00000000013e5fee
R13: ffff89120c3bbc08 R14: 0000000000000000 R15: ffff89123ffd9800
FS:  00007f7f79b1d740(0000) GS:ffff89123a640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000001eca2b0 CR3: 00000000a9be4000 CR4: 00000000003607e0
Call Trace:
[<ffffffff8f3eb4e0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff8f3edb1b>] do_wp_page+0xfb/0x720
[<ffffffff8f3bbffb>] ? unlock_page+0x2b/0x30
[<ffffffff8f3ea939>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff8f3ef4a5>] handle_pte_fault+0x3d5/0xe20
[<ffffffff8f414c68>] ? alloc_pages_current+0x98/0x110
[<ffffffff8f3f200d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff8f987653>] __do_page_fault+0x213/0x500
[<ffffffff8f987975>] do_page_fault+0x35/0x90
[<ffffffff8f983778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #325849
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff845949a9
Build id: 3.10.0-1160.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff843ef080
Build id: 3.10.0-1160.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff843f16bb
Build id: 3.10.0-1160.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff843bdf6b
Build id: 3.10.0-1160.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff843ee4d9
Build id: 3.10.0-1160.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff843f5d32
Build id: 3.10.0-1160.el7.x86_64
0xb22
7
? update_curr
vmlinux 0xffffffff842e43cc
Build id: 3.10.0-1160.el7.x86_64
0x14c
8
__do_page_fault
vmlinux 0xffffffff8498e653
Build id: 3.10.0-1160.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffff8498e975
Build id: 3.10.0-1160.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffff8498a778
Build id: 3.10.0-1160.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#15 stuck for 22s! [firewalld:4220]
Modules linked in: tcp_lp xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 sb_edac snd_rawmidi snd_ac97_codec coretemp ac97_bus iosf_mbi crc32_pclmul snd_seq ghash_clmulni_intel snd_seq_device aesni_intel lrw snd_pcm gf128mul glue_helper snd_timer ablk_helper cryptd snd
ppdev vmw_balloon soundcore pcspkr joydev sg i2c_piix4 vmw_vmci parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common crc32c_intel mptspi scsi_transport_spi libata mptscsih e1000 serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 15 PID: 4220 Comm: firewalld Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff88fa80a76300 ti: ffff88f5c792c000 task.ti: ffff88f5c792c000
RIP: 0010:[<ffffffff845949a9>]  [<ffffffff845949a9>] copy_page+0x49/0xe0
RSP: 0000:ffff88f5c792fcc0  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 00007f7330758f90 RSI: ffff88f7869b8000 RDI: ffff88f8d99eb000
RBP: ffff88f5c792fd38 R08: 00007f732ff34cc0 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: 0000000060b59975
R13: ffff88f5c792fc80 R14: ffff8905fff9e000 R15: ffff8905fff9f000
FS:  00007f7340c06740(0000) GS:ffff8905bd9c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000002143df0 CR3: 0000000007930000 CR4: 00000000001607e0
Call Trace:
[<ffffffff843ef080>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff843f16bb>] do_wp_page+0xfb/0x720
[<ffffffff843bdf6b>] ? unlock_page+0x2b/0x30
[<ffffffff843ee4d9>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff843f5d32>] handle_mm_fault+0xb22/0xfb0
[<ffffffff842e43cc>] ? update_curr+0x14c/0x1e0
[<ffffffff8498e653>] __do_page_fault+0x213/0x500
[<ffffffff8498e975>] do_page_fault+0x35/0x90
[<ffffffff8498a778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #325137
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffa3f85da9
Build id: 3.10.0-957.27.2.el7.x86_64
0x49
2
? wp_page_copy.isra.71
vmlinux 0xffffffffa3de6b31
Build id: 3.10.0-957.27.2.el7.x86_64
0x121
3
do_wp_page
vmlinux 0xffffffffa3de8f6b
Build id: 3.10.0-957.27.2.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffa3db7b8b
Build id: 3.10.0-957.27.2.el7.x86_64
0x2b
5
? do_read_fault.isra.61
vmlinux 0xffffffffa3de5fd9
Build id: 3.10.0-957.27.2.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffffa3dea8fd
Build id: 3.10.0-957.27.2.el7.x86_64
0x37d
7
handle_mm_fault
vmlinux 0xffffffffa3ded3ad
Build id: 3.10.0-957.27.2.el7.x86_64
0x39d
8
__do_page_fault
vmlinux 0xffffffffa4371603
Build id: 3.10.0-957.27.2.el7.x86_64
0x203
9
do_page_fault
vmlinux 0xffffffffa4371925
Build id: 3.10.0-957.27.2.el7.x86_64
0x35
10
? error_swapgs
vmlinux 0xffffffffa436dab6
Build id: 3.10.0-957.27.2.el7.x86_64
0xa7
11
page_fault
vmlinux 0xffffffffa436d768
Build id: 3.10.0-957.27.2.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 42s! [kworker/2:2:27634]
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 42s! [lfd - (child) c:28732]
Modules linked in: ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 ip6table_filter nf_log_ipv4 nf_log_common nf_nat_ftp xt_REDIRECT nf_nat_redirect xt_conntrack nf_conntrack_ftp xt_LOG xt_limit xt_multiport iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 ip6table_mangle ip6table_raw ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 nf_nat nf_conntrack ip6_tables iptable_mangle iptable_raw ipt_REJECT nf_reject_ipv4 iptable_filter sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd vmw_balloon pcspkr joydev parport_pc sg parport i2c_piix4 vmw_vmci tcp_htcp ip_tables xfs libcrc32c vmwgfx drm_kms_helper sd_mod sr_mod syscopyarea cdrom sysfillrect crc_t10dif sysimgblt fb_sys_fops crct10dif_generic ata_generic pata_acpi
crct10dif_pclmul ttm ata_piix crct10dif_common drm crc32c_intel serio_raw e1000 vmw_pvscsi libata drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: talpa_syscallhook]
CPU: 1 PID: 28732 Comm: lfd - (child) c Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-957.27.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffffa0fb11ae1040 ti: ffffa0fba4240000 task.ti: ffffa0fba4240000
RIP: 0010:[<ffffffffa3f85da9>]  [<ffffffffa3f85da9>] copy_page+0x49/0xe0
RSP: 0000:ffffa0fba4243c48  EFLAGS: 00010206
RAX: 00000000706f6f6e RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffffa0fb998fa000 RDI: ffffa0fcca8ec000
RBP: ffffa0fba4243cc0 R08: 0000000000000000 R09: 0000000001e573c8
R10: 0000000100000000 R11: 0000000000000000 R12: 00000000e482a771
R13: ffffa0fba4243bf8 R14: 0000000000000000 R15: ffffa0fd7ffce000
FS:  00007f1178c94740(0000) GS:ffffa0fd7fc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000001e70180 CR3: 00000003083c2000 CR4: 00000000000407e0
Call Trace:
[<ffffffffa3de6b31>] ? wp_page_copy.isra.71+0x121/0x560
[<ffffffffa3de8f6b>] do_wp_page+0xfb/0x720
[<ffffffffa3db7b8b>] ? unlock_page+0x2b/0x30
[<ffffffffa3de5fd9>] ? do_read_fault.isra.61+0x139/0x1b0
[<ffffffffa3dea8fd>] handle_pte_fault+0x37d/0xd10
[<ffffffffa3ded3ad>] handle_mm_fault+0x39d/0x9b0
[<ffffffffa4371603>] __do_page_fault+0x203/0x4f0
[<ffffffffa4371925>] do_page_fault+0x35/0x90
[<ffffffffa436dab6>] ? error_swapgs+0xa7/0xbd
[<ffffffffa436d768>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #324010
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff915955e3
Build id: 3.10.0-1160.45.1.el7.x86_64
0x23
2
? wp_page_copy.isra.73
vmlinux 0xffffffff913ef9f0
Build id: 3.10.0-1160.45.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff913f202b
Build id: 3.10.0-1160.45.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff913be42b
Build id: 3.10.0-1160.45.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff913eee49
Build id: 3.10.0-1160.45.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff913f66a2
Build id: 3.10.0-1160.45.1.el7.x86_64
0xb22
7
__do_page_fault
vmlinux 0xffffffff91990653
Build id: 3.10.0-1160.45.1.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffff91990975
Build id: 3.10.0-1160.45.1.el7.x86_64
0x35
9
page_fault
vmlinux 0xffffffff9198c778
Build id: 3.10.0-1160.45.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 21s! [abrtd:39815]
Modules linked in: binfmt_misc rfcomm ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack talpa_vfshook(OE) talpa_pedconnector(OE) talpa_pedevice(OE) talpa_vcdevice(OE) talpa_core(OE) talpa_linux(OE) talpa_syscallhook(OE) ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bnep vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 iosf_mbi crc32_pclmul ghash_clmulni_intel snd_rawmidi snd_ac97_codec aesni_intel ac97_bus snd_seq lrw snd_seq_device
gf128mul snd_pcm glue_helper ablk_helper cryptd snd_timer btusb snd btrtl btbcm soundcore ppdev btintel bluetooth sg rfkill joydev pcspkr vmw_balloon parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm crc32c_intel mptspi scsi_transport_spi nfit ata_piix mptscsih mptbase libnvdimm libata drm_panel_orientation_quirks serio_raw e1000 dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 39815 Comm: abrtd Kdump: loaded Tainted: P           OEL ------------   3.10.0-1160.45.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff8accb851a100 ti: ffff8acbc96f0000 task.ti: ffff8acbc96f0000
RIP: 0010:[<ffffffff915955e3>]  [<ffffffff915955e3>] copy_page+0x23/0xe0
RSP: 0000:ffff8acbc96f3cc0  EFLAGS: 00010206
RAX: ffffc6cdc72ceec0 RBX: 0000000000000000 RCX: 000000000000003a
RDX: ffffffff91c8ed70 RSI: ffff8ace059a4000 RDI: ffff8acd0b3bb000
RBP: ffff8acbc96f3d38 R08: ffffffff91c8ed5f R09: ffffc6cdc72cef00
R10: 0000000000003bb2 R11: ffff8acbcb113008 R12: 00000000747d5d06
R13: ffff8acbc96f3c80 R14: 0000000000000000 R15: ffff8accbaaf1e00
FS:  00007faf0a067900(0000) GS:ffff8ace11a80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007faf0a09d968 CR3: 00000000735ec000 CR4: 00000000001607e0
Call Trace:
[<ffffffff913ef9f0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff913f202b>] do_wp_page+0xfb/0x720
[<ffffffff913be42b>] ? unlock_page+0x2b/0x30
[<ffffffff913eee49>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff913f66a2>] handle_mm_fault+0xb22/0xfb0
[<ffffffff91990653>] __do_page_fault+0x213/0x500
[<ffffffff91990975>] do_page_fault+0x35/0x90
[<ffffffff9198c778>] page_fault+0x28/0x30
Code: c3 0f 1f 80 00 00 00 00 48 83 ec 10 48 89 1c 24 4c 89 64 24 08 b9 3b 00 00 00 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 48 ff c9 <48> 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 
Complete report #274696
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffa5f846f9
Build id: 3.10.0-957.21.3.el7.x86_64
0x49
2
? wp_page_copy.isra.71
vmlinux 0xffffffffa5de59e1
Build id: 3.10.0-957.21.3.el7.x86_64
0x121
3
do_wp_page
vmlinux 0xffffffffa5de7e3b
Build id: 3.10.0-957.21.3.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffa5db6abb
Build id: 3.10.0-957.21.3.el7.x86_64
0x2b
5
? do_read_fault.isra.61
vmlinux 0xffffffffa5de4e89
Build id: 3.10.0-957.21.3.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffffa5de97cd
Build id: 3.10.0-957.21.3.el7.x86_64
0x37d
7
? __slab_free
vmlinux 0xffffffffa5e1b9a1
Build id: 3.10.0-957.21.3.el7.x86_64
0x81
8
handle_mm_fault
vmlinux 0xffffffffa5dec27d
Build id: 3.10.0-957.21.3.el7.x86_64
0x39d
9
__do_page_fault
vmlinux 0xffffffffa6370603
Build id: 3.10.0-957.21.3.el7.x86_64
0x203
10
do_page_fault
vmlinux 0xffffffffa6370925
Build id: 3.10.0-957.21.3.el7.x86_64
0x35
11
page_fault
vmlinux 0xffffffffa636c768
Build id: 3.10.0-957.21.3.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 29s! [httpd:35125]
Modules linked in: xt_TCPMSS xt_state xt_recent xt_multiport xt_LOG xt_mac xt_owner nf_conntrack_irc nf_conntrack_ftp xt_ecn xt_limit xt_length ipt_ULOG ipt_REJECT nf_reject_ipv4 iptable_mangle nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd e1000e pcspkr sg joydev ptp ppdev pps_core vmw_balloon parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel ahci serio_raw libahci vmwgfx drm_kms_helper ata_piix syscopyarea sysfillrect sysimgblt fb_sys_fops ttm e1000 libata drm drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log
dm_mod
CPU: 6 PID: 35125 Comm: httpd Kdump: loaded Tainted: G        W    L ------------   3.10.0-957.21.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff8a7a72be0000 ti: ffff8a7a63ba8000 task.ti: ffff8a7a63ba8000
RIP: 0010:[<ffffffffa5f846f9>]  [<ffffffffa5f846f9>] copy_page+0x49/0xe0
RSP: 0000:ffff8a7a63babc48  EFLAGS: 00010206
RAX: 0000840400000001 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 00005652ed93f930 RSI: ffff8a7a4d874000 RDI: ffff8a78f5e42000
RBP: ffff8a7a63babcc0 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 00007ff983224f42 R12: 00000000be78cd6e
R13: 0000000000000000 R14: 0000000000000000 R15: ffff8a7a7ffd7000
FS:  00007ff99513b880(0000) GS:ffff8a7a75780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005652ed9fc000 CR3: 00000001c0bb6000 CR4: 00000000001607e0
Call Trace:
[<ffffffffa5de59e1>] ? wp_page_copy.isra.71+0x121/0x560
[<ffffffffa5de7e3b>] do_wp_page+0xfb/0x720
[<ffffffffa5db6abb>] ? unlock_page+0x2b/0x30
[<ffffffffa5de4e89>] ? do_read_fault.isra.61+0x139/0x1b0
[<ffffffffa5de97cd>] handle_pte_fault+0x37d/0xd10
[<ffffffffa5e1b9a1>] ? __slab_free+0x81/0x2f0
[<ffffffffa5dec27d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffa6370603>] __do_page_fault+0x203/0x4f0
[<ffffffffa6370925>] do_page_fault+0x35/0x90
[<ffffffffa636c768>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #252231
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffb2b949a9
Build id: 3.10.0-1160.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffffb29ef080
Build id: 3.10.0-1160.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffffb29f16bb
Build id: 3.10.0-1160.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffb29bdf6b
Build id: 3.10.0-1160.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffffb29ee4d9
Build id: 3.10.0-1160.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffffb29f5d32
Build id: 3.10.0-1160.el7.x86_64
0xb22
7
? user_path_at_empty
vmlinux 0xffffffffb2a60d72
Build id: 3.10.0-1160.el7.x86_64
0x72
8
__do_page_fault
vmlinux 0xffffffffb2f8e653
Build id: 3.10.0-1160.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffffb2f8e975
Build id: 3.10.0-1160.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffffb2f8a778
Build id: 3.10.0-1160.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [bash:61957]
Modules linked in: tcp_lp veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack bonding ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel vmw_balloon pcspkr cryptd joydev sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif
cdrom crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt crct10dif_pclmul fb_sys_fops crct10dif_common ttm crc32c_intel drm nfit serio_raw libnvdimm ata_piix mptspi libata scsi_transport_spi e1000 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 61957 Comm: bash Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff902f7f101080 ti: ffff902f7e630000 task.ti: ffff902f7e630000
RIP: 0010:[<ffffffffb2b949a9>]  [<ffffffffb2b949a9>] copy_page+0x49/0xe0
RSP: 0000:ffff902f7e633cc0  EFLAGS: 00010206
RAX: 0000557ef0912630 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000557ef087dba0 RSI: ffff902fbf856000 RDI: ffff90311732d000
RBP: ffff902f7e633d38 R08: 000000000000003b R09: ffffffffffffffff
R10: 0000000000000000 R11: 0000000000000041 R12: 0000000036684da2
R13: ffff902f7e633c80 R14: ffff90317ffda000 R15: ffff90317ffdb000
FS:  00007f7a45e83d48(0000) GS:ffff903175600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000557ef0912878 CR3: 0000000096a88000 CR4: 00000000003607f0
Call Trace:
[<ffffffffb29ef080>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffffb29f16bb>] do_wp_page+0xfb/0x720
[<ffffffffb29bdf6b>] ? unlock_page+0x2b/0x30
[<ffffffffb29ee4d9>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffffb29f5d32>] handle_mm_fault+0xb22/0xfb0
[<ffffffffb2a60d72>] ? user_path_at_empty+0x72/0xc0
[<ffffffffb2f8e653>] __do_page_fault+0x213/0x500
[<ffffffffb2f8e975>] do_page_fault+0x35/0x90
[<ffffffffb2f8a778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #251696
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff86993bc9
Build id: 3.10.0-1127.19.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff867ef1b0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff867f17eb
Build id: 3.10.0-1127.19.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff867be7ab
Build id: 3.10.0-1127.19.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff867ee609
Build id: 3.10.0-1127.19.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff867f5e82
Build id: 3.10.0-1127.19.1.el7.x86_64
0xb22
7
__do_page_fault
vmlinux 0xffffffff86d8d653
Build id: 3.10.0-1127.19.1.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffff86d8d975
Build id: 3.10.0-1127.19.1.el7.x86_64
0x35
9
page_fault
vmlinux 0xffffffff86d89778
Build id: 3.10.0-1127.19.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 21s! [service:109634]
Modules linked in: bridge stp llc ip_set nfnetlink vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac snd_ens1371 snd_rawmidi snd_ac97_codec iosf_mbi ac97_bus crc32_pclmul ghash_clmulni_intel snd_seq aesni_intel snd_seq_device lrw gf128mul snd_pcm glue_helper ablk_helper cryptd snd_timer ppdev snd soundcore vmw_balloon pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common libata crc32c_intel nfit mptspi scsi_transport_spi libnvdimm e1000 mptscsih serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
CPU: 5 PID: 109634 Comm: service Kdump: loaded Tainted: G        W    L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff9aa4190bd230 ti: ffff9aa42b6d0000 task.ti: ffff9aa42b6d0000
RIP: 0010:[<ffffffff86993bc9>]  [<ffffffff86993bc9>] copy_page+0x49/0xe0
RSP: 0000:ffff9aa42b6d3cc0  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff9aa3605ee000 RDI: ffff9aa36cffd000
RBP: ffff9aa42b6d3d38 R08: 00000000004a12a0 R09: 0000000000000000
R10: 00000000004a12a0 R11: 0000000000000000 R12: 00000000826a2118
R13: ffff9aa42b6d3c80 R14: ffff9aa43ffda000 R15: ffff9aa43ffdb000
FS:  00007fb858cf6740(0000) GS:ffff9aa42d740000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000006e6bd4 CR3: 000000036e238000 CR4: 00000000001607e0
Call Trace:
[<ffffffff867ef1b0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff867f17eb>] do_wp_page+0xfb/0x720
[<ffffffff867be7ab>] ? unlock_page+0x2b/0x30
[<ffffffff867ee609>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff867f5e82>] handle_mm_fault+0xb22/0xfb0
[<ffffffff86d8d653>] __do_page_fault+0x213/0x500
[<ffffffff86d8d975>] do_page_fault+0x35/0x90
[<ffffffff86d89778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #250991
Frame # Function Binary Source or offset Line
1
page_add_new_anon_rmap
vmlinux 0xffffffffa2c018a7
Build id: 3.10.0-1160.41.1.el7.x86_64
0x17
2
wp_page_copy.isra.73
vmlinux 0xffffffffa2befc25
Build id: 3.10.0-1160.41.1.el7.x86_64
0x355
3
do_wp_page
vmlinux 0xffffffffa2bf202b
Build id: 3.10.0-1160.41.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffa2bbe42b
Build id: 3.10.0-1160.41.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffffa2beee49
Build id: 3.10.0-1160.41.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffffa2bf66a2
Build id: 3.10.0-1160.41.1.el7.x86_64
0xb22
7
__do_page_fault
vmlinux 0xffffffffa3190653
Build id: 3.10.0-1160.41.1.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffffa3190975
Build id: 3.10.0-1160.41.1.el7.x86_64
0x35
9
? error_swapgs
vmlinux 0xffffffffa318cac9
Build id: 3.10.0-1160.41.1.el7.x86_64
0xaa
10
page_fault
vmlinux 0xffffffffa318c778
Build id: 3.10.0-1160.41.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 28s! [java:32412]
Modules linked in: tcp_lp xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc crc32_pclmul ghash_clmulni_intel aesni_intel lrw ppdev gf128mul glue_helper ablk_helper cryptd vmw_balloon joydev pcspkr parport_pc sg parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper e1000 syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata crct10dif_pclmul crct10dif_common crc32c_intel mptspi serio_raw scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks
floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 4 PID: 32412 Comm: java Kdump: loaded Tainted: G             L ------------   3.10.0-1160.41.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff9629241aa100 ti: ffff962a0c83c000 task.ti: ffff962a0c83c000
RIP: 0010:[<ffffffffa2c018a7>]  [<ffffffffa2c018a7>] page_add_new_anon_rmap+0x17/0x170
RSP: 0000:ffff962a0c83fcb0  EFLAGS: 00010246
RAX: 800000010f60a025 RBX: ffff962916b82bc0 RCX: ffff962916b82bc0
RDX: 00000000ffe06708 RSI: ffff962abe302a20 RDI: fffffb31c7fc1040
RBP: ffff962a0c83fcc8 R08: 0000000000000001 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: ffff962a0c83fc70
R13: 0000000000000000 R14: ffff962916b82f08 R15: 0000000000000000
FS:  00007fd086073700(0000) GS:ffff962affd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000ffe06708 CR3: 0000000235be2000 CR4: 00000000000007e0
Call Trace:
[<ffffffffa2befc25>] wp_page_copy.isra.73+0x355/0x5b0
[<ffffffffa2bf202b>] do_wp_page+0xfb/0x720
[<ffffffffa2bbe42b>] ? unlock_page+0x2b/0x30
[<ffffffffa2beee49>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffffa2bf66a2>] handle_mm_fault+0xb22/0xfb0
[<ffffffffa3190653>] __do_page_fault+0x213/0x500
[<ffffffffa3190975>] do_page_fault+0x35/0x90
[<ffffffffa318cac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffa318c778>] page_fault+0x28/0x30
Code: 30 ff ff ff 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 41 55 49 89 d5 41 54 49 89 f4 53 48 89 fb <f0> 80 4f 02 08 48 8b 07 c7 47 18 00 00 00 00 f6 c4 40 75 75 be 
Complete report #245108
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff8858e059
Build id: 3.10.0-1062.1.2.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff883eb4e0
Build id: 3.10.0-1062.1.2.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff883edb1b
Build id: 3.10.0-1062.1.2.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff883bbffb
Build id: 3.10.0-1062.1.2.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff883ea939
Build id: 3.10.0-1062.1.2.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffff883ef4a5
Build id: 3.10.0-1062.1.2.el7.x86_64
0x3d5
7
? alloc_pages_current
vmlinux 0xffffffff88414c68
Build id: 3.10.0-1062.1.2.el7.x86_64
0x98
8
handle_mm_fault
vmlinux 0xffffffff883f200d
Build id: 3.10.0-1062.1.2.el7.x86_64
0x39d
9
__do_page_fault
vmlinux 0xffffffff88987653
Build id: 3.10.0-1062.1.2.el7.x86_64
0x213
10
do_page_fault
vmlinux 0xffffffff88987975
Build id: 3.10.0-1062.1.2.el7.x86_64
0x35
11
page_fault
vmlinux 0xffffffff88983778
Build id: 3.10.0-1062.1.2.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 80s! [postmaster:28212]
Modules linked in: binfmt_misc xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun bridge stp llc devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev sb_edac vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic
 ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi scsi_transport_spi crct10dif_pclmul ata_piix crct10dif_common crc32c_intel mptscsih libata serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 28212 Comm: postmaster Tainted: G        W    L ------------   3.10.0-1062.1.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff8aa688161070 ti: ffff8aa738188000 task.ti: ffff8aa738188000
RIP: 0010:[<ffffffff8858e059>]  [<ffffffff8858e059>] copy_page+0x49/0xe0
RSP: 0000:ffff8aa73818bc38  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff8aa7399d4000 RDI: ffff8aa9bf4f5000
RBP: ffff8aa73818bcb0 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: 00000000ccf39f4e
R13: ffff8aa73818bc08 R14: 0000000000000000 R15: ffff8aaebffda000
FS:  00007f04578f28c0(0000) GS:ffff8aae9d600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f04576fe458 CR3: 00000000b8f42000 CR4: 00000000003607f0
vmxnet3 0000:03:00.0 ens160: resetting
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 [<ffffffff883eb4e0>] ? wp_page_copy.isra.73+0x120/0x5b0
 [<ffffffff883edb1b>] do_wp_page+0xfb/0x720
 [<ffffffff883bbffb>] ? unlock_page+0x2b/0x30
 [<ffffffff883ea939>] ? do_read_fault.isra.63+0x139/0x1b0
 [<ffffffff883ef4a5>] handle_pte_fault+0x3d5/0xe20
 [<ffffffff88414c68>] ? alloc_pages_current+0x98/0x110
 [<ffffffff883f200d>] handle_mm_fault+0x39d/0x9b0
 [<ffffffff88987653>] __do_page_fault+0x213/0x500
 [<ffffffff88987975>] do_page_fault+0x35/0x90
 [<ffffffff88983778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #237860
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffb9b840e9
Build id: 3.10.0-957.1.3.el7.x86_64
0x49
2
? wp_page_copy.isra.71
vmlinux 0xffffffffb99e5641
Build id: 3.10.0-957.1.3.el7.x86_64
0x121
3
do_wp_page
vmlinux 0xffffffffb99e7a9b
Build id: 3.10.0-957.1.3.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffb99b676b
Build id: 3.10.0-957.1.3.el7.x86_64
0x2b
5
? do_read_fault.isra.61
vmlinux 0xffffffffb99e4ae9
Build id: 3.10.0-957.1.3.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffffb99e942d
Build id: 3.10.0-957.1.3.el7.x86_64
0x37d
7
handle_mm_fault
vmlinux 0xffffffffb99ebedd
Build id: 3.10.0-957.1.3.el7.x86_64
0x39d
8
__do_page_fault
vmlinux 0xffffffffb9f6f5e3
Build id: 3.10.0-957.1.3.el7.x86_64
0x203
9
do_page_fault
vmlinux 0xffffffffb9f6f915
Build id: 3.10.0-957.1.3.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffffb9f6b758
Build id: 3.10.0-957.1.3.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [crond:52122]
Modules linked in: udp_diag inet_diag binfmt_misc authenc l2tp_ppp l2tp_netlink l2tp_core pppox ppp_generic slhc drbg ansi_cprng rmd160 crypto_null iptable_filter ip_vti ip_tunnel af_key ah6 ah4 esp6 esp4 xfrm4_mode_beet xfrm4_tunnel tunnel4 xfrm4_mode_tunnel xfrm4_mode_transport xfrm6_mode_transport xfrm6_mode_ro xfrm6_mode_beet xfrm6_mode_tunnel ipcomp ipcomp6 xfrm6_tunnel xfrm_ipcomp tunnel6 cmac camellia_generic camellia_aesni_avx_x86_64 camellia_x86_64 cast6_avx_x86_64 cast6_generic cast5_avx_x86_64 cast5_generic cast_common deflate cts gcm ccm serpent_avx_x86_64 serpent_sse2_x86_64 serpent_generic blowfish_generic blowfish_x86_64 blowfish_common twofish_generic twofish_avx_x86_64 twofish_x86_64_3way xts twofish_x86_64 twofish_common xcbc sha512_ssse3 sha512_generic des_generic vmw_vsock_vmci_transport
vsock ppdev iosf_mbi snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq btusb btrtl snd_seq_device btbcm btintel snd_pcm bluetooth snd_timer snd rfkill soundcore sg parport_pc parport i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_generic pata_acpi vmwgfx e1000 drm_kms_helper syscopyarea sysfillrect ata_piix sysimgblt fb_sys_fops ttm libata drm mptspi scsi_transport_spi drm_panel_orientation_quirks mptscsih mptbase nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 52122 Comm: crond Kdump: loaded Tainted: G        W    L ------------   3.10.0-957.1.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff9ef31fe80000 ti: ffff9ef18cb30000 task.ti: ffff9ef18cb30000
RIP: 0010:[<ffffffffb9b840e9>]  [<ffffffffb9b840e9>] copy_page+0x49/0xe0
RSP: 0000:ffff9ef18cb33c48  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff9ef1b80a0000 RDI: ffff9ef10bfc5000
RBP: ffff9ef18cb33cc0 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: 000000001ac95572
R13: ffff9ef18cb33c18 R14: 0000000000000000 R15: ffff9ef33ffd7000
FS:  00007f37afb3b840(0000) GS:ffff9ef335640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f37ae89d458 CR3: 000000022aa68000 CR4: 00000000001607e0
Call Trace:
[<ffffffffb99e5641>] ? wp_page_copy.isra.71+0x121/0x560
[<ffffffffb99e7a9b>] do_wp_page+0xfb/0x720
[<ffffffffb99b676b>] ? unlock_page+0x2b/0x30
[<ffffffffb99e4ae9>] ? do_read_fault.isra.61+0x139/0x1b0
[<ffffffffb99e942d>] handle_pte_fault+0x37d/0xd10
[<ffffffffb99ebedd>] handle_mm_fault+0x39d/0x9b0
[<ffffffffb9f6f5e3>] __do_page_fault+0x203/0x500
[<ffffffffb9f6f915>] do_page_fault+0x35/0x90
[<ffffffffb9f6b758>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #236691
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffa61955b9
Build id: 3.10.0-1160.36.2.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffffa5fef9d0
Build id: 3.10.0-1160.36.2.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffffa5ff200b
Build id: 3.10.0-1160.36.2.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffa5fbe40b
Build id: 3.10.0-1160.36.2.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffffa5feee29
Build id: 3.10.0-1160.36.2.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffffa5ff6682
Build id: 3.10.0-1160.36.2.el7.x86_64
0xb22
7
? do_mmap
vmlinux 0xffffffffa5ffd34c
Build id: 3.10.0-1160.36.2.el7.x86_64
0x39c
8
? mprotect_fixup
vmlinux 0xffffffffa5ffed29
Build id: 3.10.0-1160.36.2.el7.x86_64
0x1b9
9
__do_page_fault
vmlinux 0xffffffffa6590653
Build id: 3.10.0-1160.36.2.el7.x86_64
0x213
10
do_page_fault
vmlinux 0xffffffffa6590975
Build id: 3.10.0-1160.36.2.el7.x86_64
0x35
11
? error_swapgs
vmlinux 0xffffffffa658cac9
Build id: 3.10.0-1160.36.2.el7.x86_64
0xaa
12
page_fault
vmlinux 0xffffffffa658c778
Build id: 3.10.0-1160.36.2.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 668s! [cleanup:16127]
Modules linked in: ipt_REJECT nf_reject_ipv4 xt_conntrack iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat vmw_vsock_vmci_transport vsock nf_conntrack sunrpc coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd pcspkr vmw_balloon joydev sg parport_pc i2c_piix4 parport vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul ata_piix crct10dif_common drm mptspi e1000 crc32c_intel scsi_transport_spi mptscsih serio_raw libata mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 16127 Comm: cleanup Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.36.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/30/2013
task: ffff881137fc0000 ti: ffff881137e78000 task.ti: ffff881137e78000
RIP: 0010:[<ffffffffa61955b9>]  [<ffffffffa61955b9>] copy_page+0x49/0xe0
RSP: 0000:ffff881137e7bcc0  EFLAGS: 00010206
RAX: 0000003800000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000109 RSI: ffff881149339000 RDI: ffff88116519c000
RBP: ffff881137e7bd38 R08: 0000010100000000 R09: 0000001900000020
R10: 0000000000000000 R11: 0000000000000000 R12: 00000000b3e94ac0
R13: ffffffffa5fc0e8d R14: ffff881137e7bc90 R15: ffff88111e9eca00
FS:  0000000000000000(0000) GS:ffff88117fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f1b190c9de8 CR3: 00000000408c6000 CR4: 00000000000407f0
Call Trace:
[<ffffffffa5fef9d0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffffa5ff200b>] do_wp_page+0xfb/0x720
[<ffffffffa5fbe40b>] ? unlock_page+0x2b/0x30
[<ffffffffa5feee29>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffffa5ff6682>] handle_mm_fault+0xb22/0xfb0
[<ffffffffa5ffd34c>] ? do_mmap+0x39c/0x590
[<ffffffffa5ffed29>] ? mprotect_fixup+0x1b9/0x3a0
[<ffffffffa6590653>] __do_page_fault+0x213/0x500
[<ffffffffa6590975>] do_page_fault+0x35/0x90
[<ffffffffa658cac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffa658c778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #231819
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff8b394f59
Build id: 3.10.0-1160.25.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff8b1ef2d0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff8b1f190b
Build id: 3.10.0-1160.25.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff8b1be20b
Build id: 3.10.0-1160.25.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff8b1ee729
Build id: 3.10.0-1160.25.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff8b1f5f82
Build id: 3.10.0-1160.25.1.el7.x86_64
0xb22
7
? do_mmap
vmlinux 0xffffffff8b1fcc4c
Build id: 3.10.0-1160.25.1.el7.x86_64
0x39c
8
? mprotect_fixup
vmlinux 0xffffffff8b1fe629
Build id: 3.10.0-1160.25.1.el7.x86_64
0x1b9
9
__do_page_fault
vmlinux 0xffffffff8b790653
Build id: 3.10.0-1160.25.1.el7.x86_64
0x213
10
do_page_fault
vmlinux 0xffffffff8b790975
Build id: 3.10.0-1160.25.1.el7.x86_64
0x35
11
page_fault
vmlinux 0xffffffff8b78c778
Build id: 3.10.0-1160.25.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [curl:22524]
Modules linked in: vsock_diag tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg ppdev joydev pcspkr vmw_balloon i2c_piix4 parport_pc parport vmw_vmci binfmt_misc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common e1000e syscopyarea sysfillrect
crc32c_intel serio_raw sysimgblt ahci fb_sys_fops ttm libahci ptp pps_core drm nfit ata_piix vmw_pvscsi libnvdimm libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 22524 Comm: curl Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/28/2017
task: ffff94d36b619080 ti: ffff94d6358a4000 task.ti: ffff94d6358a4000
RIP: 0010:[<ffffffff8b394f59>]  [<ffffffff8b394f59>] copy_page+0x49/0xe0
RSP: 0000:ffff94d6358a7cc0  EFLAGS: 00010206
RAX: 484c24748d4c0000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 2e66282444894848 RSI: ffff94d9aff49000 RDI: ffff94d698cfa000
RBP: ffff94d6358a7d38 R08: 0000000000841f0f R09: 00000400bee2894c
R10: fffff480e8df8948 R11: 00010f840fc08548 R12: 00000000a63455bc
R13: ffffffff8b1c0c8d R14: ffff94d9fffda000 R15: ffff94d9fffdb000
FS:  0000000000000000(0000) GS:ffff94d9ffc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0c0eb3deb8 CR3: 00000006ddee0000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8b1ef2d0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff8b1f190b>] do_wp_page+0xfb/0x720
[<ffffffff8b1be20b>] ? unlock_page+0x2b/0x30
[<ffffffff8b1ee729>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff8b1f5f82>] handle_mm_fault+0xb22/0xfb0
[<ffffffff8b1fcc4c>] ? do_mmap+0x39c/0x590
[<ffffffff8b1fe629>] ? mprotect_fixup+0x1b9/0x3a0
[<ffffffff8b790653>] __do_page_fault+0x213/0x500
[<ffffffff8b790975>] do_page_fault+0x35/0x90
[<ffffffff8b78c778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #213593
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffa15950b9
Build id: 3.10.0-1160.31.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffffa13ef4f0
Build id: 3.10.0-1160.31.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffffa13f1b2b
Build id: 3.10.0-1160.31.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffa13bdf2b
Build id: 3.10.0-1160.31.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffffa13ee949
Build id: 3.10.0-1160.31.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffffa13f61a2
Build id: 3.10.0-1160.31.1.el7.x86_64
0xb22
7
__do_page_fault
vmlinux 0xffffffffa1990653
Build id: 3.10.0-1160.31.1.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffffa1990975
Build id: 3.10.0-1160.31.1.el7.x86_64
0x35
9
? error_swapgs
vmlinux 0xffffffffa198cac9
Build id: 3.10.0-1160.31.1.el7.x86_64
0xaa
10
page_fault
vmlinux 0xffffffffa198c778
Build id: 3.10.0-1160.31.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [wdavdaemon:13500]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables vsock_diag tcp_diag udp_diag inet_diag unix_diag tun devlink bridge stp llc ip_set vmw_vsock_vmci_transport vsock iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 nfsd nfs_acl lockd grace auth_rpcgss
sunrpc xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops serio_raw ttm vmxnet3 mptspi drm ata_piix scsi_transport_spi mptscsih nfit mptbase libata libnvdimm drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: ip_tables]
CPU: 1 PID: 13500 Comm: wdavdaemon Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.31.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9df47a1c4200 ti: ffff9df1d8db4000 task.ti: ffff9df1d8db4000
RIP: 0010:[<ffffffffa15950b9>]  [<ffffffffa15950b9>] copy_page+0x49/0xe0
RSP: 0000:ffff9df1d8db7cc0  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff9df4c95cf000 RDI: ffff9df2c02a5000
RBP: ffff9df1d8db7d38 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: 0000000014811691
R13: ffff9df1d8db7c80 R14: 0000000000000000 R15: ffff9df239b71080
FS:  00007f572cffc700(0000) GS:ffff9df4ffc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f570bc739d0 CR3: 00000001e4d58000 CR4: 00000000000407e0
Call Trace:
[<ffffffffa13ef4f0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffffa13f1b2b>] do_wp_page+0xfb/0x720
[<ffffffffa13bdf2b>] ? unlock_page+0x2b/0x30
[<ffffffffa13ee949>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffffa13f61a2>] handle_mm_fault+0xb22/0xfb0
[<ffffffffa1990653>] __do_page_fault+0x213/0x500
[<ffffffffa1990975>] do_page_fault+0x35/0x90
[<ffffffffa198cac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffa198c778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #208992
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffb4593aa0
Build id: 3.10.0-1127.el7.x86_64
0x20
2
? wp_page_copy.isra.73
vmlinux 0xffffffffb43ef130
Build id: 3.10.0-1127.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffffb43f176b
Build id: 3.10.0-1127.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffb43be6fb
Build id: 3.10.0-1127.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffffb43ee589
Build id: 3.10.0-1127.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffffb43f5e02
Build id: 3.10.0-1127.el7.x86_64
0xb22
7
? __schedule
vmlinux 0xffffffffb498562a
Build id: 3.10.0-1127.el7.x86_64
0x10a
8
__do_page_fault
vmlinux 0xffffffffb498d653
Build id: 3.10.0-1127.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffffb498d975
Build id: 3.10.0-1127.el7.x86_64
0x35
10
? error_swapgs
vmlinux 0xffffffffb4989ac9
Build id: 3.10.0-1127.el7.x86_64
0xaa
11
page_fault
vmlinux 0xffffffffb4989778
Build id: 3.10.0-1127.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [dracut-rootfs-g:70]
Modules linked in:
CPU: 0 PID: 70 Comm: dracut-rootfs-g Not tainted 3.10.0-1127.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
task: ffff9a0babd6b150 ti: ffff9a09595d8000 task.ti: ffff9a09595d8000
RIP: 0010:[<ffffffffb4593aa0>]  [<ffffffffb4593aa0>] copy_page+0x20/0xe0
RSP: 0000:ffff9a09595dbcc0  EFLAGS: 00000202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000008
RDX: 0000000000000000 RSI: ffff9a0bbfb84cc0 RDI: ffff9a0bbf728cc0
RBP: ffff9a09595dbd38 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: 000000002be5ed56
R13: ffff9a09595dbc80 R14: ffff9a0bbffce000 R15: ffff9a0bbffcf000
FS:  00007fb607d17740(0000) GS:ffff9a0bbfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00000000006e82c8 CR3: 00000001d9d52000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 0000000000000000 DR7: 0000000000000000
Call Trace:
 [<ffffffffb43ef130>] ? wp_page_copy.isra.73+0x120/0x5b0
 [<ffffffffb43f176b>] do_wp_page+0xfb/0x720
 [<ffffffffb43be6fb>] ? unlock_page+0x2b/0x30
 [<ffffffffb43ee589>] ? do_read_fault.isra.63+0x139/0x1b0
 [<ffffffffb43f5e02>] handle_mm_fault+0xb22/0xfb0
 [<ffffffffb498562a>] ? __schedule+0x10a/0x840
 [<ffffffffb498d653>] __do_page_fault+0x213/0x500
 [<ffffffffb498d975>] do_page_fault+0x35/0x90
 [<ffffffffb4989ac9>] ? error_swapgs+0xaa/0xc0
 [<ffffffffb4989778>] page_fault+0x28/0x30
Code: f3 48 a5 c3 0f 1f 80 00 00 00 00 48 83 ec 10 48 89 1c 24 4c 89 64 24 08 b9 3b 00 00 00 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 <48> ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 
Complete report #204570
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff8c793bc9
Build id: 3.10.0-1127.19.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff8c5ef1b0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff8c5f17eb
Build id: 3.10.0-1127.19.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff8c5be7ab
Build id: 3.10.0-1127.19.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff8c5ee609
Build id: 3.10.0-1127.19.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff8c5f5e82
Build id: 3.10.0-1127.19.1.el7.x86_64
0xb22
7
__do_page_fault
vmlinux 0xffffffff8cb8d653
Build id: 3.10.0-1127.19.1.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffff8cb8d975
Build id: 3.10.0-1127.19.1.el7.x86_64
0x35
9
? error_swapgs
vmlinux 0xffffffff8cb89ac9
Build id: 3.10.0-1127.19.1.el7.x86_64
0xaa
10
page_fault
vmlinux 0xffffffff8cb89778
Build id: 3.10.0-1127.19.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 49s! [httpd:15079]
Modules linked in: binfmt_misc tcp_diag inet_diag vfat fat isofs ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 ip6table_filter xt_time nf_log_ipv4 nf_log_common nf_nat_ftp xt_conntrack nf_conntrack_ftp xt_LOG xt_limit kcare(OE) ip6table_mangle ip6table_raw ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables iptable_mangle iptable_raw ipt_REJECT nf_reject_ipv4 xt_REDIRECT nf_nat_redirect iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_owner xt_multiport ext4 mbcache jbd2 loop sunrpc ppdev vmw_balloon pcspkr coretemp joydev sg vmw_vmci parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod crct10dif_generic cdrom crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper crc32c_intel syscopyarea sysfillrect
sysimgblt serio_raw fb_sys_fops ttm mptspi scsi_transport_spi ata_piix mptscsih drm libata vmxnet3 mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 15079 Comm: httpd Kdump: loaded Tainted: G           OEL ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff9c079a979070 ti: ffff9c038c620000 task.ti: ffff9c038c620000
RIP: 0010:[<ffffffff8c793bc9>]  [<ffffffff8c793bc9>] copy_page+0x49/0xe0
RSP: 0000:ffff9c038c623cc0  EFLAGS: 00010206
RAX: 00002aac5400c910 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff9c05e56f2000 RDI: ffff9c03e2704000
RBP: ffff9c038c623d38 R08: 00002aac8000a660 R09: 0000000000000030
R10: 0000000000000045 R11: 322e3731322e3539 R12: 00000000d4d1488d
R13: ffff9c038c623c80 R14: ffff9c07bffce000 R15: ffff9c07bffcf000
FS:  00002aac3ac15700(0000) GS:ffff9c07bfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00002aac5401edd0 CR3: 000000000b978000 CR4: 00000000000007f0
Call Trace:
[<ffffffff8c5ef1b0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff8c5f17eb>] do_wp_page+0xfb/0x720
[<ffffffff8c5be7ab>] ? unlock_page+0x2b/0x30
[<ffffffff8c5ee609>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff8c5f5e82>] handle_mm_fault+0xb22/0xfb0
[<ffffffff8cb8d653>] __do_page_fault+0x213/0x500
[<ffffffff8cb8d975>] do_page_fault+0x35/0x90
[<ffffffff8cb89ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffff8cb89778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #191991
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff8bd93bc9
Build id: 3.10.0-1127.19.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff8bbef1b0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff8bbf17eb
Build id: 3.10.0-1127.19.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff8bbbe7ab
Build id: 3.10.0-1127.19.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff8bbee609
Build id: 3.10.0-1127.19.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff8bbf5e82
Build id: 3.10.0-1127.19.1.el7.x86_64
0xb22
7
? update_curr
vmlinux 0xffffffff8bae4eac
Build id: 3.10.0-1127.19.1.el7.x86_64
0x14c
8
__do_page_fault
vmlinux 0xffffffff8c18d653
Build id: 3.10.0-1127.19.1.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffff8c18d975
Build id: 3.10.0-1127.19.1.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffff8c189778
Build id: 3.10.0-1127.19.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [yum-cron:2987]
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ksmtuned:3777]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr joydev vmxnet3 vmw_balloon sg vmw_vmci parport_pc parport i2c_piix4 binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper ata_piix syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw
drm libata vmw_pvscsi drm_panel_orientation_quirks nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 3777 Comm: ksmtuned Kdump: loaded Tainted: G             L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff996fab5162a0 ti: ffff996d9d2bc000 task.ti: ffff996d9d2bc000
RIP: 0010:[<ffffffff8bd93bc9>]  [<ffffffff8bd93bc9>] copy_page+0x49/0xe0
RSP: 0000:ffff996d9d2bfcc0  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 00000000009f7980 RSI: ffff996f5dcce000 RDI: ffff996d885df000
RBP: ffff996d9d2bfd38 R08: 0000000000002636 R09: 0000000000222a24
R10: 0000000000000021 R11: 0000000000a3b6b0 R12: 00000000ddc21bb5
R13: ffff996d9d2bfc80 R14: ffff99703ffda000 R15: ffff99703ffdb000
FS:  00007f611e4ba740(0000) GS:ffff99703fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000a2b5c8 CR3: 000000009844c000 CR4: 00000000001607f0
Call Trace:
[<ffffffff8bbef1b0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff8bbf17eb>] do_wp_page+0xfb/0x720
[<ffffffff8bbbe7ab>] ? unlock_page+0x2b/0x30
[<ffffffff8bbee609>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff8bbf5e82>] handle_mm_fault+0xb22/0xfb0
[<ffffffff8bae4eac>] ? update_curr+0x14c/0x1e0
[<ffffffff8c18d653>] __do_page_fault+0x213/0x500
[<ffffffff8c18d975>] do_page_fault+0x35/0x90
[<ffffffff8c189778>] page_fault+0x28/0x30
Complete report #189027
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff84394e89
Build id: 3.10.0-1160.15.2.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff841ef200
Build id: 3.10.0-1160.15.2.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff841f183b
Build id: 3.10.0-1160.15.2.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff841be15b
Build id: 3.10.0-1160.15.2.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff841ee659
Build id: 3.10.0-1160.15.2.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff841f5eb2
Build id: 3.10.0-1160.15.2.el7.x86_64
0xb22
7
? do_mmap
vmlinux 0xffffffff841fcb7c
Build id: 3.10.0-1160.15.2.el7.x86_64
0x39c
8
__do_page_fault
vmlinux 0xffffffff8478f653
Build id: 3.10.0-1160.15.2.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffff8478f975
Build id: 3.10.0-1160.15.2.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffff8478b778
Build id: 3.10.0-1160.15.2.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 36s! [sshd:21262]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon sg pcspkr joydev parport_pc parport vmw_vmci i2c_piix4 binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx
drm_kms_helper syscopyarea sysfillrect nfit sysimgblt fb_sys_fops ttm drm libnvdimm e1000e ahci ata_piix libahci sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw ptp pps_core vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 21262 Comm: sshd Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9e87c0100000 ti: ffff9e86c3d48000 task.ti: ffff9e86c3d48000
RIP: 0010:[<ffffffff84394e89>]  [<ffffffff84394e89>] copy_page+0x49/0xe0
RSP: 0000:ffff9e86c3d4bcc0  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff9e8761cab000 RDI: ffff9e87c5ed1000
RBP: ffff9e86c3d4bd38 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: 000000001599ac66
R13: ffffffff841c0bdd R14: ffff9e87fffd8000 R15: ffff9e87fffd9000
FS:  0000000000000000(0000) GS:ffff9e87ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f6c48b29eb0 CR3: 00000000050c6000 CR4: 00000000007607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffff841ef200>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff841f183b>] do_wp_page+0xfb/0x720
[<ffffffff841be15b>] ? unlock_page+0x2b/0x30
[<ffffffff841ee659>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff841f5eb2>] handle_mm_fault+0xb22/0xfb0
[<ffffffff841fcb7c>] ? do_mmap+0x39c/0x590
[<ffffffff8478f653>] __do_page_fault+0x213/0x500
[<ffffffff8478f975>] do_page_fault+0x35/0x90
[<ffffffff8478b778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #183777
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff93394f59
Build id: 3.10.0-1160.25.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff931ef2d0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff931f190b
Build id: 3.10.0-1160.25.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff931be20b
Build id: 3.10.0-1160.25.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff931ee729
Build id: 3.10.0-1160.25.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff931f5f82
Build id: 3.10.0-1160.25.1.el7.x86_64
0xb22
7
__do_page_fault
vmlinux 0xffffffff93790653
Build id: 3.10.0-1160.25.1.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffff93790975
Build id: 3.10.0-1160.25.1.el7.x86_64
0x35
9
? error_swapgs
vmlinux 0xffffffff9378cac9
Build id: 3.10.0-1160.25.1.el7.x86_64
0xaa
10
page_fault
vmlinux 0xffffffff9378c778
Build id: 3.10.0-1160.25.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 40s! [ksmtuned:11824]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 squashfs sb_edac coretemp loop iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr vmw_balloon sg joydev parport_pc vmw_vmci parport i2c_piix4 ip_tables xfs libcrc32c sr_mod
sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm ata_piix mptspi scsi_transport_spi libata mptscsih mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 11824 Comm: ksmtuned Kdump: loaded Tainted: G             L ------------   3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
task: ffff953d39f79080 ti: ffff953e5ae38000 task.ti: ffff953e5ae38000
RIP: 0010:[<ffffffff93394f59>]  [<ffffffff93394f59>] copy_page+0x49/0xe0
RSP: 0000:ffff953e5ae3bcc0  EFLAGS: 00010206
RAX: 0000006c61636f6c RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff953c0fbd3000 RDI: ffff953f9e40e000
RBP: ffff953e5ae3bd38 R08: 0000000000000021 R09: 007473696c646970
R10: 0000000000000000 R11: 0000000000000000 R12: 0000000046a221a1
R13: ffffffff931c0c8d R14: ffff953ffffce000 R15: ffff953ffffcf000
FS:  00007f934520c740(0000) GS:ffff953fffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000001329e2c CR3: 000000029f648000 CR4: 00000000000607f0
Call Trace:
[<ffffffff931ef2d0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff931f190b>] do_wp_page+0xfb/0x720
[<ffffffff931be20b>] ? unlock_page+0x2b/0x30
[<ffffffff931ee729>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff931f5f82>] handle_mm_fault+0xb22/0xfb0
[<ffffffff93790653>] __do_page_fault+0x213/0x500
[<ffffffff93790975>] do_page_fault+0x35/0x90
[<ffffffff9378cac9>] ? error_swapgs+0xaa/0xc0
[<ffffffff9378c778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #179848
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffbad93bc9
Build id: 3.10.0-1127.19.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffffbabef1b0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffffbabf17eb
Build id: 3.10.0-1127.19.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffbabbe7ab
Build id: 3.10.0-1127.19.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffffbabee609
Build id: 3.10.0-1127.19.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffffbabf5e82
Build id: 3.10.0-1127.19.1.el7.x86_64
0xb22
7
? do_mmap
vmlinux 0xffffffffbabfcb28
Build id: 3.10.0-1127.19.1.el7.x86_64
0x378
8
? mprotect_fixup
vmlinux 0xffffffffbabfe4c9
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1b9
9
__do_page_fault
vmlinux 0xffffffffbb18d653
Build id: 3.10.0-1127.19.1.el7.x86_64
0x213
10
do_page_fault
vmlinux 0xffffffffbb18d975
Build id: 3.10.0-1127.19.1.el7.x86_64
0x35
11
page_fault
vmlinux 0xffffffffbb189778
Build id: 3.10.0-1127.19.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [usleep:23812]
Modules linked in: vsock_diag tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw ppdev gf128mul glue_helper ablk_helper cryptd pcspkr joydev vmw_balloon sg parport_pc parport i2c_piix4 vmw_vmci binfmt_misc ip_tables xfs libcrc32c ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix ahci
drm libahci crct10dif_pclmul crct10dif_common e1000e nfit crc32c_intel libnvdimm libata serio_raw ptp pps_core vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 23812 Comm: usleep Kdump: loaded Tainted: G             L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8e765babe2a0 ti: ffff8e7579c30000 task.ti: ffff8e7579c30000
RIP: 0010:[<ffffffffbad93bc9>]  [<ffffffffbad93bc9>] copy_page+0x49/0xe0
RSP: 0000:ffff8e7579c33cc0  EFLAGS: 00010206
RAX: 380e0ac10201d00e RBX: 0000000000000000 RCX: 000000000000003a
RDX: 42100e42180e4220 RSI: ffff8e774a918000 RDI: ffff8e781997f000
RBP: ffff8e7579c33d38 R08: 000000000b44080e R09: 000007b400000044
R10: 000001faffffd4b8 R11: 0e42028e100e4200 R12: 000000007e3cdfd3
R13: ffffffffbabc0eed R14: ffff8e78fffda000 R15: ffff8e78fffdb000
FS:  0000000000000000(0000) GS:ffff8e78ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7d6dedce98 CR3: 00000002707e2000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffbabef1b0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffffbabf17eb>] do_wp_page+0xfb/0x720
[<ffffffffbabbe7ab>] ? unlock_page+0x2b/0x30
[<ffffffffbabee609>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffffbabf5e82>] handle_mm_fault+0xb22/0xfb0
[<ffffffffbabfcb28>] ? do_mmap+0x378/0x530
[<ffffffffbabfe4c9>] ? mprotect_fixup+0x1b9/0x3a0
[<ffffffffbb18d653>] __do_page_fault+0x213/0x500
[<ffffffffbb18d975>] do_page_fault+0x35/0x90
[<ffffffffbb189778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #106707
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff9e194ba9
Build id: 3.10.0-1160.11.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff9dfef260
Build id: 3.10.0-1160.11.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff9dff189b
Build id: 3.10.0-1160.11.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff9dfbe1bb
Build id: 3.10.0-1160.11.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff9dfee6b9
Build id: 3.10.0-1160.11.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff9dff5f12
Build id: 3.10.0-1160.11.1.el7.x86_64
0xb22
7
? mprotect_fixup
vmlinux 0xffffffff9dffe559
Build id: 3.10.0-1160.11.1.el7.x86_64
0x1b9
8
__do_page_fault
vmlinux 0xffffffff9e58e653
Build id: 3.10.0-1160.11.1.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffff9e58e975
Build id: 3.10.0-1160.11.1.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffff9e58a778
Build id: 3.10.0-1160.11.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [abrt-server:5755]
Modules linked in: xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi ppdev snd_ac97_codec ac97_bus snd_seq aesni_intel vmw_balloon snd_seq_device lrw gf128mul glue_helper ablk_helper cryptd snd_pcm sg snd_timer joydev pcspkr snd vmw_vmci soundcore i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ttm nfit drm libnvdimm ata_piix crct10dif_pclmul crct10dif_common libata e1000 crc32c_intel mptspi scsi_transport_spi mptscsih serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 5755 Comm: abrt-server Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.11.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff89907096a100 ti: ffff899005268000 task.ti: ffff899005268000
RIP: 0010:[<ffffffff9e194ba9>]  [<ffffffff9e194ba9>] copy_page+0x49/0xe0
RSP: 0000:ffff89900526bcc0  EFLAGS: 00010206
RAX: 0000000000228cd0 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff8990b1446000 RDI: ffff89909be4f000
RBP: ffff89900526bd38 R08: 0000000000009986 R09: 0000000000009996
R10: 00000000000099a6 R11: 00000000000099b6 R12: 0000000046a0421c
R13: ffffffff9dfc0c3d R14: ffff89910ffd8000 R15: ffff89910ffd9000
FS:  00007f8fb65d8900(0000) GS:ffff89910a200000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8fb1f81008 CR3: 0000000005398000 CR4: 00000000003607f0
Call Trace:
[<ffffffff9dfef260>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff9dff189b>] do_wp_page+0xfb/0x720
[<ffffffff9dfbe1bb>] ? unlock_page+0x2b/0x30
[<ffffffff9dfee6b9>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff9dff5f12>] handle_mm_fault+0xb22/0xfb0
[<ffffffff9dffe559>] ? mprotect_fixup+0x1b9/0x3a0
[<ffffffff9e58e653>] __do_page_fault+0x213/0x500
[<ffffffff9e58e975>] do_page_fault+0x35/0x90
[<ffffffff9e58a778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #105467
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff84b83e79
Build id: 3.10.0-957.el7.x86_64
0x49
2
? wp_page_copy.isra.71
vmlinux 0xffffffff849e53d1
Build id: 3.10.0-957.el7.x86_64
0x121
3
do_wp_page
vmlinux 0xffffffff849e782b
Build id: 3.10.0-957.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff849b64fb
Build id: 3.10.0-957.el7.x86_64
0x2b
5
? do_read_fault.isra.61
vmlinux 0xffffffff849e4879
Build id: 3.10.0-957.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffff849e91bd
Build id: 3.10.0-957.el7.x86_64
0x37d
7
handle_mm_fault
vmlinux 0xffffffff849ebc6d
Build id: 3.10.0-957.el7.x86_64
0x39d
8
__do_page_fault
vmlinux 0xffffffff84f6f5e3
Build id: 3.10.0-957.el7.x86_64
0x203
9
do_page_fault
vmlinux 0xffffffff84f6f915
Build id: 3.10.0-957.el7.x86_64
0x35
10
? error_swapgs
vmlinux 0xffffffff84f6ba96
Build id: 3.10.0-957.el7.x86_64
0xa7
11
page_fault
vmlinux 0xffffffff84f6b758
Build id: 3.10.0-957.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 23s! [abrt-dump-oops:73094]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper vmw_balloon cryptd pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt sr_mod fb_sys_fops crct10dif_pclmul cdrom mptspi crct10dif_common ttm ata_generic pata_acpi scsi_transport_spi ata_piix crc32c_intel mptscsih serio_raw
nfit drm libata e1000 drm_panel_orientation_quirks mptbase libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 73094 Comm: abrt-dump-oops Kdump: loaded Tainted: G        W    L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff9498f6672080 ti: ffff94994b278000 task.ti: ffff94994b278000
RIP: 0010:[<ffffffff84b83e79>]  [<ffffffff84b83e79>] copy_page+0x49/0xe0
RSP: 0000:ffff94994b27bc48  EFLAGS: 00010206
RAX: 000000000000005c RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000007e00000000 RSI: ffff9497820c3000 RDI: ffff9498b95e5000
RBP: ffff94994b27bcc0 R08: 0000000000000000 R09: 0000000000000129
R10: 0000000000000000 R11: 0000000000000000 R12: 000000005d3eef9d
R13: ffff94994b27bc18 R14: 0000000000000000 R15: ffff94997ffd7000
FS:  0000000000000000(0000) GS:ffff949975740000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff5a413fe28 CR3: 000000020abfc000 CR4: 00000000000607e0
Call Trace:
[<ffffffff849e53d1>] ? wp_page_copy.isra.71+0x121/0x560
[<ffffffff849e782b>] do_wp_page+0xfb/0x720
[<ffffffff849b64fb>] ? unlock_page+0x2b/0x30
[<ffffffff849e4879>] ? do_read_fault.isra.61+0x139/0x1b0
[<ffffffff849e91bd>] handle_pte_fault+0x37d/0xd10
[<ffffffff849ebc6d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff84f6f5e3>] __do_page_fault+0x203/0x500
[<ffffffff84f6f915>] do_page_fault+0x35/0x90
[<ffffffff84f6ba96>] ? error_swapgs+0xa7/0xbd
[<ffffffff84f6b758>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #100614
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffacf846d3
Build id: 3.10.0-957.21.3.el7.x86_64
0x23
2
? wp_page_copy.isra.71
vmlinux 0xffffffffacde59e1
Build id: 3.10.0-957.21.3.el7.x86_64
0x121
3
do_wp_page
vmlinux 0xffffffffacde7e3b
Build id: 3.10.0-957.21.3.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffacdb6abb
Build id: 3.10.0-957.21.3.el7.x86_64
0x2b
5
? do_read_fault.isra.61
vmlinux 0xffffffffacde4e89
Build id: 3.10.0-957.21.3.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffffacde97cd
Build id: 3.10.0-957.21.3.el7.x86_64
0x37d
7
handle_mm_fault
vmlinux 0xffffffffacdec27d
Build id: 3.10.0-957.21.3.el7.x86_64
0x39d
8
__do_page_fault
vmlinux 0xffffffffad370603
Build id: 3.10.0-957.21.3.el7.x86_64
0x203
9
do_page_fault
vmlinux 0xffffffffad370925
Build id: 3.10.0-957.21.3.el7.x86_64
0x35
10
? error_swapgs
vmlinux 0xffffffffad36cab6
Build id: 3.10.0-957.21.3.el7.x86_64
0xa7
11
page_fault
vmlinux 0xffffffffad36c768
Build id: 3.10.0-957.21.3.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 25s! [postmaster:6349]
Modules linked in: tcp_diag inet_diag vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd vmw_balloon joydev pcspkr sg vmw_vmci i2c_piix4 parport_pc parport nfsd nfs_acl lockd auth_rpcgss grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod syscopyarea crc_t10dif sysfillrect crct10dif_generic sysimgblt fb_sys_fops ttm ata_piix drm libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 6349 Comm: postmaster Kdump: loaded Not tainted 3.10.0-957.21.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
task: ffff99a4ac7b2080 ti: ffff99a4ad35c000 task.ti: ffff99a4ad35c000
RIP: 0010:[<ffffffffacf846d3>]  [<ffffffffacf846d3>] copy_page+0x23/0xe0
RSP: 0000:ffff99a4ad35fc48  EFLAGS: 00010206
RAX: ffffdc02012a5d40 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff99a4b96e9000 RDI: ffff99a44a975000
RBP: ffff99a4ad35fcc0 R08: ffffffffad6824f1 R09: ffffdc02012a5d80
R10: 0000000000002ee9 R11: 00003ffffffff000 R12: 000000001ee743be
R13: 0000000000000000 R14: 0000000000000000 R15: ffff99a5bffd8000
FS:  00007f19089618c0(0000) GS:ffff99a5b8600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000023fd7c0 CR3: 0000000001050000 CR4: 00000000000607f0
Call Trace:
[<ffffffffacde59e1>] ? wp_page_copy.isra.71+0x121/0x560
[<ffffffffacde7e3b>] do_wp_page+0xfb/0x720
[<ffffffffacdb6abb>] ? unlock_page+0x2b/0x30
[<ffffffffacde4e89>] ? do_read_fault.isra.61+0x139/0x1b0
[<ffffffffacde97cd>] handle_pte_fault+0x37d/0xd10
[<ffffffffacdec27d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffad370603>] __do_page_fault+0x203/0x4f0
[<ffffffffad370925>] do_page_fault+0x35/0x90
[<ffffffffad36cab6>] ? error_swapgs+0xa7/0xbd
[<ffffffffad36c768>] page_fault+0x28/0x30
Code: c3 0f 1f 80 00 00 00 00 48 83 ec 10 48 89 1c 24 4c 89 64 24 08 b9 3b 00 00 00 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 48 ff c9 <48> 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 
Complete report #58324
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffb4384629
Build id: 3.10.0-957.12.2.el7.x86_64
0x49
2
? wp_page_copy.isra.71
vmlinux 0xffffffffb41e5961
Build id: 3.10.0-957.12.2.el7.x86_64
0x121
3
do_wp_page
vmlinux 0xffffffffb41e7dbb
Build id: 3.10.0-957.12.2.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffb41b6a3b
Build id: 3.10.0-957.12.2.el7.x86_64
0x2b
5
? do_read_fault.isra.61
vmlinux 0xffffffffb41e4e09
Build id: 3.10.0-957.12.2.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffffb41e974d
Build id: 3.10.0-957.12.2.el7.x86_64
0x37d
7
? update_curr
vmlinux 0xffffffffb40e02dc
Build id: 3.10.0-957.12.2.el7.x86_64
0x14c
8
? __enqueue_entity
vmlinux 0xffffffffb40db8f8
Build id: 3.10.0-957.12.2.el7.x86_64
0x78
9
handle_mm_fault
vmlinux 0xffffffffb41ec1fd
Build id: 3.10.0-957.12.2.el7.x86_64
0x39d
10
__do_page_fault
vmlinux 0xffffffffb4770603
Build id: 3.10.0-957.12.2.el7.x86_64
0x203
11
do_page_fault
vmlinux 0xffffffffb4770925
Build id: 3.10.0-957.12.2.el7.x86_64
0x35
12
? error_swapgs
vmlinux 0xffffffffb476cab6
Build id: 3.10.0-957.12.2.el7.x86_64
0xa7
13
page_fault
vmlinux 0xffffffffb476c768
Build id: 3.10.0-957.12.2.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ksmtuned:13313]
Modules linked in: binfmt_misc xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink nf_conntrack_ipv4 nf_defrag_ipv4 vmw_vsock_vmci_transport vsock xt_conntrack nf_conntrack iptable_filter sunrpc coretemp iosf_mbi ppdev crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon pcspkr joydev sg parport_pc vmw_vmci parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw e1000 nfit libnvdimm ata_generic pata_acpi vmwgfx floppy drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi
scsi_transport_spi libata mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 13313 Comm: ksmtuned Kdump: loaded Tainted: G             L ------------   3.10.0-957.12.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff8dcdc3291040 ti: ffff8dce71d60000 task.ti: ffff8dce71d60000
RIP: 0010:[<ffffffffb4384629>]  [<ffffffffb4384629>] copy_page+0x49/0xe0
RSP: 0000:ffff8dce71d63c48  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000ba0d60 RSI: ffff8dcc587ae000 RDI: ffff8dcdeb063000
RBP: ffff8dce71d63cc0 R08: 00000000000038d6 R09: 0000000000000000
R10: 0000000000000021 R11: 0000000000be69e0 R12: 00000000e8da1ef1
R13: 0000000000000000 R14: 0000000000000000 R15: ffff8dce7ffd6000
FS:  00007fe125950740(0000) GS:ffff8dce7fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000bb93f0 CR3: 000000032f220000 CR4: 00000000000407f0
Call Trace:
[<ffffffffb41e5961>] ? wp_page_copy.isra.71+0x121/0x560
[<ffffffffb41e7dbb>] do_wp_page+0xfb/0x720
[<ffffffffb41b6a3b>] ? unlock_page+0x2b/0x30
[<ffffffffb41e4e09>] ? do_read_fault.isra.61+0x139/0x1b0
[<ffffffffb41e974d>] handle_pte_fault+0x37d/0xd10
[<ffffffffb40e02dc>] ? update_curr+0x14c/0x1e0
[<ffffffffb40db8f8>] ? __enqueue_entity+0x78/0x80
[<ffffffffb41ec1fd>] handle_mm_fault+0x39d/0x9b0
[<ffffffffb4770603>] __do_page_fault+0x203/0x4f0
[<ffffffffb4770925>] do_page_fault+0x35/0x90
[<ffffffffb476cab6>] ? error_swapgs+0xa7/0xbd
[<ffffffffb476c768>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #52387
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff9db846f9
Build id: 3.10.0-957.21.3.el7.x86_64
0x49
2
? wp_page_copy.isra.71
vmlinux 0xffffffff9d9e59e1
Build id: 3.10.0-957.21.3.el7.x86_64
0x121
3
do_wp_page
vmlinux 0xffffffff9d9e7e3b
Build id: 3.10.0-957.21.3.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff9d9b6abb
Build id: 3.10.0-957.21.3.el7.x86_64
0x2b
5
? do_read_fault.isra.61
vmlinux 0xffffffff9d9e4e89
Build id: 3.10.0-957.21.3.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffff9d9e97cd
Build id: 3.10.0-957.21.3.el7.x86_64
0x37d
7
handle_mm_fault
vmlinux 0xffffffff9d9ec27d
Build id: 3.10.0-957.21.3.el7.x86_64
0x39d
8
__do_page_fault
vmlinux 0xffffffff9df70603
Build id: 3.10.0-957.21.3.el7.x86_64
0x203
9
do_page_fault
vmlinux 0xffffffff9df70925
Build id: 3.10.0-957.21.3.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffff9df6c768
Build id: 3.10.0-957.21.3.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 39s! [perl:67171]
Modules linked in: vfat fat isofs bsr(OE) binfmt_misc fuse ext4 mbcache jbd2 nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel vmw_balloon snd_ens1371 snd_rawmidi aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_ac97_codec ac97_bus snd_seq snd_seq_device joydev snd_pcm pcspkr snd_timer snd soundcore vmw_vmci sg i2c_piix4 parport_pc
parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common crc32c_intel drm_kms_helper serio_raw syscopyarea sysfillrect sysimgblt fb_sys_fops ttm vmxnet3 drm ata_piix nfit libata mptspi libnvdimm scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod [last unloaded: bsr]
CPU: 0 PID: 67171 Comm: perl Kdump: loaded Tainted: G           OEL ------------   3.10.0-957.21.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff9863a66ed140 ti: ffff9863ae288000 task.ti: ffff9863ae288000
RIP: 0010:[<ffffffff9db846f9>]  [<ffffffff9db846f9>] copy_page+0x49/0xe0
RSP: 0000:ffff9863ae28bc48  EFLAGS: 00010206
RAX: 00007f3291f84ff0 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 00007f3291f97760 RSI: ffff9863a6543000 RDI: ffff986381b1f000
RBP: ffff9863ae28bcc0 R08: 00007f329200fcf0 R09: 00007f329207d080
R10: 00007f3291f74d96 R11: 00007f3290d3c9f0 R12: 00000000e7d584d7
R13: ffff9863ae28bc18 R14: 0000000000000000 R15: ffff9863bffd9800
FS:  00007f32924d5740(0000) GS:ffff9863ba600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f32922cd898 CR3: 0000000010ca8000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9d9e59e1>] ? wp_page_copy.isra.71+0x121/0x560
[<ffffffff9d9e7e3b>] do_wp_page+0xfb/0x720
[<ffffffff9d9b6abb>] ? unlock_page+0x2b/0x30
[<ffffffff9d9e4e89>] ? do_read_fault.isra.61+0x139/0x1b0
[<ffffffff9d9e97cd>] handle_pte_fault+0x37d/0xd10
[<ffffffff9d9ec27d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff9df70603>] __do_page_fault+0x203/0x4f0
[<ffffffff9df70925>] do_page_fault+0x35/0x90
[<ffffffff9df6c768>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #17857
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff9d558a99
Build id: 3.10.0-862.el7.x86_64
0x49
2
? wp_page_copy.isra.70
vmlinux 0xffffffff9d3c1726
Build id: 3.10.0-862.el7.x86_64
0x106
3
do_wp_page
vmlinux 0xffffffff9d3c3abb
Build id: 3.10.0-862.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff9d393d3b
Build id: 3.10.0-862.el7.x86_64
0x2b
5
? do_read_fault.isra.60
vmlinux 0xffffffff9d3c0c31
Build id: 3.10.0-862.el7.x86_64
0x121
6
handle_pte_fault
vmlinux 0xffffffff9d3c536d
Build id: 3.10.0-862.el7.x86_64
0x36d
7
handle_mm_fault
vmlinux 0xffffffff9d3c747d
Build id: 3.10.0-862.el7.x86_64
0x39d
8
__do_page_fault
vmlinux 0xffffffff9d91a597
Build id: 3.10.0-862.el7.x86_64
0x197
9
do_page_fault
vmlinux 0xffffffff9d91a925
Build id: 3.10.0-862.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffff9d916768
Build id: 3.10.0-862.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 62s! [crond:16056]
Modules linked in: tcp_lp nls_utf8 isofs fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr sg joydev nfit libnvdimm parport_pc parport shpchp vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi serio_raw scsi_transport_spi
mptscsih mptbase e1000 ata_piix libata i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 16056 Comm: crond Kdump: loaded Tainted: G             L ------------   3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff891b89348000 ti: ffff891bf8bf4000 task.ti: ffff891bf8bf4000
RIP: 0010:[<ffffffff9d558a99>]  [<ffffffff9d558a99>] copy_page+0x49/0xe0
RSP: 0000:ffff891bf8bf7c50  EFLAGS: 00010206
RAX: 7974745f7379735f RBX: ffff891b89348000 RCX: 000000000000003a
RDX: 6f6e6b6d5f706163 RSI: ffff891bee571000 RDI: ffff891bcf35d000
RBP: ffff891bf8bf7cc8 R08: 656c5f7061630064 R09: 5f70616300657361
R10: 72775f7469647561 R11: 5f70616300657469 R12: 00000000000200da
R13: 00000000c2234744 R14: ffffffff9d551412 R15: ffff891bf8bf7bc8
FS:  00007f79a61aa840(0000) GS:ffff891c79600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f799cad9ed8 CR3: 0000000034a38000 CR4: 00000000003607f0
Call Trace:
[<ffffffff9d3c1726>] ? wp_page_copy.isra.70+0x106/0x4f0
[<ffffffff9d3c3abb>] do_wp_page+0xfb/0x710
[<ffffffff9d393d3b>] ? unlock_page+0x2b/0x30
[<ffffffff9d3c0c31>] ? do_read_fault.isra.60+0x121/0x1a0
[<ffffffff9d3c536d>] handle_pte_fault+0x36d/0xc30
[<ffffffff9d3c747d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff9d91a597>] __do_page_fault+0x197/0x4f0
[<ffffffff9d91a925>] do_page_fault+0x35/0x90
[<ffffffff9d916768>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #16651
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff83994983
Build id: 3.10.0-1160.2.2.el7.x86_64
0x23
2
? wp_page_copy.isra.73
vmlinux 0xffffffff837ef080
Build id: 3.10.0-1160.2.2.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff837f16bb
Build id: 3.10.0-1160.2.2.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff837bdf6b
Build id: 3.10.0-1160.2.2.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff837ee4d9
Build id: 3.10.0-1160.2.2.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff837f5d32
Build id: 3.10.0-1160.2.2.el7.x86_64
0xb22
7
? do_mmap
vmlinux 0xffffffff837fc9d8
Build id: 3.10.0-1160.2.2.el7.x86_64
0x378
8
__do_page_fault
vmlinux 0xffffffff83d8e653
Build id: 3.10.0-1160.2.2.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffff83d8e975
Build id: 3.10.0-1160.2.2.el7.x86_64
0x35
10
? error_swapgs
vmlinux 0xffffffff83d8aac9
Build id: 3.10.0-1160.2.2.el7.x86_64
0xaa
11
page_fault
vmlinux 0xffffffff83d8a778
Build id: 3.10.0-1160.2.2.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 25s! [crond:20027]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev vmw_balloon coretemp pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic crct10dif_common drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops ttm drm ata_piix serio_raw libata e1000 mptspi scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 20027 Comm: crond Kdump: loaded Tainted: G             L ------------   3.10.0-1160.2.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 06/22/2012
task: ffff89833c7b5280 ti: ffff8982c9314000 task.ti: ffff8982c9314000
RIP: 0010:[<ffffffff83994983>]  [<ffffffff83994983>] copy_page+0x23/0xe0
RSP: 0000:ffff8982c9317cc0  EFLAGS: 00010206
RAX: ffffd9d082736340 RBX: 0000000000000000 RCX: 000000000000003a
RDX: ffffffff8408e4c8 RSI: ffff898274b41000 RDI: ffff89825cd8d000
RBP: ffff8982c9317d38 R08: ffffffff8408e4b7 R09: ffffd9d082736380
R10: 0000000000003399 R11: ffff8981d4f91a20 R12: 00000000e9b52e6a
R13: ffffffff837c09ed R14: ffff89837ffd7000 R15: ffff89837ffd8000
FS:  00007f40d8181840(0000) GS:ffff89837fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000558a5f27b008 CR3: 000000010b214000 CR4: 00000000000407f0
Call Trace:
[<ffffffff837ef080>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff837f16bb>] do_wp_page+0xfb/0x720
[<ffffffff837bdf6b>] ? unlock_page+0x2b/0x30
[<ffffffff837ee4d9>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff837f5d32>] handle_mm_fault+0xb22/0xfb0
[<ffffffff837fc9d8>] ? do_mmap+0x378/0x530
[<ffffffff83d8e653>] __do_page_fault+0x213/0x500
[<ffffffff83d8e975>] do_page_fault+0x35/0x90
[<ffffffff83d8aac9>] ? error_swapgs+0xaa/0xc0
[<ffffffff83d8a778>] page_fault+0x28/0x30
Code: c3 0f 1f 80 00 00 00 00 48 83 ec 10 48 89 1c 24 4c 89 64 24 08 b9 3b 00 00 00 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 48 ff c9 <48> 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 
Complete report #7214
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff84393bc9
Build id: 3.10.0-1127.19.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffff841ef1b0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffff841f17eb
Build id: 3.10.0-1127.19.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff841be7ab
Build id: 3.10.0-1127.19.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffff841ee609
Build id: 3.10.0-1127.19.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffff841f5e82
Build id: 3.10.0-1127.19.1.el7.x86_64
0xb22
7
__do_page_fault
vmlinux 0xffffffff8478d653
Build id: 3.10.0-1127.19.1.el7.x86_64
0x213
8
do_page_fault
vmlinux 0xffffffff8478d975
Build id: 3.10.0-1127.19.1.el7.x86_64
0x35
9
page_fault
vmlinux 0xffffffff84789778
Build id: 3.10.0-1127.19.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 25s! [directadmin:20977]
Modules linked in: tcp_diag udp_diag inet_diag unix_diag ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 ip6table_filter nf_log_ipv4 nf_log_common xt_owner nf_nat_ftp xt_REDIRECT nf_nat_redirect xt_conntrack nf_conntrack_ftp xt_LOG xt_limit xt_multiport iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 ip6table_mangle ip6table_raw ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 nf_nat nf_conntrack ip6_tables iptable_mangle iptable_raw ipt_REJECT nf_reject_ipv4 iptable_filter coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg parport_pc vmw_vmci parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm mptspi libata scsi_transport_spi mptscsih crct10dif_pclmul crct10dif_common drm_panel_orientation_quirks mptbase crc32c_intel serio_raw vmxnet3 floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 20977 Comm: directadmin Kdump: loaded Tainted: G             L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff98c6e61f0000 ti: ffff98c6f0bfc000 task.ti: ffff98c6f0bfc000
RIP: 0010:[<ffffffff84393bc9>]  [<ffffffff84393bc9>] copy_page+0x49/0xe0
RSP: 0000:ffff98c6f0bffcc0  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff98c8efecb000 RDI: ffff98c79519a000
RBP: ffff98c6f0bffd38 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000031 R11: 746163696c707061 R12: 0000000007598955
R13: ffff98c6f0bffc80 R14: ffff98c97ffda000 R15: ffff98c97ffdb000
FS:  00007f2a4c7f7740(0000) GS:ffff98c97fc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000002b7e030 CR3: 00000003d0fa6000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff841ef1b0>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffff841f17eb>] do_wp_page+0xfb/0x720
[<ffffffff841be7ab>] ? unlock_page+0x2b/0x30
[<ffffffff841ee609>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff841f5e82>] handle_mm_fault+0xb22/0xfb0
[<ffffffff8478d653>] __do_page_fault+0x213/0x500
[<ffffffff8478d975>] do_page_fault+0x35/0x90
[<ffffffff84789778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #6454
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffb9f93b89
Build id: 3.10.0-1127.13.1.el7.x86_64
0x49
2
? wp_page_copy.isra.73
vmlinux 0xffffffffb9def190
Build id: 3.10.0-1127.13.1.el7.x86_64
0x120
3
do_wp_page
vmlinux 0xffffffffb9df17cb
Build id: 3.10.0-1127.13.1.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffb9dbe75b
Build id: 3.10.0-1127.13.1.el7.x86_64
0x2b
5
? do_read_fault.isra.63
vmlinux 0xffffffffb9dee5e9
Build id: 3.10.0-1127.13.1.el7.x86_64
0x139
6
handle_mm_fault
vmlinux 0xffffffffb9df5e62
Build id: 3.10.0-1127.13.1.el7.x86_64
0xb22
7
? do_mmap
vmlinux 0xffffffffb9dfcb08
Build id: 3.10.0-1127.13.1.el7.x86_64
0x378
8
__do_page_fault
vmlinux 0xffffffffba38d653
Build id: 3.10.0-1127.13.1.el7.x86_64
0x213
9
do_page_fault
vmlinux 0xffffffffba38d975
Build id: 3.10.0-1127.13.1.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffffba389778
Build id: 3.10.0-1127.13.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 24s! [pgrep:16726]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper vmw_balloon ablk_helper cryptd pcspkr joydev sg vmw_vmci i2c_piix4 parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic vmwgfx sr_mod cdrom ata_generic drm_kms_helper pata_acpi syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common mptspi scsi_transport_spi mptscsih
e1000 mptbase crc32c_intel ata_piix libata serio_raw drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 16726 Comm: pgrep Kdump: loaded Tainted: G             L ------------   3.10.0-1127.13.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
task: ffff8b60151d41c0 ti: ffff8b5fc4e58000 task.ti: ffff8b5fc4e58000
RIP: 0010:[<ffffffffb9f93b89>]  [<ffffffffb9f93b89>] copy_page+0x49/0xe0
RSP: 0000:ffff8b5fc4e5bcc0  EFLAGS: 00010206
RAX: 75db854800201164 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 48087b8b48eb8948 RSI: ffff8b5f7beaa000 RDI: ffff8b5fcb75c000
RBP: ffff8b5fc4e5bd38 R08: 48ffffe131e82b8b R09: 48ffffe129e8df89
R10: 2011372d8948ed85 R11: ff28e9c031dd7500 R12: 00000000fa0f79d1
R13: ffffffffb9dc0e9d R14: ffff8b62fffda000 R15: ffff8b62fffdb000
FS:  0000000000000000(0000) GS:ffff8b62ee6c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc460453eb8 CR3: 00000001048d0000 CR4: 00000000001607e0
Call Trace:
[<ffffffffb9def190>] ? wp_page_copy.isra.73+0x120/0x5b0
[<ffffffffb9df17cb>] do_wp_page+0xfb/0x720
[<ffffffffb9dbe75b>] ? unlock_page+0x2b/0x30
[<ffffffffb9dee5e9>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffffb9df5e62>] handle_mm_fault+0xb22/0xfb0
[<ffffffffb9dfcb08>] ? do_mmap+0x378/0x530
[<ffffffffba38d653>] __do_page_fault+0x213/0x500
[<ffffffffba38d975>] do_page_fault+0x35/0x90
[<ffffffffba389778>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #2453
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffff97383e79
Build id: 3.10.0-957.el7.x86_64
0x49
2
? wp_page_copy.isra.71
vmlinux 0xffffffff971e53d1
Build id: 3.10.0-957.el7.x86_64
0x121
3
do_wp_page
vmlinux 0xffffffff971e782b
Build id: 3.10.0-957.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffff971b64fb
Build id: 3.10.0-957.el7.x86_64
0x2b
5
? do_read_fault.isra.61
vmlinux 0xffffffff971e4879
Build id: 3.10.0-957.el7.x86_64
0x139
6
handle_pte_fault
vmlinux 0xffffffff971e91bd
Build id: 3.10.0-957.el7.x86_64
0x37d
7
handle_mm_fault
vmlinux 0xffffffff971ebc6d
Build id: 3.10.0-957.el7.x86_64
0x39d
8
__do_page_fault
vmlinux 0xffffffff9776f5e3
Build id: 3.10.0-957.el7.x86_64
0x203
9
do_page_fault
vmlinux 0xffffffff9776f915
Build id: 3.10.0-957.el7.x86_64
0x35
10
page_fault
vmlinux 0xffffffff9776b758
Build id: 3.10.0-957.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 42s! [crond:39891]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock bnep sunrpc ppdev vmw_balloon iosf_mbi crc32_pclmul snd_seq_midi ghash_clmulni_intel snd_seq_midi_event aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus pcspkr snd_seq snd_seq_device joydev snd_pcm snd_timer snd btusb btrtl btbcm btintel bluetooth soundcore rfkill sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod cdrom crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel
serio_raw ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix e1000 drm mptspi libata scsi_transport_spi mptscsih nfit mptbase drm_panel_orientation_quirks libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 39891 Comm: crond Kdump: loaded Not tainted 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffffa056b3d35140 ti: ffffa0558c0ac000 task.ti: ffffa0558c0ac000
RIP: 0010:[<ffffffff97383e79>]  [<ffffffff97383e79>] copy_page+0x49/0xe0
RSP: 0000:ffffa0558c0afc48  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffffa056bf7f7000 RDI: ffffa05637fb2000
RBP: ffffa0558c0afcc0 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: 00000000c4bd4801
R13: ffffa0558c0afc18 R14: 0000000000000000 R15: ffffa056bffd8000
FS:  00007f4ab1993840(0000) GS:ffffa056b9600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4ab06f4458 CR3: 000000000c0b0000 CR4: 00000000003607f0
Call Trace:
[<ffffffff971e53d1>] ? wp_page_copy.isra.71+0x121/0x560
[<ffffffff971e782b>] do_wp_page+0xfb/0x720
[<ffffffff971b64fb>] ? unlock_page+0x2b/0x30
[<ffffffff971e4879>] ? do_read_fault.isra.61+0x139/0x1b0
[<ffffffff971e91bd>] handle_pte_fault+0x37d/0xd10
[<ffffffff971ebc6d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff9776f5e3>] __do_page_fault+0x203/0x500
[<ffffffff9776f915>] do_page_fault+0x35/0x90
[<ffffffff9776b758>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89 
Complete report #1805
Frame # Function Binary Source or offset Line
1
copy_page
vmlinux 0xffffffffa6d58a39
Build id: 3.10.0-862.2.3.el7.x86_64
0x49
2
? wp_page_copy.isra.70
vmlinux 0xffffffffa6bc16c6
Build id: 3.10.0-862.2.3.el7.x86_64
0x106
3
do_wp_page
vmlinux 0xffffffffa6bc3a5b
Build id: 3.10.0-862.2.3.el7.x86_64
0xfb
4
? unlock_page
vmlinux 0xffffffffa6b93cdb
Build id: 3.10.0-862.2.3.el7.x86_64
0x2b
5
? do_read_fault.isra.60
vmlinux 0xffffffffa6bc0bd1
Build id: 3.10.0-862.2.3.el7.x86_64
0x121
6
handle_pte_fault
vmlinux 0xffffffffa6bc530d
Build id: 3.10.0-862.2.3.el7.x86_64
0x36d
7
handle_mm_fault
vmlinux 0xffffffffa6bc741d
Build id: 3.10.0-862.2.3.el7.x86_64
0x39d
8
__do_page_fault
vmlinux 0xffffffffa711a557
Build id: 3.10.0-862.2.3.el7.x86_64
0x197
9
do_page_fault
vmlinux 0xffffffffa711a8e5
Build id: 3.10.0-862.2.3.el7.x86_64
0x35
10
? error_swapgs
vmlinux 0xffffffffa7116aa6
Build id: 3.10.0-862.2.3.el7.x86_64
0xa7
11
page_fault
vmlinux 0xffffffffa7116758
Build id: 3.10.0-862.2.3.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [pkla-check-auth:17986]
Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 ipt_REJECT nf_reject_ipv4 iptable_filter xt_conntrack iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle ip_tables ip_set nfnetlink tun bridge stp llc devlink vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr joydev nfit vmw_balloon sg libnvdimm vmw_vmci parport_pc parport shpchp i2c_piix4 xfs libcrc32c sr_mod cdrom
sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm ata_piix mptspi scsi_transport_spi e1000 mptscsih libata mptbase i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
CPU: 0 PID: 17986 Comm: pkla-check-auth Kdump: loaded Tainted: G             L ------------   3.10.0-862.2.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff899d491d4f10 ti: ffff899ea1760000 task.ti: ffff899ea1760000
RIP: 0010:[<ffffffffa6d58a39>]  [<ffffffffa6d58a39>] copy_page+0x49/0xe0
RSP: 0000:ffff899ea1763c50  EFLAGS: 00010206
RAX: 0000000000000000 RBX: ffff899d491d4f10 RCX: 000000000000003a
RDX: 0000000000000000 RSI: ffff899e27d93000 RDI: ffff899e7291c000
RBP: ffff899ea1763cc8 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: 00000000000200da
R13: 00000000d5aa40ac R14: ffffffffa6d513b2 R15: ffff899ea1763bc8
FS:  0000000000000000(0000) GS:ffff899ebfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007fea37ad9c80 CR3: 00000001a0f34000 CR4: 00000000000607f0
Call Trace:
[<ffffffffa6bc16c6>] ? wp_page_copy.isra.70+0x106/0x4f0
[<ffffffffa6bc3a5b>] do_wp_page+0xfb/0x710
[<ffffffffa6b93cdb>] ? unlock_page+0x2b/0x30
[<ffffffffa6bc0bd1>] ? do_read_fault.isra.60+0x121/0x1a0
[<ffffffffa6bc530d>] handle_pte_fault+0x36d/0xc30
[<ffffffffa6bc741d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffa711a557>] __do_page_fault+0x197/0x4f0
[<ffffffffa711a8e5>] do_page_fault+0x35/0x90
[<ffffffffa7116aa6>] ? error_swapgs+0xa7/0xbd
[<ffffffffa7116758>] page_fault+0x28/0x30
Code: 00 00 48 ff c9 48 8b 06 48 8b 5e 08 48 8b 56 10 4c 8b 46 18 4c 8b 4e 20 4c 8b 56 28 4c 8b 5e 30 4c 8b 66 38 0f 18 8e 40 01 00 00 <48> 89 07 48 89 5f 08 48 89 57 10 4c 89 47 18 4c 89 4f 20 4c 89