Info

Permalink
Function
generic_exec_single
First occurrence
2020-10-05
Last occurrence
2026-10-10
State
NEW
Components
kernel
Quality
-31

Statistics

Operating system Count
CentOS 7 586
Architecture Count
x86_64 586
Related packages Count
kernel 561
 0:3.10.0-1062.9.1.el7 371
 0:3.10.0-693.5.2.el7 114
 0:3.10.0-957.el7 11
 0:3.10.0-1160.119.1.el7 7
 0:3.10.0-1160.15.2.el7 6
 0:3.10.0-1160.el7 6
 0:3.10.0-1062.el7 4
 0:3.10.0-862.el7 4
 0:3.10.0-1062.12.1.el7 3
 0:3.10.0-1062.1.2.el7 3
 0:3.10.0-1127.10.1.el7 3
 0:3.10.0-1160.118.1.el7 3
 0:3.10.0-693.el7 3
 0:3.10.0-1062.18.1.el7 2
 0:3.10.0-1127.19.1.el7 2
 0:3.10.0-1160.71.1.el7 2
 0:3.10.0-1160.76.1.el7 2
 0:3.10.0-1160.11.1.el7 1
 0:3.10.0-1160.21.1.el7 1
 0:3.10.0-1160.25.1.el7 1
 0:3.10.0-1160.36.2.el7 1
 0:3.10.0-1160.45.1.el7 1
 0:3.10.0-1160.59.1.el7 1
 0:3.10.0-1160.66.1.el7 1
 0:3.10.0-1160.81.1.el7 1
 0:3.10.0-1160.83.1.el7 1
 0:3.10.0-1160.88.1.el7 1
 0:3.10.0-862.11.6.el7 1
 0:3.10.0-957.10.1.el7 1
 0:3.10.0-957.12.1.el7 1
 0:3.10.0-514.el7 1
 0:3.10.0-514.2.2.el7 1
kernel-plus 25
 0:3.10.0-957.el7.centos.plus 25

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

Report backtrace


Complete report #509885
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa391109a
Build id: 3.10.0-957.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffffa387a3d0
Build id: 3.10.0-957.el7.x86_64 		0x110
3
? leave_mm
vmlinux 0xffffffffa387a3d0
Build id: 3.10.0-957.el7.x86_64 		0x110
4
? leave_mm
vmlinux 0xffffffffa387a3d0
Build id: 3.10.0-957.el7.x86_64 		0x110
5
smp_call_function_single
vmlinux 0xffffffffa39111af
Build id: 3.10.0-957.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffa3b75465
Build id: 3.10.0-957.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffa391175b
Build id: 3.10.0-957.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffa387a598
Build id: 3.10.0-957.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffa387a608
Build id: 3.10.0-957.el7.x86_64 		0x68
10
pmdp_clear_flush
vmlinux 0xffffffffa39fd5f7
Build id: 3.10.0-957.el7.x86_64 		0x37
11
khugepaged_scan_mm_slot
vmlinux 0xffffffffa3a29075
Build id: 3.10.0-957.el7.x86_64 		0x7b5
12
khugepaged
vmlinux 0xffffffffa3a298fb
Build id: 3.10.0-957.el7.x86_64 		0x13b
13
? wake_up_atomic_t
vmlinux 0xffffffffa38c2d00
Build id: 3.10.0-957.el7.x86_64 		0x30
14
? khugepaged_scan_mm_slot
vmlinux 0xffffffffa3a297c0
Build id: 3.10.0-957.el7.x86_64 		0xf00
15
kthread
vmlinux 0xffffffffa38c1c31
Build id: 3.10.0-957.el7.x86_64 		0xd1
16
? insert_kthread_work
vmlinux 0xffffffffa38c1b60
Build id: 3.10.0-957.el7.x86_64 		0x40
17
ret_from_fork_nospec_begin
vmlinux 0xffffffffa3f74c37
Build id: 3.10.0-957.el7.x86_64 		0x21
18
? insert_kthread_work
vmlinux 0xffffffffa38c1b60
Build id: 3.10.0-957.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 24s! [khugepaged:69]
Modules linked in: ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac iosf_mbi ppdev crc32_pclmul vmw_balloon ghash_clmulni_intel ext4 aesni_intel lrw gf128mul glue_helper ablk_helper snd_ens1371 mbcache cryptd jbd2 snd_rawmidi snd_ac97_codec ac97_bus snd_seq joydev pcspkr snd_seq_device
snd_pcm snd_timer snd soundcore sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod sd_mod crc_t10dif cdrom crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common crc32c_intel drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix nfit mptspi serio_raw scsi_transport_spi drm libata mptscsih e1000 drm_panel_orientation_quirks mptbase libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 69 Comm: khugepaged Kdump: loaded Tainted: G        W    L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff9c00395830c0 ti: ffff9c0039020000 task.ti: ffff9c0039020000
RIP: 0010:[<ffffffffa391109a>]  [<ffffffffa391109a>] generic_exec_single+0xfa/0x1b0
RSP: 0018:ffff9c0039023c00  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff9c0039023bd0 RCX: 0000000000000001
RDX: ffffffffa4012d90 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff9c0039023c50 R08: ffffffffa4012d88 R09: 0000000000000000
R10: ffff9c007fb95d00 R11: ffff9c0001201000 R12: ffff9c007ff9e000
R13: 0000000000000009 R14: 000000000000006c R15: 0000000000000020
FS:  0000000000000000(0000) GS:ffff9c003d680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb8efe7e420 CR3: 0000000219210000 CR4: 00000000001607e0
Call Trace:
[<ffffffffa387a3d0>] ? leave_mm+0x110/0x110
[<ffffffffa387a3d0>] ? leave_mm+0x110/0x110
[<ffffffffa387a3d0>] ? leave_mm+0x110/0x110
[<ffffffffa39111af>] smp_call_function_single+0x5f/0xa0
[<ffffffffa3b75465>] ? cpumask_next_and+0x35/0x50
[<ffffffffa391175b>] smp_call_function_many+0x22b/0x270
[<ffffffffa387a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa387a608>] flush_tlb_mm_range+0x68/0x140
[<ffffffffa39fd5f7>] pmdp_clear_flush+0x37/0x60
[<ffffffffa3a29075>] khugepaged_scan_mm_slot+0x7b5/0xf00
[<ffffffffa3a298fb>] khugepaged+0x13b/0x480
[<ffffffffa38c2d00>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffa3a297c0>] ? khugepaged_scan_mm_slot+0xf00/0xf00
[<ffffffffa38c1c31>] kthread+0xd1/0xe0
[<ffffffffa38c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffffa3f74c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa38c1b60>] ? insert_kthread_work+0x40/0x40
Code: 00 b7 01 00 48 89 de 48 03 14 c5 60 b9 54 a4 48 89 df e8 1a b2 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #1102656
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffb211109a
Build id: 3.10.0-957.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffffb207a3d0
Build id: 3.10.0-957.el7.x86_64 		0x110
3
? leave_mm
vmlinux 0xffffffffb207a3d0
Build id: 3.10.0-957.el7.x86_64 		0x110
4
? leave_mm
vmlinux 0xffffffffb207a3d0
Build id: 3.10.0-957.el7.x86_64 		0x110
5
smp_call_function_single
vmlinux 0xffffffffb21111af
Build id: 3.10.0-957.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffb2375465
Build id: 3.10.0-957.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffb211175b
Build id: 3.10.0-957.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffb207a598
Build id: 3.10.0-957.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffb207a608
Build id: 3.10.0-957.el7.x86_64 		0x68
10
pmdp_clear_flush
vmlinux 0xffffffffb21fd5f7
Build id: 3.10.0-957.el7.x86_64 		0x37
11
khugepaged_scan_mm_slot
vmlinux 0xffffffffb2229075
Build id: 3.10.0-957.el7.x86_64 		0x7b5
12
khugepaged
vmlinux 0xffffffffb22298fb
Build id: 3.10.0-957.el7.x86_64 		0x13b
13
? wake_up_atomic_t
vmlinux 0xffffffffb20c2d00
Build id: 3.10.0-957.el7.x86_64 		0x30
14
? khugepaged_scan_mm_slot
vmlinux 0xffffffffb22297c0
Build id: 3.10.0-957.el7.x86_64 		0xf00
15
kthread
vmlinux 0xffffffffb20c1c31
Build id: 3.10.0-957.el7.x86_64 		0xd1
16
? insert_kthread_work
vmlinux 0xffffffffb20c1b60
Build id: 3.10.0-957.el7.x86_64 		0x40
17
ret_from_fork_nospec_begin
vmlinux 0xffffffffb2774c37
Build id: 3.10.0-957.el7.x86_64 		0x21
18
? insert_kthread_work
vmlinux 0xffffffffb20c1b60
Build id: 3.10.0-957.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [khugepaged:59]
Modules linked in: binfmt_misc sysmon_edr(OE) netfilter_edr(OE) ppdev sg virtio_balloon parport_pc parport joydev i2c_piix4 pcspkr ip_tables xfs libcrc32c sr_mod cdrom virtio_net virtio_console virtio_blk virtio_scsi ata_generic pata_acpi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm serio_raw floppy drm ata_piix libata drm_panel_orientation_quirks virtio_pci virtio_ring virtio dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 59 Comm: khugepaged Kdump: loaded Tainted: G           OEL ------------   3.10.0-957.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.7.5-0-ge51488c-20140602_164612-nilsson.home.kraxel.org 04/01/2014
task: ffff99c18c17a080 ti: ffff99c18c1cc000 task.ti: ffff99c18c1cc000
RIP: 0010:[<ffffffffb211109a>]  [<ffffffffb211109a>] generic_exec_single+0xfa/0x1b0
RSP: 0000:ffff99c18c1cfc00  EFLAGS: 00000202
RAX: ffff99c19ed1fb00 RBX: 0000000900000002 RCX: ffff99c19ed1fb80
RDX: ffff99c19ed1b700 RSI: ffff99c18c1cfc00 RDI: ffff99c18c1cfc00
RBP: ffff99c18c1cfc50 R08: 0000000000000001 R09: ffffd3359f908000
R10: ffff99c1bfb68e80 R11: ffff99ba196f0000 R12: ffff99c1bffbe000
R13: 0000000000000009 R14: 000000000000006c R15: 0000000000000020
FS:  0000000000000000(0000) GS:ffff99c19ecc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f28c9141000 CR3: 000000080b176000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffb207a3d0>] ? leave_mm+0x110/0x110
[<ffffffffb207a3d0>] ? leave_mm+0x110/0x110
[<ffffffffb207a3d0>] ? leave_mm+0x110/0x110
[<ffffffffb21111af>] smp_call_function_single+0x5f/0xa0
[<ffffffffb2375465>] ? cpumask_next_and+0x35/0x50
[<ffffffffb211175b>] smp_call_function_many+0x22b/0x270
[<ffffffffb207a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb207a608>] flush_tlb_mm_range+0x68/0x140
[<ffffffffb21fd5f7>] pmdp_clear_flush+0x37/0x60
[<ffffffffb2229075>] khugepaged_scan_mm_slot+0x7b5/0xf00
[<ffffffffb22298fb>] khugepaged+0x13b/0x480
[<ffffffffb20c2d00>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffb22297c0>] ? khugepaged_scan_mm_slot+0xf00/0xf00
[<ffffffffb20c1c31>] kthread+0xd1/0xe0
[<ffffffffb20c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffffb2774c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb20c1b60>] ? insert_kthread_work+0x40/0x40
Code: 00 b7 01 00 48 89 de 48 03 14 c5 60 b9 d4 b2 48 89 df e8 1a b2 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #1053444
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810f933e
Build id: 3.10.0-693.5.2.el7.x86_64 		0xfe
2
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.5.2.el7.x86_64 		0x70
3
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.5.2.el7.x86_64 		0x70
4
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.5.2.el7.x86_64 		0x70
5
smp_call_function_single
vmlinux 0xffffffff810f943f
Build id: 3.10.0-693.5.2.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff813227c5
Build id: 3.10.0-693.5.2.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff810f99d3
Build id: 3.10.0-693.5.2.el7.x86_64 		0x223
8
native_flush_tlb_others
vmlinux 0xffffffff8106e668
Build id: 3.10.0-693.5.2.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8106e738
Build id: 3.10.0-693.5.2.el7.x86_64 		0x68
10
pmdp_clear_flush
vmlinux 0xffffffff811c250e
Build id: 3.10.0-693.5.2.el7.x86_64 		0x4e
11
khugepaged_scan_mm_slot
vmlinux 0xffffffff811eaee2
Build id: 3.10.0-693.5.2.el7.x86_64 		0x6c2
12
khugepaged
vmlinux 0xffffffff811eb64b
Build id: 3.10.0-693.5.2.el7.x86_64 		0x13b
13
? wake_up_atomic_t
vmlinux 0xffffffff810b1920
Build id: 3.10.0-693.5.2.el7.x86_64 		0x30
14
? khugepaged_scan_mm_slot
vmlinux 0xffffffff811eb510
Build id: 3.10.0-693.5.2.el7.x86_64 		0xcf0
15
kthread
vmlinux 0xffffffff810b099f
Build id: 3.10.0-693.5.2.el7.x86_64 		0xcf
16
? insert_kthread_work
vmlinux 0xffffffff810b08d0
Build id: 3.10.0-693.5.2.el7.x86_64 		0x40
17
ret_from_fork
vmlinux 0xffffffff816b4fd8
Build id: 3.10.0-693.5.2.el7.x86_64 		0x58
18
? insert_kthread_work
vmlinux 0xffffffff810b08d0
Build id: 3.10.0-693.5.2.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#26 stuck for 22s! [khugepaged:346]
Modules linked in: rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache panfs(POE) 8021q garp mrp stp llc falcon_lsm_serviceable(PE) falcon_nf_netcontain(E) falcon_kal(E) falcon_lsm_pinned_17219(E) rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) mlx5_fpga_tools(OE) ip6_tables iptable_filter vfat fat kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd dell_smbios sparse_keymap dcdbas sg shpchp i2c_piix4 wmi pcspkr ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter tpm_crb mlx5_ib(OE) mlx4_ib(OE) ib_uverbs(OE) mlx4_en(OE) mlx5_core(OE) mlxfw(OE) vfio_mdev(OE) vfio_iommu_type1 vfio mdev(OE) knem(OE) nfsd auth_rpcgss mlx4_core(OE) nfs_acl lockd grace sunrpc binfmt_misc devlink ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic mgag200
i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci crct10dif_pclmul crct10dif_common crc32c_intel tg3 libata megaraid_sas ptp i2c_core pps_core ib_ipoib(OE) ib_cm(OE) ib_umad(OE) ib_core(OE) mlx_compat(OE)
CPU: 26 PID: 346 Comm: khugepaged Tainted: P        W  OEL ------------   3.10.0-693.5.2.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R6515/0J91V2, BIOS 2.11.4 03/22/2023
task: ffff883f790d1fa0 ti: ffff883f79144000 task.ti: ffff883f79144000
RIP: 0010:[<ffffffff810f933e>]  [<ffffffff810f933e>] generic_exec_single+0xfe/0x1a0
RSP: 0018:ffff883f79147c00  EFLAGS: 00000202
RAX: 0000000000000040 RBX: ffffea00bd2e0000 RCX: 0000000000000001
RDX: 0000000000000040 RSI: 0000000000000000 RDI: 0000000000000282
RBP: ffff883f79147c48 R08: ffffffff816ce468 R09: 0000000000000000
R10: ffffea00bd2e0040 R11: ffff883697689000 R12: 0000000000000009
R13: 000000000000006c R14: 0000000000000020 R15: ffff883f7de9a1d8
FS:  0000000000000000(0000) GS:ffff883f7de80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055581f6e6648 CR3: 0000003f7c483000 CR4: 00000000003406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff8106e4a0 ffff883f79147cd0
0000000000000003 00000000469bdab9 0000000000000000 ffffffff8106e4a0
ffffffff8106e4a0 ffff883f79147c78 ffffffff810f943f ffff883f79147c78
Call Trace:
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff810f943f>] smp_call_function_single+0x5f/0xa0
[<ffffffff813227c5>] ? cpumask_next_and+0x35/0x50
[<ffffffff810f99d3>] smp_call_function_many+0x223/0x260
[<ffffffff8106e668>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8106e738>] flush_tlb_mm_range+0x68/0x140
[<ffffffff811c250e>] pmdp_clear_flush+0x4e/0x80
[<ffffffff811eaee2>] khugepaged_scan_mm_slot+0x6c2/0xcf0
[<ffffffff811eb64b>] khugepaged+0x13b/0x480
[<ffffffff810b1920>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff811eb510>] ? khugepaged_scan_mm_slot+0xcf0/0xcf0
[<ffffffff810b099f>] kthread+0xcf/0xe0
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4fd8>] ret_from_fork+0x58/0x90
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
Code: 48 89 de 48 03 14 c5 e0 fd b0 81 48 89 df e8 3a db 23 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 f6 43 20 01 <75> f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 00 0f 85 7f
Complete report #1003442
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffb191dba2
Build id: 3.10.0-1160.118.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffb1881b10
Build id: 3.10.0-1160.118.1.el7.x86_64 		0x130
3
? leave_mm
vmlinux 0xffffffffb1881b10
Build id: 3.10.0-1160.118.1.el7.x86_64 		0x130
4
? leave_mm
vmlinux 0xffffffffb1881b10
Build id: 3.10.0-1160.118.1.el7.x86_64 		0x130
5
smp_call_function_single
vmlinux 0xffffffffb191dcbf
Build id: 3.10.0-1160.118.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffb1b9c615
Build id: 3.10.0-1160.118.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffb191e27b
Build id: 3.10.0-1160.118.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffb1881fa8
Build id: 3.10.0-1160.118.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffb188201b
Build id: 3.10.0-1160.118.1.el7.x86_64 		0x6b
10
pmdp_clear_flush
vmlinux 0xffffffffb1a142e7
Build id: 3.10.0-1160.118.1.el7.x86_64 		0x37
11
khugepaged_scan_mm_slot
vmlinux 0xffffffffb1a41e02
Build id: 3.10.0-1160.118.1.el7.x86_64 		0x7d2
12
khugepaged
vmlinux 0xffffffffb1a4273b
Build id: 3.10.0-1160.118.1.el7.x86_64 		0x13b
13
? wake_up_atomic_t
vmlinux 0xffffffffb18cc790
Build id: 3.10.0-1160.118.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [khugepaged:57]
Modules linked in: veth xt_nat xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_addrtype br_netfilter bridge stp llc iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon sg pcspkr joydev vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm nfit sd_mod libahci ata_piix crc_t10dif crct10dif_generic libnvdimm libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash
dm_log dm_mod fuse
CPU: 3 PID: 57 Comm: khugepaged Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.118.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9d146a955280 ti: ffff9d14665bc000 task.ti: ffff9d14665bc000
RIP: 0010:[<ffffffffb191dba2>]  [<ffffffffb191dba2>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9d14665bfc00  EFLAGS: 00000202
RAX: 0000000000000006 RBX: ffff9d14665bfbd0 RCX: 000000000000003a
RDX: 000000000000003f RSI: 0000000000000006 RDI: 0000000000000286
RBP: ffff9d14665bfc50 R08: ffffffffb20139c0 R09: ffffe2b6c7498000
R10: ffff9d147fbd6240 R11: 7fffffffffffffff R12: ffff9d147ffda000
R13: 0000000000000000 R14: 0000000000000002 R15: ffff9d147ffed228
FS:  0000000000000000(0000) GS:ffff9d147fcc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2bd40ac000 CR3: 000000052741e000 CR4: 00000000007607e0
PKRU: 00000000
Call Trace:
[<ffffffffb1881b10>] ? leave_mm+0x130/0x130
[<ffffffffb1881b10>] ? leave_mm+0x130/0x130
[<ffffffffb1881b10>] ? leave_mm+0x130/0x130
[<ffffffffb191dcbf>] smp_call_function_single+0x5f/0xa0
[<ffffffffb1b9c615>] ? cpumask_next_and+0x35/0x50
[<ffffffffb191e27b>] smp_call_function_many+0x22b/0x270
[<ffffffffb1881fa8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb188201b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb1a142e7>] pmdp_clear_flush+0x37/0x70
[<ffffffffb1a41e02>] khugepaged_scan_mm_slot+0x7d2/0xfd0
[<ffffffffb1a4273b>] khugepaged+0x13b/0x490
[<ffffffffb18cc790>] ? wake_up_atomic_t+0x40/0x40
Complete report #310439
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff9790779a
Build id: 3.10.0-862.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffff97876e50
Build id: 3.10.0-862.el7.x86_64 		0x110
3
? leave_mm
vmlinux 0xffffffff97876e50
Build id: 3.10.0-862.el7.x86_64 		0x110
4
? leave_mm
vmlinux 0xffffffff97876e50
Build id: 3.10.0-862.el7.x86_64 		0x110
5
smp_call_function_single
vmlinux 0xffffffff979078af
Build id: 3.10.0-862.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff97b4a275
Build id: 3.10.0-862.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff97907e5b
Build id: 3.10.0-862.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff97877018
Build id: 3.10.0-862.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff97877088
Build id: 3.10.0-862.el7.x86_64 		0x68
10
pmdp_clear_flush
vmlinux 0xffffffff979d88a7
Build id: 3.10.0-862.el7.x86_64 		0x37
11
khugepaged_scan_mm_slot
vmlinux 0xffffffff97a036d9
Build id: 3.10.0-862.el7.x86_64 		0x779
12
? __schedule
vmlinux 0xffffffff97f1291c
Build id: 3.10.0-862.el7.x86_64 		0x41c
13
khugepaged
vmlinux 0xffffffff97a03ecb
Build id: 3.10.0-862.el7.x86_64 		0x13b
14
? wake_up_atomic_t
vmlinux 0xffffffff978bbe20
Build id: 3.10.0-862.el7.x86_64 		0x30
15
? khugepaged_scan_mm_slot
vmlinux 0xffffffff97a03d90
Build id: 3.10.0-862.el7.x86_64 		0xe30
16
kthread
vmlinux 0xffffffff978bae31
Build id: 3.10.0-862.el7.x86_64 		0xd1
17
? insert_kthread_work
vmlinux 0xffffffff978bad60
Build id: 3.10.0-862.el7.x86_64 		0x40
18
ret_from_fork_nospec_begin
vmlinux 0xffffffff97f1f637
Build id: 3.10.0-862.el7.x86_64 		0x21
19
? insert_kthread_work
vmlinux 0xffffffff978bad60
Build id: 3.10.0-862.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [khugepaged:44]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_REJECT nf_reject_ipv4 tun ebtable_filter ebtables ip6table_filter ip6_tables devlink ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) vmw_vsock_vmci_transport vsock iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr vmw_balloon sg nfit joydev libnvdimm parport_pc parport shpchp vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif drm_kms_helper crct10dif_generic ahci syscopyarea sysfillrect sysimgblt fb_sys_fops ttm libahci ata_piix crct10dif_pclmul
crct10dif_common libata drm crc32c_intel serio_raw i2c_core vmxnet3 vmw_pvscsi floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 44 Comm: khugepaged Tainted: G             L ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff885a793f4f10 ti: ffff885a74a5c000 task.ti: ffff885a74a5c000
RIP: 0010:[<ffffffff9790779a>]  [<ffffffff9790779a>] generic_exec_single+0xfa/0x1b0
RSP: 0018:ffff885a74a5fc00  EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffff885a74a5fbd0 RCX: 000000000000003c
RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000286
RBP: ffff885a74a5fc50 R08: ffffffff980133e0 R09: 0000000000000000
R10: ffffbcbdc41d8040 R11: 0000000000000000 R12: ffff885a74512bc0
R13: 0000000000000000 R14: ffff885a7fc18b00 R15: 0000000000000002
FS:  0000000000000000(0000) GS:ffff885a7fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8ef6412000 CR3: 00000000b9b8c000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff97876e50>] ? leave_mm+0x110/0x110
[<ffffffff97876e50>] ? leave_mm+0x110/0x110
[<ffffffff97876e50>] ? leave_mm+0x110/0x110
[<ffffffff979078af>] smp_call_function_single+0x5f/0xa0
[<ffffffff97b4a275>] ? cpumask_next_and+0x35/0x50
[<ffffffff97907e5b>] smp_call_function_many+0x22b/0x270
[<ffffffff97877018>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff97877088>] flush_tlb_mm_range+0x68/0x140
[<ffffffff979d88a7>] pmdp_clear_flush+0x37/0x60
[<ffffffff97a036d9>] khugepaged_scan_mm_slot+0x779/0xe30
[<ffffffff97f1291c>] ? __schedule+0x41c/0xa20
[<ffffffff97a03ecb>] khugepaged+0x13b/0x480
[<ffffffff978bbe20>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff97a03d90>] ? khugepaged_scan_mm_slot+0xe30/0xe30
[<ffffffff978bae31>] kthread+0xd1/0xe0
[<ffffffff978bad60>] ? insert_kthread_work+0x40/0x40
[<ffffffff97f1f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff978bad60>] ? insert_kthread_work+0x40/0x40
Code: 80 96 01 00 48 89 de 48 03 14 c5 a0 53 53 98 48 89 df e8 4a 87 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #98046
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810f93ba
Build id: 3.10.0-514.2.2.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffff8106c430
Build id: 3.10.0-514.2.2.el7.x86_64 		0x70
3
? leave_mm
vmlinux 0xffffffff8106c430
Build id: 3.10.0-514.2.2.el7.x86_64 		0x70
4
? leave_mm
vmlinux 0xffffffff8106c430
Build id: 3.10.0-514.2.2.el7.x86_64 		0x70
5
smp_call_function_single
vmlinux 0xffffffff810f94bf
Build id: 3.10.0-514.2.2.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff81317b25
Build id: 3.10.0-514.2.2.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff810f9a63
Build id: 3.10.0-514.2.2.el7.x86_64 		0x223
8
native_flush_tlb_others
vmlinux 0xffffffff8106c5f8
Build id: 3.10.0-514.2.2.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8106c6c9
Build id: 3.10.0-514.2.2.el7.x86_64 		0x69
10
pmdp_clear_flush
vmlinux 0xffffffff811c0f4e
Build id: 3.10.0-514.2.2.el7.x86_64 		0x4e
11
khugepaged_scan_mm_slot
vmlinux 0xffffffff811e8d34
Build id: 3.10.0-514.2.2.el7.x86_64 		0x684
12
? schedule_timeout
vmlinux 0xffffffff8168922d
Build id: 3.10.0-514.2.2.el7.x86_64 		0x17d
13
khugepaged
vmlinux 0xffffffff811e9577
Build id: 3.10.0-514.2.2.el7.x86_64 		0x257
14
? wake_up_atomic_t
vmlinux 0xffffffff810b1720
Build id: 3.10.0-514.2.2.el7.x86_64 		0x30
15
? khugepaged_scan_mm_slot
vmlinux 0xffffffff811e9320
Build id: 3.10.0-514.2.2.el7.x86_64 		0xc70
16
kthread
vmlinux 0xffffffff810b064f
Build id: 3.10.0-514.2.2.el7.x86_64 		0xcf
17
? kthread_create_on_node
vmlinux 0xffffffff810b0580
Build id: 3.10.0-514.2.2.el7.x86_64 		0x140
18
ret_from_fork
vmlinux 0xffffffff81696718
Build id: 3.10.0-514.2.2.el7.x86_64 		0x58
19
? kthread_create_on_node
vmlinux 0xffffffff810b0580
Build id: 3.10.0-514.2.2.el7.x86_64 		0x140 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [khugepaged:43]
Modules linked in: rfcomm fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun binfmt_misc xt_nat xt_mark ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmhgfs(OE) bnep vmw_vsock_vmci_transport vsock ext4 mbcache jbd2 intel_powerclamp coretemp snd_seq_midi snd_seq_midi_event iosf_mbi btusb crc32_pclmul btrtl ghash_clmulni_intel aesni_intel btbcm btintel bluetooth lrw gf128mul glue_helper ablk_helper cryptd
ppdev snd_ens1371 vmw_balloon snd_rawmidi snd_ac97_codec ac97_bus snd_seq sg snd_seq_device pcspkr snd_pcm vmw_vmci rfkill nfit snd_timer snd i2c_piix4 soundcore shpchp libnvdimm parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops serio_raw ttm drm mptspi ata_piix scsi_transport_spi mptscsih libata e1000 mptbase i2c_core fjes dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 43 Comm: khugepaged Tainted: G           OEL ------------   3.10.0-514.2.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff880136824e70 ti: ffff8801323c0000 task.ti: ffff8801323c0000
RIP: 0010:[<ffffffff810f93ba>]  [<ffffffff810f93ba>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff8801323c3c10  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff8801323c3be0 RCX: 0000000000000001
RDX: ffffffff816af9b0 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff8801323c3c58 R08: ffffffff816af9a8 R09: ffffea0001e48000
R10: 0000000000000020 R11: ffff8800a3a28000 R12: 0000000000000009
R13: 000000000000006c R14: 0000000000000020 R15: ffff88013ffd7800
FS:  0000000000000000(0000) GS:ffff880139640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc0de4502d0 CR3: 00000000019ba000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff8106c430 ffff8801323c3ce0
0000000000000003 00000000e7d2b12c 0000000000000000 ffffffff8106c430
ffffffff8106c430 ffff8801323c3c88 ffffffff810f94bf ffff8801323c3c88
Call Trace:
[<ffffffff8106c430>] ? leave_mm+0x70/0x70
[<ffffffff8106c430>] ? leave_mm+0x70/0x70
[<ffffffff8106c430>] ? leave_mm+0x70/0x70
[<ffffffff810f94bf>] smp_call_function_single+0x5f/0xa0
[<ffffffff81317b25>] ? cpumask_next_and+0x35/0x50
[<ffffffff810f9a63>] smp_call_function_many+0x223/0x260
[<ffffffff8106c5f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8106c6c9>] flush_tlb_mm_range+0x69/0x140
[<ffffffff811c0f4e>] pmdp_clear_flush+0x4e/0x80
[<ffffffff811e8d34>] khugepaged_scan_mm_slot+0x684/0xc70
[<ffffffff8168922d>] ? schedule_timeout+0x17d/0x2d0
[<ffffffff811e9577>] khugepaged+0x257/0x480
[<ffffffff810b1720>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff811e9320>] ? khugepaged_scan_mm_slot+0xc70/0xc70
[<ffffffff810b064f>] kthread+0xcf/0xe0
[<ffffffff810b0580>] ? kthread_create_on_node+0x140/0x140
[<ffffffff81696718>] ret_from_fork+0x58/0x90
[<ffffffff810b0580>] ? kthread_create_on_node+0x140/0x140
Code: 80 77 01 00 48 89 de 48 03 14 c5 80 57 ad 81 48 89 df e8 0a 29 23 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #52852
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810f925a
Build id: 3.10.0-514.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffff8106c300
Build id: 3.10.0-514.el7.x86_64 		0x70
3
? leave_mm
vmlinux 0xffffffff8106c300
Build id: 3.10.0-514.el7.x86_64 		0x70
4
? leave_mm
vmlinux 0xffffffff8106c300
Build id: 3.10.0-514.el7.x86_64 		0x70
5
smp_call_function_single
vmlinux 0xffffffff810f935f
Build id: 3.10.0-514.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff813179a5
Build id: 3.10.0-514.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff810f9903
Build id: 3.10.0-514.el7.x86_64 		0x223
8
native_flush_tlb_others
vmlinux 0xffffffff8106c4c8
Build id: 3.10.0-514.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8106c599
Build id: 3.10.0-514.el7.x86_64 		0x69
10
pmdp_clear_flush
vmlinux 0xffffffff811c0dee
Build id: 3.10.0-514.el7.x86_64 		0x4e
11
khugepaged_scan_mm_slot
vmlinux 0xffffffff811e8bd4
Build id: 3.10.0-514.el7.x86_64 		0x684
12
? schedule_timeout
vmlinux 0xffffffff8168900d
Build id: 3.10.0-514.el7.x86_64 		0x17d
13
khugepaged
vmlinux 0xffffffff811e9417
Build id: 3.10.0-514.el7.x86_64 		0x257
14
? wake_up_atomic_t
vmlinux 0xffffffff810b1600
Build id: 3.10.0-514.el7.x86_64 		0x30
15
? khugepaged_scan_mm_slot
vmlinux 0xffffffff811e91c0
Build id: 3.10.0-514.el7.x86_64 		0xc70
16
kthread
vmlinux 0xffffffff810b052f
Build id: 3.10.0-514.el7.x86_64 		0xcf
17
? kthread_create_on_node
vmlinux 0xffffffff810b0460
Build id: 3.10.0-514.el7.x86_64 		0x140
18
ret_from_fork
vmlinux 0xffffffff81696518
Build id: 3.10.0-514.el7.x86_64 		0x58
19
? kthread_create_on_node
vmlinux 0xffffffff810b0460
Build id: 3.10.0-514.el7.x86_64 		0x140 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [khugepaged:43]
Modules linked in: fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event intel_powerclamp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel snd_ens1371 lrw snd_rawmidi gf128mul glue_helper snd_ac97_codec ablk_helper cryptd ac97_bus snd_seq snd_seq_device snd_pcm ppdev nfit snd_timer snd soundcore pcspkr vmw_vmci vmw_balloon sg libnvdimm i2c_piix4 parport_pc parport shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif
crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix crct10dif_pclmul crct10dif_common libata crc32c_intel drm mptspi serio_raw scsi_transport_spi i2c_core mptscsih mptbase e1000 fjes
CPU: 2 PID: 43 Comm: khugepaged Not tainted 3.10.0-514.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff8801369d6dd0 ti: ffff8801327f0000 task.ti: ffff8801327f0000
RIP: 0010:[<ffffffff810f925a>]  [<ffffffff810f925a>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff8801327f3c10  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff8801327f3be0 RCX: 0000000000000002
RDX: ffffffff816afc30 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff8801327f3c58 R08: ffffffff816afc28 R09: ffffea0002780000
R10: 00000000000000bc R11: ffff8800b1f89000 R12: 0000000000000009
R13: 000000000000006c R14: 0000000000000020 R15: ffff88013ffd7800
FS:  0000000000000000(0000) GS:ffff880139680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f10b1c9d000 CR3: 00000000882e3000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff8106c300 ffff8801327f3ce0
0000000000000003 00000000b641e656 0000000000000001 ffffffff8106c300
ffffffff8106c300 ffff8801327f3c88 ffffffff810f935f ffff8801327f3c88
Call Trace:
[<ffffffff8106c300>] ? leave_mm+0x70/0x70
[<ffffffff8106c300>] ? leave_mm+0x70/0x70
[<ffffffff8106c300>] ? leave_mm+0x70/0x70
[<ffffffff810f935f>] smp_call_function_single+0x5f/0xa0
[<ffffffff813179a5>] ? cpumask_next_and+0x35/0x50
[<ffffffff810f9903>] smp_call_function_many+0x223/0x260
[<ffffffff8106c4c8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8106c599>] flush_tlb_mm_range+0x69/0x140
[<ffffffff811c0dee>] pmdp_clear_flush+0x4e/0x80
[<ffffffff811e8bd4>] khugepaged_scan_mm_slot+0x684/0xc70
[<ffffffff8168900d>] ? schedule_timeout+0x17d/0x2d0
[<ffffffff811e9417>] khugepaged+0x257/0x480
[<ffffffff810b1600>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff811e91c0>] ? khugepaged_scan_mm_slot+0xc70/0xc70
[<ffffffff810b052f>] kthread+0xcf/0xe0
[<ffffffff810b0460>] ? kthread_create_on_node+0x140/0x140
[<ffffffff81696518>] ret_from_fork+0x58/0x90
[<ffffffff810b0460>] ? kthread_create_on_node+0x140/0x140
Code: 80 77 01 00 48 89 de 48 03 14 c5 40 57 ad 81 48 89 df e8 ea 28 23 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #5400
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffaf516f72
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffaf47e730
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffffaf47e730
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffffaf47e730
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffffaf51708f
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffaf785005
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffaf51763b
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffaf47e8f8
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffaf47e96b
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x6b
10
pmdp_clear_flush
vmlinux 0xffffffffaf6078f7
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x37
11
khugepaged_scan_mm_slot
vmlinux 0xffffffffaf63485a
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x7da
12
khugepaged
vmlinux 0xffffffffaf63517b
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x13b
13
? wake_up_atomic_t
vmlinux 0xffffffffaf4c7780
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x30
14
? khugepaged_scan_mm_slot
vmlinux 0xffffffffaf635040
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xfc0
15
kthread
vmlinux 0xffffffffaf4c6691
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xd1
16
? insert_kthread_work
vmlinux 0xffffffffaf4c65c0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x40
17
ret_from_fork_nospec_begin
vmlinux 0xffffffffafb92d1d
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x7
18
? insert_kthread_work
vmlinux 0xffffffffaf4c65c0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#34 stuck for 22s! [khugepaged:393]
Modules linked in: tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc iTCO_wdt iTCO_vendor_support skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel snd_hda_codec_realtek kvm snd_hda_codec_generic irqbypass crc32_pclmul snd_hda_intel ghash_clmulni_intel aesni_intel lrw gf128mul snd_hda_codec glue_helper ablk_helper cryptd snd_hda_core ipmi_ssif snd_hwdep pcspkr snd_seq snd_seq_device snd_pcm joydev snd_timer snd i2c_i801 lpc_ich soundcore mei_me mei sg wmi ipmi_si ipmi_devintf ipmi_msghandler acpi_pad acpi_power_meter ip_tables xfs
libcrc32c sd_mod crc_t10dif crct10dif_generic ast i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm i40e crct10dif_pclmul drm crct10dif_common crc32c_intel ptp pps_core ahci libahci libata drm_panel_orientation_quirks nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 34 PID: 393 Comm: khugepaged Kdump: loaded Not tainted 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: Supermicro X11DAi-N/X11DAi-N, BIOS 2.0b 02/28/2018
task: ffff9e90cd7c3150 ti: ffff9e90cd7f8000 task.ti: ffff9e90cd7f8000
RIP: 0010:[<ffffffffaf516f72>]  [<ffffffffaf516f72>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9e90cd7fbc00  EFLAGS: 00000202
RAX: 00000000000000b8 RBX: ffffe0445c110000 RCX: 0000000000000008
RDX: 00000000000000b8 RSI: 0000000000000038 RDI: 0000000000000282
RBP: ffff9e90cd7fbc50 R08: ffffffffafc181c8 R09: 0000000000000000
R10: ffff9e9cffbd4b00 R11: 7fffffffffffffff R12: 0000000000000009
R13: 000000000000006c R14: 0000000000000020 R15: ffffffffaf9c30ef
FS:  0000000000000000(0000) GS:ffff9e9cce200000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff5d4025768 CR3: 00000002dd210000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 00000000
Call Trace:
[<ffffffffaf47e730>] ? leave_mm+0x120/0x120
[<ffffffffaf47e730>] ? leave_mm+0x120/0x120
[<ffffffffaf47e730>] ? leave_mm+0x120/0x120
[<ffffffffaf51708f>] smp_call_function_single+0x5f/0xa0
[<ffffffffaf785005>] ? cpumask_next_and+0x35/0x50
[<ffffffffaf51763b>] smp_call_function_many+0x22b/0x270
[<ffffffffaf47e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffaf47e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffaf6078f7>] pmdp_clear_flush+0x37/0x60
[<ffffffffaf63485a>] khugepaged_scan_mm_slot+0x7da/0xfc0
[<ffffffffaf63517b>] khugepaged+0x13b/0x490
[<ffffffffaf4c7780>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffaf635040>] ? khugepaged_scan_mm_slot+0xfc0/0xfc0
[<ffffffffaf4c6691>] kthread+0xd1/0xe0
[<ffffffffaf4c65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffafb92d1d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffaf4c65c0>] ? insert_kthread_work+0x40/0x40
Code: 89 de 48 03 14 c5 a0 10 15 b0 48 89 df e8 07 52 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00