Info

Permalink
Function
generic_exec_single
First occurrence
2020-11-15
Last occurrence
2026-01-23
State
NEW
Components
kernel
Quality
-26

Statistics

Operating system Count
CentOS 7 545
Architecture Count
x86_64 545
Related packages Count
kernel 545
 0:3.10.0-1160.99.1.el7 184
 0:3.10.0-1160.el7 73
 0:3.10.0-1160.119.1.el7 38
 0:3.10.0-1160.53.1.el7 35
 0:3.10.0-957.el7 35
 0:3.10.0-1062.el7 22
 0:3.10.0-862.el7 16
 0:3.10.0-1160.95.1.el7 10
 0:3.10.0-1160.41.1.el7 9
 0:3.10.0-1160.71.1.el7 9
 0:3.10.0-1127.19.1.el7 7
 0:3.10.0-1160.15.2.el7 7
 0:3.10.0-1127.18.2.el7 6
 0:3.10.0-1160.76.1.el7 6
 0:3.10.0-693.el7 6
 0:3.10.0-693.21.1.el7 5
 0:3.10.0-1062.1.1.el7 4
 0:3.10.0-1160.24.1.el7 4
 0:3.10.0-1160.59.1.el7 4
 0:3.10.0-1160.6.1.el7 4
 0:3.10.0-1160.88.1.el7 4
 0:3.10.0-1062.18.1.el7 3
 0:3.10.0-1127.el7 3
 0:3.10.0-1160.105.1.el7 3
 0:3.10.0-1160.49.1.el7 3
 0:3.10.0-693.11.1.el7 3
 0:3.10.0-862.14.4.el7 3
 0:3.10.0-1062.12.1.el7 2
 0:3.10.0-1127.10.1.el7 2
 0:3.10.0-1127.8.2.el7 2
 0:3.10.0-1160.62.1.el7 2
 0:3.10.0-1160.80.1.el7 2
 0:3.10.0-1160.81.1.el7 2
 0:3.10.0-957.1.3.el7 2
 0:3.10.0-957.27.2.el7 2
 0:3.10.0-229.14.1.el7 2
 0:3.10.0-1062.4.3.el7 1
 0:3.10.0-1127.13.1.el7 1
 0:3.10.0-1160.11.1.el7 1
 0:3.10.0-1160.114.2.el7 1
 0:3.10.0-1160.119.1.el7.tuxcare.els18 1
 0:3.10.0-1160.139.1.el7.tuxcare.els3 1
 0:3.10.0-1160.31.1.el7 1
 0:3.10.0-1160.42.2.el7 1
 0:3.10.0-1160.83.1.el7 1
 0:3.10.0-514.26.2.el7 1
 0:3.10.0-693.2.2.el7 1
 0:3.10.0-693.5.2.el7 1
 0:3.10.0-957.5.1.el7 1
 0:3.10.0-1160.36.2.el7 1
 0:3.10.0-957.12.2.el7 1
 0:3.10.0-327.10.1.el7 1
 0:3.10.0-1160.45.1.el7 1
 0:3.10.0-1062.4.1.el7 1
 0:3.10.0-327.el7 1
 0:3.10.0-1160.118.1.el7 1
 0:3.10.0-1160.92.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #930412
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff9051db12
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff90481b10
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x130
3
? leave_mm
vmlinux 0xffffffff90481b10
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x130
4
? leave_mm
vmlinux 0xffffffff90481b10
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x130
5
smp_call_function_single
vmlinux 0xffffffff9051dc2f
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff9079c485
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff9051e1eb
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff90481fa8
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9048201b
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x6b
10
dup_mm
vmlinux 0xffffffff9049ca26
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x656
11
copy_process
vmlinux 0xffffffff9049dfee
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x148e
12
do_fork
vmlinux 0xffffffff9049e791
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x91
13
SyS_clone
vmlinux 0xffffffff9049eae6
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x16
14
stub_clone
vmlinux 0xffffffff90bc5774
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x44
15
? tracesys
vmlinux 0xffffffff90bc562e
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xa6 
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 22s! [check_mk_agent:1198]
Modules linked in: veth xt_nat xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_addrtype br_netfilter bridge stp llc overlay(T) xt_owner ebtable_filter ebtables devlink ip6_tables iptable_filter binfmt_misc vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon pcspkr joydev sg parport_pc parport i2c_piix4 vmw_vmci auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod syscopyarea sysfillrect sysimgblt fb_sys_fops crc_t10dif ttm crct10dif_generic ata_piix drm nfit libata crct10dif_pclmul crct10dif_common crc32c_intel libnvdimm serio_raw
vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 7 PID: 1198 Comm: check_mk_agent Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-1160.92.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff99f0bceb2100 ti: ffff99f0bde70000 task.ti: ffff99f0bde70000
RIP: 0010:[<ffffffff9051db12>]  [<ffffffff9051db12>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff99f0bde73c50  EFLAGS: 00000202
RAX: 0000000000000008 RBX: ffff99f0bde73c20 RCX: 0000000000000038
RDX: 00000000000000ff RSI: 0000000000000008 RDI: 0000000000000282
RBP: ffff99f0bde73ca0 R08: ffffffff90c13940 R09: ffffffff9049c602
R10: ffff99f0af6add88 R11: 0000000000000000 R12: ffff99f0bde73bd8
R13: fffffc7488b32e40 R14: 00007ffffa133000 R15: 0000000000000000
FS:  00007f9ad3cac740(0000) GS:ffff99f0ffdc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000001cf4e10 CR3: 0000000fef63e000 CR4: 00000000001607e0
Call Trace:
[<ffffffff90481b10>] ? leave_mm+0x130/0x130
[<ffffffff90481b10>] ? leave_mm+0x130/0x130
[<ffffffff90481b10>] ? leave_mm+0x130/0x130
[<ffffffff9051dc2f>] smp_call_function_single+0x5f/0xa0
[<ffffffff9079c485>] ? cpumask_next_and+0x35/0x50
[<ffffffff9051e1eb>] smp_call_function_many+0x22b/0x270
[<ffffffff90481fa8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9048201b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9049ca26>] dup_mm+0x656/0x750
[<ffffffff9049dfee>] copy_process+0x148e/0x1a80
[<ffffffff9049e791>] do_fork+0x91/0x340
[<ffffffff9049eae6>] SyS_clone+0x16/0x20
[<ffffffff90bc5774>] stub_clone+0x44/0x70
[<ffffffff90bc562e>] ? tracesys+0xa6/0xcc
Code: 89 de 48 03 14 c5 00 19 15 91 48 89 df e8 c7 66 29 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #893070
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff9bf16a32
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff9be7ddd0
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffff9be7ddd0
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffff9be7ddd0
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffff9bf16b4f
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff9c186a55
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff9bf170fb
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff9be7e258
Build id: 3.10.0-1160.59.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9be7e2cb
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x6b
10
dup_mm
vmlinux 0xffffffff9be98526
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x666
11
copy_process
vmlinux 0xffffffff9be99ad6
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x1486
12
do_fork
vmlinux 0xffffffff9be9a281
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x91
13
? __check_object_size
vmlinux 0xffffffff9c04b13a
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x1ca
14
SyS_clone
vmlinux 0xffffffff9be9a5a6
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x16
15
stub_clone
vmlinux 0xffffffff9c59a374
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x44
16
? system_call_fastpath
vmlinux 0xffffffff9c599f92
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 22s! [BT-Task:2122]
Modules linked in: binfmt_misc xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ext4 mbcache jbd2 snd_ens1371 snd_rawmidi snd_ac97_codec crc32_pclmul ac97_bus snd_seq ghash_clmulni_intel snd_seq_device ppdev nfit snd_pcm aesni_intel libnvdimm lrw gf128mul vmw_balloon snd_timer glue_helper ablk_helper cryptd snd soundcore joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ttm ata_piix mptspi crct10dif_pclmul drm crct10dif_common crc32c_intel scsi_transport_spi libata serio_raw mptscsih e1000 mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 7 PID: 2122 Comm: BT-Task Kdump: loaded Not tainted 3.10.0-1160.59.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff95d8f2e82100 ti: ffff95d7728b0000 task.ti: ffff95d7728b0000
RIP: 0010:[<ffffffff9bf16a32>]  [<ffffffff9bf16a32>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff95d7728b3c50  EFLAGS: 00000202
RAX: 0000000000000040 RBX: 000000000000dba9 RCX: 0000000000000001
RDX: 0000000000000040 RSI: 0000000000000000 RDI: 0000000000000286
RBP: ffff95d7728b3ca0 R08: ffffffff9c6137c8 R09: ffffffff9be980f2
R10: ffff95d77287bcb0 R11: 0000000000000000 R12: ffffffff9c00c1ca
R13: ffffecd2c8c0a580 R14: 00007fff3b44a000 R15: 0000000000000000
FS:  00007f99b0758740(0000) GS:ffff95d8f67c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f99a8cc6b90 CR3: 00000000b28b4000 CR4: 00000000001607e0
Call Trace:
[<ffffffff9be7ddd0>] ? leave_mm+0x120/0x120
[<ffffffff9be7ddd0>] ? leave_mm+0x120/0x120
[<ffffffff9be7ddd0>] ? leave_mm+0x120/0x120
[<ffffffff9bf16b4f>] smp_call_function_single+0x5f/0xa0
[<ffffffff9c186a55>] ? cpumask_next_and+0x35/0x50
[<ffffffff9bf170fb>] smp_call_function_many+0x22b/0x270
[<ffffffff9be7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9be7e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9be98526>] dup_mm+0x666/0x760
[<ffffffff9be99ad6>] copy_process+0x1486/0x1a80
[<ffffffff9be9a281>] do_fork+0x91/0x330
[<ffffffff9c04b13a>] ? __check_object_size+0x1ca/0x250
[<ffffffff9be9a5a6>] SyS_clone+0x16/0x20
[<ffffffff9c59a374>] stub_clone+0x44/0x70
[<ffffffff9c599f92>] ? system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 60 18 b5 9c 48 89 df e8 97 71 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #862215
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff8df1d9c2
Build id: 3.10.0-1160.81.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff8de81ab0
Build id: 3.10.0-1160.81.1.el7.x86_64 		0x130
3
? leave_mm
vmlinux 0xffffffff8de81ab0
Build id: 3.10.0-1160.81.1.el7.x86_64 		0x130
4
? leave_mm
vmlinux 0xffffffff8de81ab0
Build id: 3.10.0-1160.81.1.el7.x86_64 		0x130
5
smp_call_function_single
vmlinux 0xffffffff8df1dadf
Build id: 3.10.0-1160.81.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff8e19bf55
Build id: 3.10.0-1160.81.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff8df1e09b
Build id: 3.10.0-1160.81.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff8de81f48
Build id: 3.10.0-1160.81.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8de81fbb
Build id: 3.10.0-1160.81.1.el7.x86_64 		0x6b
10
dup_mm
vmlinux 0xffffffff8de9c9d6
Build id: 3.10.0-1160.81.1.el7.x86_64 		0x666
11
copy_process
vmlinux 0xffffffff8de9df9e
Build id: 3.10.0-1160.81.1.el7.x86_64 		0x148e 
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [ora_psp0_orcl:2756]
Modules linked in: tcp_diag udp_diag inet_diag xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc joydev sg pcspkr virtio_balloon i2c_piix4 binfmt_misc ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic crct10dif_common ata_generic pata_acpi virtio_net net_failover
virtio_scsi failover bochs_drm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata virtio_pci serio_raw virtio_ring virtio drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 2756 Comm: ora_psp0_orcl Kdump: loaded Tainted: G             L ------------   3.10.0-1160.81.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.1-0-g3208b098f51a-prebuilt.qemu.org 04/01/2014
task: ffff895ce6a74200 ti: ffff895d1baf4000 task.ti: ffff895d1baf4000
RIP: 0010:[<ffffffff8df1d9c2>]  [<ffffffff8df1d9c2>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff895d1baf7c50  EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffff895d1baf7c20 RCX: 000000000000003c
RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000282
RBP: ffff895d1baf7ca0 R08: ffffffff8e613dc0 R09: ffffffff8de9c5a2
R10: ffff895d1cce1870 R11: 0000000000000000 R12: ffff895d1baf7bd8
R13: fffffab92074a940 R14: 00007ffd6c19c000 R15: 0000000000000000
FS:  00007fdee6270f40(0000) GS:ffff895d3fd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000009826c484 CR3: 0000000794d94000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8de81ab0>] ? leave_mm+0x130/0x130
[<ffffffff8de81ab0>] ? leave_mm+0x130/0x130
[<ffffffff8de81ab0>] ? leave_mm+0x130/0x130
[<ffffffff8df1dadf>] smp_call_function_single+0x5f/0xa0
[<ffffffff8e19bf55>] ? cpumask_next_and+0x35/0x50
[<ffffffff8df1e09b>] smp_call_function_many+0x22b/0x270
[<ffffffff8de81f48>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8de81fbb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff8de9c9d6>] dup_mm+0x666/0x760
[<ffffffff8de9df9e>] copy_process+0x148e/0x1a80
Complete report #641888
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810f932a
Build id: 3.10.0-693.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.el7.x86_64 		0x70
3
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.el7.x86_64 		0x70
4
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.el7.x86_64 		0x70
5
smp_call_function_single
vmlinux 0xffffffff810f942f
Build id: 3.10.0-693.el7.x86_64 		0x5f
6
? smp_call_function_many
vmlinux 0xffffffff810f9877
Build id: 3.10.0-693.el7.x86_64 		0xd7
7
smp_call_function_many
vmlinux 0xffffffff810f99c3
Build id: 3.10.0-693.el7.x86_64 		0x223
8
native_flush_tlb_others
vmlinux 0xffffffff8106e668
Build id: 3.10.0-693.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8106e738
Build id: 3.10.0-693.el7.x86_64 		0x68
10
dup_mm
vmlinux 0xffffffff81084e05
Build id: 3.10.0-693.el7.x86_64 		0x5f5
11
copy_process
vmlinux 0xffffffff8108637e
Build id: 3.10.0-693.el7.x86_64 		0x144e
12
do_fork
vmlinux 0xffffffff81086a51
Build id: 3.10.0-693.el7.x86_64 		0x91
13
SyS_clone
vmlinux 0xffffffff81086d66
Build id: 3.10.0-693.el7.x86_64 		0x16
14
stub_clone
vmlinux 0xffffffff816b5319
Build id: 3.10.0-693.el7.x86_64 		0x69
15
? system_call_fastpath
vmlinux 0xffffffff816b4fc9
Build id: 3.10.0-693.el7.x86_64 		0x16 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [rabbitmq-server:7754]
Modules linked in: tcp_diag inet_diag vmw_vsock_vmci_transport vsock sb_edac xfs edac_core coretemp libcrc32c iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables ext4 mbcache jbd2 sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect crct10dif_pclmul crct10dif_common sysimgblt fb_sys_fops mptspi ttm crc32c_intel scsi_transport_spi serio_raw mptscsih drm ata_piix libata mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 7754 Comm: rabbitmq-server Tainted: G             L ------------   3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff8801b2f8bf40 ti: ffff880078500000 task.ti: ffff880078500000
RIP: 0010:[<ffffffff810f932a>]  [<ffffffff810f932a>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff880078503c60  EFLAGS: 00000202
RAX: 00000000000008fd RBX: ffff880078503c18 RCX: 0000000000000000
RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000282
RBP: ffff880078503ca8 R08: 0000000000000001 R09: ffffffff81084a30
R10: ffff8801bffd7000 R11: 0000000000000000 R12: ffff88018538f878
R13: ffff880078503be0 R14: ffffea0006cec840 R15: 00007ffde1fc3000
FS:  00007f07c7775740(0000) GS:ffff8801bfc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000001b27038 CR3: 0000000095a42000 CR4: 00000000000407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
 0000000000000000 0000000000000000 ffffffff8106e4a0 ffff880078503d30
 0000000000000002 00000000326845c2 0000000000000000 ffffffff8106e4a0
 ffffffff8106e4a0 ffff880078503cd8 ffffffff810f942f ffffffff810f9877
Call Trace:
 [<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
 [<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
 [<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
 [<ffffffff810f942f>] smp_call_function_single+0x5f/0xa0
 [<ffffffff810f9877>] ? smp_call_function_many+0xd7/0x260
 [<ffffffff810f99c3>] smp_call_function_many+0x223/0x260
 [<ffffffff8106e668>] native_flush_tlb_others+0xb8/0xc0
 [<ffffffff8106e738>] flush_tlb_mm_range+0x68/0x140
 [<ffffffff81084e05>] dup_mm+0x5f5/0x6f0
 [<ffffffff8108637e>] copy_process+0x144e/0x1970
 [<ffffffff81086a51>] do_fork+0x91/0x320
 [<ffffffff81086d66>] SyS_clone+0x16/0x20
 [<ffffffff816b5319>] stub_clone+0x69/0x90
 [<ffffffff816b4fc9>] ? system_call_fastpath+0x16/0x1b
Code: 00 78 01 00 48 89 de 48 03 14 c5 e0 fd b0 81 48 89 df e8 7a da 23 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #610458
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810e675a
Build id: 3.10.0-327.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffff81065c90
Build id: 3.10.0-327.el7.x86_64 		0x70
3
? leave_mm
vmlinux 0xffffffff81065c90
Build id: 3.10.0-327.el7.x86_64 		0x70
4
? leave_mm
vmlinux 0xffffffff81065c90
Build id: 3.10.0-327.el7.x86_64 		0x70
5
smp_call_function_single
vmlinux 0xffffffff810e685f
Build id: 3.10.0-327.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff812f2785
Build id: 3.10.0-327.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff810e6e03
Build id: 3.10.0-327.el7.x86_64 		0x223
8
native_flush_tlb_others
vmlinux 0xffffffff81065e58
Build id: 3.10.0-327.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff81065f26
Build id: 3.10.0-327.el7.x86_64 		0x66
10
dup_mm
vmlinux 0xffffffff81078acd
Build id: 3.10.0-327.el7.x86_64 		0x55d
11
copy_process.part.25
vmlinux 0xffffffff81079cf9
Build id: 3.10.0-327.el7.x86_64 		0x10e9
12
do_fork
vmlinux 0xffffffff8107a401
Build id: 3.10.0-327.el7.x86_64 		0xe1
13
? __do_page_fault
vmlinux 0xffffffff81640ec9
Build id: 3.10.0-327.el7.x86_64 		0x1f9
14
SyS_clone
vmlinux 0xffffffff8107a6c6
Build id: 3.10.0-327.el7.x86_64 		0x16
15
stub_clone
vmlinux 0xffffffff81645c59
Build id: 3.10.0-327.el7.x86_64 		0x69
16
? system_call_fastpath
vmlinux 0xffffffff81645909
Build id: 3.10.0-327.el7.x86_64 		0x16 
BUG: soft lockup - CPU#2 stuck for 23s! [BT-Task:1950]
Modules linked in: gsch(OE) redirfs(OE) dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop bridge stp llc ip_set nfnetlink dsa_filter(POE) vmw_vsock_vmci_transport vsock sunrpc crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr sg shpchp vmw_vmci parport_pc parport i2c_piix4 xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel vmwgfx serio_raw drm_kms_helper ttm mptsas scsi_transport_sas drm mptscsih mptbase ata_piix vmxnet3 libata i2c_core dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
CPU: 2 PID: 1950 Comm: BT-Task Tainted: P           OEL ------------   3.10.0-327.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff880425426780 ti: ffff880406a38000 task.ti: ffff880406a38000
RIP: 0010:[<ffffffff810e675a>]  [<ffffffff810e675a>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff880406a3bc80  EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffff880406a3bc50 RCX: 000000000000003c
RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000282
RBP: ffff880406a3bcd0 R08: ffffffff8165ea60 R09: ffffffff81078770
R10: ffff88043ffcd000 R11: 0000000000000000 R12: ffff880036acbe80
R13: 00007ffca64d9000 R14: ffff8804069d6990 R15: ffff880226971990
FS:  00007f602cb4a700(0000) GS:ffff88043fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f602c0a3000 CR3: 0000000427095000 CR4: 00000000001407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff81065c90 ffff880406a3bd58
0000000000000002 0000000054148644 ffff880406a3bfd8 0000000000000001
ffffffff81065c90 ffffffff81065c90 ffff880406a3bd00 ffffffff810e685f
Call Trace:
[<ffffffff81065c90>] ? leave_mm+0x70/0x70
[<ffffffff81065c90>] ? leave_mm+0x70/0x70
[<ffffffff81065c90>] ? leave_mm+0x70/0x70
[<ffffffff810e685f>] smp_call_function_single+0x5f/0xa0
[<ffffffff812f2785>] ? cpumask_next_and+0x35/0x50
[<ffffffff810e6e03>] smp_call_function_many+0x223/0x260
[<ffffffff81065e58>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff81065f26>] flush_tlb_mm_range+0x66/0x140
[<ffffffff81078acd>] dup_mm+0x55d/0x670
[<ffffffff81079cf9>] copy_process.part.25+0x10e9/0x1610
[<ffffffff8107a401>] do_fork+0xe1/0x320
[<ffffffff81640ec9>] ? __do_page_fault+0x1f9/0x420
[<ffffffff8107a6c6>] SyS_clone+0x16/0x20
[<ffffffff81645c59>] stub_clone+0x69/0x90
[<ffffffff81645909>] ? system_call_fastpath+0x16/0x1b
Code: 40 52 01 00 48 89 de 48 03 14 c5 e0 b8 a5 81 48 89 df e8 da fc 21 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #547028
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff97716ae2
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff9767ddd0
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffff9767ddd0
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffff9767ddd0
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffff97716bff
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff97986845
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff977171ab
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff9767e258
Build id: 3.10.0-1160.76.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9767e2cb
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x6b
10
dup_mm
vmlinux 0xffffffff976986b6
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x666
11
copy_process
vmlinux 0xffffffff97699c66
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x1486
12
do_fork
vmlinux 0xffffffff9769a411
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x91
13
? system_call_after_swapgs
vmlinux 0xffffffff97d99ec9
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x96
14
SyS_clone
vmlinux 0xffffffff9769a736
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x16
15
stub_clone
vmlinux 0xffffffff97d9a374
Build id: 3.10.0-1160.76.1.el7.x86_64 		0x44
16
? tracesys
vmlinux 0xffffffff97d9a226
Build id: 3.10.0-1160.76.1.el7.x86_64 		0xa6 
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 22s! [sctps:40398]
Modules linked in: veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter overlay(T) sunrpc ppdev sg i2c_piix4 parport_pc virtio_balloon parport joydev pcspkr ip_tables xfs libcrc32c sr_mod cdrom virtio_net ata_generic pata_acpi net_failover virtio_console virtio_scsi virtio_blk failover cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata serio_raw virtio_pci drm_panel_orientation_quirks virtio_ring floppy virtio dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 7 PID: 40398 Comm: sctps Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.76.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff90436e67c200 ti: ffff9046bab98000 task.ti: ffff9046bab98000
RIP: 0010:[<ffffffff97716ae2>]  [<ffffffff97716ae2>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9046bab9bc50  EFLAGS: 00000202
RAX: 0000000000000060 RBX: ffff9046bab9bc20 RCX: 0000000000000020
RDX: 00000000ffffffff RSI: 0000000000000060 RDI: 0000000000000282
RBP: ffff9046bab9bca0 R08: ffffffff97e13a48 R09: 0000000180250025
R10: ffff9045dc722bd0 R11: 0000000000000000 R12: ffff9046bab9bbd8
R13: fffff3fc404d0780 R14: 00007ffc7dc00000 R15: 0000000000000000
FS:  00007f813b014700(0000) GS:ffff90472dfc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f92f9826000 CR3: 00000001408ae000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9767ddd0>] ? leave_mm+0x120/0x120
[<ffffffff9767ddd0>] ? leave_mm+0x120/0x120
[<ffffffff9767ddd0>] ? leave_mm+0x120/0x120
[<ffffffff97716bff>] smp_call_function_single+0x5f/0xa0
[<ffffffff97986845>] ? cpumask_next_and+0x35/0x50
[<ffffffff977171ab>] smp_call_function_many+0x22b/0x270
[<ffffffff9767e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9767e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff976986b6>] dup_mm+0x666/0x760
[<ffffffff97699c66>] copy_process+0x1486/0x1a80
[<ffffffff9769a411>] do_fork+0x91/0x330
[<ffffffff97d99ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff9769a736>] SyS_clone+0x16/0x20
[<ffffffff97d9a374>] stub_clone+0x44/0x70
[<ffffffff97d9a226>] ? tracesys+0xa6/0xcc
Code: 89 de 48 03 14 c5 00 19 35 98 48 89 df e8 d7 6e 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #490900
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa6d14a20
Build id: 3.10.0-1062.el7.x86_64 		0x100
2
? leave_mm
vmlinux 0xffffffffa6c7d1d0
Build id: 3.10.0-1062.el7.x86_64 		0x110
3
? leave_mm
vmlinux 0xffffffffa6c7d1d0
Build id: 3.10.0-1062.el7.x86_64 		0x110
4
? leave_mm
vmlinux 0xffffffffa6c7d1d0
Build id: 3.10.0-1062.el7.x86_64 		0x110
5
smp_call_function_single
vmlinux 0xffffffffa6d14b3f
Build id: 3.10.0-1062.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffa6f7f475
Build id: 3.10.0-1062.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffa6d150eb
Build id: 3.10.0-1062.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffa6c7d398
Build id: 3.10.0-1062.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffa6c7d40b
Build id: 3.10.0-1062.el7.x86_64 		0x6b
10
dup_mm
vmlinux 0xffffffffa6c97b8d
Build id: 3.10.0-1062.el7.x86_64 		0x65d
11
copy_process
vmlinux 0xffffffffa6c9910e
Build id: 3.10.0-1062.el7.x86_64 		0x145e
12
do_fork
vmlinux 0xffffffffa6c998b1
Build id: 3.10.0-1062.el7.x86_64 		0x91
13
SyS_clone
vmlinux 0xffffffffa6c99bd6
Build id: 3.10.0-1062.el7.x86_64 		0x16
14
stub_clone
vmlinux 0xffffffffa738c2b4
Build id: 3.10.0-1062.el7.x86_64 		0x44
15
? tracesys
vmlinux 0xffffffffa738c172
Build id: 3.10.0-1062.el7.x86_64 		0xa6 
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 24s! [sctps:35653]
Modules linked in: veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter overlay(T) sunrpc ppdev sg joydev virtio_balloon i2c_piix4 pcspkr parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_scsi virtio_net virtio_blk virtio_console cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata drm_panel_orientation_quirks virtio_pci virtio_ring serio_raw virtio floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 7 PID: 35653 Comm: sctps Kdump: loaded Tainted: G             L ------------ T 3.10.0-1062.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff9ed743a93150 ti: ffff9ed71f8b0000 task.ti: ffff9ed71f8b0000
RIP: 0010:[<ffffffffa6d14a20>]  [<ffffffffa6d14a20>] generic_exec_single+0x100/0x1c0
RSP: 0018:ffff9ed71f8b3c50  EFLAGS: 00000202
RAX: 0000000000000060 RBX: ffff9ed71f8b3c20 RCX: 0000000000000020
RDX: 00000000ffffffff RSI: 0000000000000060 RDI: 0000000000000282
RBP: ffff9ed71f8b3ca0 R08: ffffffffa7413f08 R09: ffffffffa6c9776c
R10: ffff9ed6ffe626c0 R11: 0000000000000000 R12: ffff9ed71f8b3bd8
R13: ffffdb88c1a789c0 R14: 00007fff5a244000 R15: 0000000000000000
FS:  00007f05a5276700(0000) GS:ffff9ed86dfc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c0008d5000 CR3: 000000007dffa000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa6c7d1d0>] ? leave_mm+0x110/0x110
[<ffffffffa6c7d1d0>] ? leave_mm+0x110/0x110
[<ffffffffa6c7d1d0>] ? leave_mm+0x110/0x110
[<ffffffffa6d14b3f>] smp_call_function_single+0x5f/0xa0
[<ffffffffa6f7f475>] ? cpumask_next_and+0x35/0x50
[<ffffffffa6d150eb>] smp_call_function_many+0x22b/0x270
[<ffffffffa6c7d398>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa6c7d40b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa6c97b8d>] dup_mm+0x65d/0x750
[<ffffffffa6c9910e>] copy_process+0x145e/0x1a50
[<ffffffffa6c998b1>] do_fork+0x91/0x330
[<ffffffffa6c99bd6>] SyS_clone+0x16/0x20
[<ffffffffa738c2b4>] stub_clone+0x44/0x70
[<ffffffffa738c172>] ? tracesys+0xa6/0xcc
Code: 00 48 89 de 48 03 14 c5 e0 d7 94 a7 48 89 df e8 d7 1a 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 <f3> 90 f6 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28
Complete report #470587
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff9fd163d2
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff9fc7e2b0
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x110
3
? leave_mm
vmlinux 0xffffffff9fc7e2b0
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x110
4
? leave_mm
vmlinux 0xffffffff9fc7e2b0
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x110
5
smp_call_function_single
vmlinux 0xffffffff9fd164ef
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff9ff81685
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff9fd16a9b
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff9fc7e478
Build id: 3.10.0-1062.12.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9fc7e4eb
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x6b
10
dup_mm
vmlinux 0xffffffff9fc98c6d
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x65d
11
copy_process
vmlinux 0xffffffff9fc9a1ee
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x145e
12
do_fork
vmlinux 0xffffffff9fc9a991
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x91 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [sdsvrd:134788]
Modules linked in: binfmt_misc xt_multiport nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc ppdev virtio_balloon pcspkr sg joydev parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_console virtio_blk
virtio_scsi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata serio_raw virtio_pci virtio_ring virtio drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 134788 Comm: sdsvrd Kdump: loaded Tainted: G             L ------------   3.10.0-1062.12.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff9db3a0a320e0 ti: ffff9db311318000 task.ti: ffff9db311318000
RIP: 0010:[<ffffffff9fd163d2>]  [<ffffffff9fd163d2>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9db31131bc50  EFLAGS: 00000202
RAX: 00000000000000a0 RBX: ffff9db31131bc20 RCX: 0000000000000020
RDX: 00000000ffffffff RSI: 00000000000000a0 RDI: 0000000000000282
RBP: ffff9db31131bca0 R08: ffffffffa0413cc8 R09: ffffffff9fc9884c
R10: ffff9dafb5787440 R11: 0000000000000000 R12: ffff9db31131bbd8
R13: fffff697444b21c0 R14: 00007ffece000000 R15: 0000000000000000
FS:  00000000410ec940(0063) GS:ffff9db3ace00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000003640e18 CR3: 0000000375ebe000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9fc7e2b0>] ? leave_mm+0x110/0x110
[<ffffffff9fc7e2b0>] ? leave_mm+0x110/0x110
[<ffffffff9fc7e2b0>] ? leave_mm+0x110/0x110
[<ffffffff9fd164ef>] smp_call_function_single+0x5f/0xa0
[<ffffffff9ff81685>] ? cpumask_next_and+0x35/0x50
[<ffffffff9fd16a9b>] smp_call_function_many+0x22b/0x270
[<ffffffff9fc7e478>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9fc7e4eb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9fc98c6d>] dup_mm+0x65d/0x750
[<ffffffff9fc9a1ee>] copy_process+0x145e/0x1a50
[<ffffffff9fc9a991>] do_fork+0x91/0x330
Complete report #439980
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffbaf14af6
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x106
2
? leave_mm
vmlinux 0xffffffffbae7d2b0
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x110
3
? leave_mm
vmlinux 0xffffffffbae7d2b0
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x110
4
? leave_mm
vmlinux 0xffffffffbae7d2b0
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x110
5
smp_call_function_single
vmlinux 0xffffffffbaf14c0f
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffbb17fce5
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffbaf151bb
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffbae7d478
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffbae7d4eb
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x6b
10
dup_mm
vmlinux 0xffffffffbae97c6d
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x65d
11
copy_process
vmlinux 0xffffffffbae991ee
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x145e
12
do_fork
vmlinux 0xffffffffbae99991
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x91
13
SyS_clone
vmlinux 0xffffffffbae99cb6
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x16
14
stub_clone
vmlinux 0xffffffffbb58c2b4
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x44
15
? system_call_fastpath
vmlinux 0xffffffffbb58bede
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [crond:2875]
Modules linked in: veth nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache devlink falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13501(E) binfmt_misc ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel snd_hda_codec_generic aesni_intel
lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel snd_hda_codec joydev snd_hda_core sg virtio_balloon snd_hwdep snd_seq snd_seq_device parport_pc parport snd_pcm snd_timer snd i2c_piix4 soundcore pcspkr auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_blk cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata crct10dif_pclmul crct10dif_common floppy crc32c_intel serio_raw virtio_pci virtio_ring drm_panel_orientation_quirks virtio dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 2875 Comm: crond Kdump: loaded Tainted: P            EL ------------ T 3.10.0-1062.4.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
task: ffff8c3486f7c1c0 ti: ffff8c3486f40000 task.ti: ffff8c3486f40000
RIP: 0010:[<ffffffffbaf14af6>]  [<ffffffffbaf14af6>] generic_exec_single+0x106/0x1c0
RSP: 0000:ffff8c3486f43c50  EFLAGS: 00000202
RAX: 0000000000000018 RBX: ffff8c3486f43c20 RCX: 0000000000000028
RDX: 0000000000ffffff RSI: 0000000000000018 RDI: 0000000000000282
RBP: ffff8c3486f43ca0 R08: ffffffffbb613540 R09: ffffffffbae9784c
R10: ffff8c3488ebd440 R11: 0000000000000001 R12: 8000000000000845
R13: 00003ffffffff000 R14: ffff8c3488ebd440 R15: 0000000000000001
FS:  00007fb7d10c2840(0000) GS:ffff8c349f140000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000b2847005 CR3: 0000002f46f00000 CR4: 00000000001606e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffbae7d2b0>] ? leave_mm+0x110/0x110
[<ffffffffbae7d2b0>] ? leave_mm+0x110/0x110
[<ffffffffbae7d2b0>] ? leave_mm+0x110/0x110
[<ffffffffbaf14c0f>] smp_call_function_single+0x5f/0xa0
[<ffffffffbb17fce5>] ? cpumask_next_and+0x35/0x50
[<ffffffffbaf151bb>] smp_call_function_many+0x22b/0x270
[<ffffffffbae7d478>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffbae7d4eb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffbae97c6d>] dup_mm+0x65d/0x750
[<ffffffffbae991ee>] copy_process+0x145e/0x1a50
[<ffffffffbae99991>] do_fork+0x91/0x330
[<ffffffffbae99cb6>] SyS_clone+0x16/0x20
[<ffffffffbb58c2b4>] stub_clone+0x44/0x70
[<ffffffffbb58bede>] ? system_call_fastpath+0x25/0x2a
Code: 14 c5 e0 d6 b4 bb 48 89 df e8 77 22 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 f6 43 20 01 <75> f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 00 0f 85 8f
Complete report #299872
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffb2116a32
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffb207ddd0
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffffb207ddd0
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffffb207ddd0
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffffb2116b4f
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffb2386a45
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffb21170fb
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffb207e258
Build id: 3.10.0-1160.45.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffb207e2cb
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x6b
10
dup_mm
vmlinux 0xffffffffb2098526
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x666
11
copy_process
vmlinux 0xffffffffb2099ad6
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x1486
12
do_fork
vmlinux 0xffffffffb209a281
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x91
13
SyS_clone
vmlinux 0xffffffffb209a5a6
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x16
14
stub_clone
vmlinux 0xffffffffb2796374
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x44
15
? system_call_fastpath
vmlinux 0xffffffffb2795f92
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [rtorrent main:3060]
Modules linked in: xt_nat veth ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) ipmi_devintf ipmi_msghandler bonding nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter hwmon_vid lm63 mlx5_core(OE) mlxfw(OE) ext4 mbcache jbd2 squashfs loop enhanceio_rand(OE) enhanceio_lru(OE) enhanceio_fifo(OE) enhanceio(OE) rpcrdma sunrpc ib_isert
iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ipoib edac_mce_amd kvm_amd kvm rdma_ucm irqbypass crc32_pclmul ib_uverbs ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd raid0 ib_umad pcspkr k10temp eeepc_wmi rdma_cm asus_wmi ccp sparse_keymap i2c_piix4 rfkill video mxm_wmi ib_cm sg iw_cm ib_core tpm_crb gpio_amdpt pinctrl_amd acpi_pad i2c_designware_platform wmi i2c_designware_core acpi_cpufreq sch_fq_codel tcp_illinois ip_tables xfs libcrc32c mlx4_en(OE) mlx4_ib(OE) sd_mod crc_t10dif crct10dif_generic ahci mlx4_core(OE) libahci igb mpt2sas libata crct10dif_pclmul crct10dif_common crc32c_intel sdhci_acpi ptp devlink iosf_mbi serio_raw pps_core raid_class sdhci i2c_algo_bit scsi_transport_sas
dca mlx_compat(OE) mmc_core dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 3060 Comm: rtorrent main Kdump: loaded Tainted: G           OE  ------------ T 3.10.0-1160.45.1.el7.x86_64 #1
Hardware name: System manufacturer System Product Name/ROG STRIX B450-F GAMING II, BIOS 4602 08/17/2021
task: ffff970f88c11080 ti: ffff9710bba50000 task.ti: ffff9710bba50000
RIP: 0010:[<ffffffffb2116a32>]  [<ffffffffb2116a32>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9710bba53c50  EFLAGS: 00000202
RAX: 0000000000000020 RBX: 00000001f8151000 RCX: 0000000000000020
RDX: 0000000000000020 RSI: 0000000000000020 RDI: 0000000000000286
RBP: ffff9710bba53ca0 R08: ffffffffb28146c0 R09: ffffffffb20980f2
R10: ffff970f8c161e60 R11: 0000000000000000 R12: ffff9710bba53bd8
R13: fffff3d587e05440 R14: 00007ffe0ef32000 R15: 0000000000000000
FS:  00007f9292b52880(0000) GS:ffff9710be280000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ffe0ef4ff68 CR3: 00000006e1206000 CR4: 00000000003407e0
Call Trace:
[<ffffffffb207ddd0>] ? leave_mm+0x120/0x120
[<ffffffffb207ddd0>] ? leave_mm+0x120/0x120
[<ffffffffb207ddd0>] ? leave_mm+0x120/0x120
[<ffffffffb2116b4f>] smp_call_function_single+0x5f/0xa0
[<ffffffffb2386a45>] ? cpumask_next_and+0x35/0x50
[<ffffffffb21170fb>] smp_call_function_many+0x22b/0x270
[<ffffffffb207e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb207e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb2098526>] dup_mm+0x666/0x760
[<ffffffffb2099ad6>] copy_process+0x1486/0x1a80
[<ffffffffb209a281>] do_fork+0x91/0x330
[<ffffffffb209a5a6>] SyS_clone+0x16/0x20
[<ffffffffb2796374>] stub_clone+0x44/0x70
[<ffffffffb2795f92>] ? system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 60 15 d5 b2 48 89 df e8 87 71 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #230009
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff9fb0779a
Build id: 3.10.0-862.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffff9fa76e50
Build id: 3.10.0-862.el7.x86_64 		0x110
3
? leave_mm
vmlinux 0xffffffff9fa76e50
Build id: 3.10.0-862.el7.x86_64 		0x110
4
? leave_mm
vmlinux 0xffffffff9fa76e50
Build id: 3.10.0-862.el7.x86_64 		0x110
5
smp_call_function_single
vmlinux 0xffffffff9fb078af
Build id: 3.10.0-862.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff9fd4a275
Build id: 3.10.0-862.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff9fb07e5b
Build id: 3.10.0-862.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff9fa77018
Build id: 3.10.0-862.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9fa77088
Build id: 3.10.0-862.el7.x86_64 		0x68
10
dup_mm
vmlinux 0xffffffff9fa8ea45
Build id: 3.10.0-862.el7.x86_64 		0x615
11
copy_process
vmlinux 0xffffffff9fa8ffc2
Build id: 3.10.0-862.el7.x86_64 		0x1452
12
do_fork
vmlinux 0xffffffff9fa90761
Build id: 3.10.0-862.el7.x86_64 		0x91
13
SyS_clone
vmlinux 0xffffffff9fa90a76
Build id: 3.10.0-862.el7.x86_64 		0x16
14
stub_clone
vmlinux 0xffffffffa011fb94
Build id: 3.10.0-862.el7.x86_64 		0x44
15
? system_call_fastpath
vmlinux 0xffffffffa011f7d5
Build id: 3.10.0-862.el7.x86_64 		0x1c 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 33s! [sh:10224]
Modules linked in: esn_cfs(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm coretemp snd_timer snd soundcore iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg vmw_balloon parport_pc parport shpchp vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul
syscopyarea crct10dif_common sysfillrect sysimgblt fb_sys_fops crc32c_intel ttm ata_piix drm mptspi serio_raw scsi_transport_spi mptscsih e1000 mptbase libata i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 10224 Comm: sh Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2012
task: ffff8870ba0e8000 ti: ffff88705edd8000 task.ti: ffff88705edd8000
RIP: 0010:[<ffffffff9fb0779a>]  [<ffffffff9fb0779a>] generic_exec_single+0xfa/0x1b0
RSP: 0018:ffff88705eddbc60  EFLAGS: 00000202
RAX: 0000000000000040 RBX: ffff88705eddbc18 RCX: 0000000000000001
RDX: 0000000000000040 RSI: 0000000000000000 RDI: 0000000000000282
RBP: ffff88705eddbca8 R08: ffffffffa0213168 R09: ffffffff9fa8e670
R10: ffff8870bffd9800 R11: 0000000000000000 R12: ffff887061207e10
R13: ffff88705eddbbe0 R14: ffffdcbb007bfc00 R15: 00007ffdb8400000
FS:  00007fd8c52e0740(0000) GS:ffff8870bc640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000d98c20 CR3: 000000001ec28000 CR4: 00000000001607e0
Call Trace:
[<ffffffff9fa76e50>] ? leave_mm+0x110/0x110
[<ffffffff9fa76e50>] ? leave_mm+0x110/0x110
[<ffffffff9fa76e50>] ? leave_mm+0x110/0x110
[<ffffffff9fb078af>] smp_call_function_single+0x5f/0xa0
[<ffffffff9fd4a275>] ? cpumask_next_and+0x35/0x50
[<ffffffff9fb07e5b>] smp_call_function_many+0x22b/0x270
[<ffffffff9fa77018>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9fa77088>] flush_tlb_mm_range+0x68/0x140
[<ffffffff9fa8ea45>] dup_mm+0x615/0x710
[<ffffffff9fa8ffc2>] copy_process+0x1452/0x1a40
[<ffffffff9fa90761>] do_fork+0x91/0x320
[<ffffffff9fa90a76>] SyS_clone+0x16/0x20
[<ffffffffa011fb94>] stub_clone+0x44/0x70
[<ffffffffa011f7d5>] ? system_call_fastpath+0x1c/0x21
Code: 80 96 01 00 48 89 de 48 03 14 c5 a0 53 73 a0 48 89 df e8 4a 87 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #229867
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff9fb0779a
Build id: 3.10.0-862.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffff9fa76e50
Build id: 3.10.0-862.el7.x86_64 		0x110
3
? leave_mm
vmlinux 0xffffffff9fa76e50
Build id: 3.10.0-862.el7.x86_64 		0x110
4
? leave_mm
vmlinux 0xffffffff9fa76e50
Build id: 3.10.0-862.el7.x86_64 		0x110
5
smp_call_function_single
vmlinux 0xffffffff9fb078af
Build id: 3.10.0-862.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff9fd4a275
Build id: 3.10.0-862.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff9fb07e5b
Build id: 3.10.0-862.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff9fa77018
Build id: 3.10.0-862.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9fa77088
Build id: 3.10.0-862.el7.x86_64 		0x68
10
dup_mm
vmlinux 0xffffffff9fa8ea45
Build id: 3.10.0-862.el7.x86_64 		0x615 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [ksmtuned:5200]
Modules linked in: esn_cfs(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm coretemp snd_timer snd soundcore iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg vmw_balloon parport_pc parport shpchp vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul
syscopyarea crct10dif_common sysfillrect sysimgblt fb_sys_fops crc32c_intel ttm ata_piix drm mptspi serio_raw scsi_transport_spi mptscsih e1000 mptbase libata i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 5200 Comm: ksmtuned Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2012
task: ffff887093bdbf40 ti: ffff88706115c000 task.ti: ffff88706115c000
RIP: 0010:[<ffffffff9fb0779a>]  [<ffffffff9fb0779a>] generic_exec_single+0xfa/0x1b0
RSP: 0018:ffff88706115fc60  EFLAGS: 00000202
RAX: ffff88706172f700 RBX: ffff88706115fc18 RCX: ffff88706172f790
RDX: ffff8870bc619680 RSI: ffff88706115fc60 RDI: ffff88706115fc60
RBP: ffff88706115fca8 R08: 0000000000000001 R09: ffffffff9fa8e670
R10: ffff8870bffd9800 R11: 0000000000000000 R12: ffff887064dcad18
R13: ffff88706115fbe0 R14: ffffdcbb00f65c40 R15: 00007ffcb473c000
FS:  00007f034c325740(0000) GS:ffff8870bc640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000002423240 CR3: 0000000021418000 CR4: 00000000001607e0
Call Trace:
[<ffffffff9fa76e50>] ? leave_mm+0x110/0x110
[<ffffffff9fa76e50>] ? leave_mm+0x110/0x110
[<ffffffff9fa76e50>] ? leave_mm+0x110/0x110
[<ffffffff9fb078af>] smp_call_function_single+0x5f/0xa0
[<ffffffff9fd4a275>] ? cpumask_next_and+0x35/0x50
[<ffffffff9fb07e5b>] smp_call_function_many+0x22b/0x270
[<ffffffff9fa77018>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9fa77088>] flush_tlb_mm_range+0x68/0x140
[<ffffffff9fa8ea45>] dup_mm+0x615/0x710
Complete report #183223
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810d66ea
Build id: 3.10.0-229.14.1.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffff8105fab0
Build id: 3.10.0-229.14.1.el7.x86_64 		0x70
3
? leave_mm
vmlinux 0xffffffff8105fab0
Build id: 3.10.0-229.14.1.el7.x86_64 		0x70
4
? leave_mm
vmlinux 0xffffffff8105fab0
Build id: 3.10.0-229.14.1.el7.x86_64 		0x70
5
smp_call_function_single
vmlinux 0xffffffff810d67ef
Build id: 3.10.0-229.14.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff812d4695
Build id: 3.10.0-229.14.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff810d6d83
Build id: 3.10.0-229.14.1.el7.x86_64 		0x223
8
native_flush_tlb_others
vmlinux 0xffffffff8105fc78
Build id: 3.10.0-229.14.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8105fd3c
Build id: 3.10.0-229.14.1.el7.x86_64 		0x5c
10
dup_mm
vmlinux 0xffffffff8106bc7d
Build id: 3.10.0-229.14.1.el7.x86_64 		0x54d
11
copy_process.part.25
vmlinux 0xffffffff8106c809
Build id: 3.10.0-229.14.1.el7.x86_64 		0xa49
12
do_fork
vmlinux 0xffffffff8106d44c
Build id: 3.10.0-229.14.1.el7.x86_64 		0xbc
13
SyS_clone
vmlinux 0xffffffff8106d766
Build id: 3.10.0-229.14.1.el7.x86_64 		0x16
14
stub_clone
vmlinux 0xffffffff816146d9
Build id: 3.10.0-229.14.1.el7.x86_64 		0x69
15
? system_call_fastpath
vmlinux 0xffffffff81614389
Build id: 3.10.0-229.14.1.el7.x86_64 		0x16 
BUG: soft lockup - CPU#3 stuck for 22s! [php:53067]
Modules linked in: binfmt_misc tun ebtable_filter ebtables ip6table_filter ip6_tables bridge stp llc dahdi(OF) crc_ccitt netatop(OF) vmw_vsock_vmci_transport vsock xt_CHECKSUM iptable_mangle xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_addrtype iptable_nat nf_nat_ipv4 nf_nat nf_log_ipv4 nf_log_common xt_LOG ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 xt_recent xt_multiport xt_mark xt_conntrack nf_conntrack iptable_filter coretemp ext4 mbcache jbd2 snd_ens1371 snd_rawmidi snd_ac97_codec crc32_pclmul ac97_bus ghash_clmulni_intel snd_seq snd_seq_device ppdev aesni_intel snd_pcm lrw gf128mul glue_helper vmw_balloon ablk_helper snd_timer cryptd snd ahci pcspkr soundcore libahci sg vmw_vmci i2c_piix4 shpchp parport_pc parport nfsd auth_rpcgss nfs_acl lockd sunrpc ip_tables xfs libcrc32c
sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper ttm crct10dif_pclmul crct10dif_common crc32c_intel drm mptspi e1000 scsi_transport_spi ata_piix serio_raw mptscsih libata mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 53067 Comm: php Tainted: GF          O--------------   3.10.0-229.14.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff8802b7f8f1c0 ti: ffff88000ae54000 task.ti: ffff88000ae54000
RIP: 0010:[<ffffffff810d66ea>]  [<ffffffff810d66ea>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff88000ae57c90  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff88000ae57c60 RCX: 0000000000000010
RDX: ffffffff816321b0 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff88000ae57ce0 R08: ffffffff816321a8 R09: ffffffff8106b930
R10: ffff88033ffd8000 R11: 0000000000000000 R12: ffff8803266c12c0
R13: 00007ffc92e5b000 R14: ffff8800027584b8 R15: ffff88013ad5f4b8
FS:  00007fdc4363b840(0000) GS:ffff880332660000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fdc44fec700 CR3: 000000008d35c000 CR4: 00000000001407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff8105fab0 ffff88000ae57d68
0000000000000003 000000009bea7574 ffff88000ae57fd8 000000000000000f
ffffffff8105fab0 ffffffff8105fab0 ffff88000ae57d10 ffffffff810d67ef
Call Trace:
[<ffffffff8105fab0>] ? leave_mm+0x70/0x70
[<ffffffff8105fab0>] ? leave_mm+0x70/0x70
[<ffffffff8105fab0>] ? leave_mm+0x70/0x70
[<ffffffff810d67ef>] smp_call_function_single+0x5f/0xa0
[<ffffffff812d4695>] ? cpumask_next_and+0x35/0x50
[<ffffffff810d6d83>] smp_call_function_many+0x223/0x260
[<ffffffff8105fc78>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8105fd3c>] flush_tlb_mm_range+0x5c/0x180
[<ffffffff8106bc7d>] dup_mm+0x54d/0x660
[<ffffffff8106c809>] copy_process.part.25+0xa49/0x14d0
[<ffffffff8106d44c>] do_fork+0xbc/0x350
[<ffffffff8106d766>] SyS_clone+0x16/0x20
[<ffffffff816146d9>] stub_clone+0x69/0x90
[<ffffffff81614389>] ? system_call_fastpath+0x16/0x1b
Code: 40 41 01 00 48 89 de 48 03 14 c5 00 4d a1 81 48 89 df e8 ba 12 21 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #18096
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810e685a
Build id: 3.10.0-327.10.1.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffff81065c80
Build id: 3.10.0-327.10.1.el7.x86_64 		0x70
3
? leave_mm
vmlinux 0xffffffff81065c80
Build id: 3.10.0-327.10.1.el7.x86_64 		0x70
4
? leave_mm
vmlinux 0xffffffff81065c80
Build id: 3.10.0-327.10.1.el7.x86_64 		0x70
5
smp_call_function_single
vmlinux 0xffffffff810e695f
Build id: 3.10.0-327.10.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff812f2815
Build id: 3.10.0-327.10.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff810e6f03
Build id: 3.10.0-327.10.1.el7.x86_64 		0x223
8
native_flush_tlb_others
vmlinux 0xffffffff81065e48
Build id: 3.10.0-327.10.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff81065f16
Build id: 3.10.0-327.10.1.el7.x86_64 		0x66
10
dup_mm
vmlinux 0xffffffff81078acd
Build id: 3.10.0-327.10.1.el7.x86_64 		0x55d
11
copy_process.part.25
vmlinux 0xffffffff81079cf9
Build id: 3.10.0-327.10.1.el7.x86_64 		0x10e9
12
do_fork
vmlinux 0xffffffff8107a401
Build id: 3.10.0-327.10.1.el7.x86_64 		0xe1
13
SyS_clone
vmlinux 0xffffffff8107a6c6
Build id: 3.10.0-327.10.1.el7.x86_64 		0x16
14
stub_clone
vmlinux 0xffffffff81645d99
Build id: 3.10.0-327.10.1.el7.x86_64 		0x69
15
? system_call_fastpath
vmlinux 0xffffffff81645a49
Build id: 3.10.0-327.10.1.el7.x86_64 		0x16 
BUG: soft lockup - CPU#7 stuck for 35s! [python:31060]
sd 2:0:0:0: [sda] CDB: Write(10) 2a 00 01 5c 42 c0 00 00 20 00
mptscsih: ioc0: task abort: SUCCESS (rv=2002) (sc=ffff8801b7d68e00)
Modules linked in: fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock coretemp ppdev vmw_balloon pcspkr sg parport_pc i2c_piix4 shpchp parport vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod crct10dif_generic cdrom crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper mptspi ttm scsi_transport_spi ata_piix drm mptscsih serio_raw libata mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 7 PID: 31060 Comm: python Tainted: G             L ------------   3.10.0-327.10.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff880035f3e780 ti: ffff880112bcc000 task.ti: ffff880112bcc000
RIP: 0010:[<ffffffff810e685a>]  [<ffffffff810e685a>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff880112bcfc80  EFLAGS: 00000202
RAX: 000000000000000a RBX: ffff880112bcfc18 RCX: 0000000000000036
RDX: 000000000000000a RSI: 000000000000000a RDI: 0000000000000286
RBP: ffff880112bcfcd0 R08: ffffffff8165f460 R09: ffffffff81078770
R10: ffff88043ffcd000 R11: 0000000000000000 R12: ffff88027338ddc0
R13: 00007fff79ccb000 R14: ffff880232f45e70 R15: ffff88038d4d1e70
FS:  00007f19b1167740(0000) GS:ffff880437200000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f19adfb4aa0 CR3: 00000001b7c1a000 CR4: 00000000000007e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff81065c80 ffff880112bcfd58
0000000000000002 0000000009d92827 ffff880112bcffd8 0000000000000005
ffffffff81065c80 ffffffff81065c80 ffff880112bcfd00 ffffffff810e695f
Call Trace:
[<ffffffff81065c80>] ? leave_mm+0x70/0x70
[<ffffffff81065c80>] ? leave_mm+0x70/0x70
[<ffffffff81065c80>] ? leave_mm+0x70/0x70
[<ffffffff810e695f>] smp_call_function_single+0x5f/0xa0
[<ffffffff812f2815>] ? cpumask_next_and+0x35/0x50
[<ffffffff810e6f03>] smp_call_function_many+0x223/0x260
[<ffffffff81065e48>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff81065f16>] flush_tlb_mm_range+0x66/0x140
[<ffffffff81078acd>] dup_mm+0x55d/0x670
[<ffffffff81079cf9>] copy_process.part.25+0x10e9/0x1610
[<ffffffff8107a401>] do_fork+0xe1/0x320
[<ffffffff8107a6c6>] SyS_clone+0x16/0x20
[<ffffffff81645d99>] stub_clone+0x69/0x90
[<ffffffff81645a49>] ? system_call_fastpath+0x16/0x1b
Code: 40 52 01 00 48 89 de 48 03 14 c5 e0 b8 a5 81 48 89 df e8 6a fc 21 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #17971
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffb2d124ca
Build id: 3.10.0-957.27.2.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffffb2c7b5c0
Build id: 3.10.0-957.27.2.el7.x86_64 		0x110
3
? leave_mm
vmlinux 0xffffffffb2c7b5c0
Build id: 3.10.0-957.27.2.el7.x86_64 		0x110
4
? leave_mm
vmlinux 0xffffffffb2c7b5c0
Build id: 3.10.0-957.27.2.el7.x86_64 		0x110
5
smp_call_function_single
vmlinux 0xffffffffb2d125df
Build id: 3.10.0-957.27.2.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffb2f77345
Build id: 3.10.0-957.27.2.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffb2d12b8b
Build id: 3.10.0-957.27.2.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffb2c7b788
Build id: 3.10.0-957.27.2.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffb2c7b7f8
Build id: 3.10.0-957.27.2.el7.x86_64 		0x68
10
dup_mm
vmlinux 0xffffffffb2c95bdd
Build id: 3.10.0-957.27.2.el7.x86_64 		0x65d
11
copy_process
vmlinux 0xffffffffb2c97152
Build id: 3.10.0-957.27.2.el7.x86_64 		0x1452
12
do_fork
vmlinux 0xffffffffb2c978f1
Build id: 3.10.0-957.27.2.el7.x86_64 		0x91
13
SyS_clone
vmlinux 0xffffffffb2c97c06
Build id: 3.10.0-957.27.2.el7.x86_64 		0x16
14
stub_clone
vmlinux 0xffffffffb33771b4
Build id: 3.10.0-957.27.2.el7.x86_64 		0x44
15
? system_call_fastpath
vmlinux 0xffffffffb3376ddb
Build id: 3.10.0-957.27.2.el7.x86_64 		0x22 
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [oneagentos:35491]
Modules linked in: binfmt_misc xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter unix_diag vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi iosf_mbi snd_ac97_codec ppdev crc32_pclmul ac97_bus snd_seq ghash_clmulni_intel snd_seq_device vmw_balloon snd_pcm aesni_intel lrw gf128mul snd_timer glue_helper snd ablk_helper soundcore cryptd pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm drm mptspi scsi_transport_spi mptscsih mptbase crct10dif_pclmul crct10dif_common ata_piix nfit drm_panel_orientation_quirks crc32c_intel libnvdimm e1000 libata serio_raw floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 35491 Comm: oneagentos Kdump: loaded Tainted: G        W    L ------------   3.10.0-957.27.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff8bdc50d58000 ti: ffff8bdd367fc000 task.ti: ffff8bdd367fc000
RIP: 0010:[<ffffffffb2d124ca>]  [<ffffffffb2d124ca>] generic_exec_single+0xfa/0x1b0
RSP: 0018:ffff8bdd367ffc50  EFLAGS: 00000202
RAX: 0000000000000040 RBX: 000000013664c000 RCX: 0000000000000001
RDX: 0000000000000040 RSI: 0000000000000000 RDI: 0000000000000286
RBP: ffff8bdd367ffca0 R08: ffffffffb3413148 R09: 0000000180250025
R10: ffff8bdcb2faa1b0 R11: 0000000000000000 R12: ffff8bdd367ffbd8
R13: ffffce0284d99300 R14: 00007ffea8000000 R15: 0000000000000000
FS:  00007fb9197fa700(0000) GS:ffff8bdd3a6c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007efcff31e000 CR3: 00000000a6626000 CR4: 00000000001607e0
Call Trace:
[<ffffffffb2c7b5c0>] ? leave_mm+0x110/0x110
[<ffffffffb2c7b5c0>] ? leave_mm+0x110/0x110
[<ffffffffb2c7b5c0>] ? leave_mm+0x110/0x110
[<ffffffffb2d125df>] smp_call_function_single+0x5f/0xa0
[<ffffffffb2f77345>] ? cpumask_next_and+0x35/0x50
[<ffffffffb2d12b8b>] smp_call_function_many+0x22b/0x270
[<ffffffffb2c7b788>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb2c7b7f8>] flush_tlb_mm_range+0x68/0x140
[<ffffffffb2c95bdd>] dup_mm+0x65d/0x750
[<ffffffffb2c97152>] copy_process+0x1452/0x1a40
[<ffffffffb2c978f1>] do_fork+0x91/0x320
[<ffffffffb2c97c06>] SyS_clone+0x16/0x20
[<ffffffffb33771b4>] stub_clone+0x44/0x70
[<ffffffffb3376ddb>] ? system_call_fastpath+0x22/0x27
Code: 00 b7 01 00 48 89 de 48 03 14 c5 a0 bf 94 b3 48 89 df e8 1a bd 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #15717
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff88d163d2
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff88c7e2b0
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x110
3
? leave_mm
vmlinux 0xffffffff88c7e2b0
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x110
4
? leave_mm
vmlinux 0xffffffff88c7e2b0
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x110
5
smp_call_function_single
vmlinux 0xffffffff88d164ef
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff88f81685
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff88d16a9b
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff88c7e478
Build id: 3.10.0-1062.12.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff88c7e4eb
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x6b
10
dup_mm
vmlinux 0xffffffff88c98c6d
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x65d
11
copy_process
vmlinux 0xffffffff88c9a1ee
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x145e
12
do_fork
vmlinux 0xffffffff88c9a991
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x91
13
SyS_clone
vmlinux 0xffffffff88c9acb6
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x16
14
stub_clone
vmlinux 0xffffffff8938e2b4
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x44
15
? system_call_fastpath
vmlinux 0xffffffff8938dede
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#9 stuck for 23s! [ksmtuned:14509]
Modules linked in: xt_time pcc_cpufreq squashfs tcp_diag inet_diag xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun bridge stp llc ebtable_filter ebtables devlink xt_owner ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 nf_log_ipv4 nf_log_common ip6table_filter nf_nat_ftp xt_REDIRECT nf_nat_redirect xt_conntrack nf_conntrack_ftp xt_LOG xt_limit xt_multiport iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 ip6table_mangle ip6table_raw ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 nf_nat nf_conntrack ip6_tables iptable_mangle iptable_raw ipt_REJECT nf_reject_ipv4 iptable_filter ext4 mbcache jbd2 loop vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr
sg i2c_piix4 vmw_vmci parport_pc parport ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nfit crct10dif_pclmul crct10dif_common ata_piix crc32c_intel mptspi libnvdimm libata scsi_transport_spi serio_raw mptscsih mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 9 PID: 14509 Comm: ksmtuned Kdump: loaded Tainted: G             L ------------   3.10.0-1062.12.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff882607bd0000 ti: ffff88226f8dc000 task.ti: ffff88226f8dc000
RIP: 0010:[<ffffffff88d163d2>]  [<ffffffff88d163d2>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff88226f8dfc50  EFLAGS: 00000202
RAX: 0000000000000040 RBX: 0000000311179000 RCX: 000000000000000c
RDX: 0000000000000040 RSI: 0000000000000000 RDI: 0000000000000286
RBP: ffff88226f8dfca0 R08: ffffffff894150c8 R09: ffffffff88c9884c
R10: ffff882606369d88 R11: 0000000000000000 R12: ffff88226f8dfbd8
R13: ffffe9e04c445e40 R14: 00007ffe14a40000 R15: 0000000000000000
FS:  00007f92498ee740(0000) GS:ffff882cfe840000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055777b57e768 CR3: 00000001ea04e000 CR4: 00000000001607e0
Call Trace:
[<ffffffff88c7e2b0>] ? leave_mm+0x110/0x110
[<ffffffff88c7e2b0>] ? leave_mm+0x110/0x110
[<ffffffff88c7e2b0>] ? leave_mm+0x110/0x110
[<ffffffff88d164ef>] smp_call_function_single+0x5f/0xa0
[<ffffffff88f81685>] ? cpumask_next_and+0x35/0x50
[<ffffffff88d16a9b>] smp_call_function_many+0x22b/0x270
[<ffffffff88c7e478>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff88c7e4eb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff88c98c6d>] dup_mm+0x65d/0x750
[<ffffffff88c9a1ee>] copy_process+0x145e/0x1a50
[<ffffffff88c9a991>] do_fork+0x91/0x330
[<ffffffff88c9acb6>] SyS_clone+0x16/0x20
[<ffffffff8938e2b4>] stub_clone+0x44/0x70
[<ffffffff8938dede>] ? system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 20 e8 94 89 48 89 df e8 37 23 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00