Info

Permalink
Function
generic_exec_single
First occurrence
2021-01-26
Last occurrence
2026-07-25
State
NEW
Components
kernel
Quality
-36

Statistics

Operating system Count
CentOS 7 202
Architecture Count
x86_64 202
Related packages Count
kernel 202
 0:3.10.0-693.el7 65
 0:3.10.0-1160.49.1.el7 29
 0:3.10.0-1062.9.1.el7 20
 0:3.10.0-327.el7 16
 0:3.10.0-1127.19.1.el7 15
 0:3.10.0-1062.18.1.el7 9
 0:3.10.0-1160.6.1.el7 8
 0:3.10.0-1160.119.1.el7 6
 0:3.10.0-1160.el7 5
 0:3.10.0-957.21.3.el7 5
 0:3.10.0-1062.12.1.el7 3
 0:3.10.0-1160.102.1.el7 3
 0:3.10.0-1160.76.1.el7 3
 0:3.10.0-1160.119.1.el7.tuxcare.els19 2
 0:3.10.0-1160.80.1.el7 2
 0:3.10.0-1160.95.1.el7 2
 0:3.10.0-1127.el7 1
 0:3.10.0-1160.31.1.el7 1
 0:3.10.0-1160.88.1.el7 1
 0:3.10.0-693.5.2.el7 1
 0:3.10.0-1160.59.1.el7 1
 0:3.10.0-1160.66.1.el7 1
 0:3.10.0-862.14.4.el7 1
 0:3.10.0-693.2.2.el7 1
 0:3.10.0-957.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

Report backtrace


Complete report #1293235
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffb9b1dba2
Build id: 3.10.0-1160.119.1.el7.x86_64
0x102
2
? leave_mm
vmlinux 0xffffffffb9a81b10
Build id: 3.10.0-1160.119.1.el7.x86_64
0x130
3
? leave_mm
vmlinux 0xffffffffb9a81b10
Build id: 3.10.0-1160.119.1.el7.x86_64
0x130
4
? leave_mm
vmlinux 0xffffffffb9a81b10
Build id: 3.10.0-1160.119.1.el7.x86_64
0x130
5
smp_call_function_single
vmlinux 0xffffffffb9b1dcbf
Build id: 3.10.0-1160.119.1.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffffb9d9c615
Build id: 3.10.0-1160.119.1.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffffb9b1e27b
Build id: 3.10.0-1160.119.1.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffb9a81fa8
Build id: 3.10.0-1160.119.1.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffb9a8201b
Build id: 3.10.0-1160.119.1.el7.x86_64
0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffb9bfa0ce
Build id: 3.10.0-1160.119.1.el7.x86_64
0xae
11
arch_tlb_finish_mmu
vmlinux 0xffffffffb9bfbc4f
Build id: 3.10.0-1160.119.1.el7.x86_64
0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffb9bfbd83
Build id: 3.10.0-1160.119.1.el7.x86_64
0x23
13
unmap_region
vmlinux 0xffffffffb9c05904
Build id: 3.10.0-1160.119.1.el7.x86_64
0xf4
14
do_munmap
vmlinux 0xffffffffb9c07f65
Build id: 3.10.0-1160.119.1.el7.x86_64
0x2a5
15
vm_munmap
vmlinux 0xffffffffb9c081a5
Build id: 3.10.0-1160.119.1.el7.x86_64
0x65
16
SyS_munmap
vmlinux 0xffffffffb9c094d2
Build id: 3.10.0-1160.119.1.el7.x86_64
0x22
17
system_call_fastpath
vmlinux 0xffffffffba1c539a
Build id: 3.10.0-1160.119.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [pdfx:16053]
Modules linked in: binfmt_misc tcp_diag inet_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter sunrpc nfit libnvdimm iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper i2c_piix4 pcspkr ablk_helper cryptd sg joydev sch_fq_codel ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_console net_failover virtio_blk failover bochs_drm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata crct10dif_pclmul crct10dif_common crc32c_intel virtio_pci serio_raw virtio_ring floppy drm_panel_orientation_quirks
virtio dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: sisevt]
CPU: 1 PID: 16053 Comm: pdfx Kdump: loaded Tainted: P           OEL ------------   3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.14.0-0-g155821a1990b-prebuilt.qemu.org 04/01/2014
task: ffff8d6f0f1e8000 ti: ffff8d6c9b930000 task.ti: ffff8d6c9b930000
RIP: 0010:[<ffffffffb9b1dba2>]  [<ffffffffb9b1dba2>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff8d6c9b933c20  EFLAGS: 00000202
RAX: 000000000000000a RBX: ffff8d6c9b933bf0 RCX: 0000000000000036
RDX: 00000000000003ff RSI: 000000000000000a RDI: 0000000000000282
RBP: ffff8d6c9b933c70 R08: ffffffffba2139c0 R09: ffffffffb9c0ef7f
R10: ffff8d702f09f0a0 R11: ffffdb2a0c4a0a40 R12: ffffffffb9c4aa1e
R13: ffff8d6c9b933be0 R14: ffff8d6d7fd57400 R15: 0000000000000001
FS:  00007fb10c066740(0000) GS:ffff8d702f080000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb93d449000 CR3: 00000000ad306000 CR4: 0000000000760fe0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffffb9a81b10>] ? leave_mm+0x130/0x130
[<ffffffffb9a81b10>] ? leave_mm+0x130/0x130
[<ffffffffb9a81b10>] ? leave_mm+0x130/0x130
[<ffffffffb9b1dcbf>] smp_call_function_single+0x5f/0xa0
[<ffffffffb9d9c615>] ? cpumask_next_and+0x35/0x50
[<ffffffffb9b1e27b>] smp_call_function_many+0x22b/0x270
[<ffffffffb9a81fa8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb9a8201b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb9bfa0ce>] tlb_flush_mmu_tlbonly+0xae/0xd0
[<ffffffffb9bfbc4f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffb9bfbd83>] tlb_finish_mmu+0x23/0x40
[<ffffffffb9c05904>] unmap_region+0xf4/0x150
[<ffffffffb9c07f65>] do_munmap+0x2a5/0x480
[<ffffffffb9c081a5>] vm_munmap+0x65/0xb0
[<ffffffffb9c094d2>] SyS_munmap+0x22/0x30
[<ffffffffba1c539a>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 c0 19 75 ba 48 89 df e8 b7 67 29 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #1008690
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa9d1109a
Build id: 3.10.0-957.el7.x86_64
0xfa
2
? leave_mm
vmlinux 0xffffffffa9c7a3d0
Build id: 3.10.0-957.el7.x86_64
0x110
3
? leave_mm
vmlinux 0xffffffffa9c7a3d0
Build id: 3.10.0-957.el7.x86_64
0x110
4
? leave_mm
vmlinux 0xffffffffa9c7a3d0
Build id: 3.10.0-957.el7.x86_64
0x110
5
smp_call_function_single
vmlinux 0xffffffffa9d111af
Build id: 3.10.0-957.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffffa9f75465
Build id: 3.10.0-957.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffffa9d1175b
Build id: 3.10.0-957.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffa9c7a598
Build id: 3.10.0-957.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffa9c7a608
Build id: 3.10.0-957.el7.x86_64
0x68
10
tlb_flush_mmu.part.76
vmlinux 0xffffffffa9de4077
Build id: 3.10.0-957.el7.x86_64
0x37
11
tlb_finish_mmu
vmlinux 0xffffffffa9de5975
Build id: 3.10.0-957.el7.x86_64
0x55
12
unmap_region
vmlinux 0xffffffffa9def014
Build id: 3.10.0-957.el7.x86_64
0xf4
13
do_munmap
vmlinux 0xffffffffa9df1605
Build id: 3.10.0-957.el7.x86_64
0x2a5
14
vm_munmap
vmlinux 0xffffffffa9df1845
Build id: 3.10.0-957.el7.x86_64
0x65
15
SyS_munmap
vmlinux 0xffffffffa9df2ad2
Build id: 3.10.0-957.el7.x86_64
0x22
16
system_call_fastpath
vmlinux 0xffffffffaa374ddb
Build id: 3.10.0-957.el7.x86_64
0x22
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [XFMR_WORKER_17:47943]
Modules linked in: tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus crc32_pclmul ghash_clmulni_intel aesni_intel snd_seq lrw gf128mul glue_helper snd_seq_device snd_pcm snd_timer ablk_helper snd cryptd soundcore ppdev pcspkr vmw_balloon joydev sg parport_pc parport i2c_piix4 vmw_vmci binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul
crct10dif_common vmwgfx crc32c_intel drm_kms_helper mptspi scsi_transport_spi mptscsih syscopyarea sysfillrect e1000 ata_piix sysimgblt fb_sys_fops mptbase serio_raw ttm libata drm nfit libnvdimm drm_panel_orientation_quirks
CPU: 4 PID: 47943 Comm: XFMR_WORKER_17 Kdump: loaded Tainted: G             L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff8f97e2a3b0c0 ti: ffff8f994ee80000 task.ti: ffff8f994ee80000
RIP: 0010:[<ffffffffa9d1109a>]  [<ffffffffa9d1109a>] generic_exec_single+0xfa/0x1b0
RSP: 0018:ffff8f994ee83c30  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff8f994ee83c00 RCX: 0000000000000009
RDX: ffffffffaa414190 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff8f994ee83c78 R08: ffffffffaa414188 R09: ffffffffa9df8298
R10: ffff8f9a6d71f0a0 R11: ffffe4ac101aea40 R12: ffff8f9a7ffdb008
R13: ffff8f97e2a3b0c0 R14: ffff8f97e2a3b0c0 R15: ffff8f97e2a3b0c0
FS:  00007f862beaa700(0000) GS:ffff8f9a6d700000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f862a7c4008 CR3: 000000032729e000 CR4: 0000000000760fe0
PKRU: 55555554
Call Trace:
[<ffffffffa9c7a3d0>] ? leave_mm+0x110/0x110
[<ffffffffa9c7a3d0>] ? leave_mm+0x110/0x110
[<ffffffffa9c7a3d0>] ? leave_mm+0x110/0x110
[<ffffffffa9d111af>] smp_call_function_single+0x5f/0xa0
[<ffffffffa9f75465>] ? cpumask_next_and+0x35/0x50
[<ffffffffa9d1175b>] smp_call_function_many+0x22b/0x270
[<ffffffffa9c7a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa9c7a608>] flush_tlb_mm_range+0x68/0x140
[<ffffffffa9de4077>] tlb_flush_mmu.part.76+0x37/0xe0
[<ffffffffa9de5975>] tlb_finish_mmu+0x55/0x60
[<ffffffffa9def014>] unmap_region+0xf4/0x140
[<ffffffffa9df1605>] do_munmap+0x2a5/0x480
[<ffffffffa9df1845>] vm_munmap+0x65/0xb0
[<ffffffffa9df2ad2>] SyS_munmap+0x22/0x30
[<ffffffffaa374ddb>] system_call_fastpath+0x22/0x27
Code: 00 b7 01 00 48 89 de 48 03 14 c5 60 b9 94 aa 48 89 df e8 1a b2 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #873964
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff8f91db82
Build id: 3.10.0-1160.102.1.el7.x86_64
0x102
2
? leave_mm
vmlinux 0xffffffff8f881b10
Build id: 3.10.0-1160.102.1.el7.x86_64
0x130
3
? leave_mm
vmlinux 0xffffffff8f881b10
Build id: 3.10.0-1160.102.1.el7.x86_64
0x130
4
? leave_mm
vmlinux 0xffffffff8f881b10
Build id: 3.10.0-1160.102.1.el7.x86_64
0x130
5
smp_call_function_single
vmlinux 0xffffffff8f91dc9f
Build id: 3.10.0-1160.102.1.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff8fb9c5d5
Build id: 3.10.0-1160.102.1.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff8f91e25b
Build id: 3.10.0-1160.102.1.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff8f881fa8
Build id: 3.10.0-1160.102.1.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8f88201b
Build id: 3.10.0-1160.102.1.el7.x86_64
0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff8f9fa07e
Build id: 3.10.0-1160.102.1.el7.x86_64
0xae
11
arch_tlb_finish_mmu
vmlinux 0xffffffff8f9fbbff
Build id: 3.10.0-1160.102.1.el7.x86_64
0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff8f9fbd33
Build id: 3.10.0-1160.102.1.el7.x86_64
0x23
13
unmap_region
vmlinux 0xffffffff8fa058b4
Build id: 3.10.0-1160.102.1.el7.x86_64
0xf4
14
do_munmap
vmlinux 0xffffffff8fa07f15
Build id: 3.10.0-1160.102.1.el7.x86_64
0x2a5
15
vm_munmap
vmlinux 0xffffffff8fa08155
Build id: 3.10.0-1160.102.1.el7.x86_64
0x65
16
SyS_munmap
vmlinux 0xffffffff8fa09482
Build id: 3.10.0-1160.102.1.el7.x86_64
0x22
17
system_call_fastpath
vmlinux 0xffffffff8ffc539a
Build id: 3.10.0-1160.102.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 38s! [httpd:11273]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_16004(E) falcon_lsm_pinned_15907(E) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi ppdev crc32_pclmul ghash_clmulni_intel aesni_intel sg vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev parport_pc i2c_piix4 parport vmw_vmci ip_tables xfs libcrc32c
sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel mptspi libata scsi_transport_spi serio_raw e1000 mptscsih mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: falcon_kal]
CPU: 1 PID: 11273 Comm: httpd Kdump: loaded Tainted: P            E  ------------   3.10.0-1160.102.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff89b2b4854200 ti: ffff89b109998000 task.ti: ffff89b109998000
RIP: 0010:[<ffffffff8f91db82>]  [<ffffffff8f91db82>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff89b10999bc20  EFLAGS: 00000202
RAX: 00000000000008fd RBX: ffff89b2bffd7008 RCX: 0000000000000000
RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000282
RBP: ffff89b10999bc70 R08: 0000000000000001 R09: ffffd9544469eac0
R10: 0000000000003476 R11: 0000000000000000 R12: ffff89b2b4854200
R13: 0000000000000001 R14: ffff89b2b4854200 R15: ffff89b2b4854200
FS:  00007eff2efa2880(0000) GS:ffff89b2bfd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f6ad1579083 CR3: 00000000974b6000 CR4: 00000000000407e0
Call Trace:
[<ffffffff8f881b10>] ? leave_mm+0x130/0x130
[<ffffffff8f881b10>] ? leave_mm+0x130/0x130
[<ffffffff8f881b10>] ? leave_mm+0x130/0x130
[<ffffffff8f91dc9f>] smp_call_function_single+0x5f/0xa0
[<ffffffff8fb9c5d5>] ? cpumask_next_and+0x35/0x50
[<ffffffff8f91e25b>] smp_call_function_many+0x22b/0x270
[<ffffffff8f881fa8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8f88201b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff8f9fa07e>] tlb_flush_mmu_tlbonly+0xae/0xd0
[<ffffffff8f9fbbff>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff8f9fbd33>] tlb_finish_mmu+0x23/0x40
[<ffffffff8fa058b4>] unmap_region+0xf4/0x150
[<ffffffff8fa07f15>] do_munmap+0x2a5/0x480
[<ffffffff8fa08155>] vm_munmap+0x65/0xb0
[<ffffffff8fa09482>] SyS_munmap+0x22/0x30
[<ffffffff8ffc539a>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 40 19 55 90 48 89 df e8 97 67 29 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #798361
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810e675a
Build id: 3.10.0-327.el7.x86_64
0xfa
2
? leave_mm
vmlinux 0xffffffff81065c90
Build id: 3.10.0-327.el7.x86_64
0x70
3
? leave_mm
vmlinux 0xffffffff81065c90
Build id: 3.10.0-327.el7.x86_64
0x70
4
? leave_mm
vmlinux 0xffffffff81065c90
Build id: 3.10.0-327.el7.x86_64
0x70
5
smp_call_function_single
vmlinux 0xffffffff810e685f
Build id: 3.10.0-327.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff812f2785
Build id: 3.10.0-327.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff810e6e03
Build id: 3.10.0-327.el7.x86_64
0x223
8
native_flush_tlb_others
vmlinux 0xffffffff81065e58
Build id: 3.10.0-327.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff81065f26
Build id: 3.10.0-327.el7.x86_64
0x66
10
tlb_flush_mmu.part.54
vmlinux 0xffffffff81192563
Build id: 3.10.0-327.el7.x86_64
0x33
11
tlb_finish_mmu
vmlinux 0xffffffff811930f5
Build id: 3.10.0-327.el7.x86_64
0x55
12
unmap_region
vmlinux 0xffffffff8119b2d2
Build id: 3.10.0-327.el7.x86_64
0xe2
13
do_munmap
vmlinux 0xffffffff8119d612
Build id: 3.10.0-327.el7.x86_64
0x242
14
vm_munmap
vmlinux 0xffffffff8119d821
Build id: 3.10.0-327.el7.x86_64
0x41
15
SyS_munmap
vmlinux 0xffffffff8119e772
Build id: 3.10.0-327.el7.x86_64
0x22
16
tracesys
vmlinux 0xffffffff81645b12
Build id: 3.10.0-327.el7.x86_64
0xdd
BUG: soft lockup - CPU#1 stuck for 23s! [java:955]
Modules linked in: veth xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop ip6t_rpfilter ip6t_REJECT ipt_REJECT xt_conntrack ebtable_nat ebtable_broute bridge stp llc ebtable_filter ebtables ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw ip6table_filter ip6_tables iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw iptable_filter crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev virtio_rng virtio_balloon sg i2c_piix4 parport_pc pcspkr parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_console
virtio_blk cirrus syscopyarea sysfillrect crct10dif_pclmul sysimgblt crct10dif_common drm_kms_helper serio_raw ttm crc32c_intel ata_piix drm virtio_pci virtio_ring libata i2c_core virtio floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 955 Comm: java Tainted: G        W    L ------------   3.10.0-327.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 1.11.0-2.el7 04/01/2014
task: ffff8800a1da1700 ti: ffff8800a1fa4000 task.ti: ffff8800a1fa4000
RIP: 0010:[<ffffffff810e675a>]  [<ffffffff810e675a>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff8800a1fa7c80  EFLAGS: 00000202
RAX: 0000000000000008 RBX: ffff8800a1fa7c50 RCX: 0000000000000038
RDX: 00000000000000ff RSI: 0000000000000008 RDI: 0000000000000282
RBP: ffff8800a1fa7cd0 R08: ffffffff8165f460 R09: ffffe8ffffc6be60
R10: ffffffff811a2b52 R11: ffffea000f628c40 R12: ffff88043ffd8000
R13: 0000000000000001 R14: 0000000200000000 R15: ffffffff811d027e
FS:  00007f451615db10(0000) GS:ffff88043fc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f1f0a3abdfd CR3: 00000003b3e4e000 CR4: 00000000001406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff81065c90 ffff8800a1fa7d58
0000000000000003 0000000075ce2ff4 0000000000000000 0000000000000005
ffffffff81065c90 ffffffff81065c90 ffff8800a1fa7d00 ffffffff810e685f
Call Trace:
[<ffffffff81065c90>] ? leave_mm+0x70/0x70
[<ffffffff81065c90>] ? leave_mm+0x70/0x70
[<ffffffff81065c90>] ? leave_mm+0x70/0x70
[<ffffffff810e685f>] smp_call_function_single+0x5f/0xa0
[<ffffffff812f2785>] ? cpumask_next_and+0x35/0x50
[<ffffffff810e6e03>] smp_call_function_many+0x223/0x260
[<ffffffff81065e58>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff81065f26>] flush_tlb_mm_range+0x66/0x140
[<ffffffff81192563>] tlb_flush_mmu.part.54+0x33/0xc0
[<ffffffff811930f5>] tlb_finish_mmu+0x55/0x60
[<ffffffff8119b2d2>] unmap_region+0xe2/0x130
[<ffffffff8119d612>] do_munmap+0x242/0x410
[<ffffffff8119d821>] vm_munmap+0x41/0x60
[<ffffffff8119e772>] SyS_munmap+0x22/0x30
[<ffffffff81645b12>] tracesys+0xdd/0xe2
Code: 40 52 01 00 48 89 de 48 03 14 c5 e0 b8 a5 81 48 89 df e8 da fc 21 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #746404
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffb0d113ea
Build id: 3.10.0-957.21.3.el7.x86_64
0xfa
2
? leave_mm
vmlinux 0xffffffffb0c7a4e0
Build id: 3.10.0-957.21.3.el7.x86_64
0x110
3
? leave_mm
vmlinux 0xffffffffb0c7a4e0
Build id: 3.10.0-957.21.3.el7.x86_64
0x110
4
? leave_mm
vmlinux 0xffffffffb0c7a4e0
Build id: 3.10.0-957.21.3.el7.x86_64
0x110
5
smp_call_function_single
vmlinux 0xffffffffb0d114ff
Build id: 3.10.0-957.21.3.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffffb0f75cd5
Build id: 3.10.0-957.21.3.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffffb0d11aab
Build id: 3.10.0-957.21.3.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffb0c7a6a8
Build id: 3.10.0-957.21.3.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffb0c7a718
Build id: 3.10.0-957.21.3.el7.x86_64
0x68
10
tlb_flush_mmu.part.76
vmlinux 0xffffffffb0de4687
Build id: 3.10.0-957.21.3.el7.x86_64
0x37
11
tlb_finish_mmu
vmlinux 0xffffffffb0de5f85
Build id: 3.10.0-957.21.3.el7.x86_64
0x55
12
unmap_region
vmlinux 0xffffffffb0def624
Build id: 3.10.0-957.21.3.el7.x86_64
0xf4
13
do_munmap
vmlinux 0xffffffffb0df1c15
Build id: 3.10.0-957.21.3.el7.x86_64
0x2a5
14
vm_munmap
vmlinux 0xffffffffb0df1e55
Build id: 3.10.0-957.21.3.el7.x86_64
0x65
15
SyS_munmap
vmlinux 0xffffffffb0df30e2
Build id: 3.10.0-957.21.3.el7.x86_64
0x22
16
system_call_fastpath
vmlinux 0xffffffffb1375ddb
Build id: 3.10.0-957.21.3.el7.x86_64
0x22
17
? system_call_after_swapgs
vmlinux 0xffffffffb1375d21
Build id: 3.10.0-957.21.3.el7.x86_64
0xae
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 39s! [java:10440]
Modules linked in: arc4 md4 xt_CHECKSUM iptable_mangle rpcsec_gss_krb5 nfsv4 nfs ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 fscache nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nls_utf8 cifs ccm dns_resolver vmw_vsock_vmci_transport vsock ppdev vmw_balloon coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ext4 ablk_helper cryptd joydev mbcache jbd2 pcspkr parport_pc parport sg i2c_piix4 vmw_vmci nfsd nfs_acl lockd auth_rpcgss grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_generic pata_acpi
vmxnet3 vmwgfx floppy drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata mptspi scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks involflt(POE) dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 10440 Comm: java Kdump: loaded Tainted: P           OEL ------------   3.10.0-957.21.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff9f05002fd140 ti: ffff9f0915b20000 task.ti: ffff9f0915b20000
RIP: 0010:[<ffffffffb0d113ea>]  [<ffffffffb0d113ea>] generic_exec_single+0xfa/0x1b0
RSP: 0018:ffff9f0915b23c30  EFLAGS: 00000202
RAX: 00000000000008fd RBX: 0000000200000000 RCX: 0000000000000000
RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000286
RBP: ffff9f0915b23c78 R08: 0000000000000001 R09: ffffffffb0df88a8
R10: ffff9f0c3fd9f0a0 R11: fffff7c490ef03c0 R12: ffffffffb0e31cfe
R13: ffff9f0915b23bf0 R14: ffff9f057fd43800 R15: 0000000000000000
FS:  00007f2a0d11b700(0000) GS:ffff9f0c3fd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f29dc652000 CR3: 00000007a0760000 CR4: 00000000000007e0
Call Trace:
[<ffffffffb0c7a4e0>] ? leave_mm+0x110/0x110
[<ffffffffb0c7a4e0>] ? leave_mm+0x110/0x110
[<ffffffffb0c7a4e0>] ? leave_mm+0x110/0x110
[<ffffffffb0d114ff>] smp_call_function_single+0x5f/0xa0
[<ffffffffb0f75cd5>] ? cpumask_next_and+0x35/0x50
[<ffffffffb0d11aab>] smp_call_function_many+0x22b/0x270
[<ffffffffb0c7a6a8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb0c7a718>] flush_tlb_mm_range+0x68/0x140
[<ffffffffb0de4687>] tlb_flush_mmu.part.76+0x37/0xe0
[<ffffffffb0de5f85>] tlb_finish_mmu+0x55/0x60
[<ffffffffb0def624>] unmap_region+0xf4/0x140
[<ffffffffb0df1c15>] do_munmap+0x2a5/0x480
[<ffffffffb0df1e55>] vm_munmap+0x65/0xb0
[<ffffffffb0df30e2>] SyS_munmap+0x22/0x30
[<ffffffffb1375ddb>] system_call_fastpath+0x22/0x27
[<ffffffffb1375d21>] ? system_call_after_swapgs+0xae/0x146
Code: 00 b7 01 00 48 89 de 48 03 14 c5 a0 bc 94 b1 48 89 df e8 4a b7 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #570769
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810f932a
Build id: 3.10.0-693.2.2.el7.x86_64
0xfa
2
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.2.2.el7.x86_64
0x70
3
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.2.2.el7.x86_64
0x70
4
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.2.2.el7.x86_64
0x70
5
smp_call_function_single
vmlinux 0xffffffff810f942f
Build id: 3.10.0-693.2.2.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff81322905
Build id: 3.10.0-693.2.2.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff810f99c3
Build id: 3.10.0-693.2.2.el7.x86_64
0x223
8
native_flush_tlb_others
vmlinux 0xffffffff8106e668
Build id: 3.10.0-693.2.2.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8106e738
Build id: 3.10.0-693.2.2.el7.x86_64
0x68
10
tlb_flush_mmu.part.63
vmlinux 0xffffffff811ad053
Build id: 3.10.0-693.2.2.el7.x86_64
0x33
11
tlb_finish_mmu
vmlinux 0xffffffff811ae375
Build id: 3.10.0-693.2.2.el7.x86_64
0x55
12
unmap_region
vmlinux 0xffffffff811b5444
Build id: 3.10.0-693.2.2.el7.x86_64
0xf4
13
do_munmap
vmlinux 0xffffffff811b7a02
Build id: 3.10.0-693.2.2.el7.x86_64
0x292
14
vm_munmap
vmlinux 0xffffffff811b7c45
Build id: 3.10.0-693.2.2.el7.x86_64
0x65
15
SyS_munmap
vmlinux 0xffffffff811b8d52
Build id: 3.10.0-693.2.2.el7.x86_64
0x22
16
system_call_fastpath
vmlinux 0xffffffff816b5009
Build id: 3.10.0-693.2.2.el7.x86_64
0x16
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 29s! [ds_am:17196]
Modules linked in: gsch(OE) redirfs(OE) nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache dsa_filter(POE) vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper vmw_balloon cryptd ppdev sg vmw_vmci joydev pcspkr parport_pc shpchp parport i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common mptspi scsi_transport_spi mptscsih crc32c_intel serio_raw ata_piix libata mptbase vmxnet3 i2c_core dm_mirror dm_region_hash dm_log
dm_mod
CPU: 3 PID: 17196 Comm: ds_am Tainted: P           OEL ------------   3.10.0-693.2.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff8800b982af70 ti: ffff8802087f8000 task.ti: ffff8802087f8000
RIP: 0010:[<ffffffff810f932a>]  [<ffffffff810f932a>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff8802087fbc60  EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffff8802087fbc30 RCX: 000000000000003c
RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000286
RBP: ffff8802087fbcb0 R08: ffffffff816ce460 R09: 000000010040002b
R10: 0000000023e54801 R11: ffffea00008f9500 R12: ffff88023ffd9008
R13: ffff8800b982af70 R14: ffff8800b982af70 R15: ffff8800b982af70
FS:  00007f9908ff9700(0000) GS:ffff88023fd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2447e88000 CR3: 00000000b9912000 CR4: 00000000001407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff8106e4a0 ffff8802087fbd38
0000000000000003 00000000d44cc56a 00000000d44cc56a 0000000000000000
ffffffff8106e4a0 ffffffff8106e4a0 ffff8802087fbce0 ffffffff810f942f
Call Trace:
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff810f942f>] smp_call_function_single+0x5f/0xa0
[<ffffffff81322905>] ? cpumask_next_and+0x35/0x50
[<ffffffff810f99c3>] smp_call_function_many+0x223/0x260
[<ffffffff8106e668>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8106e738>] flush_tlb_mm_range+0x68/0x140
[<ffffffff811ad053>] tlb_flush_mmu.part.63+0x33/0xc0
[<ffffffff811ae375>] tlb_finish_mmu+0x55/0x60
[<ffffffff811b5444>] unmap_region+0xf4/0x140
[<ffffffff811b7a02>] do_munmap+0x292/0x470
[<ffffffff811b7c45>] vm_munmap+0x65/0xb0
[<ffffffff811b8d52>] SyS_munmap+0x22/0x30
[<ffffffff816b5009>] system_call_fastpath+0x16/0x1b
Code: 00 78 01 00 48 89 de 48 03 14 c5 e0 fd b0 81 48 89 df e8 8a dc 23 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #526955
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810f932a
Build id: 3.10.0-693.el7.x86_64
0xfa
2
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.el7.x86_64
0x70
3
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.el7.x86_64
0x70
4
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.el7.x86_64
0x70
5
smp_call_function_single
vmlinux 0xffffffff810f942f
Build id: 3.10.0-693.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff813226f5
Build id: 3.10.0-693.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff810f99c3
Build id: 3.10.0-693.el7.x86_64
0x223
8
native_flush_tlb_others
vmlinux 0xffffffff8106e668
Build id: 3.10.0-693.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8106e738
Build id: 3.10.0-693.el7.x86_64
0x68
10
tlb_flush_mmu.part.63
vmlinux 0xffffffff811ad053
Build id: 3.10.0-693.el7.x86_64
0x33
11
tlb_finish_mmu
vmlinux 0xffffffff811ae375
Build id: 3.10.0-693.el7.x86_64
0x55
12
unmap_region
vmlinux 0xffffffff811b5444
Build id: 3.10.0-693.el7.x86_64
0xf4
13
do_munmap
vmlinux 0xffffffff811b7a02
Build id: 3.10.0-693.el7.x86_64
0x292
14
vm_munmap
vmlinux 0xffffffff811b7c45
Build id: 3.10.0-693.el7.x86_64
0x65
15
SyS_munmap
vmlinux 0xffffffff811b8d52
Build id: 3.10.0-693.el7.x86_64
0x22
16
tracesys
vmlinux 0xffffffff816b51d2
Build id: 3.10.0-693.el7.x86_64
0xdd
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [java:10794]
Modules linked in: tcp_diag udp_diag inet_diag nf_conntrack_ftp xt_nat veth nf_conntrack_netlink xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_addrtype br_netfilter tun binfmt_misc overlay(T) ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock vfat fat sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd
ppdev vmw_balloon pcspkr joydev sg vmw_vmci shpchp i2c_piix4 parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi scsi_transport_spi ata_piix crct10dif_pclmul crct10dif_common mptscsih libata crc32c_intel serio_raw mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 4 PID: 10794 Comm: java Tainted: G             L ------------ T 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.0.B64.1410210136 10/21/2014
task: ffff880226211fa0 ti: ffff880357018000 task.ti: ffff880357018000
RIP: 0010:[<ffffffff810f932a>]  [<ffffffff810f932a>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff88035701bc60  EFLAGS: 00000202
RAX: 0000000000000010 RBX: ffff88035701bc30 RCX: 0000000000000030
RDX: 000000000000ffff RSI: 0000000000000010 RDI: 0000000000000286
RBP: ffff88035701bcb0 R08: ffffffff816d0720 R09: ffffffff811bd768
R10: ffff880237d19bc0 R11: ffffea001096d540 R12: ffff88023ffdb008
R13: ffff880226211fa0 R14: ffff880226211fa0 R15: ffff880226211fa0
FS:  00007fd951e2fb10(0000) GS:ffff880237d00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000008a6527c8 CR3: 000000000ebd6000 CR4: 00000000001407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff8106e4a0 ffff88035701bd38
0000000000000003 00000000289a0728 ffff88035701bca8 000000000000000e
ffffffff8106e4a0 ffffffff8106e4a0 ffff88035701bce0 ffffffff810f942f
Call Trace:
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff810f942f>] smp_call_function_single+0x5f/0xa0
[<ffffffff813226f5>] ? cpumask_next_and+0x35/0x50
[<ffffffff810f99c3>] smp_call_function_many+0x223/0x260
[<ffffffff8106e668>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8106e738>] flush_tlb_mm_range+0x68/0x140
[<ffffffff811ad053>] tlb_flush_mmu.part.63+0x33/0xc0
[<ffffffff811ae375>] tlb_finish_mmu+0x55/0x60
[<ffffffff811b5444>] unmap_region+0xf4/0x140
[<ffffffff811b7a02>] do_munmap+0x292/0x470
[<ffffffff811b7c45>] vm_munmap+0x65/0xb0
[<ffffffff811b8d52>] SyS_munmap+0x22/0x30
[<ffffffff816b51d2>] tracesys+0xdd/0xe2
Code: 00 78 01 00 48 89 de 48 03 14 c5 e0 fd b0 81 48 89 df e8 7a da 23 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #472171
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffaa10aa2a
Build id: 3.10.0-862.14.4.el7.x86_64
0xfa
2
? leave_mm
vmlinux 0xffffffffaa079c90
Build id: 3.10.0-862.14.4.el7.x86_64
0x110
3
? leave_mm
vmlinux 0xffffffffaa079c90
Build id: 3.10.0-862.14.4.el7.x86_64
0x110
4
? leave_mm
vmlinux 0xffffffffaa079c90
Build id: 3.10.0-862.14.4.el7.x86_64
0x110
5
smp_call_function_single
vmlinux 0xffffffffaa10ab3f
Build id: 3.10.0-862.14.4.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffffaa34edb5
Build id: 3.10.0-862.14.4.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffffaa10b0eb
Build id: 3.10.0-862.14.4.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffaa079e58
Build id: 3.10.0-862.14.4.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffaa079ec8
Build id: 3.10.0-862.14.4.el7.x86_64
0x68
10
tlb_flush_mmu.part.75
vmlinux 0xffffffffaa1c3487
Build id: 3.10.0-862.14.4.el7.x86_64
0x37
11
tlb_finish_mmu
vmlinux 0xffffffffaa1c4d85
Build id: 3.10.0-862.14.4.el7.x86_64
0x55
12
unmap_region
vmlinux 0xffffffffaa1cdb74
Build id: 3.10.0-862.14.4.el7.x86_64
0xf4
13
do_munmap
vmlinux 0xffffffffaa1d0145
Build id: 3.10.0-862.14.4.el7.x86_64
0x295
14
vm_munmap
vmlinux 0xffffffffaa1d0385
Build id: 3.10.0-862.14.4.el7.x86_64
0x65
15
SyS_munmap
vmlinux 0xffffffffaa1d15a2
Build id: 3.10.0-862.14.4.el7.x86_64
0x22
16
system_call_fastpath
vmlinux 0xffffffffaa72579b
Build id: 3.10.0-862.14.4.el7.x86_64
0x22
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [java:123676]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel
snd_ens1371 snd_rawmidi aesni_intel lrw gf128mul snd_ac97_codec glue_helper ppdev ablk_helper cryptd ac97_bus snd_seq vmw_balloon snd_seq_device snd_pcm snd_timer snd soundcore joydev pcspkr sg vmw_vmci i2c_piix4 shpchp nfit libnvdimm parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix crct10dif_pclmul crct10dif_common libata mptspi drm scsi_transport_spi crc32c_intel e1000 mptscsih serio_raw mptbase i2c_core
CPU: 1 PID: 123676 Comm: java Kdump: loaded Not tainted 3.10.0-862.14.4.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff98a75cdb9fa0 ti: ffff98a8363fc000 task.ti: ffff98a8363fc000
RIP: 0010:[<ffffffffaa10aa2a>]  [<ffffffffaa10aa2a>] generic_exec_single+0xfa/0x1b0
RSP: 0018:ffff98a8363ffc30  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff98a8363ffc00 RCX: 0000000000000001
RDX: ffffffffaa8132b0 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff98a8363ffc78 R08: ffffffffaa8132a8 R09: ffffffffaa1d6e5c
R10: ffff98a83965ba80 R11: fffff4b841f4d200 R12: ffff98a83ffd9008
R13: ffff98a75cdb9fa0 R14: ffff98a75cdb9fa0 R15: ffff98a75cdb9fa0
FS:  00007f5e17bee700(0000) GS:ffff98a839640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5e00420000 CR3: 0000000102e1c000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffaa079c90>] ? leave_mm+0x110/0x110
[<ffffffffaa079c90>] ? leave_mm+0x110/0x110
[<ffffffffaa079c90>] ? leave_mm+0x110/0x110
[<ffffffffaa10ab3f>] smp_call_function_single+0x5f/0xa0
[<ffffffffaa34edb5>] ? cpumask_next_and+0x35/0x50
[<ffffffffaa10b0eb>] smp_call_function_many+0x22b/0x270
[<ffffffffaa079e58>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffaa079ec8>] flush_tlb_mm_range+0x68/0x140
[<ffffffffaa1c3487>] tlb_flush_mmu.part.75+0x37/0xe0
[<ffffffffaa1c4d85>] tlb_finish_mmu+0x55/0x60
[<ffffffffaa1cdb74>] unmap_region+0xf4/0x140
[<ffffffffaa1d0145>] do_munmap+0x295/0x470
[<ffffffffaa1d0385>] vm_munmap+0x65/0xb0
[<ffffffffaa1d15a2>] SyS_munmap+0x22/0x30
[<ffffffffaa72579b>] system_call_fastpath+0x22/0x27
Code: c0 96 01 00 48 89 de 48 03 14 c5 a0 54 d3 aa 48 89 df e8 6a a1 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #357004
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810f932a
Build id: 3.10.0-693.el7.x86_64
0xfa
2
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.el7.x86_64
0x70
3
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.el7.x86_64
0x70
4
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.el7.x86_64
0x70
5
smp_call_function_single
vmlinux 0xffffffff810f942f
Build id: 3.10.0-693.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff813226f5
Build id: 3.10.0-693.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff810f99c3
Build id: 3.10.0-693.el7.x86_64
0x223
8
native_flush_tlb_others
vmlinux 0xffffffff8106e668
Build id: 3.10.0-693.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8106e738
Build id: 3.10.0-693.el7.x86_64
0x68
10
tlb_flush_mmu.part.63
vmlinux 0xffffffff811ad053
Build id: 3.10.0-693.el7.x86_64
0x33
11
tlb_finish_mmu
vmlinux 0xffffffff811ae375
Build id: 3.10.0-693.el7.x86_64
0x55
12
unmap_region
vmlinux 0xffffffff811b5444
Build id: 3.10.0-693.el7.x86_64
0xf4
13
do_munmap
vmlinux 0xffffffff811b7a02
Build id: 3.10.0-693.el7.x86_64
0x292
14
vm_munmap
vmlinux 0xffffffff811b7c45
Build id: 3.10.0-693.el7.x86_64
0x65
15
SyS_munmap
vmlinux 0xffffffff811b8d52
Build id: 3.10.0-693.el7.x86_64
0x22
16
system_call_fastpath
vmlinux 0xffffffff816b4fc9
Build id: 3.10.0-693.el7.x86_64
0x16
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [ContainerBackgr:4699]
Modules linked in: binfmt_misc tcp_diag inet_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg parport_pc parport i2c_piix4 shpchp vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common
drm ata_piix crc32c_intel mptspi scsi_transport_spi serio_raw mptscsih libata i2c_core mptbase vmxnet3 dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 4699 Comm: ContainerBackgr Tainted: G             L ------------   3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff880369a60000 ti: ffff880106e20000 task.ti: ffff880106e20000
RIP: 0010:[<ffffffff810f932a>]  [<ffffffff810f932a>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff880106e23c60  EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffff880106e23c30 RCX: 000000000000003c
RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000286
RBP: ffff880106e23cb0 R08: ffffffff816ce420 R09: ffffea0004176580
R10: ffff880126bc0640 R11: 0000000000000206 R12: ffff8803bffd9008
R13: ffff880369a60000 R14: ffff880369a60000 R15: ffff880369a60000
FS:  00007f85cba8e700(0000) GS:ffff8803bfc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f04cdfd1000 CR3: 000000039d776000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff8106e4a0 ffff880106e23d38
0000000000000003 00000000e0ed0f45 00000000e0ed0f45 0000000000000000
ffffffff8106e4a0 ffffffff8106e4a0 ffff880106e23ce0 ffffffff810f942f
Call Trace:
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff810f942f>] smp_call_function_single+0x5f/0xa0
[<ffffffff813226f5>] ? cpumask_next_and+0x35/0x50
[<ffffffff810f99c3>] smp_call_function_many+0x223/0x260
[<ffffffff8106e668>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8106e738>] flush_tlb_mm_range+0x68/0x140
[<ffffffff811ad053>] tlb_flush_mmu.part.63+0x33/0xc0
[<ffffffff811ae375>] tlb_finish_mmu+0x55/0x60
[<ffffffff811b5444>] unmap_region+0xf4/0x140
[<ffffffff811b7a02>] do_munmap+0x292/0x470
[<ffffffff811b7c45>] vm_munmap+0x65/0xb0
[<ffffffff811b8d52>] SyS_munmap+0x22/0x30
[<ffffffff816b4fc9>] system_call_fastpath+0x16/0x1b
Code: 00 78 01 00 48 89 de 48 03 14 c5 e0 fd b0 81 48 89 df e8 7a da 23 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #334516
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa79163c2
Build id: 3.10.0-1062.9.1.el7.x86_64
0x102
2
? leave_mm
vmlinux 0xffffffffa787e2b0
Build id: 3.10.0-1062.9.1.el7.x86_64
0x110
3
? leave_mm
vmlinux 0xffffffffa787e2b0
Build id: 3.10.0-1062.9.1.el7.x86_64
0x110
4
? leave_mm
vmlinux 0xffffffffa787e2b0
Build id: 3.10.0-1062.9.1.el7.x86_64
0x110
5
smp_call_function_single
vmlinux 0xffffffffa79164df
Build id: 3.10.0-1062.9.1.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffffa7b81635
Build id: 3.10.0-1062.9.1.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffffa7916a8b
Build id: 3.10.0-1062.9.1.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffa787e478
Build id: 3.10.0-1062.9.1.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffa787e4eb
Build id: 3.10.0-1062.9.1.el7.x86_64
0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffa79ec026
Build id: 3.10.0-1062.9.1.el7.x86_64
0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffffa79edaef
Build id: 3.10.0-1062.9.1.el7.x86_64
0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffa79edc13
Build id: 3.10.0-1062.9.1.el7.x86_64
0x23
13
unmap_region
vmlinux 0xffffffffa79f7404
Build id: 3.10.0-1062.9.1.el7.x86_64
0xf4
14
do_munmap
vmlinux 0xffffffffa79f9a05
Build id: 3.10.0-1062.9.1.el7.x86_64
0x2a5
15
vm_munmap
vmlinux 0xffffffffa79f9c45
Build id: 3.10.0-1062.9.1.el7.x86_64
0x65
16
SyS_munmap
vmlinux 0xffffffffa79faee2
Build id: 3.10.0-1062.9.1.el7.x86_64
0x22
17
system_call_fastpath
vmlinux 0xffffffffa7f8dede
Build id: 3.10.0-1062.9.1.el7.x86_64
0x25
18
? system_call_after_swapgs
vmlinux 0xffffffffa7f8de21
Build id: 3.10.0-1062.9.1.el7.x86_64
0xae
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [httpd:8936]
Firewall: *TCP_IN Blocked* IN=ens32 OUT= MAC=00:50:56:0c:ea:3d:00:ff:ff:ff:ff:fe:08:00 SRC=167.114.191.207 DST=192.99.224.79 LEN=60 TOS=0x00 PREC=0x00 TTL=63 ID=30510 DF PROTO=TCP SPT=45880 DPT=36637 WINDOW=29200 RES=0x00 SYN URGP=0 
Firewall: *TCP_IN Blocked* IN=ens32 OUT= MAC=00:50:56:0c:ea:3d:00:ff:ff:ff:ff:fd:08:00 SRC=220.178.71.156 DST=192.99.224.79 LEN=40 TOS=0x00 PREC=0x00 TTL=233 ID=25673 PROTO=TCP SPT=58383 DPT=1433 WINDOW=1024 RES=0x00 SYN URGP=0 
Modules linked in: tcp_diag inet_diag ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 ip6table_filter nf_log_ipv4 nf_log_common nf_nat_ftp xt_REDIRECT nf_nat_redirect xt_conntrack nf_conntrack_ftp xt_LOG xt_limit talpa_vfshook(OE) talpa_pedconnector(OE) talpa_pedevice(OE) talpa_vcdevice(OE) talpa_core(OE) talpa_linux(OE) talpa_syscallhook(OE) xt_multiport iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 ip6table_mangle ip6table_raw ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 nf_nat nf_conntrack ip6_tables iptable_mangle iptable_raw ipt_REJECT nf_reject_ipv4 iptable_filter sb_edac coretemp iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc vmw_vmci parport i2c_piix4 tcp_htcp ip_tables
xfs libcrc32c sd_mod sr_mod vmwgfx crc_t10dif cdrom crct10dif_generic drm_kms_helper ata_generic pata_acpi syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel serio_raw libata e1000 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 8936 Comm: httpd Kdump: loaded Tainted: G           OEL ------------   3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff9109b8ede2a0 ti: ffff91061afa8000 task.ti: ffff91061afa8000
RIP: 0010:[<ffffffffa79163c2>]  [<ffffffffa79163c2>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff91061afabc20  EFLAGS: 00000202
RAX: 00000000000008fd RBX: ffffffffa79c00be RCX: 0000000000000000
RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000282
RBP: ffff91061afabc70 R08: 0000000000000001 R09: 00003ffffffff000
R10: ffff910a2c332eb0 R11: 0000000000000206 R12: ffff910a3ffcf000
R13: 0000014100000000 R14: ffff910a3ffcf008 R15: ffff9109b8ede2a0
FS:  00007fcb876ac880(0000) GS:ffff910a3fc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fcb874ff000 CR3: 000000001b2d2000 CR4: 00000000000407e0
Call Trace:
[<ffffffffa787e2b0>] ? leave_mm+0x110/0x110
[<ffffffffa787e2b0>] ? leave_mm+0x110/0x110
[<ffffffffa787e2b0>] ? leave_mm+0x110/0x110
[<ffffffffa79164df>] smp_call_function_single+0x5f/0xa0
[<ffffffffa7b81635>] ? cpumask_next_and+0x35/0x50
[<ffffffffa7916a8b>] smp_call_function_many+0x22b/0x270
[<ffffffffa787e478>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa787e4eb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa79ec026>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffffa79edaef>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffa79edc13>] tlb_finish_mmu+0x23/0x30
[<ffffffffa79f7404>] unmap_region+0xf4/0x140
[<ffffffffa79f9a05>] do_munmap+0x2a5/0x480
[<ffffffffa79f9c45>] vm_munmap+0x65/0xb0
[<ffffffffa79faee2>] SyS_munmap+0x22/0x30
[<ffffffffa7f8dede>] system_call_fastpath+0x25/0x2a
[<ffffffffa7f8de21>] ? system_call_after_swapgs+0xae/0x146
Code: 89 de 48 03 14 c5 20 e8 54 a8 48 89 df e8 f7 22 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #249253
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffab916f72
Build id: 3.10.0-1127.19.1.el7.x86_64
0x102
2
? leave_mm
vmlinux 0xffffffffab87e730
Build id: 3.10.0-1127.19.1.el7.x86_64
0x120
3
? leave_mm
vmlinux 0xffffffffab87e730
Build id: 3.10.0-1127.19.1.el7.x86_64
0x120
4
? leave_mm
vmlinux 0xffffffffab87e730
Build id: 3.10.0-1127.19.1.el7.x86_64
0x120
5
smp_call_function_single
vmlinux 0xffffffffab91708f
Build id: 3.10.0-1127.19.1.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffffabb85005
Build id: 3.10.0-1127.19.1.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffffab91763b
Build id: 3.10.0-1127.19.1.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffab87e8f8
Build id: 3.10.0-1127.19.1.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffab87e96b
Build id: 3.10.0-1127.19.1.el7.x86_64
0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffab9ede36
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa6
11
unmap_page_range
vmlinux 0xffffffffab9f0ff9
Build id: 3.10.0-1127.19.1.el7.x86_64
0x979
12
unmap_single_vma
vmlinux 0xffffffffab9f1381
Build id: 3.10.0-1127.19.1.el7.x86_64
0x81
13
unmap_vmas
vmlinux 0xffffffffab9f2db9
Build id: 3.10.0-1127.19.1.el7.x86_64
0x49
14
unmap_region
vmlinux 0xffffffffab9f91fe
Build id: 3.10.0-1127.19.1.el7.x86_64
0xbe
15
do_munmap
vmlinux 0xffffffffab9fb825
Build id: 3.10.0-1127.19.1.el7.x86_64
0x2a5
16
vm_munmap
vmlinux 0xffffffffab9fba65
Build id: 3.10.0-1127.19.1.el7.x86_64
0x65
17
SyS_munmap
vmlinux 0xffffffffab9fcd02
Build id: 3.10.0-1127.19.1.el7.x86_64
0x22
18
system_call_fastpath
vmlinux 0xffffffffabf92ed2
Build id: 3.10.0-1127.19.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [Compositor:3039]
Modules linked in: veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) tcp_lp rfcomm fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock bnep sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul squashfs loop snd_ens1371 snd_rawmidi ghash_clmulni_intel ppdev
snd_ac97_codec ac97_bus btusb snd_seq btrtl aesni_intel btbcm btintel vmw_balloon snd_seq_device lrw bluetooth gf128mul glue_helper ablk_helper cryptd snd_pcm joydev pcspkr snd_timer rfkill snd sg soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common nfit crc32c_intel ata_piix libnvdimm mptspi scsi_transport_spi libata mptscsih serio_raw e1000 mptbase drm_panel_orientation_quirks
CPU: 1 PID: 3039 Comm: Compositor Kdump: loaded Tainted: G               ------------ T 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff9acc398f5230 ti: ffff9ace3bee0000 task.ti: ffff9ace3bee0000
RIP: 0010:[<ffffffffab916f72>]  [<ffffffffab916f72>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9ace3bee3b10  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff9ace3bee3ae0 RCX: 0000000000000001
RDX: ffffffffac0136d0 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff9ace3bee3b58 R08: ffffffffac0136c8 R09: 00003ffffffff000
R10: ffff9acc2a366ca8 R11: 0000000000000246 R12: ffff9acd5a835300
R13: ffffffffab8d3c52 R14: ffff9ace3bee3ac8 R15: 0000000000000002
FS:  00007f4bc3e07700(0000) GS:ffff9ace86440000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8f8efaf000 CR3: 00000002bbe88000 CR4: 00000000003607e0
Call Trace:
[<ffffffffab87e730>] ? leave_mm+0x120/0x120
[<ffffffffab87e730>] ? leave_mm+0x120/0x120
[<ffffffffab87e730>] ? leave_mm+0x120/0x120
[<ffffffffab91708f>] smp_call_function_single+0x5f/0xa0
[<ffffffffabb85005>] ? cpumask_next_and+0x35/0x50
[<ffffffffab91763b>] smp_call_function_many+0x22b/0x270
[<ffffffffab87e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffab87e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffab9ede36>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffffab9f0ff9>] unmap_page_range+0x979/0xc80
[<ffffffffab9f1381>] unmap_single_vma+0x81/0xf0
[<ffffffffab9f2db9>] unmap_vmas+0x49/0x90
[<ffffffffab9f91fe>] unmap_region+0xbe/0x140
[<ffffffffab9fb825>] do_munmap+0x2a5/0x480
[<ffffffffab9fba65>] vm_munmap+0x65/0xb0
[<ffffffffab9fcd02>] SyS_munmap+0x22/0x30
[<ffffffffabf92ed2>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 a0 10 55 ac 48 89 df e8 07 52 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [CRTC:37:crtc-0] flip_done timed out
Complete report #234568
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810f933a
Build id: 3.10.0-693.5.2.el7.x86_64
0xfa
2
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.5.2.el7.x86_64
0x70
3
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.5.2.el7.x86_64
0x70
4
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.5.2.el7.x86_64
0x70
5
smp_call_function_single
vmlinux 0xffffffff810f943f
Build id: 3.10.0-693.5.2.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff813227c5
Build id: 3.10.0-693.5.2.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff810f99d3
Build id: 3.10.0-693.5.2.el7.x86_64
0x223
8
native_flush_tlb_others
vmlinux 0xffffffff8106e668
Build id: 3.10.0-693.5.2.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8106e738
Build id: 3.10.0-693.5.2.el7.x86_64
0x68
10
tlb_flush_mmu.part.63
vmlinux 0xffffffff811acfc3
Build id: 3.10.0-693.5.2.el7.x86_64
0x33
11
tlb_finish_mmu
vmlinux 0xffffffff811ae2e5
Build id: 3.10.0-693.5.2.el7.x86_64
0x55
12
unmap_region
vmlinux 0xffffffff811b53b4
Build id: 3.10.0-693.5.2.el7.x86_64
0xf4
13
do_munmap
vmlinux 0xffffffff811b7972
Build id: 3.10.0-693.5.2.el7.x86_64
0x292
14
vm_munmap
vmlinux 0xffffffff811b7bb5
Build id: 3.10.0-693.5.2.el7.x86_64
0x65
15
SyS_munmap
vmlinux 0xffffffff811b8cc2
Build id: 3.10.0-693.5.2.el7.x86_64
0x22
16
system_call_fastpath
vmlinux 0xffffffff816b5089
Build id: 3.10.0-693.5.2.el7.x86_64
0x16
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [httpd:47015]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun nf_conntrack_netbios_ns nf_conntrack_broadcast nf_conntrack_ftp ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event ext4 mbcache jbd2 sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq ppdev aesni_intel lrw
snd_seq_device gf128mul snd_pcm glue_helper ablk_helper cryptd vmw_balloon pcspkr joydev snd_timer snd sg soundcore nfit i2c_piix4 libnvdimm shpchp vmw_vmci parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata mptspi crct10dif_pclmul crct10dif_common crc32c_intel scsi_transport_spi e1000 mptscsih serio_raw mptbase i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 47015 Comm: httpd Tainted: G        W    L ------------   3.10.0-693.5.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff8800352c2f70 ti: ffff880218290000 task.ti: ffff880218290000
RIP: 0010:[<ffffffff810f933a>]  [<ffffffff810f933a>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff880218293c60  EFLAGS: 00000202
RAX: 0000000000000040 RBX: 0000000200000000 RCX: 0000000000000002
RDX: 0000000000000040 RSI: 0000000000000000 RDI: 0000000000000282
RBP: ffff880218293cb0 R08: ffffffff816ce6e8 R09: ffffea0008b8d140
R10: ffff8800ad545570 R11: 0000000000000206 R12: ffff88023ffd9008
R13: ffff8800352c2f70 R14: ffff8800352c2f70 R15: ffff8800352c2f70
FS:  00007fbac0694880(0000) GS:ffff880236600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fbac05f7000 CR3: 0000000222b82000 CR4: 00000000001407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff8106e4a0 ffff880218293d38
0000000000000002 00000000b69f8ce5 00000000b69f8ce5 0000000000000001
ffffffff8106e4a0 ffffffff8106e4a0 ffff880218293ce0 ffffffff810f943f
Call Trace:
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff810f943f>] smp_call_function_single+0x5f/0xa0
[<ffffffff813227c5>] ? cpumask_next_and+0x35/0x50
[<ffffffff810f99d3>] smp_call_function_many+0x223/0x260
[<ffffffff8106e668>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8106e738>] flush_tlb_mm_range+0x68/0x140
[<ffffffff811acfc3>] tlb_flush_mmu.part.63+0x33/0xc0
[<ffffffff811ae2e5>] tlb_finish_mmu+0x55/0x60
[<ffffffff811b53b4>] unmap_region+0xf4/0x140
[<ffffffff811b7972>] do_munmap+0x292/0x470
[<ffffffff811b7bb5>] vm_munmap+0x65/0xb0
[<ffffffff811b8cc2>] SyS_munmap+0x22/0x30
[<ffffffff816b5089>] system_call_fastpath+0x16/0x1b
Code: 00 78 01 00 48 89 de 48 03 14 c5 e0 fd b0 81 48 89 df e8 3a db 23 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #165508
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810e6758
Build id: 3.10.0-327.el7.x86_64
0xf8
2
? leave_mm
vmlinux 0xffffffff81065c90
Build id: 3.10.0-327.el7.x86_64
0x70
3
? leave_mm
vmlinux 0xffffffff81065c90
Build id: 3.10.0-327.el7.x86_64
0x70
4
? leave_mm
vmlinux 0xffffffff81065c90
Build id: 3.10.0-327.el7.x86_64
0x70
5
smp_call_function_single
vmlinux 0xffffffff810e685f
Build id: 3.10.0-327.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff812f2785
Build id: 3.10.0-327.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff810e6e03
Build id: 3.10.0-327.el7.x86_64
0x223
8
native_flush_tlb_others
vmlinux 0xffffffff81065e58
Build id: 3.10.0-327.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff81065f26
Build id: 3.10.0-327.el7.x86_64
0x66
10
tlb_flush_mmu.part.54
vmlinux 0xffffffff81192563
Build id: 3.10.0-327.el7.x86_64
0x33
11
tlb_finish_mmu
vmlinux 0xffffffff811930f5
Build id: 3.10.0-327.el7.x86_64
0x55
12
unmap_region
vmlinux 0xffffffff8119b2d2
Build id: 3.10.0-327.el7.x86_64
0xe2
13
do_munmap
vmlinux 0xffffffff8119d612
Build id: 3.10.0-327.el7.x86_64
0x242
14
vm_munmap
vmlinux 0xffffffff8119d821
Build id: 3.10.0-327.el7.x86_64
0x41
15
SyS_munmap
vmlinux 0xffffffff8119e772
Build id: 3.10.0-327.el7.x86_64
0x22
16
system_call_fastpath
vmlinux 0xffffffff81645909
Build id: 3.10.0-327.el7.x86_64
0x16
BUG: soft lockup - CPU#3 stuck for 23s! [tarantool:11465]
Modules linked in: vmw_vsock_vmci_transport vsock coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr sg parport_pc parport vmw_vmci shpchp i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common drm_kms_helper crc32c_intel ttm serio_raw mptspi ata_piix scsi_transport_spi drm mptscsih e1000 libata mptbase i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 11465 Comm: tarantool Tainted: G        W    L ------------   3.10.0-327.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff8804282f4500 ti: ffff8804277c8000 task.ti: ffff8804277c8000
RIP: 0010:[<ffffffff810e6758>]  [<ffffffff810e6758>] generic_exec_single+0xf8/0x1a0
RSP: 0018:ffff8804277cbc80  EFLAGS: 00000202
RAX: 00000000000008fd RBX: ffff8804277cbc78 RCX: 0000000000000000
RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000282
RBP: ffff8804277cbcd0 R08: 0000000000000001 R09: ffff88043fcd7520
R10: ffffffff811a2b52 R11: ffffea00109de1c0 R12: ffff88043ffd8000
R13: 0000000000000003 R14: 0000000200000000 R15: ffff88043ffd9000
FS:  00007f44cb319a80(0000) GS:ffff88043fcc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000004185a000 CR3: 0000000426da5000 CR4: 00000000001407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff81065c90 ffff8804277cbd58
0000000000000002 0000000008880ef1 0000000000000000 0000000000000000
ffffffff81065c90 ffffffff81065c90 ffff8804277cbd00 ffffffff810e685f
Call Trace:
[<ffffffff81065c90>] ? leave_mm+0x70/0x70
[<ffffffff81065c90>] ? leave_mm+0x70/0x70
[<ffffffff81065c90>] ? leave_mm+0x70/0x70
[<ffffffff810e685f>] smp_call_function_single+0x5f/0xa0
[<ffffffff812f2785>] ? cpumask_next_and+0x35/0x50
[<ffffffff810e6e03>] smp_call_function_many+0x223/0x260
[<ffffffff81065e58>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff81065f26>] flush_tlb_mm_range+0x66/0x140
[<ffffffff81192563>] tlb_flush_mmu.part.54+0x33/0xc0
[<ffffffff811930f5>] tlb_finish_mmu+0x55/0x60
[<ffffffff8119b2d2>] unmap_region+0xe2/0x130
[<ffffffff8119d612>] do_munmap+0x242/0x410
[<ffffffff8119d821>] vm_munmap+0x41/0x60
[<ffffffff8119e772>] SyS_munmap+0x22/0x30
[<ffffffff81645909>] system_call_fastpath+0x16/0x1b
Code: c7 c2 40 52 01 00 48 89 de 48 03 14 c5 e0 b8 a5 81 48 89 df e8 da fc 21 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 <f3> 90 f6 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 
Complete report #160684
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa7916f72
Build id: 3.10.0-1127.19.1.el7.x86_64
0x102
2
? leave_mm
vmlinux 0xffffffffa787e730
Build id: 3.10.0-1127.19.1.el7.x86_64
0x120
3
? leave_mm
vmlinux 0xffffffffa787e730
Build id: 3.10.0-1127.19.1.el7.x86_64
0x120
4
? leave_mm
vmlinux 0xffffffffa787e730
Build id: 3.10.0-1127.19.1.el7.x86_64
0x120
5
smp_call_function_single
vmlinux 0xffffffffa791708f
Build id: 3.10.0-1127.19.1.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffffa7b85005
Build id: 3.10.0-1127.19.1.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffffa791763b
Build id: 3.10.0-1127.19.1.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffa787e8f8
Build id: 3.10.0-1127.19.1.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffa787e96b
Build id: 3.10.0-1127.19.1.el7.x86_64
0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffa79ede36
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffffa79ef8ff
Build id: 3.10.0-1127.19.1.el7.x86_64
0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffa79efa23
Build id: 3.10.0-1127.19.1.el7.x86_64
0x23
13
unmap_region
vmlinux 0xffffffffa79f9234
Build id: 3.10.0-1127.19.1.el7.x86_64
0xf4
14
do_munmap
vmlinux 0xffffffffa79fb825
Build id: 3.10.0-1127.19.1.el7.x86_64
0x2a5
15
vm_munmap
vmlinux 0xffffffffa79fba65
Build id: 3.10.0-1127.19.1.el7.x86_64
0x65
16
SyS_munmap
vmlinux 0xffffffffa79fcd02
Build id: 3.10.0-1127.19.1.el7.x86_64
0x22
17
tracesys
vmlinux 0xffffffffa7f93166
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa6
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [transmission-da:55159]
IPv4: martian source 192.168.1.254 from 10.26.112.78, on dev br-d523c1c8dcdf
ll header: 00000000: 02 42 8c c0 84 74 02 42 ac 11 00 14 08 00        .B...t.B......
IPv4: martian source 172.17.0.20 from 154.3.42.11, on dev eth0
ll header: 00000000: 02 42 ac 11 00 14 02 42 8c c0 84 74 08 00        .B.....B...t..
IPv4: martian source 172.17.0.20 from 172.98.71.211, on dev eth0
ll header: 00000000: 02 42 ac 11 00 14 02 42 8c c0 84 74 08 00        .B.....B...t..
IPv4: martian source 172.17.0.20 from 172.98.71.211, on dev eth0
ll header: 00000000: 02 42 ac 11 00 14 02 42 8c c0 84 74 08 00        .B.....B...t..
IPv4: martian source 172.17.0.20 from 154.3.42.11, on dev eth0
ll header: 00000000: 02 42 ac 11 00 14 02 42 8c c0 84 74 08 00        .B.....B...t..
IPv4: martian source 172.17.0.20 from 172.98.71.211, on dev eth0
ll header: 00000000: 02 42 ac 11 00 14 02 42 8c c0 84 74 08 00        .B.....B...t..
IPv4: martian source 172.17.0.20 from 172.98.71.211, on dev eth0
ll header: 00000000: 02 42 ac 11 00 14 02 42 8c c0 84 74 08 00        .B.....B...t..
IPv4: martian source 172.17.0.20 from 154.3.42.11, on dev eth0
ll header: 00000000: 02 42 ac 11 00 14 02 42 8c c0 84 74 08 00        .B.....B...t..
IPv4: Redirect from 192.168.1.15 on ens33 about 192.168.1.241 ignored#012  Advised path = 192.168.1.33 -> 192.168.1.241
Modules linked in: veth nf_conntrack_netlink xt_addrtype br_netfilter dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache overlay nf_conntrack_netbios_ns nf_conntrack_broadcast xt_nat xt_mark ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash
dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 iosf_mbi snd_rawmidi snd_ac97_codec crc32_pclmul ac97_bus ppdev ghash_clmulni_intel snd_seq aesni_intel lrw gf128mul glue_helper snd_seq_device ablk_helper snd_pcm cryptd snd_timer vmw_balloon snd soundcore pcspkr joydev sg i2c_piix4 vmw_vmci parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc sch_fq_codel ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm nfit libnvdimm ata_piix serio_raw libata mptspi scsi_transport_spi e1000 mptscsih mptbase drm_panel_orientation_quirks
CPU: 2 PID: 55159 Comm: transmission-da Kdump: loaded Tainted: G        W    L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff935e83b062a0 ti: ffff935ffc8a0000 task.ti: ffff935ffc8a0000
RIP: 0010:[<ffffffffa7916f72>]  [<ffffffffa7916f72>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff935ffc8a3c20  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff935ffc8a3bf0 RCX: 0000000000000004
RDX: ffffffffa8013e50 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff935ffc8a3c70 R08: ffffffffa8013e48 R09: ffffffffa7a02718
R10: ffff9360b569f0a0 R11: ffffe598c010e040 R12: ffffffffa7a3cf5e
R13: ffff935ffc8a3be0 R14: ffff935fffdd7c00 R15: 0000000000000000
FS:  00007f7445028b20(0000) GS:ffff9360b5680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c000476000 CR3: 000000010559a000 CR4: 00000000003607e0
Call Trace:
[<ffffffffa787e730>] ? leave_mm+0x120/0x120
[<ffffffffa787e730>] ? leave_mm+0x120/0x120
[<ffffffffa787e730>] ? leave_mm+0x120/0x120
[<ffffffffa791708f>] smp_call_function_single+0x5f/0xa0
[<ffffffffa7b85005>] ? cpumask_next_and+0x35/0x50
[<ffffffffa791763b>] smp_call_function_many+0x22b/0x270
[<ffffffffa787e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa787e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa79ede36>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffffa79ef8ff>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffa79efa23>] tlb_finish_mmu+0x23/0x30
[<ffffffffa79f9234>] unmap_region+0xf4/0x140
[<ffffffffa79fb825>] do_munmap+0x2a5/0x480
[<ffffffffa79fba65>] vm_munmap+0x65/0xb0
[<ffffffffa79fcd02>] SyS_munmap+0x22/0x30
[<ffffffffa7f93166>] tracesys+0xa6/0xcc
Code: 89 de 48 03 14 c5 a0 10 55 a8 48 89 df e8 07 52 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #100982
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810e675a
Build id: 3.10.0-327.el7.x86_64
0xfa
2
? leave_mm
vmlinux 0xffffffff81065c90
Build id: 3.10.0-327.el7.x86_64
0x70
3
? leave_mm
vmlinux 0xffffffff81065c90
Build id: 3.10.0-327.el7.x86_64
0x70
4
? leave_mm
vmlinux 0xffffffff81065c90
Build id: 3.10.0-327.el7.x86_64
0x70
5
smp_call_function_single
vmlinux 0xffffffff810e685f
Build id: 3.10.0-327.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff812f2785
Build id: 3.10.0-327.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff810e6e03
Build id: 3.10.0-327.el7.x86_64
0x223
8
native_flush_tlb_others
vmlinux 0xffffffff81065e58
Build id: 3.10.0-327.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff81065f26
Build id: 3.10.0-327.el7.x86_64
0x66
10
tlb_flush_mmu.part.54
vmlinux 0xffffffff81192563
Build id: 3.10.0-327.el7.x86_64
0x33
11
tlb_finish_mmu
vmlinux 0xffffffff811930f5
Build id: 3.10.0-327.el7.x86_64
0x55
12
unmap_region
vmlinux 0xffffffff8119b2d2
Build id: 3.10.0-327.el7.x86_64
0xe2
13
do_munmap
vmlinux 0xffffffff8119d612
Build id: 3.10.0-327.el7.x86_64
0x242
14
vm_munmap
vmlinux 0xffffffff8119d821
Build id: 3.10.0-327.el7.x86_64
0x41
15
SyS_munmap
vmlinux 0xffffffff8119e772
Build id: 3.10.0-327.el7.x86_64
0x22
16
system_call_fastpath
vmlinux 0xffffffff81645909
Build id: 3.10.0-327.el7.x86_64
0x16
BUG: soft lockup - CPU#1 stuck for 22s! [tarantool:19305]
Modules linked in: vmw_vsock_vmci_transport vsock coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon pcspkr sg vmw_vmci parport_pc parport i2c_piix4 shpchp ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx ata_piix drm_kms_helper ttm mptspi scsi_transport_spi crct10dif_pclmul mptscsih drm crct10dif_common serio_raw crc32c_intel mptbase libata i2c_core e1000 floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 19305 Comm: tarantool Tainted: G             L ------------   3.10.0-327.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff8804256c8000 ti: ffff8804275a0000 task.ti: ffff8804275a0000
RIP: 0010:[<ffffffff810e675a>]  [<ffffffff810e675a>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff8804275a3c80  EFLAGS: 00000202
RAX: 00000000000008fd RBX: ffff88043fcd50a8 RCX: 0000000000000000
RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000282
RBP: ffff8804275a3cd0 R08: 0000000000000001 R09: ffff88043fc57520
R10: ffffffff811a2b52 R11: ffffea00045c8f40 R12: ffff88043ffd8000
R13: ffff880428425110 R14: 0000000200000000 R15: ffff88043ffd9000
FS:  00007f414200da80(0000) GS:ffff88043fc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000004129f000 CR3: 00000004234c1000 CR4: 00000000001407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff81065c90 ffff8804275a3d58
0000000000000003 000000002b02ceb2 0000000000000000 0000000000000000
ffffffff81065c90 ffffffff81065c90 ffff8804275a3d00 ffffffff810e685f
Call Trace:
[<ffffffff81065c90>] ? leave_mm+0x70/0x70
[<ffffffff81065c90>] ? leave_mm+0x70/0x70
[<ffffffff81065c90>] ? leave_mm+0x70/0x70
[<ffffffff810e685f>] smp_call_function_single+0x5f/0xa0
[<ffffffff812f2785>] ? cpumask_next_and+0x35/0x50
[<ffffffff810e6e03>] smp_call_function_many+0x223/0x260
[<ffffffff81065e58>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff81065f26>] flush_tlb_mm_range+0x66/0x140
[<ffffffff81192563>] tlb_flush_mmu.part.54+0x33/0xc0
[<ffffffff811930f5>] tlb_finish_mmu+0x55/0x60
[<ffffffff8119b2d2>] unmap_region+0xe2/0x130
[<ffffffff8119d612>] do_munmap+0x242/0x410
[<ffffffff8119d821>] vm_munmap+0x41/0x60
[<ffffffff8119e772>] SyS_munmap+0x22/0x30
[<ffffffff81645909>] system_call_fastpath+0x16/0x1b
Code: 40 52 01 00 48 89 de 48 03 14 c5 e0 b8 a5 81 48 89 df e8 da fc 21 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #51005
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff9c9163c2
Build id: 3.10.0-1062.9.1.el7.x86_64
0x102
2
? leave_mm
vmlinux 0xffffffff9c87e2b0
Build id: 3.10.0-1062.9.1.el7.x86_64
0x110
3
? leave_mm
vmlinux 0xffffffff9c87e2b0
Build id: 3.10.0-1062.9.1.el7.x86_64
0x110
4
? leave_mm
vmlinux 0xffffffff9c87e2b0
Build id: 3.10.0-1062.9.1.el7.x86_64
0x110
5
smp_call_function_single
vmlinux 0xffffffff9c9164df
Build id: 3.10.0-1062.9.1.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff9cb81635
Build id: 3.10.0-1062.9.1.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff9c916a8b
Build id: 3.10.0-1062.9.1.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff9c87e478
Build id: 3.10.0-1062.9.1.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9c87e4eb
Build id: 3.10.0-1062.9.1.el7.x86_64
0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff9c9ec026
Build id: 3.10.0-1062.9.1.el7.x86_64
0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffff9c9edaef
Build id: 3.10.0-1062.9.1.el7.x86_64
0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff9c9edc13
Build id: 3.10.0-1062.9.1.el7.x86_64
0x23
13
unmap_region
vmlinux 0xffffffff9c9f7404
Build id: 3.10.0-1062.9.1.el7.x86_64
0xf4
14
do_munmap
vmlinux 0xffffffff9c9f9a05
Build id: 3.10.0-1062.9.1.el7.x86_64
0x2a5
15
vm_munmap
vmlinux 0xffffffff9c9f9c45
Build id: 3.10.0-1062.9.1.el7.x86_64
0x65
16
SyS_munmap
vmlinux 0xffffffff9c9faee2
Build id: 3.10.0-1062.9.1.el7.x86_64
0x22
17
system_call_fastpath
vmlinux 0xffffffff9cf8dede
Build id: 3.10.0-1062.9.1.el7.x86_64
0x25
18
? system_call_after_swapgs
vmlinux 0xffffffff9cf8de21
Build id: 3.10.0-1062.9.1.el7.x86_64
0xae
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [yum:14269]
Modules linked in: binfmt_misc tcp_lp fuse tun xt_nat xt_mark ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ppdev crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev virtio_rng sg pcspkr parport_pc parport i2c_piix4 auth_rpcgss sunrpc ip_tables xfs libcrc32c virtio_console virtio_scsi virtio_net virtio_blk sr_mod cdrom ata_generic pata_acpi qxl drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel drm libata serio_raw virtio_pci virtio_ring virtio drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 14269 Comm: yum Kdump: loaded Tainted: G             L ------------   3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: oVirt oVirt Node, BIOS 1.11.0-2.el7 04/01/2014
task: ffff9dffe7efd230 ti: ffff9dff82058000 task.ti: ffff9dff82058000
RIP: 0010:[<ffffffff9c9163c2>]  [<ffffffff9c9163c2>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9dff8205bc20  EFLAGS: 00000202
RAX: 0000000000000010 RBX: ffff9dff8205bbf0 RCX: 0000000000000030
RDX: 000000000000ffff RSI: 0000000000000010 RDI: 0000000000000282
RBP: ffff9dff8205bc70 R08: ffffffff9d013540 R09: ffffffff9ca006a8
R10: ffff9e003925f0a0 R11: fffff1ab466f9b80 R12: ffffffff9ca3aa2e
R13: ffff9dff8205bbe0 R14: ffff9dffffd5c000 R15: 0000000000000000
FS:  00007f1f0daf5740(0000) GS:ffff9e0039240000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000019b2530 CR3: 00000001b77dc000 CR4: 00000000000206e0
Call Trace:
[<ffffffff9c87e2b0>] ? leave_mm+0x110/0x110
[<ffffffff9c87e2b0>] ? leave_mm+0x110/0x110
[<ffffffff9c87e2b0>] ? leave_mm+0x110/0x110
[<ffffffff9c9164df>] smp_call_function_single+0x5f/0xa0
[<ffffffff9cb81635>] ? cpumask_next_and+0x35/0x50
[<ffffffff9c916a8b>] smp_call_function_many+0x22b/0x270
[<ffffffff9c87e478>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9c87e4eb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9c9ec026>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffff9c9edaef>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff9c9edc13>] tlb_finish_mmu+0x23/0x30
[<ffffffff9c9f7404>] unmap_region+0xf4/0x140
[<ffffffff9c9f9a05>] do_munmap+0x2a5/0x480
[<ffffffff9c9f9c45>] vm_munmap+0x65/0xb0
[<ffffffff9c9faee2>] SyS_munmap+0x22/0x30
[<ffffffff9cf8dede>] system_call_fastpath+0x25/0x2a
[<ffffffff9cf8de21>] ? system_call_after_swapgs+0xae/0x146
Code: 89 de 48 03 14 c5 20 e8 54 9d 48 89 df e8 f7 22 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00