Info

Permalink
Function
generic_exec_single
First occurrence
2020-10-16
Last occurrence
2025-04-09
State
NEW
Components
kernel
Quality
-42

Statistics

Operating system Count
CentOS 7 27
Architecture Count
x86_64 27
Related packages Count
kernel 26
 0:3.10.0-693.el7 18
 0:3.10.0-693.11.1.el7 6
 0:3.10.0-1160.62.1.el7 2
kernel-plus 1
 0:3.10.0-693.11.1.el7.centos.plus 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #724413
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810f933a
Build id: 3.10.0-693.11.1.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.11.1.el7.x86_64 		0x70
3
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.11.1.el7.x86_64 		0x70
4
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.11.1.el7.x86_64 		0x70
5
smp_call_function_single
vmlinux 0xffffffff810f943f
Build id: 3.10.0-693.11.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff81322645
Build id: 3.10.0-693.11.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff810f99d3
Build id: 3.10.0-693.11.1.el7.x86_64 		0x223
8
native_flush_tlb_others
vmlinux 0xffffffff8106e668
Build id: 3.10.0-693.11.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8106e738
Build id: 3.10.0-693.11.1.el7.x86_64 		0x68
10
tlb_flush_mmu.part.63
vmlinux 0xffffffff811acfc3
Build id: 3.10.0-693.11.1.el7.x86_64 		0x33
11
tlb_finish_mmu
vmlinux 0xffffffff811ae2e5
Build id: 3.10.0-693.11.1.el7.x86_64 		0x55
12
unmap_region
vmlinux 0xffffffff811b53b4
Build id: 3.10.0-693.11.1.el7.x86_64 		0xf4
13
? lockref_put_or_lock
vmlinux 0xffffffff81331e98
Build id: 3.10.0-693.11.1.el7.x86_64 		0x48
14
? __vma_rb_erase
vmlinux 0xffffffff811b5971
Build id: 3.10.0-693.11.1.el7.x86_64 		0x121
15
do_munmap
vmlinux 0xffffffff811b7972
Build id: 3.10.0-693.11.1.el7.x86_64 		0x292
16
vm_munmap
vmlinux 0xffffffff811b7bb5
Build id: 3.10.0-693.11.1.el7.x86_64 		0x65
17
SyS_munmap
vmlinux 0xffffffff811b8cc2
Build id: 3.10.0-693.11.1.el7.x86_64 		0x22
18
system_call_fastpath
vmlinux 0xffffffff816b5089
Build id: 3.10.0-693.11.1.el7.x86_64 		0x16 
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [nbdisco:4510]
Modules linked in: nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache vmw_vsock_vmci_transport vsock ext4 mbcache jbd2 sb_edac edac_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev vmw_vmci sg pcspkr i2c_piix4 shpchp nfit libnvdimm parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod drm_kms_helper crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt ahci fb_sys_fops ttm libahci drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel libata serio_raw vmw_pvscsi vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 4510 Comm: nbdisco Tainted: G        W    L ------------   3.10.0-693.11.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff88081c84af70 ti: ffff8807f1f40000 task.ti: ffff8807f1f40000
RIP: 0010:[<ffffffff810f933a>]  [<ffffffff810f933a>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff8807f1f43c60  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff8807f1f43c30 RCX: 0000000000000001
RDX: ffffffff816ce470 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff8807f1f43cb0 R08: ffffffff816ce468 R09: ffffffff811bd7cc
R10: ffff88081d759bc0 R11: ffffea00200eb680 R12: ffffffff816b03a5
R13: ffff8807f1f43bf8 R14: ffffea0020654d00 R15: 0000000000000000
FS:  00007f3fc0ed3700(0000) GS:ffff88081d740000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3fdf020000 CR3: 00000007f876f000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff8106e4a0 ffff8807f1f43d38
0000000000000002 000000008f066a05 000000008f066a05 0000000000000000
ffffffff8106e4a0 ffffffff8106e4a0 ffff8807f1f43ce0 ffffffff810f943f
Call Trace:
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff810f943f>] smp_call_function_single+0x5f/0xa0
[<ffffffff81322645>] ? cpumask_next_and+0x35/0x50
[<ffffffff810f99d3>] smp_call_function_many+0x223/0x260
[<ffffffff8106e668>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8106e738>] flush_tlb_mm_range+0x68/0x140
[<ffffffff811acfc3>] tlb_flush_mmu.part.63+0x33/0xc0
[<ffffffff811ae2e5>] tlb_finish_mmu+0x55/0x60
[<ffffffff811b53b4>] unmap_region+0xf4/0x140
[<ffffffff81331e98>] ? lockref_put_or_lock+0x48/0x80
[<ffffffff811b5971>] ? __vma_rb_erase+0x121/0x220
[<ffffffff811b7972>] do_munmap+0x292/0x470
[<ffffffff811b7bb5>] vm_munmap+0x65/0xb0
[<ffffffff811b8cc2>] SyS_munmap+0x22/0x30
[<ffffffff816b5089>] system_call_fastpath+0x16/0x1b
Code: 00 78 01 00 48 89 de 48 03 14 c5 e0 fd b0 81 48 89 df e8 ba d9 23 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #8839
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff810f932a
Build id: 3.10.0-693.el7.x86_64 		0xfa
2
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.el7.x86_64 		0x70
3
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.el7.x86_64 		0x70
4
? leave_mm
vmlinux 0xffffffff8106e4a0
Build id: 3.10.0-693.el7.x86_64 		0x70
5
smp_call_function_single
vmlinux 0xffffffff810f942f
Build id: 3.10.0-693.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff813226f5
Build id: 3.10.0-693.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff810f99c3
Build id: 3.10.0-693.el7.x86_64 		0x223
8
native_flush_tlb_others
vmlinux 0xffffffff8106e668
Build id: 3.10.0-693.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8106e738
Build id: 3.10.0-693.el7.x86_64 		0x68
10
tlb_flush_mmu.part.63
vmlinux 0xffffffff811ad053
Build id: 3.10.0-693.el7.x86_64 		0x33
11
tlb_finish_mmu
vmlinux 0xffffffff811ae375
Build id: 3.10.0-693.el7.x86_64 		0x55
12
unmap_region
vmlinux 0xffffffff811b5444
Build id: 3.10.0-693.el7.x86_64 		0xf4
13
? lockref_put_or_lock
vmlinux 0xffffffff81331f48
Build id: 3.10.0-693.el7.x86_64 		0x48
14
? __vma_rb_erase
vmlinux 0xffffffff811b5a01
Build id: 3.10.0-693.el7.x86_64 		0x121
15
do_munmap
vmlinux 0xffffffff811b7a02
Build id: 3.10.0-693.el7.x86_64 		0x292
16
vm_munmap
vmlinux 0xffffffff811b7c45
Build id: 3.10.0-693.el7.x86_64 		0x65
17
SyS_munmap
vmlinux 0xffffffff811b8d52
Build id: 3.10.0-693.el7.x86_64 		0x22
18
system_call_fastpath
vmlinux 0xffffffff816b4fc9
Build id: 3.10.0-693.el7.x86_64 		0x16 
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [java:88037]
Modules linked in: xt_nat veth xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event edac_core snd_ens1371 iosf_mbi crc32_pclmul snd_rawmidi ghash_clmulni_intel snd_ac97_codec ppdev ac97_bus aesni_intel snd_seq lrw gf128mul glue_helper ablk_helper cryptd snd_seq_device snd_pcm vmw_balloon joydev sg snd_timer pcspkr vmw_vmci snd soundcore i2c_piix4 nfit shpchp libnvdimm parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic
sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi scsi_transport_spi ata_piix crct10dif_pclmul mptscsih crct10dif_common libata crc32c_intel mptbase e1000 serio_raw i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 6 PID: 88037 Comm: java Tainted: G               ------------ T 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff8801f4fb5ee0 ti: ffff88025c7b4000 task.ti: ffff88025c7b4000
RIP: 0010:[<ffffffff810f932a>]  [<ffffffff810f932a>] generic_exec_single+0xfa/0x1a0
RSP: 0018:ffff88025c7b7c60  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff88025c7b7c30 RCX: 0000000000000001
RDX: ffffffff816ce430 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff88025c7b7cb0 R08: ffffffff816ce428 R09: ffffffff811bd768
R10: ffff88042d799bc0 R11: ffffea000bd4ff00 R12: ffffffff816b02e5
R13: ffff88025c7b7bf8 R14: ffffea00107c4200 R15: 0000000000000000
FS:  00007f423c5ef700(0000) GS:ffff88042d780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f42a0615000 CR3: 00000001d0a82000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
0000000000000000 0000000000000000 ffffffff8106e4a0 ffff88025c7b7d38
0000000000000003 000000009c791199 ffff88025c7b7ca8 0000000000000000
ffffffff8106e4a0 ffffffff8106e4a0 ffff88025c7b7ce0 ffffffff810f942f
Call Trace:
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff8106e4a0>] ? leave_mm+0x70/0x70
[<ffffffff810f942f>] smp_call_function_single+0x5f/0xa0
[<ffffffff813226f5>] ? cpumask_next_and+0x35/0x50
[<ffffffff810f99c3>] smp_call_function_many+0x223/0x260
[<ffffffff8106e668>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8106e738>] flush_tlb_mm_range+0x68/0x140
[<ffffffff811ad053>] tlb_flush_mmu.part.63+0x33/0xc0
[<ffffffff811ae375>] tlb_finish_mmu+0x55/0x60
[<ffffffff811b5444>] unmap_region+0xf4/0x140
[<ffffffff81331f48>] ? lockref_put_or_lock+0x48/0x80
[<ffffffff811b5a01>] ? __vma_rb_erase+0x121/0x220
[<ffffffff811b7a02>] do_munmap+0x292/0x470
[<ffffffff811b7c45>] vm_munmap+0x65/0xb0
[<ffffffff811b8d52>] SyS_munmap+0x22/0x30
[<ffffffff816b4fc9>] system_call_fastpath+0x16/0x1b
Code: 00 78 01 00 48 89 de 48 03 14 c5 e0 fd b0 81 48 89 df e8 7a da 23 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #411579
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff90716b82
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff9067ddd0
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffff9067ddd0
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffff9067ddd0
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffff90716c9f
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff90986825
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff9071724b
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff9067e258
Build id: 3.10.0-1160.62.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9067e2cb
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff907ee666
Build id: 3.10.0-1160.62.1.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffff907f012f
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff907f0253
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x23
13
unmap_region
vmlinux 0xffffffff907f9a44
Build id: 3.10.0-1160.62.1.el7.x86_64 		0xf4
14
? fput
vmlinux 0xffffffff90850b70
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x10
15
? __vma_rb_erase
vmlinux 0xffffffff907fa001
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x121
16
do_munmap
vmlinux 0xffffffff907fc035
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x2a5
17
vm_munmap
vmlinux 0xffffffff907fc275
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x65
18
SyS_munmap
vmlinux 0xffffffff907fd572
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x22
19
system_call_fastpath
vmlinux 0xffffffff90d99f92
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 151s! [ftdc:15474]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13501(E) sctp falcon_lsm_pinned_13402(E) xt_nat veth ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter binfmt_misc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop overlay ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul
ghash_clmulni_intel aesni_intel lrw ppdev gf128mul vmw_balloon glue_helper ablk_helper cryptd vmw_vmci pcspkr joydev sg i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul libata crct10dif_common nfit libnvdimm crc32c_intel mptspi serio_raw scsi_transport_spi mptscsih vmxnet3 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: falcon_kal]
CPU: 2 PID: 15474 Comm: ftdc Kdump: loaded Tainted: P            EL ------------   3.10.0-1160.62.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffffa0c192983180 ti: ffffa0c1d03b4000 task.ti: ffffa0c1d03b4000
RIP: 0010:[<ffffffff90716b82>]  [<ffffffff90716b82>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffffa0c1d03b7c20  EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffffa0c1d03b7bf0 RCX: 000000000000003c
RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000282
RBP: ffffa0c1d03b7c70 R08: ffffffff90e137c0 R09: ffffffff9080306c
R10: ffffa0c43fd1f0a0 R11: ffffd78640415bc0 R12: 0000000000000001
R13: 0000000000000001 R14: ffffd7864ff82400 R15: 0000000100000001
FS:  00007ff5bfc1e700(0000) GS:ffffa0c43fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff5cf656000 CR3: 00000001aad32000 CR4: 00000000001607e0
Call Trace:
[<ffffffff9067ddd0>] ? leave_mm+0x120/0x120
[<ffffffff9067ddd0>] ? leave_mm+0x120/0x120
[<ffffffff9067ddd0>] ? leave_mm+0x120/0x120
[<ffffffff90716c9f>] smp_call_function_single+0x5f/0xa0
[<ffffffff90986825>] ? cpumask_next_and+0x35/0x50
[<ffffffff9071724b>] smp_call_function_many+0x22b/0x270
[<ffffffff9067e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9067e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff907ee666>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffff907f012f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff907f0253>] tlb_finish_mmu+0x23/0x30
[<ffffffff907f9a44>] unmap_region+0xf4/0x140
[<ffffffff90850b70>] ? fput+0x10/0x20
[<ffffffff907fa001>] ? __vma_rb_erase+0x121/0x220
[<ffffffff907fc035>] do_munmap+0x2a5/0x480
[<ffffffff907fc275>] vm_munmap+0x65/0xb0
[<ffffffff907fd572>] SyS_munmap+0x22/0x30
[<ffffffff90d99f92>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 60 18 35 91 48 89 df e8 17 6e 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00