Info

Permalink
Function
smp_call_function_many
First occurrence
2021-03-23
Last occurrence
2026-09-28
State
NEW
Components
kernel
Quality
-20

Statistics

Operating system Count
CentOS 7 29
Architecture Count
x86_64 29
Related packages Count
kernel 29
 0:3.10.0-693.el7 26
 0:3.10.0-693.2.2.el7 3

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #1117899
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffff810f99a2
Build id: 3.10.0-693.el7.x86_64
0x202
2
native_flush_tlb_others
vmlinux 0xffffffff8106e668
Build id: 3.10.0-693.el7.x86_64
0xb8
3
flush_tlb_mm_range
vmlinux 0xffffffff8106e738
Build id: 3.10.0-693.el7.x86_64
0x68
4
tlb_flush_mmu.part.63
vmlinux 0xffffffff811ad053
Build id: 3.10.0-693.el7.x86_64
0x33
5
tlb_finish_mmu
vmlinux 0xffffffff811ae375
Build id: 3.10.0-693.el7.x86_64
0x55
6
zap_page_range
vmlinux 0xffffffff811b08fa
Build id: 3.10.0-693.el7.x86_64
0x13a
7
? do_mmap_pgoff
vmlinux 0xffffffff811b8c6e
Build id: 3.10.0-693.el7.x86_64
0x31e
8
SyS_madvise
vmlinux 0xffffffff811ac71d
Build id: 3.10.0-693.el7.x86_64
0x3cd
9
system_call_fastpath
vmlinux 0xffffffff816b4fc9
Build id: 3.10.0-693.el7.x86_64
0x16
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [HandshakeComple:51984]
Modules linked in: binfmt_misc nls_utf8 isofs xfs qax_tq_base(OE) iptable_filter ip_tables ip_set nfnetlink bridge stp llc libcrc32c tq_base(OE) ppdev sg virtio_balloon parport_pc joydev pcspkr parport i2c_piix4 ext4 mbcache jbd2 sr_mod cdrom ata_generic pata_acpi virtio_net virtio_console virtio_scsi virtio_blk cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ata_piix ttm drm libata serio_raw virtio_pci virtio_ring virtio i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: qax_tq_base]
CPU: 1 PID: 51984 Comm: HandshakeComple Tainted: G           OEL ------------   3.10.0-693.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff880ff126eeb0 ti: ffff880e2757c000 task.ti: ffff880e2757c000
RIP: 0010:[<ffffffff810f99a2>]  [<ffffffff810f99a2>] smp_call_function_many+0x202/0x260
RSP: 0018:ffff880e2757fcb0  EFLAGS: 00000202
RAX: 0000000000000002 RBX: 000800008106e4a0 RCX: ffff880ffce9a6c8
RDX: 0000000000000002 RSI: 00000000000000a0 RDI: 0000000000000000
RBP: ffff880e2757fce8 R08: ffff8801694c3400 R09: ffffffff813227d9
R10: ffff880ffce59c80 R11: ffffea00006c0800 R12: 0000000000000282
R13: 0000000000000282 R14: ffff880e2757fc60 R15: 0000000000000001
FS:  00007f0ec58cc700(0000) GS:ffff880ffce40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0ec58b62b8 CR3: 0000000b136fa000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
00000001c58c6fff ffff8800a73ac808 ffff8800a73ac4c0 0000000000000000
ffffffffffffffff ffff8800a73ac808 ffff8800a73ac4c0 ffff880e2757fd38
ffffffff8106e668 ffff8800a73ac4c0 0000000000000000 ffffffffffffffff
Call Trace:
[<ffffffff8106e668>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8106e738>] flush_tlb_mm_range+0x68/0x140
[<ffffffff811ad053>] tlb_flush_mmu.part.63+0x33/0xc0
[<ffffffff811ae375>] tlb_finish_mmu+0x55/0x60
[<ffffffff811b08fa>] zap_page_range+0x13a/0x180
[<ffffffff811b8c6e>] ? do_mmap_pgoff+0x31e/0x3e0
[<ffffffff811ac71d>] SyS_madvise+0x3cd/0x9c0
[<ffffffff816b4fc9>] system_call_fastpath+0x16/0x1b
Code: 48 63 35 26 45 a2 00 89 c2 39 f0 0f 8d 85 fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 fd b0 81 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 f5 44 a2 00 eb b7 0f b6 4d cc 4c 89 
Complete report #107248
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffff810f99a2
Build id: 3.10.0-693.2.2.el7.x86_64
0x202
2
native_flush_tlb_others
vmlinux 0xffffffff8106e668
Build id: 3.10.0-693.2.2.el7.x86_64
0xb8
3
flush_tlb_mm_range
vmlinux 0xffffffff8106e738
Build id: 3.10.0-693.2.2.el7.x86_64
0x68
4
tlb_flush_mmu.part.63
vmlinux 0xffffffff811ad053
Build id: 3.10.0-693.2.2.el7.x86_64
0x33
5
tlb_finish_mmu
vmlinux 0xffffffff811ae375
Build id: 3.10.0-693.2.2.el7.x86_64
0x55
6
zap_page_range
vmlinux 0xffffffff811b08fa
Build id: 3.10.0-693.2.2.el7.x86_64
0x13a
7
? do_mmap_pgoff
vmlinux 0xffffffff811b8c6e
Build id: 3.10.0-693.2.2.el7.x86_64
0x31e
8
SyS_madvise
vmlinux 0xffffffff811ac71d
Build id: 3.10.0-693.2.2.el7.x86_64
0x3cd
9
? vm_mmap_pgoff
vmlinux 0xffffffff811a12c2
Build id: 3.10.0-693.2.2.el7.x86_64
0xe2
10
system_call_fastpath
vmlinux 0xffffffff816b5009
Build id: 3.10.0-693.2.2.el7.x86_64
0x16
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [java:26120]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter arc4 md4 nls_utf8 cifs dns_resolver vmw_vsock_vmci_transport vsock sb_edac edac_core ppdev coretemp iosf_mbi vmw_balloon crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport shpchp vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi
e1000 scsi_transport_spi mptscsih libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 26120 Comm: java Not tainted 3.10.0-693.2.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff8806c62d8fd0 ti: ffff8803b2a14000 task.ti: ffff8803b2a14000
RIP: 0010:[<ffffffff810f99a2>]  [<ffffffff810f99a2>] smp_call_function_many+0x202/0x260
RSP: 0018:ffff8803b2a17cb0  EFLAGS: 00000202
RAX: 0000000000000002 RBX: 000c00008106e4a0 RCX: ffff88080fd1af20
RDX: 0000000000000002 RSI: 0000000000000004 RDI: 0000000000000000
RBP: ffff8803b2a17ce8 R08: ffff880174fe6400 R09: ffffffff813229e9
R10: ffff88080fc99c80 R11: ffffea001f52a800 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8803b2a17c60 R15: 0000000000000001
FS:  00007fde439f9700(0000) GS:ffff88080fc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000014309b0 CR3: 00000007d57f7000 CR4: 00000000001407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
00000001439f3fff ffff88074b3d4e48 ffff88074b3d4b00 0000000000000000
ffffffffffffffff ffff88074b3d4e48 ffff88074b3d4b00 ffff8803b2a17d38
ffffffff8106e668 ffff88074b3d4b00 0000000000000000 ffffffffffffffff
Call Trace:
[<ffffffff8106e668>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8106e738>] flush_tlb_mm_range+0x68/0x140
[<ffffffff811ad053>] tlb_flush_mmu.part.63+0x33/0xc0
[<ffffffff811ae375>] tlb_finish_mmu+0x55/0x60
[<ffffffff811b08fa>] zap_page_range+0x13a/0x180
[<ffffffff811b8c6e>] ? do_mmap_pgoff+0x31e/0x3e0
[<ffffffff811ac71d>] SyS_madvise+0x3cd/0x9c0
[<ffffffff811a12c2>] ? vm_mmap_pgoff+0xe2/0x110
[<ffffffff816b5009>] system_call_fastpath+0x16/0x1b
Code: 48 63 35 26 45 a2 00 89 c2 39 f0 0f 8d 85 fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 fd b0 81 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 f5 44 a2 00 eb b7 0f b6 4d cc 4c 89