Info

Permalink
Function
smp_call_function_many
First occurrence
2022-03-11
Last occurrence
2026-02-24
State
NEW
Components
kernel Tainted
Quality
-27

Statistics

Operating system Count
CentOS 7 44
Architecture Count
x86_64 44
Related packages Count
kernel 44
 0:3.10.0-514.el7 44

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #927818
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffff810f98e2
Build id: 3.10.0-514.el7.x86_64
0x202
2
? drain_pages
vmlinux 0xffffffff81189700
Build id: 3.10.0-514.el7.x86_64
0xb0
3
on_each_cpu_mask
vmlinux 0xffffffff810f9a2a
Build id: 3.10.0-514.el7.x86_64
0x2a
4
drain_all_pages
vmlinux 0xffffffff811865e5
Build id: 3.10.0-514.el7.x86_64
0xb5
5
__alloc_pages_slowpath
vmlinux 0xffffffff8168199a
Build id: 3.10.0-514.el7.x86_64
0x511
6
__alloc_pages_nodemask
vmlinux 0xffffffff8118af55
Build id: 3.10.0-514.el7.x86_64
0x405
7
copy_process
vmlinux 0xffffffff810830ad
Build id: 3.10.0-514.el7.x86_64
0x1dd
8
? _autofs_dev_ioctl
vmlinux 0xffffffff8128b549
Build id: 3.10.0-514.el7.x86_64
0x179
9
do_fork
vmlinux 0xffffffff810849e1
Build id: 3.10.0-514.el7.x86_64
0x91
10
? __fd_install
vmlinux 0xffffffff8121cb77
Build id: 3.10.0-514.el7.x86_64
0x47
11
SyS_clone
vmlinux 0xffffffff81084c96
Build id: 3.10.0-514.el7.x86_64
0x16
NMI watchdog: BUG: soft lockup - CPU#41 stuck for 22s! [systemd:1]
NMI watchdog: BUG: soft lockup - CPU#41 stuck for 22s! [systemd:1]
Modules linked in: binfmt_misc tcp_diag udp_diag inet_diag 8021q garp mrp stp llc nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter bonding nls_utf8 isofs xfs libcrc32c intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd iTCO_wdt iTCO_vendor_support pcspkr sg i2c_i801 mei_me shpchp i2c_core lpc_ich acpi_power_meter mei sb_edac edac_core ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel ahci ixgbe libahci mpt3sas mdio libata ptp raid_class pps_core scsi_ep_front(OE) scsi_transport_sas dca fjes dm_mirror dm_region_hash dm_log dm_mod
CPU: 41 PID: 1 Comm: systemd Tainted: G        W  OEL ------------   3.10.0-514.el7.x86_64 #1
Hardware name: Huawei RH2288H V3/BC11HGSA0, BIOS 3.87 02/02/2018
task: ffff8820f3d78000 ti: ffff88017389c000 task.ti: ffff88017389c000
RIP: 0010:[<ffffffff810f98e2>]  [<ffffffff810f98e2>] smp_call_function_many+0x202/0x260
RSP: 0018:ffff88017389fbf0  EFLAGS: 00000202
RAX: 0000000000000017 RBX: ffffffff81189700 RCX: ffff883fff05b460
RDX: 0000000000000017 RSI: 0000000000000038 RDI: 0000000000000000
RBP: ffff88017389fc28 R08: ffff88017319a000 R09: ffffffff81317a89
R10: ffff8820000d9b40 R11: ffffea006a12e000 R12: 0000000000000282
R13: ffff88017389fba0 R14: 000000000000156d R15: 0000000001320122
FS:  00007fbdac1ca940(0000) GS:ffff8820000c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f58f7423818 CR3: 0000003ff9fd9000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
0000000100000040 ffffffff81eeef80 ffffffff81eeef80 ffffffff81189700
0000000000000000 0000000000000029 ffff88207ffda000 ffff88017389fc58
ffffffff810f9a2a 0000000000000037 0000000000000038 0000000000000038
Call Trace:
[<ffffffff81189700>] ? drain_pages+0xb0/0xb0
[<ffffffff810f9a2a>] on_each_cpu_mask+0x2a/0x60
[<ffffffff811865e5>] drain_all_pages+0xb5/0xc0
[<ffffffff8168199a>] __alloc_pages_slowpath+0x511/0x725
[<ffffffff8118af55>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff810830ad>] copy_process+0x1dd/0x1960
[<ffffffff8128b549>] ? _autofs_dev_ioctl+0x179/0x380
[<ffffffff810849e1>] do_fork+0x91/0x2c0
[<ffffffff8121cb77>] ? __fd_install+0x47/0x60
[<ffffffff81084c96>] SyS_clone+0x16/0x20
Complete report #372357
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffff810f98e6
Build id: 3.10.0-514.el7.x86_64
0x206
2
? drain_pages
vmlinux 0xffffffff81189700
Build id: 3.10.0-514.el7.x86_64
0xb0
3
on_each_cpu_mask
vmlinux 0xffffffff810f9a2a
Build id: 3.10.0-514.el7.x86_64
0x2a
4
drain_all_pages
vmlinux 0xffffffff811865e5
Build id: 3.10.0-514.el7.x86_64
0xb5
5
__alloc_pages_slowpath
vmlinux 0xffffffff8168199a
Build id: 3.10.0-514.el7.x86_64
0x511
6
__alloc_pages_nodemask
vmlinux 0xffffffff8118af55
Build id: 3.10.0-514.el7.x86_64
0x405
7
copy_process
vmlinux 0xffffffff810830ad
Build id: 3.10.0-514.el7.x86_64
0x1dd
8
? _autofs_dev_ioctl
vmlinux 0xffffffff8128b549
Build id: 3.10.0-514.el7.x86_64
0x179
9
do_fork
vmlinux 0xffffffff810849e1
Build id: 3.10.0-514.el7.x86_64
0x91
10
? __fd_install
vmlinux 0xffffffff8121cb77
Build id: 3.10.0-514.el7.x86_64
0x47
11
SyS_clone
vmlinux 0xffffffff81084c96
Build id: 3.10.0-514.el7.x86_64
0x16
12
stub_clone
vmlinux 0xffffffff81696919
Build id: 3.10.0-514.el7.x86_64
0x69
13
? system_call_fastpath
vmlinux 0xffffffff816965c9
Build id: 3.10.0-514.el7.x86_64
0x16
NMI watchdog: BUG: soft lockup - CPU#30 stuck for 22s! [systemd:1]
Modules linked in: tcp_diag inet_diag 8021q garp mrp stp llc bonding nls_utf8 isofs sunrpc iTCO_wdt iTCO_vendor_support intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel ixgbe aesni_intel lrw ptp gf128mul pps_core glue_helper mdio ablk_helper sb_edac sg dca cryptd edac_core shpchp pcspkr mei_me i2c_i801 mei lpc_ich i2c_core fjes acpi_power_meter binfmt_misc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel ahci libahci mpt3sas libata raid_class scsi_transport_sas scsi_ep_front(OE) dm_mirror dm_region_hash dm_log dm_mod
CPU: 30 PID: 1 Comm: systemd Tainted: G           OEL ------------   3.10.0-514.el7.x86_64 #1
Hardware name: Huawei RH2288H V3/BC11HGSA0, BIOS 5.03 07/25/2018
task: ffff8801679e8000 ti: ffff8801679f0000 task.ti: ffff8801679f0000
RIP: 0010:[<ffffffff810f98e6>]  [<ffffffff810f98e6>] smp_call_function_many+0x206/0x260
RSP: 0018:ffff8801679f3bf0  EFLAGS: 00000202
RAX: 0000000000000000 RBX: ffffffff81189700 RCX: ffff883f7ec1b230
RDX: 0000000000000000 RSI: 0000000000000038 RDI: 0000000000000000
RBP: ffff8801679f3c28 R08: ffff880166ff9800 R09: ffffffff81317a89
R10: ffff883f7f399b40 R11: ffffea0012b63600 R12: 0000000000000282
R13: ffff8801679f3ba0 R14: 000000000000074f R15: 0000000001320122
FS:  00007fd5b190e940(0000) GS:ffff883f7f380000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd5b1928000 CR3: 00000037423f6000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
0000000100000040 ffffffff81eeef80 ffffffff81eeef80 ffffffff81189700
0000000000000000 000000000000001e ffff88407ffd8000 ffff8801679f3c58
ffffffff810f9a2a 0000000000000037 0000000000000038 0000000000000038
Call Trace:
[<ffffffff81189700>] ? drain_pages+0xb0/0xb0
[<ffffffff810f9a2a>] on_each_cpu_mask+0x2a/0x60
[<ffffffff811865e5>] drain_all_pages+0xb5/0xc0
[<ffffffff8168199a>] __alloc_pages_slowpath+0x511/0x725
[<ffffffff8118af55>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff810830ad>] copy_process+0x1dd/0x1960
[<ffffffff8128b549>] ? _autofs_dev_ioctl+0x179/0x380
[<ffffffff810849e1>] do_fork+0x91/0x2c0
[<ffffffff8121cb77>] ? __fd_install+0x47/0x60
[<ffffffff81084c96>] SyS_clone+0x16/0x20
[<ffffffff81696919>] stub_clone+0x69/0x90
[<ffffffff816965c9>] ? system_call_fastpath+0x16/0x1b
Code: 9e 9e 00 89 c2 39 f0 0f 8d 86 fe ff ff 48 98 49 8b 0f 48 03 0c c5 40 57 ad 81 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 f6 41 20 01 <75> f8 48 63 35 45 9e 9e 00 eb b7 0f b6 4d cc 4c 89 f2 4c 89 ee