Info

Permalink
Function
native_queued_spin_lock_slowpath
First occurrence
2020-11-27
Last occurrence
2026-02-19
State
NEW
Components
kernel
Quality
-72

Statistics

Operating system Count
CentOS 7 233
Architecture Count
x86_64 233
Related packages Count
kernel 233
 0:3.10.0-957.el7 175
 0:3.10.0-1160.76.1.el7 30
 0:3.10.0-1160.el7 15
 0:3.10.0-1160.119.1.el7 3
 0:3.10.0-1127.el7 3
 0:3.10.0-1160.83.1.el7 2
 0:3.10.0-1062.18.1.el7 1
 0:3.10.0-1160.119.1.el7.tuxcare.els19 1
 0:3.10.0-1160.21.1.el7 1
 0:3.10.0-1160.49.1.el7 1
 0:3.10.0-957.1.3.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #303118
Frame # Function Binary Source or offset Line
1
native_queued_spin_lock_slowpath
vmlinux 0xffffffffbb712102
Build id: 3.10.0-957.el7.x86_64
0x122
2
queued_spin_lock_slowpath
vmlinux 0xffffffffbbd5bf4b
Build id: 3.10.0-957.el7.x86_64
0xb
3
_raw_spin_lock
vmlinux 0xffffffffbbd6a400
Build id: 3.10.0-957.el7.x86_64
0x20
4
__page_check_address
vmlinux 0xffffffffbb7f67f2
Build id: 3.10.0-957.el7.x86_64
0x102
5
try_to_unmap_one
vmlinux 0xffffffffbb7f715b
Build id: 3.10.0-957.el7.x86_64
0x7b
6
? rmap_walk
vmlinux 0xffffffffbb7f8b49
Build id: 3.10.0-957.el7.x86_64
0x2b9
7
rmap_walk
vmlinux 0xffffffffbb7f8af6
Build id: 3.10.0-957.el7.x86_64
0x266
8
try_to_unmap
vmlinux 0xffffffffbb7f8e5b
Build id: 3.10.0-957.el7.x86_64
0x8b
9
? page_remove_rmap
vmlinux 0xffffffffbb7f70e0
Build id: 3.10.0-957.el7.x86_64
0x160
10
? invalid_migration_vma
vmlinux 0xffffffffbb7f6250
Build id: 3.10.0-957.el7.x86_64
0x30
11
? try_to_unmap_one
vmlinux 0xffffffffbb7f7930
Build id: 3.10.0-957.el7.x86_64
0x850
12
? page_get_anon_vma
vmlinux 0xffffffffbb7f8780
Build id: 3.10.0-957.el7.x86_64
0xa0
13
? invalid_mkclean_vma
vmlinux 0xffffffffbb7f6220
Build id: 3.10.0-957.el7.x86_64
0x20
14
migrate_pages
vmlinux 0xffffffffbb82469f
Build id: 3.10.0-957.el7.x86_64
0x43f
15
? __reset_isolation_suitable
vmlinux 0xffffffffbb7dce10
Build id: 3.10.0-957.el7.x86_64
0x120
16
compact_zone
vmlinux 0xffffffffbb7dded0
Build id: 3.10.0-957.el7.x86_64
0x2f0
17
compact_zone_order
vmlinux 0xffffffffbb7de0bc
Build id: 3.10.0-957.el7.x86_64
0x9c
18
try_to_compact_pages
vmlinux 0xffffffffbb7de481
Build id: 3.10.0-957.el7.x86_64
0x121
19
__alloc_pages_direct_compact
vmlinux 0xffffffffbbd5cc31
Build id: 3.10.0-957.el7.x86_64
0xac
20
__alloc_pages_slowpath
vmlinux 0xffffffffbbd5d101
Build id: 3.10.0-957.el7.x86_64
0x3e9
21
? ___slab_alloc
vmlinux 0xffffffffbb81a500
Build id: 3.10.0-957.el7.x86_64
0x130
22
__alloc_pages_nodemask
vmlinux 0xffffffffbb7c0e95
Build id: 3.10.0-957.el7.x86_64
0x405
23
copy_process
vmlinux 0xffffffffbb694cdd
Build id: 3.10.0-957.el7.x86_64
0x1dd
24
do_fork
vmlinux 0xffffffffbb6966f1
Build id: 3.10.0-957.el7.x86_64
0x91
25
? system_call_after_swapgs
vmlinux 0xffffffffbbd74d15
Build id: 3.10.0-957.el7.x86_64
0xa2
26
? system_call_after_swapgs
vmlinux 0xffffffffbbd74d21
Build id: 3.10.0-957.el7.x86_64
0xae
27
? system_call_after_swapgs
vmlinux 0xffffffffbbd74d15
Build id: 3.10.0-957.el7.x86_64
0xa2
28
? system_call_after_swapgs
vmlinux 0xffffffffbbd74d21
Build id: 3.10.0-957.el7.x86_64
0xae
29
? system_call_after_swapgs
vmlinux 0xffffffffbbd74d15
Build id: 3.10.0-957.el7.x86_64
0xa2
30
SyS_clone
vmlinux 0xffffffffbb696a06
Build id: 3.10.0-957.el7.x86_64
0x16
31
stub_clone
vmlinux 0xffffffffbbd751a4
Build id: 3.10.0-957.el7.x86_64
0x44
32
? system_call_fastpath
vmlinux 0xffffffffbbd74ddb
Build id: 3.10.0-957.el7.x86_64
0x22
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [abrt-server:22660]
Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter intel_powerclamp coretemp kvm irqbypass iTCO_wdt crc32_pclmul iTCO_vendor_support ghash_clmulni_intel ipmi_ssif aesni_intel lrw gf128mul glue_helper dcdbas ablk_helper cryptd joydev pcspkr sg ipmi_si ipmi_devintf ipmi_msghandler lpc_ich i2c_i801 ioatdma i7core_edac acpi_cpufreq ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ast drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci libahci drm crct10dif_pclmul crct10dif_common crc32c_intel igb libata drm_panel_orientation_quirks ptp pps_core dca i2c_algo_bit dm_mirror dm_region_hash dm_log dm_mod
CPU: 4 PID: 22660 Comm: abrt-server Kdump: loaded Tainted: G             L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: Dell Inc.  C6100           /0D61XP, BIOS 1.66 12/23/2011
task: ffff99fa77d66180 ti: ffff99fa77c04000 task.ti: ffff99fa77c04000
RIP: 0010:[<ffffffffbb712102>]  [<ffffffffbb712102>] native_queued_spin_lock_slowpath+0x122/0x200
RSP: 0018:ffff99fa77c078b8  EFLAGS: 00000246
RAX: 0000000000000000 RBX: 0000000100000101 RCX: 0000000000210000
RDX: ffff9a01ff69b780 RSI: 0000000000410101 RDI: fffff76c2046c4f0
RBP: ffff99fa77c078b8 R08: ffff99fdefb1b780 R09: 0000000000000000
R10: ffff9a01fffda000 R11: 0000000000000000 R12: ffff99fa77c07868
R13: ffffffffbc3583e0 R14: 0000000000000004 R15: ffffffffbb975465
FS:  00007f504f068900(0000) GS:ffff99fdefb00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f504f08c000 CR3: 0000000427f14000 CR4: 00000000000207e0
Call Trace:
[<ffffffffbbd5bf4b>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffffbbd6a400>] _raw_spin_lock+0x20/0x30
[<ffffffffbb7f67f2>] __page_check_address+0x102/0x250
[<ffffffffbb7f715b>] try_to_unmap_one+0x7b/0x850
[<ffffffffbb7f8b49>] ? rmap_walk+0x2b9/0x360
[<ffffffffbb7f8af6>] rmap_walk+0x266/0x360
[<ffffffffbb7f8e5b>] try_to_unmap+0x8b/0xe0
[<ffffffffbb7f70e0>] ? page_remove_rmap+0x160/0x160
[<ffffffffbb7f6250>] ? invalid_migration_vma+0x30/0x30
[<ffffffffbb7f7930>] ? try_to_unmap_one+0x850/0x850
[<ffffffffbb7f8780>] ? page_get_anon_vma+0xa0/0xa0
[<ffffffffbb7f6220>] ? invalid_mkclean_vma+0x20/0x20
[<ffffffffbb82469f>] migrate_pages+0x43f/0x790
[<ffffffffbb7dce10>] ? __reset_isolation_suitable+0x120/0x120
[<ffffffffbb7dded0>] compact_zone+0x2f0/0x440
[<ffffffffbb7de0bc>] compact_zone_order+0x9c/0xf0
[<ffffffffbb7de481>] try_to_compact_pages+0x121/0x1a0
[<ffffffffbbd5cc31>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffffbbd5d101>] __alloc_pages_slowpath+0x3e9/0x724
[<ffffffffbb81a500>] ? ___slab_alloc+0x130/0x4f0
[<ffffffffbb7c0e95>] __alloc_pages_nodemask+0x405/0x420
[<ffffffffbb694cdd>] copy_process+0x1dd/0x1a40
[<ffffffffbb6966f1>] do_fork+0x91/0x320
[<ffffffffbbd74d15>] ? system_call_after_swapgs+0xa2/0x146
[<ffffffffbbd74d21>] ? system_call_after_swapgs+0xae/0x146
[<ffffffffbbd74d15>] ? system_call_after_swapgs+0xa2/0x146
[<ffffffffbbd74d21>] ? system_call_after_swapgs+0xae/0x146
[<ffffffffbbd74d15>] ? system_call_after_swapgs+0xa2/0x146
[<ffffffffbb696a06>] SyS_clone+0x16/0x20
[<ffffffffbbd751a4>] stub_clone+0x44/0x70
[<ffffffffbbd74ddb>] ? system_call_fastpath+0x22/0x27
Code: 13 48 c1 ea 0d 48 98 83 e2 30 48 81 c2 80 b7 01 00 48 03 14 c5 60 b9 34 bc 4c 89 02 41 8b 40 08 85 c0 75 0f 0f 1f 44 00 00 f3 90 <41> 8b 40 08 85 c0 74 f6 4d 8b 08 4d 85 c9 74 04 41 0f 18 09 8b 
Complete report #18598
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffff8ff16cba
Build id: 3.10.0-1062.18.1.el7.x86_64
0x20a
2
native_flush_tlb_others
vmlinux 0xffffffff8fe7e608
Build id: 3.10.0-1062.18.1.el7.x86_64
0xb8
3
flush_tlb_page
vmlinux 0xffffffff8fe7e7a4
Build id: 3.10.0-1062.18.1.el7.x86_64
0x54
4
ptep_clear_flush
vmlinux 0xffffffff90005638
Build id: 3.10.0-1062.18.1.el7.x86_64
0x68
5
try_to_unmap_one
vmlinux 0xffffffff8ffff2b8
Build id: 3.10.0-1062.18.1.el7.x86_64
0x158
6
rmap_walk
vmlinux 0xffffffff90000b66
Build id: 3.10.0-1062.18.1.el7.x86_64
0x266
7
try_to_unmap
vmlinux 0xffffffff90000ecb
Build id: 3.10.0-1062.18.1.el7.x86_64
0x8b
8
? page_remove_rmap
vmlinux 0xffffffff8ffff160
Build id: 3.10.0-1062.18.1.el7.x86_64
0x160
9
? invalid_migration_vma
vmlinux 0xffffffff8fffe270
Build id: 3.10.0-1062.18.1.el7.x86_64
0x30
10
? try_to_unmap_one
vmlinux 0xffffffff8ffff9c0
Build id: 3.10.0-1062.18.1.el7.x86_64
0x860
11
? page_get_anon_vma
vmlinux 0xffffffff90000360
Build id: 3.10.0-1062.18.1.el7.x86_64
0x80
12
? invalid_mkclean_vma
vmlinux 0xffffffff8fffe240
Build id: 3.10.0-1062.18.1.el7.x86_64
0x20
13
migrate_pages
vmlinux 0xffffffff9002dbaf
Build id: 3.10.0-1062.18.1.el7.x86_64
0x35f
14
? __reset_isolation_suitable
vmlinux 0xffffffff8ffe48c0
Build id: 3.10.0-1062.18.1.el7.x86_64
0x120
15
compact_zone
vmlinux 0xffffffff8ffe59dd
Build id: 3.10.0-1062.18.1.el7.x86_64
0x34d
16
compact_zone_order
vmlinux 0xffffffff8ffe5bcd
Build id: 3.10.0-1062.18.1.el7.x86_64
0x6d
17
try_to_compact_pages
vmlinux 0xffffffff8ffe5f71
Build id: 3.10.0-1062.18.1.el7.x86_64
0x121
18
__alloc_pages_direct_compact
vmlinux 0xffffffff905761e8
Build id: 3.10.0-1062.18.1.el7.x86_64
0xac
19
__alloc_pages_slowpath
vmlinux 0xffffffff905766b8
Build id: 3.10.0-1062.18.1.el7.x86_64
0x3e9
20
__alloc_pages_nodemask
vmlinux 0xffffffff8ffc8636
Build id: 3.10.0-1062.18.1.el7.x86_64
0x436
21
copy_process
vmlinux 0xffffffff8fe990cd
Build id: 3.10.0-1062.18.1.el7.x86_64
0x1dd
22
do_fork
vmlinux 0xffffffff8fe9aaf1
Build id: 3.10.0-1062.18.1.el7.x86_64
0x91
23
? system_call_after_swapgs
vmlinux 0xffffffff9058de15
Build id: 3.10.0-1062.18.1.el7.x86_64
0xa2
24
? system_call_after_swapgs
vmlinux 0xffffffff9058de21
Build id: 3.10.0-1062.18.1.el7.x86_64
0xae
25
? system_call_after_swapgs
vmlinux 0xffffffff9058de15
Build id: 3.10.0-1062.18.1.el7.x86_64
0xa2
26
? system_call_after_swapgs
vmlinux 0xffffffff9058de21
Build id: 3.10.0-1062.18.1.el7.x86_64
0xae
27
? system_call_after_swapgs
vmlinux 0xffffffff9058de15
Build id: 3.10.0-1062.18.1.el7.x86_64
0xa2
28
SyS_clone
vmlinux 0xffffffff8fe9ae16
Build id: 3.10.0-1062.18.1.el7.x86_64
0x16
29
stub_clone
vmlinux 0xffffffff9058e2b4
Build id: 3.10.0-1062.18.1.el7.x86_64
0x44
30
? system_call_fastpath
vmlinux 0xffffffff9058dede
Build id: 3.10.0-1062.18.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [zabbix_agentd:1096]
Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sg i2c_piix4 joydev pcspkr virtio_balloon ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_common ata_generic pata_acpi virtio_net virtio_console bochs_drm drm_kms_helper ata_piix syscopyarea sysfillrect sysimgblt fb_sys_fops ttm libata drm serio_raw virtio_pci virtio_ring virtio drm_panel_orientation_quirks floppy
dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 1096 Comm: zabbix_agentd Tainted: G             L ------------   3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.13.0-48-gd9c812dda519-prebuilt.qemu.org 04/01/2014
task: ffff97e4ba48b150 ti: ffff97e4bd398000 task.ti: ffff97e4bd398000
RIP: 0010:[<ffffffff8ff16cba>]  [<ffffffff8ff16cba>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff97e4bd39b838  EFLAGS: 00000202
RAX: 0000000000000002 RBX: 00000000000000fc RCX: ffff97e4bfd20298
RDX: 0000000000000002 RSI: 0000000000000004 RDI: 0000000000000000
RBP: ffff97e4bd39b870 R08: ffff97e4bd40d000 R09: ffffffff901819f9
R10: ffff97e4bfc9f160 R11: ffffdd6dc0edd300 R12: 0000000000000292
R13: ffff97e4bd39b7e8 R14: ffff97e4bd39b7a0 R15: ffff97e4ba48b1b8
FS:  00007f0ec002b840(0000) GS:ffff97e4bfc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000002f73001 CR3: 000000003d38a000 CR4: 00000000000006e0
Call Trace:
[<ffffffff8fe7e608>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8fe7e7a4>] flush_tlb_page+0x54/0xa0
[<ffffffff90005638>] ptep_clear_flush+0x68/0xa0
[<ffffffff8ffff2b8>] try_to_unmap_one+0x158/0x860
[<ffffffff90000b66>] rmap_walk+0x266/0x360
[<ffffffff90000ecb>] try_to_unmap+0x8b/0xe0
[<ffffffff8ffff160>] ? page_remove_rmap+0x160/0x160
[<ffffffff8fffe270>] ? invalid_migration_vma+0x30/0x30
[<ffffffff8ffff9c0>] ? try_to_unmap_one+0x860/0x860
[<ffffffff90000360>] ? page_get_anon_vma+0x80/0x80
[<ffffffff8fffe240>] ? invalid_mkclean_vma+0x20/0x20
[<ffffffff9002dbaf>] migrate_pages+0x35f/0x7f0
[<ffffffff8ffe48c0>] ? __reset_isolation_suitable+0x120/0x120
[<ffffffff8ffe59dd>] compact_zone+0x34d/0x4d0
[<ffffffff8ffe5bcd>] compact_zone_order+0x6d/0xa0
[<ffffffff8ffe5f71>] try_to_compact_pages+0x121/0x1a0
[<ffffffff905761e8>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff905766b8>] __alloc_pages_slowpath+0x3e9/0x729
[<ffffffff8ffc8636>] __alloc_pages_nodemask+0x436/0x450
[<ffffffff8fe990cd>] copy_process+0x1dd/0x1a50
[<ffffffff8fe9aaf1>] do_fork+0x91/0x330
[<ffffffff9058de15>] ? system_call_after_swapgs+0xa2/0x146
[<ffffffff9058de21>] ? system_call_after_swapgs+0xae/0x146
[<ffffffff9058de15>] ? system_call_after_swapgs+0xa2/0x146
[<ffffffff9058de21>] ? system_call_after_swapgs+0xae/0x146
[<ffffffff9058de15>] ? system_call_after_swapgs+0xa2/0x146
[<ffffffff8fe9ae16>] SyS_clone+0x16/0x20
[<ffffffff9058e2b4>] stub_clone+0x44/0x70
[<ffffffff9058dede>] ? system_call_fastpath+0x25/0x2a
Code: 48 63 35 ee 5c c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 e8 b4 90 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 bd 5c c4 00 eb b7 0f b6 4d cc 4c 89