Info

Permalink
Function
smp_call_function_many
First occurrence
2021-09-24
Last occurrence
2021-09-25
State
NEW
Components
kernel Tainted
Quality
-38

Statistics

Operating system Count
CentOS 7 9
Architecture Count
x86_64 9
Related packages Count
kernel 9
 0:3.10.0-1160.42.2.el7 5
 0:3.10.0-1160.71.1.el7 3
 0:3.10.0-1127.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

No reports in the last 20 weeks.

Report backtrace


Complete report #547616
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffff85f1720a
Build id: 3.10.0-1160.71.1.el7.x86_64
0x20a
2
native_flush_tlb_others
vmlinux 0xffffffff85e7e258
Build id: 3.10.0-1160.71.1.el7.x86_64
0xb8
3
flush_tlb_mm_range
vmlinux 0xffffffff85e7e2cb
Build id: 3.10.0-1160.71.1.el7.x86_64
0x6b
4
dup_mm
vmlinux 0xffffffff85e986b6
Build id: 3.10.0-1160.71.1.el7.x86_64
0x666
5
copy_process
vmlinux 0xffffffff85e99c66
Build id: 3.10.0-1160.71.1.el7.x86_64
0x1486
6
? security_file_alloc
vmlinux 0xffffffff861091fc
Build id: 3.10.0-1160.71.1.el7.x86_64
0x1c
7
do_fork
vmlinux 0xffffffff85e9a411
Build id: 3.10.0-1160.71.1.el7.x86_64
0x91
8
? system_call_after_swapgs
vmlinux 0xffffffff86599ec9
Build id: 3.10.0-1160.71.1.el7.x86_64
0x96
9
? system_call_after_swapgs
vmlinux 0xffffffff86599ed5
Build id: 3.10.0-1160.71.1.el7.x86_64
0xa2
10
? system_call_after_swapgs
vmlinux 0xffffffff86599ec9
Build id: 3.10.0-1160.71.1.el7.x86_64
0x96
11
? system_call_after_swapgs
vmlinux 0xffffffff86599ed5
Build id: 3.10.0-1160.71.1.el7.x86_64
0xa2
12
? system_call_after_swapgs
vmlinux 0xffffffff86599ec9
Build id: 3.10.0-1160.71.1.el7.x86_64
0x96
13
SyS_clone
vmlinux 0xffffffff85e9a736
Build id: 3.10.0-1160.71.1.el7.x86_64
0x16
14
stub_clone
vmlinux 0xffffffff8659a374
Build id: 3.10.0-1160.71.1.el7.x86_64
0x44
15
? system_call_fastpath
vmlinux 0xffffffff86599f92
Build id: 3.10.0-1160.71.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [TrantorAgentWat:55549]
Modules linked in: qax_tq_base(OE) binfmt_misc nls_utf8 isofs tcp_lp xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc ext4 mbcache jbd2 ppdev virtio_balloon sg i2c_piix4 parport_pc parport joydev pcspkr ip_tables xfs libcrc32c sr_mod cdrom virtio_net virtio_scsi virtio_console net_failover virtio_blk failover ata_generic pata_acpi cirrus drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata floppy drm_panel_orientation_quirks serio_raw virtio_pci virtio_ring virtio dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: qax_tq_base]
CPU: 2 PID: 55549 Comm: TrantorAgentWat Tainted: G           OE  ------------   3.10.0-1160.71.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff93c332f9d280 ti: ffff93c31fe14000 task.ti: ffff93c31fe14000
RIP: 0010:[<ffffffff85f1720a>]  [<ffffffff85f1720a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff93c31fe17ce0  EFLAGS: 00000202
RAX: 0000000000000001 RBX: 0008000085e7ddd0 RCX: ffff93ca9ce60428
RDX: 0000000000000001 RSI: 00000000000000a0 RDI: 0000000000000000
RBP: ffff93c31fe17d18 R08: ffff93c3ec4d3400 R09: ffffffff86186a19
R10: ffff93ca9ce9f160 R11: fffff81c206ed000 R12: 0000000000000286
R13: 0000000000000286 R14: ffff93c31fe17c90 R15: ffff93c382c1bf18
FS:  00007f28f0621700(0000) GS:ffff93ca9ce80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2806f92a08 CR3: 00000005184ba000 CR4: 00000000000006e0
Call Trace:
[<ffffffff85e7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff85e7e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff85e986b6>] dup_mm+0x666/0x760
[<ffffffff85e99c66>] copy_process+0x1486/0x1a80
[<ffffffff861091fc>] ? security_file_alloc+0x1c/0x20
[<ffffffff85e9a411>] do_fork+0x91/0x330
[<ffffffff86599ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff86599ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff86599ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff86599ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff86599ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff85e9a736>] SyS_clone+0x16/0x20
[<ffffffff8659a374>] stub_clone+0x44/0x70
[<ffffffff86599f92>] ? system_call_fastpath+0x25/0x2a
Code: 48 63 35 9e 87 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 18 b5 86 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 6d 87 c4 00 eb b7 0f b6 4d cc 4c 89 
Complete report #323320
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffffadf1760e
Build id: 3.10.0-1127.el7.x86_64
0x20e
2
native_flush_tlb_others
vmlinux 0xffffffffade7e8f8
Build id: 3.10.0-1127.el7.x86_64
0xb8
3
flush_tlb_mm_range
vmlinux 0xffffffffade7e96b
Build id: 3.10.0-1127.el7.x86_64
0x6b
4
dup_mm
vmlinux 0xffffffffade99006
Build id: 3.10.0-1127.el7.x86_64
0x666
5
copy_process
vmlinux 0xffffffffade9a5b6
Build id: 3.10.0-1127.el7.x86_64
0x1486
6
? security_file_alloc
vmlinux 0xffffffffae107cac
Build id: 3.10.0-1127.el7.x86_64
0x1c
7
do_fork
vmlinux 0xffffffffade9ad51
Build id: 3.10.0-1127.el7.x86_64
0x91
8
? system_call_after_swapgs
vmlinux 0xffffffffae592e09
Build id: 3.10.0-1127.el7.x86_64
0x96
9
? system_call_after_swapgs
vmlinux 0xffffffffae592e15
Build id: 3.10.0-1127.el7.x86_64
0xa2
10
? system_call_after_swapgs
vmlinux 0xffffffffae592e09
Build id: 3.10.0-1127.el7.x86_64
0x96
11
? system_call_after_swapgs
vmlinux 0xffffffffae592e15
Build id: 3.10.0-1127.el7.x86_64
0xa2
12
? system_call_after_swapgs
vmlinux 0xffffffffae592e09
Build id: 3.10.0-1127.el7.x86_64
0x96
13
SyS_clone
vmlinux 0xffffffffade9b076
Build id: 3.10.0-1127.el7.x86_64
0x16
14
stub_clone
vmlinux 0xffffffffae5932b4
Build id: 3.10.0-1127.el7.x86_64
0x44
15
? system_call_fastpath
vmlinux 0xffffffffae592ed2
Build id: 3.10.0-1127.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kubelet:2007]
Modules linked in: xt_comment xt_mark xt_addrtype xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter sunrpc ppdev sb_edac snd_intel8x0 snd_ac97_codec ac97_bus snd_seq sg snd_seq_device snd_pcm snd_timer iosf_mbi snd crc32_pclmul ghash_clmulni_intel soundcore parport_pc aesni_intel pcspkr lrw parport gf128mul glue_helper i2c_piix4 ablk_helper video cryptd br_netfilter bridge stp llc overlay(T) ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci ata_piix libahci
crct10dif_pclmul crct10dif_common libata e1000 crc32c_intel serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 2007 Comm: kubelet Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-1127.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff942a125fb150 ti: ffff942896ac4000 task.ti: ffff942896ac4000
RIP: 0010:[<ffffffffadf1760e>]  [<ffffffffadf1760e>] smp_call_function_many+0x20e/0x270
RSP: 0018:ffff942896ac7ce0  EFLAGS: 00000202
RAX: 0000000000000003 RBX: 00080000ade7e730 RCX: ffff942a1e4e0348
RDX: 0000000000000003 RSI: 0000000000000006 RDI: 0000000000000000
RBP: ffff942896ac7d18 R08: ffff94293bf11400 R09: ffffffffae185099
R10: ffff942a1e49f160 R11: ffffcc0f41f36e00 R12: 0000000000000286
R13: 0000000000000286 R14: ffff942896ac7c90 R15: ffff942a102b4558
FS:  00007f7265727700(0000) GS:ffff942a1e480000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c4217846b0 CR3: 00000000d6b18000 CR4: 00000000000606e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffade7e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffade7e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffade99006>] dup_mm+0x666/0x760
[<ffffffffade9a5b6>] copy_process+0x1486/0x1a70
[<ffffffffae107cac>] ? security_file_alloc+0x1c/0x20
[<ffffffffade9ad51>] do_fork+0x91/0x330
[<ffffffffae592e09>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffffae592e15>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffffae592e09>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffffae592e15>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffffae592e09>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffffade9b076>] SyS_clone+0x16/0x20
[<ffffffffae5932b4>] stub_clone+0x44/0x70
[<ffffffffae592ed2>] ? system_call_fastpath+0x25/0x2a
Code: 7b c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 0f b5 ae f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 f6 41 20 01 <75> f8 48 63 35 ed 7a c4 00 eb b7 0f b6 4d cc 4c 89 f2 4c 89 ee 
Complete report #254399
Frame # Function Binary Source or offset Line
1
dump_stack
vmlinux 0xffffffffad783539
Build id: 3.10.0-1160.42.2.el7.x86_64
0x19
2
print_bad_pte
vmlinux 0xffffffffad1eeb51
Build id: 3.10.0-1160.42.2.el7.x86_64
0x1f1
3
vm_normal_page
vmlinux 0xffffffffad1f0eb6
Build id: 3.10.0-1160.42.2.el7.x86_64
0xa6
4
copy_pte_range
vmlinux 0xffffffffad1f30f4
Build id: 3.10.0-1160.42.2.el7.x86_64
0x2e4
5
copy_page_range
vmlinux 0xffffffffad1f4486
Build id: 3.10.0-1160.42.2.el7.x86_64
0x476
6
dup_mm
vmlinux 0xffffffffad09839f
Build id: 3.10.0-1160.42.2.el7.x86_64
0x4df
7
copy_process
vmlinux 0xffffffffad099ad6
Build id: 3.10.0-1160.42.2.el7.x86_64
0x1486
8
? security_file_alloc
vmlinux 0xffffffffad30934c
Build id: 3.10.0-1160.42.2.el7.x86_64
0x1c
9
do_fork
vmlinux 0xffffffffad09a281
Build id: 3.10.0-1160.42.2.el7.x86_64
0x91
10
? system_call_after_swapgs
vmlinux 0xffffffffad795ec9
Build id: 3.10.0-1160.42.2.el7.x86_64
0x96
11
? system_call_after_swapgs
vmlinux 0xffffffffad795ed5
Build id: 3.10.0-1160.42.2.el7.x86_64
0xa2
12
? system_call_after_swapgs
vmlinux 0xffffffffad795ec9
Build id: 3.10.0-1160.42.2.el7.x86_64
0x96
13
? system_call_after_swapgs
vmlinux 0xffffffffad795ed5
Build id: 3.10.0-1160.42.2.el7.x86_64
0xa2
14
? system_call_after_swapgs
vmlinux 0xffffffffad795ec9
Build id: 3.10.0-1160.42.2.el7.x86_64
0x96
15
SyS_clone
vmlinux 0xffffffffad09a5a6
Build id: 3.10.0-1160.42.2.el7.x86_64
0x16
16
stub_clone
vmlinux 0xffffffffad796374
Build id: 3.10.0-1160.42.2.el7.x86_64
0x44
17
? system_call_fastpath
vmlinux 0xffffffffad795f92
Build id: 3.10.0-1160.42.2.el7.x86_64
0x25
BUG: Bad page map in process gnome-shell  pte:80000006062c8845 pmd:208788067
addr:0000000001ef2000 vm_flags:08100073 anon_vma:ffff9d302256b780 mapping:          (null) index:1ef2
CPU: 0 PID: 2228 Comm: gnome-shell Kdump: loaded Tainted: G        W I    ------------   3.10.0-1160.42.2.el7.x86_64 #1
Hardware name: System manufacturer System Product Name/P7P55D, BIOS 2101    10/20/2011
Call Trace:
[<ffffffffad783539>] dump_stack+0x19/0x1b
[<ffffffffad1eeb51>] print_bad_pte+0x1f1/0x290
[<ffffffffad1f0eb6>] vm_normal_page+0xa6/0xb0
[<ffffffffad1f30f4>] copy_pte_range+0x2e4/0x7a0
[<ffffffffad1f4486>] copy_page_range+0x476/0x660
[<ffffffffad09839f>] dup_mm+0x4df/0x760
[<ffffffffad099ad6>] copy_process+0x1486/0x1a80
[<ffffffffad30934c>] ? security_file_alloc+0x1c/0x20
[<ffffffffad09a281>] do_fork+0x91/0x330
[<ffffffffad795ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffffad795ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffffad795ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffffad795ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffffad795ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffffad09a5a6>] SyS_clone+0x16/0x20
[<ffffffffad796374>] stub_clone+0x44/0x70
[<ffffffffad795f92>] ? system_call_fastpath+0x25/0x2a