Info

Permalink
Function
smp_call_function_many
First occurrence
2020-10-08
Last occurrence
2020-10-08
State
NEW
Components
kernel
Quality
-32

Statistics

Operating system Count
CentOS 7 12
Architecture Count
x86_64 12
Related packages Count
kernel 12
 0:3.10.0-1160.108.1.el7 4
 0:3.10.0-1160.el7 3
 0:3.10.0-1160.45.1.el7 2
 0:3.10.0-957.21.3.el7 1
 0:3.10.0-1160.119.1.el7 1
 0:3.10.0-1160.71.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #1396962
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffffabf1e23a
Build id: 3.10.0-1160.108.1.el7.x86_64
0x20a
2
? drain_pages
vmlinux 0xffffffffabfd28c0
Build id: 3.10.0-1160.108.1.el7.x86_64
0xb0
3
on_each_cpu_mask
vmlinux 0xffffffffabf1e389
Build id: 3.10.0-1160.108.1.el7.x86_64
0x29
4
drain_all_pages
vmlinux 0xffffffffabfcf6c5
Build id: 3.10.0-1160.108.1.el7.x86_64
0xb5
5
__alloc_pages_nodemask
vmlinux 0xffffffffabfd46ab
Build id: 3.10.0-1160.108.1.el7.x86_64
0x8db
6
alloc_pages_vma
vmlinux 0xffffffffac0293c9
Build id: 3.10.0-1160.108.1.el7.x86_64
0xa9
7
__read_swap_cache_async
vmlinux 0xffffffffac0163a5
Build id: 3.10.0-1160.108.1.el7.x86_64
0x115
8
? __schedule
vmlinux 0xffffffffac5b7920
Build id: 3.10.0-1160.108.1.el7.x86_64
0x320
9
read_swap_cache_async
vmlinux 0xffffffffac016446
Build id: 3.10.0-1160.108.1.el7.x86_64
0x26
10
swapin_readahead
vmlinux 0xffffffffac01662b
Build id: 3.10.0-1160.108.1.el7.x86_64
0x1ab
11
? radix_tree_lookup_slot
vmlinux 0xffffffffac1a3bc2
Build id: 3.10.0-1160.108.1.el7.x86_64
0x22
12
? __find_get_page
vmlinux 0xffffffffabfc85ae
Build id: 3.10.0-1160.108.1.el7.x86_64
0x1e
13
do_swap_page
vmlinux 0xffffffffabffe3df
Build id: 3.10.0-1160.108.1.el7.x86_64
0x23f
14
? futex_wait_queue_me
vmlinux 0xffffffffabf19834
Build id: 3.10.0-1160.108.1.el7.x86_64
0xa4
15
handle_mm_fault
vmlinux 0xffffffffac00220f
Build id: 3.10.0-1160.108.1.el7.x86_64
0xabf
16
__do_page_fault
vmlinux 0xffffffffac5bf7d3
Build id: 3.10.0-1160.108.1.el7.x86_64
0x213
17
do_page_fault
vmlinux 0xffffffffac5bfb05
Build id: 3.10.0-1160.108.1.el7.x86_64
0x35
18
page_fault
vmlinux 0xffffffffac5bb7b8
Build id: 3.10.0-1160.108.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [rpcserver:2889]
Modules linked in: i2dtrack(OE) iscsi_target_mod target_core_mod sfs(OE) nbd(E) dattobd(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper sg ablk_helper cryptd ppdev vmw_balloon joydev pcspkr parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops
ttm drm nfit ata_piix mptspi libnvdimm scsi_transport_spi crct10dif_pclmul crct10dif_common mptscsih crc32c_intel libata mptbase e1000 serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 2889 Comm: rpcserver Kdump: loaded Tainted: G           OEL ------------   3.10.0-1160.108.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff92da71c03180 ti: ffff92d9d879c000 task.ti: ffff92d9d879c000
RIP: 0010:[<ffffffffabf1e23a>]  [<ffffffffabf1e23a>] smp_call_function_many+0x20a/0x270
RSP: 0000:ffff92d9d879fa10  EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00080000abfd28c0 RCX: ffff92da79620628
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff92d9d879fa48 R08: ffff92da76663400 R09: ffffffffac19c7b9
R10: ffff92da7969f160 R11: ffffec1502711000 R12: 0000000000000282
R13: 0000000000000282 R14: ffff92d9d879f9c0 R15: 0000000001320122
FS:  00007fb9f27fc700(0000) GS:ffff92da79680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb9f27fbc08 CR3: 0000000098592000 CR4: 0000000000760fe0
PKRU: 55555554
Call Trace:
[<ffffffffabfd28c0>] ? drain_pages+0xb0/0xb0
[<ffffffffabf1e389>] on_each_cpu_mask+0x29/0x70
[<ffffffffabfcf6c5>] drain_all_pages+0xb5/0xd0
[<ffffffffabfd46ab>] __alloc_pages_nodemask+0x8db/0xbf0
[<ffffffffac0293c9>] alloc_pages_vma+0xa9/0x210
[<ffffffffac0163a5>] __read_swap_cache_async+0x115/0x190
[<ffffffffac5b7920>] ? __schedule+0x320/0x680
[<ffffffffac016446>] read_swap_cache_async+0x26/0x60
[<ffffffffac01662b>] swapin_readahead+0x1ab/0x210
[<ffffffffac1a3bc2>] ? radix_tree_lookup_slot+0x22/0x50
[<ffffffffabfc85ae>] ? __find_get_page+0x1e/0xa0
[<ffffffffabffe3df>] do_swap_page+0x23f/0x7c0
[<ffffffffabf19834>] ? futex_wait_queue_me+0xa4/0x130
[<ffffffffac00220f>] handle_mm_fault+0xabf/0x1190
[<ffffffffac5bf7d3>] __do_page_fault+0x213/0x510
[<ffffffffac5bfb05>] do_page_fault+0x35/0x90
[<ffffffffac5bb7b8>] page_fault+0x28/0x30
Code: 48 63 35 8e 18 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 80 19 b5 ac f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 5d 18 c4 00 eb b7 0f b6 4d cc 4c 89 
Complete report #1202558
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffff8831720a
Build id: 3.10.0-1160.71.1.el7.x86_64
0x20a
2
? drain_pages
vmlinux 0xffffffff883c7940
Build id: 3.10.0-1160.71.1.el7.x86_64
0xb0
3
on_each_cpu_mask
vmlinux 0xffffffff88317359
Build id: 3.10.0-1160.71.1.el7.x86_64
0x29
4
drain_all_pages
vmlinux 0xffffffff883c4825
Build id: 3.10.0-1160.71.1.el7.x86_64
0xb5
5
__alloc_pages_nodemask
vmlinux 0xffffffff883c96ab
Build id: 3.10.0-1160.71.1.el7.x86_64
0x8cb
6
alloc_pages_vma
vmlinux 0xffffffff8841cc69
Build id: 3.10.0-1160.71.1.el7.x86_64
0xa9
7
__read_swap_cache_async
vmlinux 0xffffffff8840a205
Build id: 3.10.0-1160.71.1.el7.x86_64
0x115
8
read_swap_cache_async
vmlinux 0xffffffff8840a2a6
Build id: 3.10.0-1160.71.1.el7.x86_64
0x26
9
swapin_readahead
vmlinux 0xffffffff8840a48b
Build id: 3.10.0-1160.71.1.el7.x86_64
0x1ab
10
? radix_tree_lookup_slot
vmlinux 0xffffffff8858daf2
Build id: 3.10.0-1160.71.1.el7.x86_64
0x22
11
? __find_get_page
vmlinux 0xffffffff883bd98e
Build id: 3.10.0-1160.71.1.el7.x86_64
0x1e
12
do_swap_page
vmlinux 0xffffffff883f28df
Build id: 3.10.0-1160.71.1.el7.x86_64
0x23f
13
? unlock_page
vmlinux 0xffffffff883be49b
Build id: 3.10.0-1160.71.1.el7.x86_64
0x2b
14
? do_read_fault.isra.63
vmlinux 0xffffffff883eee99
Build id: 3.10.0-1160.71.1.el7.x86_64
0x139
15
handle_mm_fault
vmlinux 0xffffffff883f6677
Build id: 3.10.0-1160.71.1.el7.x86_64
0xaa7
16
? cp_new_stat
vmlinux 0xffffffff884541c5
Build id: 3.10.0-1160.71.1.el7.x86_64
0x165
17
__do_page_fault
vmlinux 0xffffffff88994653
Build id: 3.10.0-1160.71.1.el7.x86_64
0x213
18
do_page_fault
vmlinux 0xffffffff88994975
Build id: 3.10.0-1160.71.1.el7.x86_64
0x35
19
page_fault
vmlinux 0xffffffff88990778
Build id: 3.10.0-1160.71.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [packagekitd:3960]
Modules linked in: vsock_diag unix_diag af_packet_diag netlink_diag tcp_diag udp_diag inet_diag binfmt_misc tcp_lp vfat fat isofs ext4 mbcache jbd2 veth xt_nat xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_addrtype iptable_filter br_netfilter bridge stp llc overlay(T) vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus ppdev sg snd_seq joydev snd_seq_device crc32_pclmul snd_pcm ghash_clmulni_intel pcspkr aesni_intel lrw gf128mul glue_helper vmw_balloon ablk_helper snd_timer snd cryptd i2c_piix4 soundcore vmw_vmci parport_pc parport ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic
vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt mptspi pata_acpi fb_sys_fops scsi_transport_spi ttm e1000 mptscsih crct10dif_pclmul nfit drm crct10dif_common crc32c_intel mptbase ata_piix libnvdimm serio_raw libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 3960 Comm: packagekitd Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.71.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9fbbfbdbd280 ti: ffff9fbcb290c000 task.ti: ffff9fbcb290c000
RIP: 0010:[<ffffffff8831720a>]  [<ffffffff8831720a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9fbcb290fa10  EFLAGS: 00000202
RAX: 0000000000000003 RBX: 00080000883c7940 RCX: ffff9fbcb96e0600
RDX: 0000000000000003 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff9fbcb290fa48 R08: ffff9fbcb6663000 R09: ffffffff88586a19
R10: ffff9fbcb965f160 R11: fffff20a41beea00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9fbcb290f9c0 R15: 0000000001320122
FS:  00007fef931c78c0(0000) GS:ffff9fbcb9640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000008007b4830 CR3: 0000000133fb6000 CR4: 00000000003607e0
Call Trace:
[<ffffffff883c7940>] ? drain_pages+0xb0/0xb0
[<ffffffff88317359>] on_each_cpu_mask+0x29/0x70
[<ffffffff883c4825>] drain_all_pages+0xb5/0xc0
[<ffffffff883c96ab>] __alloc_pages_nodemask+0x8cb/0xbe0
[<ffffffff8841cc69>] alloc_pages_vma+0xa9/0x200
[<ffffffff8840a205>] __read_swap_cache_async+0x115/0x190
[<ffffffff8840a2a6>] read_swap_cache_async+0x26/0x60
[<ffffffff8840a48b>] swapin_readahead+0x1ab/0x210
[<ffffffff8858daf2>] ? radix_tree_lookup_slot+0x22/0x50
[<ffffffff883bd98e>] ? __find_get_page+0x1e/0xa0
[<ffffffff883f28df>] do_swap_page+0x23f/0x7c0
[<ffffffff883be49b>] ? unlock_page+0x2b/0x30
[<ffffffff883eee99>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff883f6677>] handle_mm_fault+0xaa7/0xfb0
[<ffffffff884541c5>] ? cp_new_stat+0x165/0x1a0
[<ffffffff88994653>] __do_page_fault+0x213/0x500
[<ffffffff88994975>] do_page_fault+0x35/0x90
[<ffffffff88990778>] page_fault+0x28/0x30
Code: 48 63 35 9e 87 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 18 f5 88 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 6d 87 c4 00 eb b7 0f b6 4d cc 4c 89 
Complete report #1177669
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffff8411e25a
Build id: 3.10.0-1160.119.1.el7.x86_64
0x20a
2
? drain_pages
vmlinux 0xffffffff841d2910
Build id: 3.10.0-1160.119.1.el7.x86_64
0xb0
3
on_each_cpu_mask
vmlinux 0xffffffff8411e3a9
Build id: 3.10.0-1160.119.1.el7.x86_64
0x29
4
drain_all_pages
vmlinux 0xffffffff841cf715
Build id: 3.10.0-1160.119.1.el7.x86_64
0xb5
5
__alloc_pages_nodemask
vmlinux 0xffffffff841d46fb
Build id: 3.10.0-1160.119.1.el7.x86_64
0x8db
6
alloc_pages_vma
vmlinux 0xffffffff84229419
Build id: 3.10.0-1160.119.1.el7.x86_64
0xa9
7
__read_swap_cache_async
vmlinux 0xffffffff842163f5
Build id: 3.10.0-1160.119.1.el7.x86_64
0x115
8
read_swap_cache_async
vmlinux 0xffffffff84216496
Build id: 3.10.0-1160.119.1.el7.x86_64
0x26
9
swapin_readahead
vmlinux 0xffffffff8421667b
Build id: 3.10.0-1160.119.1.el7.x86_64
0x1ab
10
? radix_tree_lookup_slot
vmlinux 0xffffffff843a3c02
Build id: 3.10.0-1160.119.1.el7.x86_64
0x22
11
? __find_get_page
vmlinux 0xffffffff841c85fe
Build id: 3.10.0-1160.119.1.el7.x86_64
0x1e
12
do_swap_page
vmlinux 0xffffffff841fe42f
Build id: 3.10.0-1160.119.1.el7.x86_64
0x23f
13
? unlock_page
vmlinux 0xffffffff841c914b
Build id: 3.10.0-1160.119.1.el7.x86_64
0x2b
14
? do_read_fault.isra.63
vmlinux 0xffffffff841fa8b9
Build id: 3.10.0-1160.119.1.el7.x86_64
0x139
15
handle_mm_fault
vmlinux 0xffffffff8420225f
Build id: 3.10.0-1160.119.1.el7.x86_64
0xabf
16
__do_page_fault
vmlinux 0xffffffff847bf7d3
Build id: 3.10.0-1160.119.1.el7.x86_64
0x213
17
do_page_fault
vmlinux 0xffffffff847bfb05
Build id: 3.10.0-1160.119.1.el7.x86_64
0x35
18
page_fault
vmlinux 0xffffffff847bb7b8
Build id: 3.10.0-1160.119.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [containerd-shim:2555]
Modules linked in: tcp_lp nls_utf8 isofs rfcomm veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter overlay(T) bnep vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel snd_ens1371 aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_rawmidi snd_ac97_codec btusb ac97_bus btrtl btbcm snd_seq btintel snd_seq_device snd_pcm bluetooth snd_timer snd ppdev rfkill soundcore joydev pcspkr vmw_balloon sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c
sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel drm nfit mptspi scsi_transport_spi serio_raw mptscsih libata libnvdimm e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 4 PID: 2555 Comm: containerd-shim Tainted: G             L ------------ T 3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffffa11091458000 ti: ffffa11091454000 task.ti: ffffa11091454000
RIP: 0010:[<ffffffff8411e25a>]  [<ffffffff8411e25a>] smp_call_function_many+0x20a/0x270
RSP: 0000:ffffa11091457a10  EFLAGS: 00000202
RAX: 0000000000000002 RBX: 00080000841d2910 RCX: ffffa110bc6a0600
RDX: 0000000000000002 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffffa11091457a48 R08: ffffa110bb56c000 R09: ffffffff8439c7f9
R10: ffffa110bc71f160 R11: fffff8700022d400 R12: 0000000000000282
R13: 0000000000000282 R14: ffffa110914579c0 R15: 0000000001320122
FS:  000000c000048490(0000) GS:ffffa110bc700000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9b60acdac8 CR3: 00000000039b0000 CR4: 00000000003607e0
Call Trace:
[<ffffffff841d2910>] ? drain_pages+0xb0/0xb0
[<ffffffff8411e3a9>] on_each_cpu_mask+0x29/0x70
[<ffffffff841cf715>] drain_all_pages+0xb5/0xd0
[<ffffffff841d46fb>] __alloc_pages_nodemask+0x8db/0xbf0
[<ffffffff84229419>] alloc_pages_vma+0xa9/0x210
[<ffffffff842163f5>] __read_swap_cache_async+0x115/0x190
[<ffffffff84216496>] read_swap_cache_async+0x26/0x60
[<ffffffff8421667b>] swapin_readahead+0x1ab/0x210
[<ffffffff843a3c02>] ? radix_tree_lookup_slot+0x22/0x50
[<ffffffff841c85fe>] ? __find_get_page+0x1e/0xa0
[<ffffffff841fe42f>] do_swap_page+0x23f/0x7c0
[<ffffffff841c914b>] ? unlock_page+0x2b/0x40
[<ffffffff841fa8b9>] ? do_read_fault.isra.63+0x139/0x1b0
[<ffffffff8420225f>] handle_mm_fault+0xabf/0x1190
[<ffffffff847bf7d3>] __do_page_fault+0x213/0x510
[<ffffffff847bfb05>] do_page_fault+0x35/0x90
[<ffffffff847bb7b8>] page_fault+0x28/0x30
Code: 48 63 35 ae 18 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 c0 19 d5 84 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 7d 18 c4 00 eb b7 0f b6 4d cc 4c 89 
Complete report #996393
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffffb1d16c0a
Build id: 3.10.0-1160.el7.x86_64
0x20a
2
? drain_pages
vmlinux 0xffffffffb1dc74a0
Build id: 3.10.0-1160.el7.x86_64
0xb0
3
on_each_cpu_mask
vmlinux 0xffffffffb1d16d59
Build id: 3.10.0-1160.el7.x86_64
0x29
4
drain_all_pages
vmlinux 0xffffffffb1dc4385
Build id: 3.10.0-1160.el7.x86_64
0xb5
5
__alloc_pages_slowpath
vmlinux 0xffffffffb237c6b2
Build id: 3.10.0-1160.el7.x86_64
0x510
6
__alloc_pages_nodemask
vmlinux 0xffffffffb1dc8d76
Build id: 3.10.0-1160.el7.x86_64
0x436
7
alloc_pages_vma
vmlinux 0xffffffffb1e1c269
Build id: 3.10.0-1160.el7.x86_64
0xa9
8
__read_swap_cache_async
vmlinux 0xffffffffb1e09805
Build id: 3.10.0-1160.el7.x86_64
0x115
9
read_swap_cache_async
vmlinux 0xffffffffb1e098a6
Build id: 3.10.0-1160.el7.x86_64
0x26
10
swapin_readahead
vmlinux 0xffffffffb1e09a8b
Build id: 3.10.0-1160.el7.x86_64
0x1ab
11
? radix_tree_lookup_slot
vmlinux 0xffffffffb1f8d072
Build id: 3.10.0-1160.el7.x86_64
0x22
12
? __find_get_page
vmlinux 0xffffffffb1dbd45e
Build id: 3.10.0-1160.el7.x86_64
0x1e
13
do_swap_page
vmlinux 0xffffffffb1df1f1f
Build id: 3.10.0-1160.el7.x86_64
0x23f
14
? futex_wait_queue_me
vmlinux 0xffffffffb1d121d4
Build id: 3.10.0-1160.el7.x86_64
0xa4
15
handle_mm_fault
vmlinux 0xffffffffb1df5cb7
Build id: 3.10.0-1160.el7.x86_64
0xaa7
16
__do_page_fault
vmlinux 0xffffffffb238e653
Build id: 3.10.0-1160.el7.x86_64
0x213
17
do_page_fault
vmlinux 0xffffffffb238e975
Build id: 3.10.0-1160.el7.x86_64
0x35
18
page_fault
vmlinux 0xffffffffb238a778
Build id: 3.10.0-1160.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [dockerd:1292]
Modules linked in: tcp_lp nls_utf8 isofs nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel ppdev snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq aesni_intel lrw gf128mul glue_helper ablk_helper vmw_balloon cryptd snd_seq_device joydev pcspkr snd_pcm snd_timer sg snd vmw_vmci soundcore i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sd_mod sr_mod cdrom
crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common crc32c_intel drm_kms_helper serio_raw syscopyarea sysfillrect sysimgblt fb_sys_fops ttm e1000 mptspi drm scsi_transport_spi ata_piix mptscsih nfit mptbase libata libnvdimm drm_panel_orientation_quirks fuse
CPU: 3 PID: 1292 Comm: dockerd Tainted: G               ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff8e71eff0c200 ti: ffff8e71e2894000 task.ti: ffff8e71e2894000
RIP: 0010:[<ffffffffb1d16c0a>]  [<ffffffffb1d16c0a>] smp_call_function_many+0x20a/0x270
RSP: 0000:ffff8e71e28979a8  EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00000000000000fc RCX: ffff8e71fc6204d8
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff8e71e28979e0 R08: ffff8e71fabebc00 R09: ffffffffb1f85f99
R10: ffff8e71fc6df160 R11: ffffd8dd4053dc00 R12: 0000000000000296
R13: ffff8e71e2897958 R14: 0000000001320122 R15: 000000009cf808b0
FS:  00007ff9d0e7d700(0000) GS:ffff8e71fc6c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c00084f6c8 CR3: 0000000022b80000 CR4: 0000000000340fe0
Call Trace:
[<ffffffffb1dc74a0>] ? drain_pages+0xb0/0xb0
[<ffffffffb1d16d59>] on_each_cpu_mask+0x29/0x70
[<ffffffffb1dc4385>] drain_all_pages+0xb5/0xc0
[<ffffffffb237c6b2>] __alloc_pages_slowpath+0x510/0x729
[<ffffffffb1dc8d76>] __alloc_pages_nodemask+0x436/0x450
[<ffffffffb1e1c269>] alloc_pages_vma+0xa9/0x200
[<ffffffffb1e09805>] __read_swap_cache_async+0x115/0x190
[<ffffffffb1e098a6>] read_swap_cache_async+0x26/0x60
[<ffffffffb1e09a8b>] swapin_readahead+0x1ab/0x210
[<ffffffffb1f8d072>] ? radix_tree_lookup_slot+0x22/0x50
[<ffffffffb1dbd45e>] ? __find_get_page+0x1e/0xa0
[<ffffffffb1df1f1f>] do_swap_page+0x23f/0x7c0
[<ffffffffb1d121d4>] ? futex_wait_queue_me+0xa4/0x130
[<ffffffffb1df5cb7>] handle_mm_fault+0xaa7/0xfb0
[<ffffffffb238e653>] __do_page_fault+0x213/0x500
[<ffffffffb238e975>] do_page_fault+0x35/0x90
[<ffffffffb238a778>] page_fault+0x28/0x30
Code: 48 63 35 1e 89 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 95 b2 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ed 88 c4 00 eb b7 0f b6 4d cc 4c 89 
Complete report #590068
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffffa8b16c0a
Build id: 3.10.0-1160.el7.x86_64
0x20a
2
? drain_pages
vmlinux 0xffffffffa8bc74a0
Build id: 3.10.0-1160.el7.x86_64
0xb0
3
on_each_cpu_mask
vmlinux 0xffffffffa8b16d59
Build id: 3.10.0-1160.el7.x86_64
0x29
4
drain_all_pages
vmlinux 0xffffffffa8bc4385
Build id: 3.10.0-1160.el7.x86_64
0xb5
5
__alloc_pages_slowpath
vmlinux 0xffffffffa917c6b2
Build id: 3.10.0-1160.el7.x86_64
0x510
6
__alloc_pages_nodemask
vmlinux 0xffffffffa8bc8d76
Build id: 3.10.0-1160.el7.x86_64
0x436
7
alloc_pages_vma
vmlinux 0xffffffffa8c1c269
Build id: 3.10.0-1160.el7.x86_64
0xa9
8
__read_swap_cache_async
vmlinux 0xffffffffa8c09805
Build id: 3.10.0-1160.el7.x86_64
0x115
9
read_swap_cache_async
vmlinux 0xffffffffa8c098a6
Build id: 3.10.0-1160.el7.x86_64
0x26
10
swapin_readahead
vmlinux 0xffffffffa8c09a8b
Build id: 3.10.0-1160.el7.x86_64
0x1ab
11
? radix_tree_lookup_slot
vmlinux 0xffffffffa8d8d072
Build id: 3.10.0-1160.el7.x86_64
0x22
12
? __find_get_page
vmlinux 0xffffffffa8bbd45e
Build id: 3.10.0-1160.el7.x86_64
0x1e
13
do_swap_page
vmlinux 0xffffffffa8bf1f1f
Build id: 3.10.0-1160.el7.x86_64
0x23f
14
handle_mm_fault
vmlinux 0xffffffffa8bf5cb7
Build id: 3.10.0-1160.el7.x86_64
0xaa7
15
? __schedule
vmlinux 0xffffffffa9186e76
Build id: 3.10.0-1160.el7.x86_64
0x596
16
__do_page_fault
vmlinux 0xffffffffa918e653
Build id: 3.10.0-1160.el7.x86_64
0x213
17
do_page_fault
vmlinux 0xffffffffa918e975
Build id: 3.10.0-1160.el7.x86_64
0x35
18
page_fault
vmlinux 0xffffffffa918a778
Build id: 3.10.0-1160.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 21s! [thread_pool.rb*:3034]
Modules linked in: tcp_lp veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul snd_ens1371 ghash_clmulni_intel snd_rawmidi ppdev snd_ac97_codec ac97_bus aesni_intel
snd_seq lrw gf128mul snd_seq_device glue_helper ablk_helper vmw_balloon snd_pcm cryptd snd_timer joydev pcspkr snd soundcore i2c_piix4 sg vmw_vmci parport_pc parport ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt ata_generic pata_acpi crct10dif_pclmul mptspi fb_sys_fops crct10dif_common ttm scsi_transport_spi drm ata_piix e1000 mptscsih crc32c_intel serio_raw mptbase nfit libnvdimm libata drm_panel_orientation_quirks fuse
CPU: 3 PID: 3034 Comm: thread_pool.rb* Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff889585789080 ti: ffff8896af0e4000 task.ti: ffff8896af0e4000
RIP: 0010:[<ffffffffa8b16c0a>]  [<ffffffffa8b16c0a>] smp_call_function_many+0x20a/0x270
RSP: 0000:ffff8896af0e79a8  EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00000000000000fc RCX: ffff8897af220650
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff8896af0e79e0 R08: ffff8896fe34b800 R09: ffffffffa8d85f99
R10: ffff8897af2df160 R11: ffffe442c8553a00 R12: 0000000000000296
R13: ffff8896af0e7958 R14: 0000000001320122 R15: 00000000f674ca93
FS:  00007fa566ea9700(0000) GS:ffff8897af2c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa53a38d4b0 CR3: 0000000193c94000 CR4: 00000000003607e0
Call Trace:
[<ffffffffa8bc74a0>] ? drain_pages+0xb0/0xb0
[<ffffffffa8b16d59>] on_each_cpu_mask+0x29/0x70
[<ffffffffa8bc4385>] drain_all_pages+0xb5/0xc0
[<ffffffffa917c6b2>] __alloc_pages_slowpath+0x510/0x729
[<ffffffffa8bc8d76>] __alloc_pages_nodemask+0x436/0x450
[<ffffffffa8c1c269>] alloc_pages_vma+0xa9/0x200
[<ffffffffa8c09805>] __read_swap_cache_async+0x115/0x190
[<ffffffffa8c098a6>] read_swap_cache_async+0x26/0x60
[<ffffffffa8c09a8b>] swapin_readahead+0x1ab/0x210
[<ffffffffa8d8d072>] ? radix_tree_lookup_slot+0x22/0x50
[<ffffffffa8bbd45e>] ? __find_get_page+0x1e/0xa0
[<ffffffffa8bf1f1f>] do_swap_page+0x23f/0x7c0
[<ffffffffa8bf5cb7>] handle_mm_fault+0xaa7/0xfb0
[<ffffffffa9186e76>] ? __schedule+0x596/0x860
[<ffffffffa918e653>] __do_page_fault+0x213/0x500
[<ffffffffa918e975>] do_page_fault+0x35/0x90
[<ffffffffa918a778>] page_fault+0x28/0x30
Code: 48 63 35 1e 89 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 75 a9 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ed 88 c4 00 eb b7 0f b6 4d cc 4c 89 
Complete report #316445
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffff9dd170da
Build id: 3.10.0-1160.45.1.el7.x86_64
0x20a
2
? drain_pages
vmlinux 0xffffffff9ddc78e0
Build id: 3.10.0-1160.45.1.el7.x86_64
0xb0
3
on_each_cpu_mask
vmlinux 0xffffffff9dd17229
Build id: 3.10.0-1160.45.1.el7.x86_64
0x29
4
drain_all_pages
vmlinux 0xffffffff9ddc47c5
Build id: 3.10.0-1160.45.1.el7.x86_64
0xb5
5
__alloc_pages_nodemask
vmlinux 0xffffffff9ddc964b
Build id: 3.10.0-1160.45.1.el7.x86_64
0x8cb
6
alloc_pages_vma
vmlinux 0xffffffff9de1cc49
Build id: 3.10.0-1160.45.1.el7.x86_64
0xa9
7
__read_swap_cache_async
vmlinux 0xffffffff9de0a1e5
Build id: 3.10.0-1160.45.1.el7.x86_64
0x115
8
read_swap_cache_async
vmlinux 0xffffffff9de0a286
Build id: 3.10.0-1160.45.1.el7.x86_64
0x26
9
swapin_readahead
vmlinux 0xffffffff9de0a46b
Build id: 3.10.0-1160.45.1.el7.x86_64
0x1ab
10
? radix_tree_lookup_slot
vmlinux 0xffffffff9df8dcd2
Build id: 3.10.0-1160.45.1.el7.x86_64
0x22
11
? __find_get_page
vmlinux 0xffffffff9ddbd91e
Build id: 3.10.0-1160.45.1.el7.x86_64
0x1e
12
do_swap_page
vmlinux 0xffffffff9ddf288f
Build id: 3.10.0-1160.45.1.el7.x86_64
0x23f
13
? unlock_page
vmlinux 0xffffffff9ddbe42b
Build id: 3.10.0-1160.45.1.el7.x86_64
0x2b
14
handle_mm_fault
vmlinux 0xffffffff9ddf6627
Build id: 3.10.0-1160.45.1.el7.x86_64
0xaa7
15
__do_page_fault
vmlinux 0xffffffff9e390653
Build id: 3.10.0-1160.45.1.el7.x86_64
0x213
16
do_page_fault
vmlinux 0xffffffff9e390975
Build id: 3.10.0-1160.45.1.el7.x86_64
0x35
17
page_fault
vmlinux 0xffffffff9e38c778
Build id: 3.10.0-1160.45.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 25s! [python:27710]
Modules linked in: tcp_lp nls_utf8 isofs tun devlink bridge stp llc ip_set vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi snd_ac97_codec ppdev aesni_intel ac97_bus lrw gf128mul glue_helper snd_seq ablk_helper cryptd vmw_balloon snd_seq_device snd_pcm sg joydev pcspkr snd_timer snd soundcore i2c_piix4 vmw_vmci parport_pc parport xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt crct10dif_pclmul fb_sys_fops crct10dif_common ttm crc32c_intel ata_piix nfit drm libata libnvdimm mptspi serio_raw scsi_transport_spi mptscsih e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: ip_tables]
CPU: 5 PID: 27710 Comm: python Kdump: loaded Tainted: G             L ------------   3.10.0-1160.45.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff8999a461b180 ti: ffff8999353b8000 task.ti: ffff8999353b8000
RIP: 0010:[<ffffffff9dd170da>]  [<ffffffff9dd170da>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8999353bba10  EFLAGS: 00000202
RAX: 0000000000000007 RBX: 000800009ddc78e0 RCX: ffff899a43be03c0
RDX: 0000000000000007 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff8999353bba48 R08: ffff8999fba8c000 R09: ffffffff9df86bf9
R10: ffff899a43b5f160 R11: ffffe76b46f86e00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8999353bb9c0 R15: 0000000001320122
FS:  00007fbdcd6e8740(0000) GS:ffff899a43b40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4f10b5ded0 CR3: 00000001b68e0000 CR4: 00000000003406e0
Call Trace:
[<ffffffff9ddc78e0>] ? drain_pages+0xb0/0xb0
[<ffffffff9dd17229>] on_each_cpu_mask+0x29/0x70
[<ffffffff9ddc47c5>] drain_all_pages+0xb5/0xc0
[<ffffffff9ddc964b>] __alloc_pages_nodemask+0x8cb/0xbe0
[<ffffffff9de1cc49>] alloc_pages_vma+0xa9/0x200
[<ffffffff9de0a1e5>] __read_swap_cache_async+0x115/0x190
[<ffffffff9de0a286>] read_swap_cache_async+0x26/0x60
[<ffffffff9de0a46b>] swapin_readahead+0x1ab/0x210
[<ffffffff9df8dcd2>] ? radix_tree_lookup_slot+0x22/0x50
[<ffffffff9ddbd91e>] ? __find_get_page+0x1e/0xa0
[<ffffffff9ddf288f>] do_swap_page+0x23f/0x7c0
[<ffffffff9ddbe42b>] ? unlock_page+0x2b/0x30
[<ffffffff9ddf6627>] handle_mm_fault+0xaa7/0xfb0
[<ffffffff9e390653>] __do_page_fault+0x213/0x500
[<ffffffff9e390975>] do_page_fault+0x35/0x90
[<ffffffff9e38c778>] page_fault+0x28/0x30
Code: 48 63 35 ce 85 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 15 95 9e f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 85 c4 00 eb b7 0f b6 4d cc 4c 89 
Complete report #6657
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffff95f11a8a
Build id: 3.10.0-957.21.3.el7.x86_64
0x20a
2
? drain_pages
vmlinux 0xffffffff95fbfb10
Build id: 3.10.0-957.21.3.el7.x86_64
0xb0
3
on_each_cpu_mask
vmlinux 0xffffffff95f11bd9
Build id: 3.10.0-957.21.3.el7.x86_64
0x29
4
drain_all_pages
vmlinux 0xffffffff95fbc9f5
Build id: 3.10.0-957.21.3.el7.x86_64
0xb5
5
__alloc_pages_slowpath
vmlinux 0xffffffff9655e568
Build id: 3.10.0-957.21.3.el7.x86_64
0x510
6
__alloc_pages_nodemask
vmlinux 0xffffffff95fc1454
Build id: 3.10.0-957.21.3.el7.x86_64
0x404
7
alloc_pages_vma
vmlinux 0xffffffff96011795
Build id: 3.10.0-957.21.3.el7.x86_64
0xb5
8
__read_swap_cache_async
vmlinux 0xffffffff95fff9e5
Build id: 3.10.0-957.21.3.el7.x86_64
0x115
9
read_swap_cache_async
vmlinux 0xffffffff95fffa86
Build id: 3.10.0-957.21.3.el7.x86_64
0x26
10
swapin_readahead
vmlinux 0xffffffff95fffb6c
Build id: 3.10.0-957.21.3.el7.x86_64
0xac
11
handle_pte_fault
vmlinux 0xffffffff95fe9c62
Build id: 3.10.0-957.21.3.el7.x86_64
0x812
12
handle_mm_fault
vmlinux 0xffffffff95fec27d
Build id: 3.10.0-957.21.3.el7.x86_64
0x39d
13
__do_page_fault
vmlinux 0xffffffff96570603
Build id: 3.10.0-957.21.3.el7.x86_64
0x203
14
do_page_fault
vmlinux 0xffffffff96570925
Build id: 3.10.0-957.21.3.el7.x86_64
0x35
15
page_fault
vmlinux 0xffffffff9656c768
Build id: 3.10.0-957.21.3.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [smbd:28215]
Modules linked in: binfmt_misc xt_CHECKSUM tun devlink rpcsec_gss_krb5 nfsv4 nfs fscache ip_set_hash_ip rbd libceph dns_resolver ipmi_devintf ipmi_msghandler nf_nat_tftp nf_conntrack_tftp nf_conntrack_netbios_ns nf_conntrack_broadcast nf_nat_ftp nf_conntrack_ftp xt_set xt_multiport ip6t_MASQUERADE nf_nat_masquerade_ipv6 xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_mark ip6t_rpfilter ipt_REJECT nf_reject_ipv4 nf_log_ipv4 ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 nf_log_common xt_LOG xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter
ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg parport_pc parport i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common crc32c_intel mptspi libata serio_raw scsi_transport_spi nfit mptscsih libnvdimm mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 28215 Comm: smbd Kdump: loaded Tainted: G        W    L ------------   3.10.0-957.21.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff924bd9d34100 ti: ffff924d63da4000 task.ti: ffff924d63da4000
RIP: 0010:[<ffffffff95f11a8a>]  [<ffffffff95f11a8a>] smp_call_function_many+0x20a/0x270
RSP: 0000:ffff924d63da79b8  EFLAGS: 00000202
RAX: 0000000000000003 RBX: 00000000000000fc RCX: ffff924e67cdfdd8
RDX: 0000000000000003 RSI: 000000000000000c RDI: 0000000000000000
RBP: ffff924d63da79f0 R08: ffff9249b6b02800 R09: ffffffff96175e39
R10: ffff924e67c5f160 R11: ffffeb5cd39e9a00 R12: 0000000000000296
R13: 0000000000000000 R14: ffff924d63da7928 R15: 0000000000000296
FS:  00007fcae1de2900(0000) GS:ffff924e67c40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fcae1e0ddc0 CR3: 00000004bc12c000 CR4: 00000000001607e0
Call Trace:
[<ffffffff95fbfb10>] ? drain_pages+0xb0/0xb0
[<ffffffff95f11bd9>] on_each_cpu_mask+0x29/0x70
[<ffffffff95fbc9f5>] drain_all_pages+0xb5/0xc0
[<ffffffff9655e568>] __alloc_pages_slowpath+0x510/0x724
[<ffffffff95fc1454>] __alloc_pages_nodemask+0x404/0x420
[<ffffffff96011795>] alloc_pages_vma+0xb5/0x200
[<ffffffff95fff9e5>] __read_swap_cache_async+0x115/0x190
[<ffffffff95fffa86>] read_swap_cache_async+0x26/0x60
[<ffffffff95fffb6c>] swapin_readahead+0xac/0x110
[<ffffffff95fe9c62>] handle_pte_fault+0x812/0xd10
[<ffffffff95fec27d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff96570603>] __do_page_fault+0x203/0x4f0
[<ffffffff96570925>] do_page_fault+0x35/0x90
[<ffffffff9656c768>] page_fault+0x28/0x30
Code: 48 63 35 3e 83 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 bc b4 96 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 0d 83 c4 00 eb b7 0f b6 4d cc 4c 89