Info

Permalink
Function
smp_call_function_many
First occurrence
2024-03-16
Last occurrence
2026-09-05
State
NEW
Components
kernel
Quality
-70

Statistics

Operating system Count
CentOS 7 4
Architecture Count
x86_64 4
Related packages Count
kernel 4
 0:3.10.0-1160.53.1.el7 3
 0:3.10.0-1160.95.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

Report backtrace


Complete report #1405074
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffffbd31e1ca
Build id: 3.10.0-1160.95.1.el7.x86_64
0x20a
2
? drain_pages
vmlinux 0xffffffffbd3d2850
Build id: 3.10.0-1160.95.1.el7.x86_64
0xb0
3
on_each_cpu_mask
vmlinux 0xffffffffbd31e319
Build id: 3.10.0-1160.95.1.el7.x86_64
0x29
4
drain_all_pages
vmlinux 0xffffffffbd3cf655
Build id: 3.10.0-1160.95.1.el7.x86_64
0xb5
5
__alloc_pages_nodemask
vmlinux 0xffffffffbd3d463b
Build id: 3.10.0-1160.95.1.el7.x86_64
0x8db
6
alloc_pages_current
vmlinux 0xffffffffbd4259d8
Build id: 3.10.0-1160.95.1.el7.x86_64
0x98
7
new_slab
vmlinux 0xffffffffbd43455b
Build id: 3.10.0-1160.95.1.el7.x86_64
0x39b
8
___slab_alloc
vmlinux 0xffffffffbd434a6c
Build id: 3.10.0-1160.95.1.el7.x86_64
0x3cc
9
? xprt_alloc_slot
sunrpc 0xffffffffc065beb9
Build id: 3.10.0-1160.95.1.el7.x86_64
0xf9
10
? xprt_alloc_slot
sunrpc 0xffffffffc065beb9
Build id: 3.10.0-1160.95.1.el7.x86_64
0xf9
11
__slab_alloc
vmlinux 0xffffffffbd9ae458
Build id: 3.10.0-1160.95.1.el7.x86_64
0x40
12
kmem_cache_alloc_trace
vmlinux 0xffffffffbd435e67
Build id: 3.10.0-1160.95.1.el7.x86_64
0x1a7
13
xprt_alloc_slot
sunrpc 0xffffffffc065beb9
Build id: 3.10.0-1160.95.1.el7.x86_64
0xf9
14
xprt_lock_and_alloc_slot
sunrpc 0xffffffffc065bf83
Build id: 3.10.0-1160.95.1.el7.x86_64
0x53
15
? call_connect_status
sunrpc 0xffffffffc06573f0
Build id: 3.10.0-1160.95.1.el7.x86_64
0x170
16
? call_connect_status
sunrpc 0xffffffffc06573f0
Build id: 3.10.0-1160.95.1.el7.x86_64
0x170
17
xprt_do_reserve
sunrpc 0xffffffffc065ace0
Build id: 3.10.0-1160.95.1.el7.x86_64
0x20
18
? call_connect_status
sunrpc 0xffffffffc06573f0
Build id: 3.10.0-1160.95.1.el7.x86_64
0x170
19
? call_connect_status
sunrpc 0xffffffffc06573f0
Build id: 3.10.0-1160.95.1.el7.x86_64
0x170
20
xprt_retry_reserve
sunrpc 0xffffffffc065ca66
Build id: 3.10.0-1160.95.1.el7.x86_64
0x46
21
call_retry_reserve
sunrpc 0xffffffffc065741d
Build id: 3.10.0-1160.95.1.el7.x86_64
0x2d
22
__rpc_execute
sunrpc 0xffffffffc0665969
Build id: 3.10.0-1160.95.1.el7.x86_64
0x99
23
rpc_async_schedule
sunrpc 0xffffffffc0665d02
Build id: 3.10.0-1160.95.1.el7.x86_64
0x12
24
process_one_work
vmlinux 0xffffffffbd2c32ef
Build id: 3.10.0-1160.95.1.el7.x86_64
0x17f
25
worker_thread
vmlinux 0xffffffffbd2c4436
Build id: 3.10.0-1160.95.1.el7.x86_64
0x126
26
? manage_workers.isra.26
vmlinux 0xffffffffbd2c4310
Build id: 3.10.0-1160.95.1.el7.x86_64
0x2b0
27
kthread
vmlinux 0xffffffffbd2cb621
Build id: 3.10.0-1160.95.1.el7.x86_64
0xd1
28
? insert_kthread_work
vmlinux 0xffffffffbd2cb550
Build id: 3.10.0-1160.95.1.el7.x86_64
0x40
29
ret_from_fork_nospec_begin
vmlinux 0xffffffffbd9c51f7
Build id: 3.10.0-1160.95.1.el7.x86_64
0x21
30
? insert_kthread_work
vmlinux 0xffffffffbd2cb550
Build id: 3.10.0-1160.95.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [kworker/5:0H:41606]
Modules linked in: rpcrdma ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ipoib rdma_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_core binfmt_misc squashfs loop overlay(T) iptable_filter nfsv3 nfs_acl rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache dm_mirror dm_region_hash dm_log dm_mod snd_hda_intel iTCO_wdt iTCO_vendor_support snd_hda_codec snd_hda_core snd_hwdep edac_mce_amd snd_seq snd_seq_device aesni_intel snd_pcm lrw gf128mul glue_helper snd_timer ablk_helper snd cryptd sg virtio_balloon joydev pcspkr i2c_i801 lpc_ich soundcore auth_rpcgss sunrpc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_common bochs_drm virtio_net drm_kms_helper net_failover virtio_console
virtio_scsi failover syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci libahci drm libata virtio_pci crc32c_intel virtio_ring serio_raw virtio drm_panel_orientation_quirks
CPU: 5 PID: 41606 Comm: kworker/5:0H Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.95.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014
Workqueue: xprtiod rpc_async_schedule [sunrpc]
task: ffff8ae10742d280 ti: ffff8ae11deb4000 task.ti: ffff8ae11deb4000
RIP: 0010:[<ffffffffbd31e1ca>]  [<ffffffffbd31e1ca>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8ae11deb7938  EFLAGS: 00000202
RAX: 000000000000002b RBX: 00000000000000fc RCX: ffff8aed224e06a0
RDX: 000000000000002b RSI: 0000000000000050 RDI: 0000000000000000
RBP: ffff8ae11deb7970 R08: ffff8ad887ad0400 R09: ffffffffbd59c749
R10: ffff8aed21b5f160 R11: fffff35904ca0800 R12: 0000000000000292
R13: 0000000000000018 R14: ffff8ae11deb78a8 R15: 0000000000000292
FS:  0000000000000000(0000) GS:ffff8aed21b40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00002af51442b9e5 CR3: 00000006680ca000 CR4: 00000000000407e0
Call Trace:
[<ffffffffbd3d2850>] ? drain_pages+0xb0/0xb0
[<ffffffffbd31e319>] on_each_cpu_mask+0x29/0x70
[<ffffffffbd3cf655>] drain_all_pages+0xb5/0xd0
[<ffffffffbd3d463b>] __alloc_pages_nodemask+0x8db/0xbf0
[<ffffffffbd4259d8>] alloc_pages_current+0x98/0x110
[<ffffffffbd43455b>] new_slab+0x39b/0x4e0
[<ffffffffbd434a6c>] ___slab_alloc+0x3cc/0x520
[<ffffffffc065beb9>] ? xprt_alloc_slot+0xf9/0x170 [sunrpc]
[<ffffffffc065beb9>] ? xprt_alloc_slot+0xf9/0x170 [sunrpc]
[<ffffffffbd9ae458>] __slab_alloc+0x40/0x60
[<ffffffffbd435e67>] kmem_cache_alloc_trace+0x1a7/0x200
[<ffffffffc065beb9>] xprt_alloc_slot+0xf9/0x170 [sunrpc]
[<ffffffffc065bf83>] xprt_lock_and_alloc_slot+0x53/0x90 [sunrpc]
[<ffffffffc06573f0>] ? call_connect_status+0x170/0x170 [sunrpc]
[<ffffffffc06573f0>] ? call_connect_status+0x170/0x170 [sunrpc]
[<ffffffffc065ace0>] xprt_do_reserve+0x20/0x130 [sunrpc]
[<ffffffffc06573f0>] ? call_connect_status+0x170/0x170 [sunrpc]
[<ffffffffc06573f0>] ? call_connect_status+0x170/0x170 [sunrpc]
[<ffffffffc065ca66>] xprt_retry_reserve+0x46/0x50 [sunrpc]
[<ffffffffc065741d>] call_retry_reserve+0x2d/0x60 [sunrpc]
[<ffffffffc0665969>] __rpc_execute+0x99/0x420 [sunrpc]
[<ffffffffc0665d02>] rpc_async_schedule+0x12/0x20 [sunrpc]
[<ffffffffbd2c32ef>] process_one_work+0x17f/0x440
[<ffffffffbd2c4436>] worker_thread+0x126/0x3c0
[<ffffffffbd2c4310>] ? manage_workers.isra.26+0x2b0/0x2b0
[<ffffffffbd2cb621>] kthread+0xd1/0xe0
[<ffffffffbd2cb550>] ? insert_kthread_work+0x40/0x40
[<ffffffffbd9c51f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffbd2cb550>] ? insert_kthread_work+0x40/0x40
Code: 48 63 35 7e 18 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 00 19 f5 bd f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 4d 18 c4 00 eb b7 0f b6 4d cc 4c 89 
Complete report #1295050
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffff819170da
Build id: 3.10.0-1160.53.1.el7.x86_64
0x20a
2
? drain_pages
vmlinux 0xffffffff819c78e0
Build id: 3.10.0-1160.53.1.el7.x86_64
0xb0
3
on_each_cpu_mask
vmlinux 0xffffffff81917229
Build id: 3.10.0-1160.53.1.el7.x86_64
0x29
4
drain_all_pages
vmlinux 0xffffffff819c47c5
Build id: 3.10.0-1160.53.1.el7.x86_64
0xb5
5
__alloc_pages_nodemask
vmlinux 0xffffffff819c964b
Build id: 3.10.0-1160.53.1.el7.x86_64
0x8cb
6
alloc_pages_current
vmlinux 0xffffffff81a193b8
Build id: 3.10.0-1160.53.1.el7.x86_64
0x98
7
new_slab
vmlinux 0xffffffff81a27aa3
Build id: 3.10.0-1160.53.1.el7.x86_64
0x393
8
___slab_alloc
vmlinux 0xffffffff81a27fbc
Build id: 3.10.0-1160.53.1.el7.x86_64
0x3cc
9
? xprt_alloc_slot
sunrpc 0xffffffffc052fbe9
Build id: 3.10.0-1160.53.1.el7.x86_64
0xf9
10
? mempool_alloc_slab
vmlinux 0xffffffff819c1505
Build id: 3.10.0-1160.53.1.el7.x86_64
0x15
11
? xprt_alloc_slot
sunrpc 0xffffffffc052fbe9
Build id: 3.10.0-1160.53.1.el7.x86_64
0xf9
12
__slab_alloc
vmlinux 0xffffffff81f7fea5
Build id: 3.10.0-1160.53.1.el7.x86_64
0x40
13
kmem_cache_alloc_trace
vmlinux 0xffffffff81a29377
Build id: 3.10.0-1160.53.1.el7.x86_64
0x1a7
14
xprt_alloc_slot
sunrpc 0xffffffffc052fbe9
Build id: 3.10.0-1160.53.1.el7.x86_64
0xf9
15
xprt_lock_and_alloc_slot
sunrpc 0xffffffffc052fcb3
Build id: 3.10.0-1160.53.1.el7.x86_64
0x53
16
? call_connect_status
sunrpc 0xffffffffc052b340
Build id: 3.10.0-1160.53.1.el7.x86_64
0x170
17
? call_connect_status
sunrpc 0xffffffffc052b340
Build id: 3.10.0-1160.53.1.el7.x86_64
0x170
18
xprt_do_reserve
sunrpc 0xffffffffc052eac0
Build id: 3.10.0-1160.53.1.el7.x86_64
0x20
19
? call_connect_status
sunrpc 0xffffffffc052b340
Build id: 3.10.0-1160.53.1.el7.x86_64
0x170
20
? call_connect_status
sunrpc 0xffffffffc052b340
Build id: 3.10.0-1160.53.1.el7.x86_64
0x170
21
xprt_retry_reserve
sunrpc 0xffffffffc053076e
Build id: 3.10.0-1160.53.1.el7.x86_64
0x3e
22
call_retry_reserve
sunrpc 0xffffffffc052b36d
Build id: 3.10.0-1160.53.1.el7.x86_64
0x2d
23
__rpc_execute
sunrpc 0xffffffffc05391c9
Build id: 3.10.0-1160.53.1.el7.x86_64
0x99
24
rpc_async_schedule
sunrpc 0xffffffffc0539562
Build id: 3.10.0-1160.53.1.el7.x86_64
0x12
25
process_one_work
vmlinux 0xffffffff818bde8f
Build id: 3.10.0-1160.53.1.el7.x86_64
0x17f
26
worker_thread
vmlinux 0xffffffff818befa6
Build id: 3.10.0-1160.53.1.el7.x86_64
0x126
27
? manage_workers.isra.26
vmlinux 0xffffffff818bee80
Build id: 3.10.0-1160.53.1.el7.x86_64
0x2a0
28
kthread
vmlinux 0xffffffff818c5e61
Build id: 3.10.0-1160.53.1.el7.x86_64
0xd1
29
? insert_kthread_work
vmlinux 0xffffffff818c5d90
Build id: 3.10.0-1160.53.1.el7.x86_64
0x40
30
ret_from_fork_nospec_begin
vmlinux 0xffffffff81f95ddd
Build id: 3.10.0-1160.53.1.el7.x86_64
0x7
31
? insert_kthread_work
vmlinux 0xffffffff818c5d90
Build id: 3.10.0-1160.53.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 29s! [kworker/7:2H:81790]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter tun bridge stp llc nfsv3 nfs_acl nfs lockd grace fscache vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod ata_generic cdrom pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod crc_t10dif crct10dif_generic drm ahci libahci nfit
ata_piix crct10dif_pclmul crct10dif_common libnvdimm crc32c_intel libata serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks fuse
CPU: 7 PID: 81790 Comm: kworker/7:2H Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.53.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
Workqueue: xprtiod rpc_async_schedule [sunrpc]
task: ffff97c4b80a3180 ti: ffff97c501d80000 task.ti: ffff97c501d80000
RIP: 0010:[<ffffffff819170da>]  [<ffffffff819170da>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff97c501d83938  EFLAGS: 00000202
RAX: 0000000000000004 RBX: 00000000000000fc RCX: ffff97c6b37206f0
RDX: 0000000000000004 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff97c501d83970 R08: ffff97c578c6c800 R09: ffffffff81b86bf9
R10: ffff97c6b37df160 R11: fffff40a801ff200 R12: 0000000000000292
R13: ffff97c501d838e8 R14: 0000000001320122 R15: 00000000c2d02fae
FS:  0000000000000000(0000) GS:ffff97c6b37c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f29b2607000 CR3: 0000000035d90000 CR4: 00000000007607e0
PKRU: 00000000
Call Trace:
[<ffffffff819c78e0>] ? drain_pages+0xb0/0xb0
[<ffffffff81917229>] on_each_cpu_mask+0x29/0x70
[<ffffffff819c47c5>] drain_all_pages+0xb5/0xc0
[<ffffffff819c964b>] __alloc_pages_nodemask+0x8cb/0xbe0
[<ffffffff81a193b8>] alloc_pages_current+0x98/0x110
[<ffffffff81a27aa3>] new_slab+0x393/0x4e0
[<ffffffff81a27fbc>] ___slab_alloc+0x3cc/0x520
[<ffffffffc052fbe9>] ? xprt_alloc_slot+0xf9/0x170 [sunrpc]
[<ffffffff819c1505>] ? mempool_alloc_slab+0x15/0x20
[<ffffffffc052fbe9>] ? xprt_alloc_slot+0xf9/0x170 [sunrpc]
[<ffffffff81f7fea5>] __slab_alloc+0x40/0x5c
[<ffffffff81a29377>] kmem_cache_alloc_trace+0x1a7/0x200
[<ffffffffc052fbe9>] xprt_alloc_slot+0xf9/0x170 [sunrpc]
[<ffffffffc052fcb3>] xprt_lock_and_alloc_slot+0x53/0x80 [sunrpc]
[<ffffffffc052b340>] ? call_connect_status+0x170/0x170 [sunrpc]
[<ffffffffc052b340>] ? call_connect_status+0x170/0x170 [sunrpc]
[<ffffffffc052eac0>] xprt_do_reserve+0x20/0x130 [sunrpc]
[<ffffffffc052b340>] ? call_connect_status+0x170/0x170 [sunrpc]
[<ffffffffc052b340>] ? call_connect_status+0x170/0x170 [sunrpc]
[<ffffffffc053076e>] xprt_retry_reserve+0x3e/0x40 [sunrpc]
[<ffffffffc052b36d>] call_retry_reserve+0x2d/0x60 [sunrpc]
[<ffffffffc05391c9>] __rpc_execute+0x99/0x420 [sunrpc]
[<ffffffffc0539562>] rpc_async_schedule+0x12/0x20 [sunrpc]
[<ffffffff818bde8f>] process_one_work+0x17f/0x440
[<ffffffff818befa6>] worker_thread+0x126/0x3c0
[<ffffffff818bee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff818c5e61>] kthread+0xd1/0xe0
[<ffffffff818c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffff81f95ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff818c5d90>] ? insert_kthread_work+0x40/0x40
Code: 48 63 35 ce 85 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 15 55 82 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 85 c4 00 eb b7 0f b6 4d cc 4c 89 
Complete report #931472
Frame # Function Binary Source or offset Line
1
smp_call_function_many
vmlinux 0xffffffff9ad170da
Build id: 3.10.0-1160.53.1.el7.x86_64
0x20a
2
? drain_pages
vmlinux 0xffffffff9adc78e0
Build id: 3.10.0-1160.53.1.el7.x86_64
0xb0
3
on_each_cpu_mask
vmlinux 0xffffffff9ad17229
Build id: 3.10.0-1160.53.1.el7.x86_64
0x29
4
drain_all_pages
vmlinux 0xffffffff9adc47c5
Build id: 3.10.0-1160.53.1.el7.x86_64
0xb5
5
__alloc_pages_nodemask
vmlinux 0xffffffff9adc964b
Build id: 3.10.0-1160.53.1.el7.x86_64
0x8cb
6
alloc_pages_current
vmlinux 0xffffffff9ae193b8
Build id: 3.10.0-1160.53.1.el7.x86_64
0x98
7
new_slab
vmlinux 0xffffffff9ae27aa3
Build id: 3.10.0-1160.53.1.el7.x86_64
0x393
8
___slab_alloc
vmlinux 0xffffffff9ae27fbc
Build id: 3.10.0-1160.53.1.el7.x86_64
0x3cc
9
? xprt_alloc_slot
sunrpc 0xffffffffc074abe9
Build id: 3.10.0-1160.53.1.el7.x86_64
0xf9
10
? xprt_alloc_slot
sunrpc 0xffffffffc074abe9
Build id: 3.10.0-1160.53.1.el7.x86_64
0xf9
11
__slab_alloc
vmlinux 0xffffffff9b37fea5
Build id: 3.10.0-1160.53.1.el7.x86_64
0x40
12
kmem_cache_alloc_trace
vmlinux 0xffffffff9ae29377
Build id: 3.10.0-1160.53.1.el7.x86_64
0x1a7
13
xprt_alloc_slot
sunrpc 0xffffffffc074abe9
Build id: 3.10.0-1160.53.1.el7.x86_64
0xf9
14
xprt_lock_and_alloc_slot
sunrpc 0xffffffffc074acb3
Build id: 3.10.0-1160.53.1.el7.x86_64
0x53
15
? call_connect_status
sunrpc 0xffffffffc0746340
Build id: 3.10.0-1160.53.1.el7.x86_64
0x170
16
? call_connect_status
sunrpc 0xffffffffc0746340
Build id: 3.10.0-1160.53.1.el7.x86_64
0x170
17
xprt_do_reserve
sunrpc 0xffffffffc0749ac0
Build id: 3.10.0-1160.53.1.el7.x86_64
0x20
18
? call_connect_status
sunrpc 0xffffffffc0746340
Build id: 3.10.0-1160.53.1.el7.x86_64
0x170
19
? call_connect_status
sunrpc 0xffffffffc0746340
Build id: 3.10.0-1160.53.1.el7.x86_64
0x170
20
xprt_retry_reserve
sunrpc 0xffffffffc074b76e
Build id: 3.10.0-1160.53.1.el7.x86_64
0x3e
21
call_retry_reserve
sunrpc 0xffffffffc074636d
Build id: 3.10.0-1160.53.1.el7.x86_64
0x2d
22
__rpc_execute
sunrpc 0xffffffffc07541c9
Build id: 3.10.0-1160.53.1.el7.x86_64
0x99
23
rpc_async_schedule
sunrpc 0xffffffffc0754562
Build id: 3.10.0-1160.53.1.el7.x86_64
0x12
24
process_one_work
vmlinux 0xffffffff9acbde8f
Build id: 3.10.0-1160.53.1.el7.x86_64
0x17f
25
worker_thread
vmlinux 0xffffffff9acbefa6
Build id: 3.10.0-1160.53.1.el7.x86_64
0x126
26
? manage_workers.isra.26
vmlinux 0xffffffff9acbee80
Build id: 3.10.0-1160.53.1.el7.x86_64
0x2a0
27
kthread
vmlinux 0xffffffff9acc5e61
Build id: 3.10.0-1160.53.1.el7.x86_64
0xd1
28
? insert_kthread_work
vmlinux 0xffffffff9acc5d90
Build id: 3.10.0-1160.53.1.el7.x86_64
0x40
29
ret_from_fork_nospec_begin
vmlinux 0xffffffff9b395ddd
Build id: 3.10.0-1160.53.1.el7.x86_64
0x7
30
? insert_kthread_work
vmlinux 0xffffffff9acc5d90
Build id: 3.10.0-1160.53.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/0:2H:24771]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter tun bridge stp llc nfsv3 nfs_acl nfs lockd grace fscache vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev joydev pcspkr sg vmw_balloon parport_pc parport vmw_vmci i2c_piix4 auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper nfit syscopyarea sysfillrect sysimgblt libnvdimm fb_sys_fops ttm ahci sd_mod libahci ata_piix crc_t10dif crct10dif_generic
drm libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks fuse
CPU: 0 PID: 24771 Comm: kworker/0:2H Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.53.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
Workqueue: xprtiod rpc_async_schedule [sunrpc]
task: ffff97a895194200 ti: ffff97a943fa4000 task.ti: ffff97a943fa4000
RIP: 0010:[<ffffffff9ad170da>]  [<ffffffff9ad170da>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff97a943fa7938  EFLAGS: 00000202
RAX: 0000000000000002 RBX: 00000000000000fc RCX: ffff97aaffc9fc10
RDX: 0000000000000002 RSI: 0000000000000006 RDI: 0000000000000000
RBP: ffff97a943fa7970 R08: ffff97a9bfd4f800 R09: ffffffff9af86bf9
R10: ffff97aaffc1f160 R11: ffffe144807dab00 R12: 0000000000000292
R13: ffff97a943fa78e8 R14: 0000000001320122 R15: 0000000008dce377
FS:  0000000000000000(0000) GS:ffff97aaffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2ebd521000 CR3: 00000002a391a000 CR4: 00000000007607f0
PKRU: 00000000
Call Trace:
[<ffffffff9adc78e0>] ? drain_pages+0xb0/0xb0
[<ffffffff9ad17229>] on_each_cpu_mask+0x29/0x70
[<ffffffff9adc47c5>] drain_all_pages+0xb5/0xc0
[<ffffffff9adc964b>] __alloc_pages_nodemask+0x8cb/0xbe0
[<ffffffff9ae193b8>] alloc_pages_current+0x98/0x110
[<ffffffff9ae27aa3>] new_slab+0x393/0x4e0
[<ffffffff9ae27fbc>] ___slab_alloc+0x3cc/0x520
[<ffffffffc074abe9>] ? xprt_alloc_slot+0xf9/0x170 [sunrpc]
[<ffffffffc074abe9>] ? xprt_alloc_slot+0xf9/0x170 [sunrpc]
[<ffffffff9b37fea5>] __slab_alloc+0x40/0x5c
[<ffffffff9ae29377>] kmem_cache_alloc_trace+0x1a7/0x200
[<ffffffffc074abe9>] xprt_alloc_slot+0xf9/0x170 [sunrpc]
[<ffffffffc074acb3>] xprt_lock_and_alloc_slot+0x53/0x80 [sunrpc]
[<ffffffffc0746340>] ? call_connect_status+0x170/0x170 [sunrpc]
[<ffffffffc0746340>] ? call_connect_status+0x170/0x170 [sunrpc]
[<ffffffffc0749ac0>] xprt_do_reserve+0x20/0x130 [sunrpc]
[<ffffffffc0746340>] ? call_connect_status+0x170/0x170 [sunrpc]
[<ffffffffc0746340>] ? call_connect_status+0x170/0x170 [sunrpc]
[<ffffffffc074b76e>] xprt_retry_reserve+0x3e/0x40 [sunrpc]
[<ffffffffc074636d>] call_retry_reserve+0x2d/0x60 [sunrpc]
[<ffffffffc07541c9>] __rpc_execute+0x99/0x420 [sunrpc]
[<ffffffffc0754562>] rpc_async_schedule+0x12/0x20 [sunrpc]
[<ffffffff9acbde8f>] process_one_work+0x17f/0x440
[<ffffffff9acbefa6>] worker_thread+0x126/0x3c0
[<ffffffff9acbee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff9acc5e61>] kthread+0xd1/0xe0
[<ffffffff9acc5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffff9b395ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff9acc5d90>] ? insert_kthread_work+0x40/0x40
Code: 48 63 35 ce 85 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 15 95 9b f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 85 c4 00 eb b7 0f b6 4d cc 4c 89