Complete report #1394331
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_queued_spin_lock_slowpath
|
vmlinux |
0xffffffffb1d1ed10
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x1d0
|
|
2
|
queued_spin_lock_slowpath
|
vmlinux |
0xffffffffb23ac21a
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0xb
|
|
3
|
_raw_spin_lock
|
vmlinux |
0xffffffffb23ba734
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x24
|
|
4
|
nfsd4_put_session
|
nfsd |
0xffffffffc079d6fd
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x4d
|
|
5
|
nfsd4_sequence_done
|
nfsd |
0xffffffffc07a07e8
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0xf8
|
|
6
|
nfs4svc_encode_compoundres
|
nfsd |
0xffffffffc079b156
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x76
|
|
7
|
nfsd_dispatch
|
nfsd |
0xffffffffc077a943
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x163
|
|
8
|
svc_process_common
|
sunrpc |
0xffffffffc05b8250
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x410
|
|
9
|
svc_process
|
sunrpc |
0xffffffffc05b871b
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0xfb
|
|
10
|
nfsd
|
nfsd |
0xffffffffc077a1ff
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0xdf
|
|
11
|
|
nfsd |
0xffffffffc077a120
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x80
|
|
12
|
kthread
|
vmlinux |
0xffffffffb1ccb621
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0xd1
|
|
13
|
|
vmlinux |
0xffffffffb1ccb550
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x40
|
|
14
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffb23c51f7
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x21
|
|
15
|
|
vmlinux |
0xffffffffb1ccb550
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#16 stuck for 22s! [nfsd:29504]
Modules linked in: nfsv4 dns_resolver nfs fscache rpcsec_gss_krb5 nfnetlink_queue nfnetlink_log bluetooth rfkill ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c iptable_filter iTCO_wdt iTCO_vendor_support mxm_wmi dcdbas sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass pcspkr sg ipmi_si ipmi_devintf ipmi_msghandler lpc_ich wmi acpi_power_meter nfsd auth_rpcgss nfs_acl lockd sch_fq_codel grace br_netfilter sunrpc bridge stp llc binfmt_misc ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic mgag200 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt ahci fb_sys_fops ttm crct10dif_pclmul crct10dif_common libahci crc32_pclmul crc32c_intel drm ghash_clmulni_intel libata aesni_intel
glue_helper lrw gf128mul megaraid_sas tg3 ablk_helper cryptd ptp drm_panel_orientation_quirks pps_core dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 16 PID: 29504 Comm: nfsd Tainted: G L ------------ 3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.7.1 001/22/2018
task: ffff8f61d1723180 ti: ffff8f61d39c4000 task.ti: ffff8f61d39c4000
RIP: 0010:[<ffffffffb1d1ed10>] [<ffffffffb1d1ed10>] native_queued_spin_lock_slowpath+0x1d0/0x200
RSP: 0018:ffff8f61d39c7d48 EFLAGS: 00000293
RAX: 0000000000000001 RBX: ffff8f6100000031 RCX: 0000000000000001
RDX: 0000000000000101 RSI: 0000000000000001 RDI: ffff8f59db276d48
RBP: ffff8f61d39c7d48 R08: 0000000000000101 R09: ffffffffb2c3fc0d
R10: 00000000000f5cb0 R11: 0000000000100000 R12: ffffffffb1ca2654
R13: ffff8f61d39c7d18 R14: 0000000000000006 R15: ffffffffb1ca09c9
FS: 0000000000000000(0000) GS:ffff8f59dfa00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f84746e6000 CR3: 0000000f74410000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffb23ac21a>] queued_spin_lock_slowpath+0xb/0x13
[<ffffffffb23ba734>] _raw_spin_lock+0x24/0x30
[<ffffffffc079d6fd>] nfsd4_put_session+0x4d/0x70 [nfsd]
[<ffffffffc07a07e8>] nfsd4_sequence_done+0xf8/0x250 [nfsd]
[<ffffffffc079b156>] nfs4svc_encode_compoundres+0x76/0xb0 [nfsd]
[<ffffffffc077a943>] nfsd_dispatch+0x163/0x290 [nfsd]
[<ffffffffc05b8250>] svc_process_common+0x410/0x7e0 [sunrpc]
[<ffffffffc05b871b>] svc_process+0xfb/0x110 [sunrpc]
[<ffffffffc077a1ff>] nfsd+0xdf/0x150 [nfsd]
[<ffffffffc077a120>] ? nfsd_destroy+0x80/0x80 [nfsd]
[<ffffffffb1ccb621>] kthread+0xd1/0xe0
[<ffffffffb1ccb550>] ? insert_kthread_work+0x40/0x40
[<ffffffffb23c51f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb1ccb550>] ? insert_kthread_work+0x40/0x40
Code: 44 00 00 f3 90 8b 37 81 fe 00 01 00 00 74 f4 e9 8b fe ff ff 0f 1f 80 00 00 00 00 83 fa 01 75 11 e9 63 fe ff ff 66 0f 1f 44 00 00 <85> c0 74 0c f3 90 8b 07 0f b6 c0 83 f8 03 75 f0 b8 01 00 00 00
Complete report #433291
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_queued_spin_lock_slowpath
|
vmlinux |
0xffffffffa0b090a0
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x1d0
|
|
2
|
queued_spin_lock_slowpath
|
vmlinux |
0xffffffffa1109510
Build id: 3.10.0-862.9.1.el7.x86_64
|
0xb
|
|
3
|
_raw_spin_lock
|
vmlinux |
0xffffffffa1116840
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x20
|
|
4
|
nfsd4_put_session
|
nfsd |
0xffffffffc0774d6d
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x4d
|
|
5
|
nfsd4_sequence_done
|
nfsd |
0xffffffffc0777b18
Build id: 3.10.0-862.9.1.el7.x86_64
|
0xf8
|
|
6
|
nfs4svc_encode_compoundres
|
nfsd |
0xffffffffc07728f6
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x76
|
|
7
|
nfsd_dispatch
|
nfsd |
0xffffffffc0752613
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x163
|
|
8
|
svc_process_common
|
sunrpc |
0xffffffffc070d866
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x466
|
|
9
|
svc_process
|
sunrpc |
0xffffffffc070dc13
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x103
|
|
10
|
nfsd
|
nfsd |
0xffffffffc0751eef
Build id: 3.10.0-862.9.1.el7.x86_64
|
0xdf
|
|
11
|
|
nfsd |
0xffffffffc0751e10
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x80
|
|
12
|
kthread
|
vmlinux |
0xffffffffa0abb621
Build id: 3.10.0-862.9.1.el7.x86_64
|
0xd1
|
|
13
|
|
vmlinux |
0xffffffffa0abb550
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x40
|
|
14
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffa11205f7
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x21
|
|
15
|
|
vmlinux |
0xffffffffa0abb550
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#30 stuck for 23s! [nfsd:16302]
Modules linked in: nfnetlink_queue nfnetlink_log nfnetlink bluetooth rfkill fuse nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c iptable_filter sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm joydev irqbypass dcdbas iTCO_wdt ipmi_si iTCO_vendor_support ipmi_devintf mxm_wmi sg pcspkr ipmi_msghandler lpc_ich wmi shpchp acpi_power_meter nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc sch_fq_codel ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic mgag200 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common ahci crc32_pclmul crc32c_intel ghash_clmulni_intel drm libahci aesni_intel
glue_helper libata lrw gf128mul tg3 ablk_helper cryptd megaraid_sas i2c_core ptp pps_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 30 PID: 16302 Comm: nfsd Tainted: G W L ------------ 3.10.0-862.9.1.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.7.1 001/22/2018
task: ffff8c56b9269fa0 ti: ffff8c5aa1ddc000 task.ti: ffff8c5aa1ddc000
RIP: 0010:[<ffffffffa0b090a0>] [<ffffffffa0b090a0>] native_queued_spin_lock_slowpath+0x1d0/0x200
RSP: 0018:ffff8c5aa1ddfd48 EFLAGS: 00000202
RAX: 0000000000110101 RBX: ffffffff00000031 RCX: 0000000000000001
RDX: 0000000000000101 RSI: 0000000000000001 RDI: ffff8c59a94d0d48
RBP: ffff8c5aa1ddfd48 R08: 0000000000000101 R09: ffffffffa1a6a081
R10: 000000000005587c R11: 0000000000100000 R12: ffffffffa0a94a94
R13: ffff8c5aa1ddfd18 R14: 0000000000000006 R15: ffffffffa0a92ed9
FS: 0000000000000000(0000) GS:ffff8c59ae9c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00002b7631fa11e4 CR3: 00000004e8e5e000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa1109510>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffffa1116840>] _raw_spin_lock+0x20/0x30
[<ffffffffc0774d6d>] nfsd4_put_session+0x4d/0x70 [nfsd]
[<ffffffffc0777b18>] nfsd4_sequence_done+0xf8/0x250 [nfsd]
[<ffffffffc07728f6>] nfs4svc_encode_compoundres+0x76/0xb0 [nfsd]
[<ffffffffc0752613>] nfsd_dispatch+0x163/0x290 [nfsd]
[<ffffffffc070d866>] svc_process_common+0x466/0x710 [sunrpc]
[<ffffffffc070dc13>] svc_process+0x103/0x190 [sunrpc]
[<ffffffffc0751eef>] nfsd+0xdf/0x150 [nfsd]
[<ffffffffc0751e10>] ? nfsd_destroy+0x80/0x80 [nfsd]
[<ffffffffa0abb621>] kthread+0xd1/0xe0
[<ffffffffa0abb550>] ? insert_kthread_work+0x40/0x40
[<ffffffffa11205f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa0abb550>] ? insert_kthread_work+0x40/0x40
Code: fe 00 01 00 00 74 f4 e9 93 fe ff ff 0f 1f 80 00 00 00 00 83 fa 01 75 11 0f 1f 00 e9 68 fe ff ff 0f 1f 00 85 c0 74 0c f3 90 8b 07 <0f> b6 c0 83 f8 03 75 f0 b8 01 00 00 00 66 89 07 5d c3 66 0f 1f