Info

Permalink
Function
nfs_reap_expired_delegations
First occurrence
2021-04-06
Last occurrence
2021-06-30
State
NEW
Components
kernel
Quality
-19

Statistics

Operating system Count
CentOS 7 8,092
Architecture Count
x86_64 8,092
Related packages Count
kernel 8,092
 0:3.10.0-693.el7 8,091
 0:3.10.0-957.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #627522
Frame # Function Binary Source or offset Line
1
nfs_reap_expired_delegations
nfsv4 0xffffffffc07b1d3a
Build id: 3.10.0-957.el7.x86_64
0x9a
2
nfs4_state_manager
nfsv4 0xffffffffc07adfad
Build id: 3.10.0-957.el7.x86_64
0x5fd
3
? nfs4_state_manager
nfsv4 0xffffffffc07ae280
Build id: 3.10.0-957.el7.x86_64
0x8d0
4
nfs4_run_state_manager
nfsv4 0xffffffffc07ae29f
Build id: 3.10.0-957.el7.x86_64
0x1f
5
kthread
vmlinux 0xffffffffa54c1c31
Build id: 3.10.0-957.el7.x86_64
0xd1
6
? insert_kthread_work
vmlinux 0xffffffffa54c1b60
Build id: 3.10.0-957.el7.x86_64
0x40
7
ret_from_fork_nospec_begin
vmlinux 0xffffffffa5b74c37
Build id: 3.10.0-957.el7.x86_64
0x21
8
? insert_kthread_work
vmlinux 0xffffffffa54c1b60
Build id: 3.10.0-957.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#16 stuck for 23s! [10.0.4.23-manag:87581]
Modules linked in: binfmt_misc rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi team_mode_activebackup team sunrpc iTCO_wdt iTCO_vendor_support mxm_wmi sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ipmi_ssif pcspkr joydev lpc_ich sg mei_me i2c_i801 mei ioatdma ipmi_si ipmi_devintf ipmi_msghandler wmi acpi_pad acpi_power_meter ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic mgag200 drm_kms_helper crct10dif_pclmul crct10dif_common crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ixgbe ahci libahci igb libata mdio ptp pps_core drm_panel_orientation_quirks dca
i2c_algo_bit dm_mirror dm_region_hash dm_log dm_mod
CPU: 16 PID: 87581 Comm: 10.0.4.23-manag Kdump: loaded Tainted: G             L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: Intel Corporation S2600WTTR/S2600WTTR, BIOS SE5C610.86B.01.01.0027.071020182329 07/10/2018
task: ffff911286d1e180 ti: ffff91150e1f8000 task.ti: ffff91150e1f8000
RIP: 0010:[<ffffffffc07b1d3a>]  [<ffffffffc07b1d3a>] nfs_reap_expired_delegations+0x9a/0x230 [nfsv4]
RSP: 0018:ffff91150e1fbdf8  EFLAGS: 00000287
RAX: 0000000000000022 RBX: ffff91227ca1f120 RCX: ffff91227447b800
RDX: 0000000000000000 RSI: 0000000000000006 RDI: ffff912274478800
RBP: ffff91150e1fbe58 R08: ffff91227447888c R09: 0000000000000000
R10: ffff91227ca1f120 R11: ffffeab80445ab00 R12: ffff91227447b800
R13: ffff91150e1fbde8 R14: ffff91227447888c R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff91227ca00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f1e41a06000 CR3: 00000003afe10000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffc07adfad>] nfs4_state_manager+0x5fd/0x8d0 [nfsv4]
[<ffffffffc07ae280>] ? nfs4_state_manager+0x8d0/0x8d0 [nfsv4]
[<ffffffffc07ae29f>] nfs4_run_state_manager+0x1f/0x40 [nfsv4]
[<ffffffffa54c1c31>] kthread+0xd1/0xe0
[<ffffffffa54c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffffa5b74c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa54c1b60>] ? insert_kthread_work+0x40/0x40
Code: 24 10 4c 8b 7c 24 10 49 39 df 75 1b e9 f0 00 00 00 49 8b 07 48 89 44 24 10 4c 8b 7c 24 10 49 39 df 0f 84 da 00 00 00 49 8b 47 48 <a8> 10 75 e2 49 8b 47 48 a8 40 74 da 49 8b be 70 03 00 00 e8 9e 
Complete report #937586
Frame # Function Binary Source or offset Line
1
nfs_delegation_grab_inode
nfsv4 0xffffffffc07813a5
Build id: 3.10.0-693.el7.x86_64
0x5
2
? nfs_reap_expired_delegations
nfsv4 0xffffffffc07828be
Build id: 3.10.0-693.el7.x86_64
0xbe
3
nfs4_state_manager
nfsv4 0xffffffffc077ec22
Build id: 3.10.0-693.el7.x86_64
0x5f2
4
? nfs4_state_manager
nfsv4 0xffffffffc077eef0
Build id: 3.10.0-693.el7.x86_64
0x8c0
5
nfs4_run_state_manager
nfsv4 0xffffffffc077ef0f
Build id: 3.10.0-693.el7.x86_64
0x1f
6
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
0xcf
7
? do_exit
vmlinux 0xffffffff8108ddeb
Build id: 3.10.0-693.el7.x86_64
0x6bb
8
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
9
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
0x58
10
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#10 stuck for 22s! [10.1.1.151-mana:19113]
Modules linked in: fuse rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter iTCO_wdt dell_smbios iTCO_vendor_support sparse_keymap dcdbas intel_powerclamp coretemp kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ipmi_ssif pcspkr sg mei_me mei shpchp i2c_i801 wmi ipmi_si ipmi_devintf ipmi_msghandler acpi_pad acpi_power_meter nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic mgag200 i2c_algo_bit drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops crct10dif_pclmul ttm crct10dif_common crc32c_intel drm ahci libahci tg3 libata megaraid_sas bnxt_en ptp i2c_core pps_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 10 PID: 19113 Comm: 10.1.1.151-mana Tainted: G        W      ------------   3.10.0-693.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R750/06V45N, BIOS 1.3.8 08/31/2021
task: ffff880026d29fa0 ti: ffff880113290000 task.ti: ffff880113290000
RIP: 0010:[<ffffffffc07813a5>]  [<ffffffffc07813a5>] nfs_delegation_grab_inode+0x5/0x50 [nfsv4]
RSP: 0018:ffff880113293df0  EFLAGS: 00000202
RAX: 0000000000000001 RBX: ffff882fafb59c40 RCX: ffff882f9c790800
RDX: 0000000000000008 RSI: 0000000000000008 RDI: ffff882facf31c00
RBP: ffff880113293e58 R08: ffff882f9c79408c R09: ffffffff81185477
R10: ffff882fafb59c40 R11: ffffea0001642a80 R12: ffff882fafb59c40
R13: ffff880113293de8 R14: ffff882f9c79408c R15: ffff880113293de8
FS:  0000000000000000(0000) GS:ffff882fafb40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055f3ba9a3ff0 CR3: 00000000019f2000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
ffffffffc07828be ffffffffc079b340 ffff886246cdcb40 ffff882facf31c00
0100000013293e38 cf12717965e13624 000000044b34a795 00000000a902b340
ffff882fabb94400 ffff882fabb94400 ffff882fabb944c8 ffff882fabb94530
Call Trace:
[<ffffffffc07828be>] ? nfs_reap_expired_delegations+0xbe/0x220 [nfsv4]
[<ffffffffc077ec22>] nfs4_state_manager+0x5f2/0x8c0 [nfsv4]
[<ffffffffc077eef0>] ? nfs4_state_manager+0x8c0/0x8c0 [nfsv4]
[<ffffffffc077ef0f>] nfs4_run_state_manager+0x1f/0x40 [nfsv4]
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff8108ddeb>] ? do_exit+0x6bb/0xa40
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 89 d1 48 8d 56 20 48 8b 76 10 e8 17 c6 fe ff 41 89 c4 48 89 df e8 8c ff ff ff 5b 44 89 e0 41 5c 5d c3 0f 1f 40 00 0f 1f 44 00 00 <55> 48 89 e5 41 54 49 89 fc 53 48 8d 5f 50 48 89 df e8 75 a7 f2 
Complete report #261725
Frame # Function Binary Source or offset Line
1
nfs_delegation_grab_inode
nfsv4 0xffffffffc09183ae
Build id: 3.10.0-693.el7.x86_64
0xe
2
nfs_reap_expired_delegations
nfsv4 0xffffffffc09198be
Build id: 3.10.0-693.el7.x86_64
0xbe
3
nfs4_state_manager
nfsv4 0xffffffffc0915c22
Build id: 3.10.0-693.el7.x86_64
0x5f2
4
? nfs4_state_manager
nfsv4 0xffffffffc0915ef0
Build id: 3.10.0-693.el7.x86_64
0x8c0
5
nfs4_run_state_manager
nfsv4 0xffffffffc0915f0f
Build id: 3.10.0-693.el7.x86_64
0x1f
6
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
0xcf
7
? do_exit
vmlinux 0xffffffff8108ddeb
Build id: 3.10.0-693.el7.x86_64
0x6bb
8
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
9
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
0x58
10
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [192.168.0.200-m:6560]
Modules linked in: arc4 md4 nls_utf8 cifs fuse rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter binfmt_misc vboxnetadp(OE) vboxnetflt(OE) vboxdrv(OE) vfat fat snd_hda_codec_hdmi dm_mirror dm_region_hash dm_log dm_mod snd_hda_intel snd_hda_codec snd_hda_core intel_powerclamp coretemp snd_hwdep kvm_intel kvm snd_seq joydev snd_seq_device snd_pcm irqbypass crc32_pclmul ghash_clmulni_intel snd_timer aesni_intel snd lrw gf128mul glue_helper ablk_helper cryptd soundcore ppdev sg pcspkr parport_pc shpchp parport tpm_crb acpi_pad int3400_thermal
nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic nouveau mxm_wmi i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm libahci libata crct10dif_pclmul crct10dif_common crc32c_intel r8169 serio_raw mii i2c_hid i2c_core video wmi
CPU: 4 PID: 6560 Comm: 192.168.0.200-m Tainted: G           OEL ------------   3.10.0-693.el7.x86_64 #1
Hardware name: LENOVO 90KQCTO1WW/317A, BIOS M31KT22A 10/15/2020
task: ffff8807bf371fa0 ti: ffff8807e5a90000 task.ti: ffff8807e5a90000
RIP: 0010:[<ffffffffc09183ae>]  [<ffffffffc09183ae>] nfs_delegation_grab_inode+0xe/0x50 [nfsv4]
RSP: 0018:ffff8807e5a93de0  EFLAGS: 00000202
RAX: 0000000000000001 RBX: ffff88036ae932e8 RCX: ffff880493698800
RDX: 0000000000000007 RSI: 0000000000000007 RDI: ffff8804be362580
RBP: ffff8807e5a93de8 R08: ffff88049369f88c R09: 0000000000000000
R10: 000000002ef2be01 R11: ffffea0020bbca00 R12: ffff8807e5a93d78
R13: ffff88036ae932e8 R14: 000000006d714489 R15: ffffea0020bbca00
FS:  0000000000000000(0000) GS:ffff88083eb00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffffffffc08f4fd5 CR3: 00000000019f2000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff8804bcfc48c8 ffff8807e5a93e58 ffffffffc09198be ffffffffc09323c0
ffff880838857440 ffff8804be362580 00000000c04433e0 000c3d7c61514939
0000000400000000 000000006d714489 ffff8804bcfc4800 00000000ffffd8e5
Call Trace:
[<ffffffffc09198be>] nfs_reap_expired_delegations+0xbe/0x220 [nfsv4]
[<ffffffffc0915c22>] nfs4_state_manager+0x5f2/0x8c0 [nfsv4]
[<ffffffffc0915ef0>] ? nfs4_state_manager+0x8c0/0x8c0 [nfsv4]
[<ffffffffc0915f0f>] nfs4_run_state_manager+0x1f/0x40 [nfsv4]
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff8108ddeb>] ? do_exit+0x6bb/0xa40
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 10 e8 17 c6 fe ff 41 89 c4 48 89 df e8 8c ff ff ff 5b 44 89 e0 41 5c 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 41 54 49 89 fc <53> 48 8d 5f 50 48 89 df e8 75 37 d9 c0 49 8b 7c 24 18 48 85 ff 
Complete report #1250456
Frame # Function Binary Source or offset Line
1
nfs_reap_expired_delegations
nfsv4 0xffffffffc082d88d
Build id: 3.10.0-693.el7.x86_64
0x8d
2
nfs4_state_manager
nfsv4 0xffffffffc0829c22
Build id: 3.10.0-693.el7.x86_64
0x5f2
3
? nfs4_state_manager
nfsv4 0xffffffffc0829ef0
Build id: 3.10.0-693.el7.x86_64
0x8c0
4
nfs4_run_state_manager
nfsv4 0xffffffffc0829f0f
Build id: 3.10.0-693.el7.x86_64
0x1f
5
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
0xcf
6
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
7
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
0x58
8
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#118 stuck for 22s! [10.1.1.17-manag:749]
Modules linked in: tcp_lp fuse joydev nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter iTCO_wdt dell_smbios iTCO_vendor_support sparse_keymap dcdbas vfat intel_powerclamp fat coretemp kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ipmi_ssif pcspkr sg mei_me mei i2c_i801 shpchp wmi ipmi_si ipmi_devintf ipmi_msghandler acpi_power_meter acpi_pad nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic mgag200 i2c_algo_bit
drm_kms_helper syscopyarea sysfillrect crct10dif_pclmul sysimgblt crct10dif_common fb_sys_fops crc32c_intel ttm drm ahci libahci tg3 libata megaraid_sas bnxt_en ptp i2c_core pps_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 118 PID: 749 Comm: 10.1.1.17-manag Tainted: G        W      ------------   3.10.0-693.el7.x86_64 #1
Hardware name: Dell Inc. PowerEdge R750/06V45N, BIOS 1.3.8 08/31/2021
task: ffff8801a369eeb0 ti: ffff88001a5e8000 task.ti: ffff88001a5e8000
RIP: 0010:[<ffffffffc082d88d>]  [<ffffffffc082d88d>] nfs_reap_expired_delegations+0x8d/0x220 [nfsv4]
RSP: 0000:ffff88001a5ebdf8  EFLAGS: 00000246
RAX: ffff88415143fa80 RBX: ffff887f6229108c RCX: ffff887f62297000
RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffff887f62291000
RBP: ffff88001a5ebe58 R08: ffff887f6229108c R09: ffffffff81185477
R10: ffff883f802d9c40 R11: ffffea0008bbb100 R12: ffff883f802d9c40
R13: ffffea0008bbb100 R14: ffff887f6229108c R15: ffff88001a5ebde8
FS:  0000000000000000(0000) GS:ffff883f802c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00002b7968e88000 CR3: 00000000019f2000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
ffffffffc0846340 ffff880103463740 ffff88415143fa80 010000001a5ebe38
97531cc867e152d4 0000000403578242 00000000bf417db9 ffff883f6cb7a000
ffff883f6cb7a000 ffff883f6cb7a0c8 ffff883f6cb7a130 0000000000000000
Call Trace:
[<ffffffffc0829c22>] nfs4_state_manager+0x5f2/0x8c0 [nfsv4]
[<ffffffffc0829ef0>] ? nfs4_state_manager+0x8c0/0x8c0 [nfsv4]
[<ffffffffc0829f0f>] nfs4_run_state_manager+0x1f/0x40 [nfsv4]
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 05 00 00 49 8d 9e 60 05 00 00 48 89 44 24 10 4c 8b 7c 24 10 49 39 df 75 1b e9 e8 00 00 00 49 8b 07 48 89 44 24 10 4c 8b 7c 24 10 <49> 39 df 0f 84 d2 00 00 00 49 8b 47 48 a8 10 75 e2 49 8b 47 48 
Complete report #1003732
Frame # Function Binary Source or offset Line
1
_atomic_dec_and_lock
vmlinux 0xffffffff81322950
Build id: 3.10.0-693.el7.x86_64
0x20
2
iput
vmlinux 0xffffffff8121de6b
Build id: 3.10.0-693.el7.x86_64
0x3b
3
nfs_reap_expired_delegations
nfsv4 0xffffffffc19c6952
Build id: 3.10.0-693.el7.x86_64
0x152
4
nfs4_state_manager
nfsv4 0xffffffffc19c2c22
Build id: 3.10.0-693.el7.x86_64
0x5f2
5
? nfs4_state_manager
nfsv4 0xffffffffc19c2ef0
Build id: 3.10.0-693.el7.x86_64
0x8c0
6
nfs4_run_state_manager
nfsv4 0xffffffffc19c2f0f
Build id: 3.10.0-693.el7.x86_64
0x1f
7
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
0xcf
8
? do_exit
vmlinux 0xffffffff8108ddeb
Build id: 3.10.0-693.el7.x86_64
0x6bb
9
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
10
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
0x58
11
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#25 stuck for 23s! [10.210.38.25-ma:5965]
Modules linked in: nvidia_uvm(OE) nvidia(POE) 8021q garp mrp stp llc panfs(POE) nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache ib_isert iscsi_target_mod ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ucm dm_mirror dm_region_hash dm_log dm_mod rpcrdma rdma_ucm ib_uverbs ib_iser ib_umad ib_ipoib rdma_cm iw_cm libiscsi ib_cm scsi_transport_iscsi skx_edac edac_core intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel iTCO_wdt iTCO_vendor_support aesni_intel lrw gf128mul glue_helper ablk_helper cryptd mlx5_ib ib_core joydev pcspkr sg i2c_i801 lpc_ich shpchp ipmi_si nfit mei_me libnvdimm mei acpi_cpufreq acpi_pad acpi_power_meter nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c raid1 sd_mod crc_t10dif
crct10dif_generic ast i2c_algo_bit drm_kms_helper mlx5_core ttm syscopyarea sysfillrect sysimgblt fb_sys_fops drm crct10dif_pclmul crct10dif_common crc32c_intel ahci libahci ptp libata pps_core devlink i2c_core wmi ipmi_devintf ipmi_msghandler [last unloaded: nvidia]
CPU: 25 PID: 5965 Comm: 10.210.38.25-ma Tainted: P           OE  ------------   3.10.0-693.el7.x86_64 #1
Hardware name: Supermicro SYS-1029GP-TR/X11DPG-SN, BIOS 2.0b 02/26/2018
task: ffff8808a5e1eeb0 ti: ffff880bf3af8000 task.ti: ffff880bf3af8000
RIP: 0010:[<ffffffff81322950>]  [<ffffffff81322950>] _atomic_dec_and_lock+0x20/0x70
RSP: 0018:ffff880bf3afbda8  EFLAGS: 00000246
RAX: 0000000000000002 RBX: ffffffffffffff10 RCX: 0000000000000002
RDX: 0000000000000002 RSI: ffff880a667cbba0 RDI: ffff880a667cbc48
RBP: ffff880bf3afbdb8 R08: ffff880bf289e240 R09: 0000000000000000
R10: ffff88180dc59c40 R11: ffffea0054ada900 R12: ffff880bf3afbe18
R13: 000000000000000c R14: 0000000000000036 R15: 0000000000000036
FS:  0000000000000000(0000) GS:ffff88180dc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055f5766ce000 CR3: 00000000019f2000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
ffff881566361000 ffff880a667cbb18 ffff880bf3afbde8 ffffffff8121de6b
ffff880a667cbb18 ffff8815663610c8 ffff881566361000 ffff881548e27000
ffff880bf3afbe58 ffffffffc19c6952 ffffffffc19df3c0 ffff880bf289e240
Call Trace:
[<ffffffff8121de6b>] iput+0x3b/0x190
[<ffffffffc19c6952>] nfs_reap_expired_delegations+0x152/0x220 [nfsv4]
[<ffffffffc19c2c22>] nfs4_state_manager+0x5f2/0x8c0 [nfsv4]
[<ffffffffc19c2ef0>] ? nfs4_state_manager+0x8c0/0x8c0 [nfsv4]
[<ffffffffc19c2f0f>] nfs4_run_state_manager+0x1f/0x40 [nfsv4]
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff8108ddeb>] ? do_exit+0x6bb/0xa40
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 5c 5d c3 90 90 90 90 90 90 90 90 55 48 89 e5 53 48 89 fb 48 83 ec 08 8b 17 83 fa 01 74 2e 8d 4a ff 89 d0 f0 0f b1 0f 39 c2 89 c1 <75> 09 31 c0 48 83 c4 08 5b 5d c3 83 f9 01 74 11 8d 51 ff 89 c8 
Complete report #750019
Frame # Function Binary Source or offset Line
1
_atomic_dec_and_lock
vmlinux 0xffffffff8132294c
Build id: 3.10.0-693.el7.x86_64
0x1c
2
iput
vmlinux 0xffffffff8121de6b
Build id: 3.10.0-693.el7.x86_64
0x3b
3
nfs_reap_expired_delegations
nfsv4 0xffffffffc092d952
Build id: 3.10.0-693.el7.x86_64
0x152
4
nfs4_state_manager
nfsv4 0xffffffffc0929c22
Build id: 3.10.0-693.el7.x86_64
0x5f2
5
? nfs4_state_manager
nfsv4 0xffffffffc0929ef0
Build id: 3.10.0-693.el7.x86_64
0x8c0
6
nfs4_run_state_manager
nfsv4 0xffffffffc0929f0f
Build id: 3.10.0-693.el7.x86_64
0x1f
7
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
0xcf
8
? do_exit
vmlinux 0xffffffff8108ddeb
Build id: 3.10.0-693.el7.x86_64
0x6bb
9
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
10
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
0x58
11
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#15 stuck for 23s! [192.168.0.200-m:19011]
Modules linked in: arc4 md4 nls_utf8 cifs rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter binfmt_misc vboxnetadp(OE) vboxnetflt(OE) vboxdrv(OE) vfat fat snd_hda_codec_hdmi dm_mirror dm_region_hash dm_log dm_mod intel_powerclamp coretemp kvm_intel kvm snd_hda_intel irqbypass joydev snd_hda_codec snd_hda_core snd_hwdep crc32_pclmul snd_seq ghash_clmulni_intel snd_seq_device aesni_intel snd_pcm lrw gf128mul glue_helper ablk_helper cryptd snd_timer snd ppdev soundcore pcspkr sg parport_pc shpchp parport tpm_crb acpi_pad int3400_thermal
nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic nouveau mxm_wmi i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci libahci drm libata crct10dif_pclmul crct10dif_common crc32c_intel r8169 serio_raw mii i2c_hid i2c_core video wmi
CPU: 15 PID: 19011 Comm: 192.168.0.200-m Tainted: G           OE  ------------   3.10.0-693.el7.x86_64 #1
Hardware name: LENOVO 90KQCTO1WW/317A, BIOS M31KT22A 10/15/2020
task: ffff88083bb08fd0 ti: ffff88081f730000 task.ti: ffff88081f730000
RIP: 0010:[<ffffffff8132294c>]  [<ffffffff8132294c>] _atomic_dec_and_lock+0x1c/0x70
RSP: 0018:ffff88081f733da8  EFLAGS: 00000246
RAX: 0000000000000002 RBX: ffffffffffffff10 RCX: 0000000000000001
RDX: 0000000000000002 RSI: ffff8807f6628e98 RDI: ffff8807f6628f40
RBP: ffff88081f733db8 R08: ffff88080733b080 R09: 0000000000000000
R10: ffff88083edd9c40 R11: ffffea0020aae880 R12: ffff88081f733e18
R13: 000000000000000b R14: 0000000000000004 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff88083edc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4e13fdbe40 CR3: 00000000019f2000 CR4: 00000000003427e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff88083436c000 ffff8807f6628e10 ffff88081f733de8 ffffffff8121de6b
ffff8807f6628e10 ffff88083436c0c8 ffff88083436c000 ffff8800923af800
ffff88081f733e58 ffffffffc092d952 ffffffffc09463c0 ffff88080733b080
Call Trace:
[<ffffffff8121de6b>] iput+0x3b/0x190
[<ffffffffc092d952>] nfs_reap_expired_delegations+0x152/0x220 [nfsv4]
[<ffffffffc0929c22>] nfs4_state_manager+0x5f2/0x8c0 [nfsv4]
[<ffffffffc0929ef0>] ? nfs4_state_manager+0x8c0/0x8c0 [nfsv4]
[<ffffffffc0929f0f>] nfs4_run_state_manager+0x1f/0x40 [nfsv4]
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff8108ddeb>] ? do_exit+0x6bb/0xa40
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 77 dd 5b 41 5c 5d c3 90 90 90 90 90 90 90 90 55 48 89 e5 53 48 89 fb 48 83 ec 08 8b 17 83 fa 01 74 2e 8d 4a ff 89 d0 f0 0f b1 0f <39> c2 89 c1 75 09 31 c0 48 83 c4 08 5b 5d c3 83 f9 01 74 11 8d 
Complete report #261617
Frame # Function Binary Source or offset Line
1
nfs_reap_expired_delegations
nfsv4 0xffffffffc09198e9
Build id: 3.10.0-693.el7.x86_64
0xe9
2
nfs4_state_manager
nfsv4 0xffffffffc0915c22
Build id: 3.10.0-693.el7.x86_64
0x5f2
3
? nfs4_state_manager
nfsv4 0xffffffffc0915ef0
Build id: 3.10.0-693.el7.x86_64
0x8c0
4
nfs4_run_state_manager
nfsv4 0xffffffffc0915f0f
Build id: 3.10.0-693.el7.x86_64
0x1f
5
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
0xcf
6
? do_exit
vmlinux 0xffffffff8108ddeb
Build id: 3.10.0-693.el7.x86_64
0x6bb
7
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
8
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
0x58
9
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [192.168.0.200-m:6560]
Modules linked in: arc4 md4 nls_utf8 cifs fuse rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter binfmt_misc vboxnetadp(OE) vboxnetflt(OE) vboxdrv(OE) vfat fat snd_hda_codec_hdmi dm_mirror dm_region_hash dm_log dm_mod snd_hda_intel snd_hda_codec snd_hda_core intel_powerclamp coretemp snd_hwdep kvm_intel kvm snd_seq joydev snd_seq_device snd_pcm irqbypass crc32_pclmul ghash_clmulni_intel snd_timer aesni_intel snd lrw gf128mul glue_helper ablk_helper cryptd soundcore ppdev sg pcspkr parport_pc shpchp parport tpm_crb acpi_pad int3400_thermal
nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic nouveau mxm_wmi i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm libahci libata crct10dif_pclmul crct10dif_common crc32c_intel r8169 serio_raw mii i2c_hid i2c_core video wmi
CPU: 4 PID: 6560 Comm: 192.168.0.200-m Tainted: G           OEL ------------   3.10.0-693.el7.x86_64 #1
Hardware name: LENOVO 90KQCTO1WW/317A, BIOS M31KT22A 10/15/2020
task: ffff8807bf371fa0 ti: ffff8807e5a90000 task.ti: ffff8807e5a90000
RIP: 0010:[<ffffffffc09198e9>]  [<ffffffffc09198e9>] nfs_reap_expired_delegations+0xe9/0x220 [nfsv4]
RSP: 0018:ffff8807e5a93df8  EFLAGS: 00000246
RAX: 00000000000003ee RBX: ffff8804bcfc4800 RCX: ffff880493698800
RDX: 00000000000003ee RSI: 00000000000003ef RDI: ffff880838857498
RBP: ffff8807e5a93e58 R08: ffff880838857440 R09: 0000000000000000
R10: 000000002ef2be01 R11: ffffea0020bbca00 R12: ffff88036ae932e8
R13: ffffffffc0919a6d R14: ffff8807e5a93d78 R15: ffff88036ae932e8
FS:  0000000000000000(0000) GS:ffff88083eb00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffffffffc08f4fe4 CR3: 00000000019f2000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffffffffc09323c0 ffff880838857440 ffff8804be362580 00000000c04433e0
000c3d7c61514939 0000000400000000 000000006d714489 ffff8804bcfc4800
00000000ffffd8e5 ffff8804bcfc48c8 ffff8804bcfc4930 0000000000000000
Call Trace:
[<ffffffffc0915c22>] nfs4_state_manager+0x5f2/0x8c0 [nfsv4]
[<ffffffffc0915ef0>] ? nfs4_state_manager+0x8c0/0x8c0 [nfsv4]
[<ffffffffc0915f0f>] nfs4_run_state_manager+0x1f/0x40 [nfsv4]
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff8108ddeb>] ? do_exit+0x6bb/0xa40
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 48 85 c0 48 89 c3 0f 84 a7 00 00 00 4d 8b 47 10 41 8b 50 58 85 d2 0f 84 2b 01 00 00 8d 72 01 49 8d 78 58 89 d0 f0 41 0f b1 70 58 <39> c2 89 c6 0f 85 f9 00 00 00 49 8b 47 20 49 8b 57 28 48 89 44 
Complete report #260485
Frame # Function Binary Source or offset Line
1
nfs_reap_expired_delegations
nfsv4 0xffffffffc09698ed
Build id: 3.10.0-693.el7.x86_64
0xed
2
nfs4_state_manager
nfsv4 0xffffffffc0965c22
Build id: 3.10.0-693.el7.x86_64
0x5f2
3
? nfs4_state_manager
nfsv4 0xffffffffc0965ef0
Build id: 3.10.0-693.el7.x86_64
0x8c0
4
nfs4_run_state_manager
nfsv4 0xffffffffc0965f0f
Build id: 3.10.0-693.el7.x86_64
0x1f
5
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
0xcf
6
? finish_task_switch
vmlinux 0xffffffff810bf107
Build id: 3.10.0-693.el7.x86_64
0x57
7
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
8
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
0x58
9
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#11 stuck for 22s! [192.168.0.200-m:2470]
Modules linked in: arc4 md4 nls_utf8 cifs rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter binfmt_misc vboxnetadp(OE) vboxnetflt(OE) vboxdrv(OE) vfat fat dm_mirror dm_region_hash dm_log dm_mod snd_hda_codec_hdmi intel_powerclamp coretemp kvm_intel snd_hda_codec_generic kvm snd_hda_intel snd_hda_codec snd_hda_core joydev irqbypass crc32_pclmul snd_hwdep snd_seq ghash_clmulni_intel aesni_intel snd_seq_device lrw snd_pcm gf128mul glue_helper ablk_helper cryptd snd_timer snd ppdev soundcore sg pcspkr parport_pc parport shpchp
tpm_crb acpi_pad int3400_thermal nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic nouveau mxm_wmi i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm libahci crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw r8169 mii i2c_hid i2c_core video wmi
CPU: 11 PID: 2470 Comm: 192.168.0.200-m Tainted: G           OE  ------------   3.10.0-693.el7.x86_64 #1
Hardware name: LENOVO 90KQCTO1WW/317A, BIOS M31KT22A 10/15/2020
task: ffff88083b20dee0 ti: ffff880510f1c000 task.ti: ffff880510f1c000
RIP: 0010:[<ffffffffc09698ed>]  [<ffffffffc09698ed>] nfs_reap_expired_delegations+0xed/0x220 [nfsv4]
RSP: 0018:ffff880510f1fdf8  EFLAGS: 00000246
RAX: 000000000000000a RBX: ffff880826d9b400 RCX: ffff8801740aa000
RDX: 000000000000000a RSI: 000000000000000a RDI: ffff8808063ec358
RBP: ffff880510f1fe58 R08: ffff8808063ec300 R09: 0000000000000000
R10: ffff88083ecd9c40 R11: ffffea00015e1e80 R12: ffff8807e1f485e0
R13: ffffffffc0969a6d R14: ffff880510f1fd78 R15: ffff8807e1f485e0
FS:  0000000000000000(0000) GS:ffff88083ecc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f92ffd2b120 CR3: 0000000832f55000 CR4: 00000000003427e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffffffffc09823c0 ffff8808063ec300 ffff8807ea30ed00 0000000000000000
000be19961514939 0000000400000000 00000000f9bbd098 ffff880826d9b400
00000000ffffd8e5 ffff880826d9b4c8 ffff880826d9b530 0000000000000000
Call Trace:
[<ffffffffc0965c22>] nfs4_state_manager+0x5f2/0x8c0 [nfsv4]
[<ffffffffc0965ef0>] ? nfs4_state_manager+0x8c0/0x8c0 [nfsv4]
[<ffffffffc0965f0f>] nfs4_run_state_manager+0x1f/0x40 [nfsv4]
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810bf107>] ? finish_task_switch+0x57/0x160
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 89 c3 0f 84 a7 00 00 00 4d 8b 47 10 41 8b 50 58 85 d2 0f 84 2b 01 00 00 8d 72 01 49 8d 78 58 89 d0 f0 41 0f b1 70 58 39 c2 89 c6 <0f> 85 f9 00 00 00 49 8b 47 20 49 8b 57 28 48 89 44 24 1c 41 8b 
Complete report #122609
Frame # Function Binary Source or offset Line
1
nfs_reap_expired_delegations
nfsv4 0xffffffffc05c99c0
Build id: 3.10.0-693.el7.x86_64
0x1c0
2
nfs4_state_manager
nfsv4 0xffffffffc05c5c22
Build id: 3.10.0-693.el7.x86_64
0x5f2
3
? nfs4_state_manager
nfsv4 0xffffffffc05c5ef0
Build id: 3.10.0-693.el7.x86_64
0x8c0
4
nfs4_run_state_manager
nfsv4 0xffffffffc05c5f0f
Build id: 3.10.0-693.el7.x86_64
0x1f
5
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
0xcf
6
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
7
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
0x58
8
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [192.168.20.225-:27108]
Modules linked in: ip_vs_rr xt_ipvs ip_vs xt_nat veth vxlan ip6_udp_tunnel udp_tunnel iptable_mangle xt_mark xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache overlay(T) vmw_vsock_vmci_transport vsock ppdev vmw_balloon sg joydev pcspkr i2c_piix4 vmw_vmci shpchp nfit libnvdimm parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx crc32_pclmul crc32c_intel drm_kms_helper sd_mod ghash_clmulni_intel crc_t10dif syscopyarea sysfillrect crct10dif_generic sysimgblt crct10dif_pclmul fb_sys_fops scsi_transport_iscsi aesni_intel
ttm crct10dif_common 8021q ahci garp stp drm ata_piix libahci llc mrp lrw gf128mul libata glue_helper ablk_helper serio_raw cryptd vmw_pvscsi vmxnet3 i2c_core sunrpc dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 27108 Comm: 192.168.20.225- Tainted: G               ------------ T 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff880c04b86eb0 ti: ffff880b47b00000 task.ti: ffff880b47b00000
RIP: 0010:[<ffffffffc05c99c0>]  [<ffffffffc05c99c0>] nfs_reap_expired_delegations+0x1c0/0x220 [nfsv4]
RSP: 0018:ffff880b47b03df8  EFLAGS: 00000296
RAX: 0000000000000000 RBX: ffff88079578f3c0 RCX: 000000000000000b
RDX: 0000000000000001 RSI: ffff880b318a4180 RDI: ffff880c013bb800
RBP: ffff880b47b03e58 R08: ffff880ba43873c0 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: ffff88079578f3c0
R13: ffffffffc05c9a6d R14: ffff880b47b03d78 R15: ffff88046cf281c8
FS:  0000000000000000(0000) GS:ffff880c3fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00000007c0843428 CR3: 00000000019f2000 CR4: 00000000000007f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffffffffc05e23c0 ffff880ba43873c0 ffff880b318a4180 0000000000000000
25b4f0025fcfc21e 0000000400000000 000000004db1e6df ffff880c013bb800
ffff880c013bb800 ffff880c013bb8c8 ffff880c013bb930 0000000000000000
Call Trace:
[<ffffffffc05c5c22>] nfs4_state_manager+0x5f2/0x8c0 [nfsv4]
[<ffffffffc05c5ef0>] ? nfs4_state_manager+0x8c0/0x8c0 [nfsv4]
[<ffffffffc05c5f0f>] nfs4_run_state_manager+0x1f/0x40 [nfsv4]
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 38 5b 41 5c 41 5d 41 5e 41 5f 5d c3 48 8d 74 24 1c 48 89 df e8 32 eb ff ff 48 8d 74 24 1c 48 89 df e8 75 d1 ff ff 4c 8b 44 24 08 <e9> 73 ff ff ff 48 8b 73 b8 48 85 f6 74 08 4c 89 f7 e8 ea ea ff