Complete report #1419038
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
_raw_spin_lock
|
vmlinux |
0xffffffff85fba71c
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0xc
|
|
2
|
|
vmlinux |
0xffffffff85a8e320
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x1a0
|
|
3
|
sync_filesystem
|
vmlinux |
0xffffffff85a9325e
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x6e
|
|
4
|
generic_shutdown_super
|
vmlinux |
0xffffffff85a5e767
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x27
|
|
5
|
kill_anon_super
|
vmlinux |
0xffffffff85a5ebc2
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x12
|
|
6
|
nfs_kill_super
|
nfs |
0xffffffffc07844eb
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x1b
|
|
7
|
deactivate_locked_super
|
vmlinux |
0xffffffff85a5efa6
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x56
|
|
8
|
deactivate_super
|
vmlinux |
0xffffffff85a5f75a
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x4a
|
|
9
|
cleanup_mnt
|
vmlinux |
0xffffffff85a7fc2f
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x3f
|
|
10
|
__cleanup_mnt
|
vmlinux |
0xffffffff85a7fcd2
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x12
|
|
11
|
task_work_run
|
vmlinux |
0xffffffff858c7f6b
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0xbb
|
|
12
|
do_notify_resume
|
vmlinux |
0xffffffff8582dcfd
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0xad
|
|
13
|
int_signal
|
vmlinux |
0xffffffff85fc56f7
Build id: 3.10.0-1160.119.1.el7.x86_64
|
0x12
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [umount.nfs:723]
Modules linked in: nfsv3 nfs_acl nfs lockd grace fscache vmw_vsock_vmci_transport vsock nfit ppdev libnvdimm vmw_balloon sg iosf_mbi joydev pcspkr parport_pc i2c_piix4 parport vmw_vmci sch_fq_codel binfmt_misc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32_pclmul crc32c_intel drm ahci ghash_clmulni_intel 8021q ata_piix libahci garp mrp stp aesni_intel lrw libata gf128mul llc glue_helper ablk_helper cryptd vmxnet3 scsi_transport_iscsi serio_raw vmw_pvscsi drm_panel_orientation_quirks sunrpc dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 723 Comm: umount.nfs Not tainted 3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff991dbcab9080 ti: ffff991c2611c000 task.ti: ffff991c2611c000
RIP: 0010:[<ffffffff85fba71c>] [<ffffffff85fba71c>] _raw_spin_lock+0xc/0x30
RSP: 0018:ffff991c2611fd58 EFLAGS: 00010246
RAX: 0000000000000000 RBX: ffffffff85fb7920 RCX: ffff991c2611ffd8
RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff991c69ce7d20
RBP: ffff991c2611fe18 R08: ffff991c2611fca0 R09: 0000000000000001
R10: 0000000000000002 R11: 0000000000000400 R12: 0000000000000001
R13: ffff991d961d3840 R14: ffff9920a729acc0 R15: ffff991fa0260c80
FS: 00007fef731dc880(0000) GS:ffff9920a7280000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c000863078 CR3: 00000004cc9a4000 CR4: 0000000000760fe0
PKRU: 55555554
Call Trace:
[<ffffffff85a8e320>] ? sync_inodes_sb+0x1a0/0x3d0
[<ffffffff85a9325e>] sync_filesystem+0x6e/0xc0
[<ffffffff85a5e767>] generic_shutdown_super+0x27/0x100
[<ffffffff85a5ebc2>] kill_anon_super+0x12/0x20
[<ffffffffc07844eb>] nfs_kill_super+0x1b/0x40 [nfs]
[<ffffffff85a5efa6>] deactivate_locked_super+0x56/0x70
[<ffffffff85a5f75a>] deactivate_super+0x4a/0x70
[<ffffffff85a7fc2f>] cleanup_mnt+0x3f/0x90
[<ffffffff85a7fcd2>] __cleanup_mnt+0x12/0x20
[<ffffffff858c7f6b>] task_work_run+0xbb/0xe0
[<ffffffff8582dcfd>] do_notify_resume+0xad/0xd0
[<ffffffff85fc56f7>] int_signal+0x12/0x17
Code: d2 74 dc eb e9 66 2e 0f 1f 84 00 00 00 00 00 b8 01 00 00 00 5d c3 cc cc cc cc 0f 1f 44 00 00 0f 1f 44 00 00 31 c0 ba 01 00 00 00 <f0> 0f b1 17 85 c0 75 05 c3 cc cc cc cc 55 89 c6 48 89 e5 e8 db
Complete report #359373
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
sync_inodes_sb
|
vmlinux |
0xffffffff8207f444
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x194
|
|
2
|
sync_filesystem
|
vmlinux |
0xffffffff820842b6
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x66
|
|
3
|
ovl_sync_fs
|
overlay |
0xffffffffc08482d0
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x40
|
|
4
|
sync_filesystem
|
vmlinux |
0xffffffff820842d0
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x80
|
|
5
|
generic_shutdown_super
|
vmlinux |
0xffffffff82050ec7
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x27
|
|
6
|
kill_anon_super
|
vmlinux |
0xffffffff82051312
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x12
|
|
7
|
deactivate_locked_super
|
vmlinux |
0xffffffff820516ee
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x4e
|
|
8
|
deactivate_super
|
vmlinux |
0xffffffff82051e76
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x46
|
|
9
|
cleanup_mnt
|
vmlinux |
0xffffffff820712af
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x3f
|
|
10
|
__cleanup_mnt
|
vmlinux |
0xffffffff82071342
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x12
|
|
11
|
task_work_run
|
vmlinux |
0xffffffff81ec297b
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0xbb
|
|
12
|
do_notify_resume
|
vmlinux |
0xffffffff81e2cc65
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0xa5
|
|
13
|
int_signal
|
vmlinux |
0xffffffff825962ef
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x12
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [dockerd:37608]
Modules linked in: tcp_diag inet_diag binfmt_misc veth xt_nat xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) ext4 mbcache jbd2 snd_seq_midi snd_seq_midi_event sb_edac iosf_mbi crc32_pclmul snd_ens1371 snd_rawmidi ghash_clmulni_intel snd_ac97_codec ppdev ac97_bus snd_seq aesni_intel snd_seq_device lrw snd_pcm gf128mul glue_helper ablk_helper vmw_balloon cryptd snd_timer pcspkr joydev snd sg vmw_vmci soundcore i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper ata_piix syscopyarea sysfillrect sysimgblt fb_sys_fops libata ttm nfit
drm libnvdimm mptspi scsi_transport_spi mptscsih crct10dif_pclmul crct10dif_common crc32c_intel mptbase e1000 serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 37608 Comm: dockerd Kdump: loaded Tainted: G ------------ T 3.10.0-1160.36.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff9989b7331080 ti: ffff998741bf8000 task.ti: ffff998741bf8000
RIP: 0010:[<ffffffff8207f444>] [<ffffffff8207f444>] sync_inodes_sb+0x194/0x3d0
RSP: 0018:ffff998741bfbd48 EFLAGS: 00010212
RAX: ffff9989c388cdd8 RBX: ffff998741bfbfd8 RCX: ffff998741bfbfd8
RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff9989c388d158
RBP: ffff998741bfbe00 R08: ffff998741bfbc88 R09: 0000000000000001
R10: 0000000000000001 R11: 0000000000000104 R12: ffff998741bfbd10
R13: 0000000000000000 R14: ffff998ae9cf2580 R15: ffff998aed61acc0
FS: 00007fb49e4a3700(0000) GS:ffff998aed600000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd2a4ec4000 CR3: 00000002df124000 CR4: 00000000000607f0
Call Trace:
[<ffffffff820842b6>] sync_filesystem+0x66/0xb0
[<ffffffffc08482d0>] ovl_sync_fs+0x40/0x60 [overlay]
[<ffffffff820842d0>] sync_filesystem+0x80/0xb0
[<ffffffff82050ec7>] generic_shutdown_super+0x27/0x100
[<ffffffff82051312>] kill_anon_super+0x12/0x20
[<ffffffff820516ee>] deactivate_locked_super+0x4e/0x70
[<ffffffff82051e76>] deactivate_super+0x46/0x60
[<ffffffff820712af>] cleanup_mnt+0x3f/0x80
[<ffffffff82071342>] __cleanup_mnt+0x12/0x20
[<ffffffff81ec297b>] task_work_run+0xbb/0xe0
[<ffffffff81e2cc65>] do_notify_resume+0xa5/0xc0
[<ffffffff825962ef>] int_signal+0x12/0x17
Code: 1f 84 00 00 00 00 00 48 89 df c6 07 00 66 66 66 90 49 8b 87 08 01 00 00 49 39 c5 4c 8d b8 f8 fe ff ff 74 93 49 8d 9f 88 00 00 00 <4d> 8b 67 30 48 89 df e8 50 c6 50 00 41 f6 87 a0 00 00 00 38 75
Complete report #21536
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
_raw_spin_lock
|
vmlinux |
0xffffffffb918241c
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0xc
|
|
2
|
|
vmlinux |
0xffffffffb8c7a560
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x1a0
|
|
3
|
sync_filesystem
|
vmlinux |
0xffffffffb8c7f3c6
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x66
|
|
4
|
ovl_sync_fs
|
overlay |
0xffffffffc05a92d0
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x40
|
|
5
|
sync_filesystem
|
vmlinux |
0xffffffffb8c7f3e0
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x80
|
|
6
|
generic_shutdown_super
|
vmlinux |
0xffffffffb8c4c9c7
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x27
|
|
7
|
kill_anon_super
|
vmlinux |
0xffffffffb8c4ce12
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x12
|
|
8
|
deactivate_locked_super
|
vmlinux |
0xffffffffb8c4d1ee
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x4e
|
|
9
|
deactivate_super
|
vmlinux |
0xffffffffb8c4d976
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x46
|
|
10
|
cleanup_mnt
|
vmlinux |
0xffffffffb8c6c4ef
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x3f
|
|
11
|
__cleanup_mnt
|
vmlinux |
0xffffffffb8c6c582
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x12
|
|
12
|
task_work_run
|
vmlinux |
0xffffffffb8ac2d2b
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0xbb
|
|
13
|
do_notify_resume
|
vmlinux |
0xffffffffb8a2cc65
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0xa5
|
|
14
|
int_signal
|
vmlinux |
0xffffffffb918d23b
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x12
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 23s! [dockerd:3957]
Modules linked in: vxlan ip6_udp_tunnel udp_tunnel xt_statistic xt_nat xt_recent xt_comment xt_mark nf_conntrack_netlink nfnetlink xt_addrtype xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 ppdev vmw_balloon coretemp joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 br_netfilter bridge stp llc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic crct10dif_common pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata serio_raw vmxnet3
vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 3957 Comm: dockerd Kdump: loaded Tainted: G L ------------ T 3.10.0-1062.4.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff9939ccf25230 ti: ffff9939ceb20000 task.ti: ffff9939ceb20000
RIP: 0010:[<ffffffffb918241c>] [<ffffffffb918241c>] _raw_spin_lock+0xc/0x30
RSP: 0018:ffff9939ceb23d40 EFLAGS: 00010246
RAX: 0000000000000000 RBX: ffff9939ceb23cd8 RCX: ffff9939ceb23fd8
RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff9940fee47a48
RBP: ffff9939ceb23e00 R08: ffff9939ceb23c88 R09: 0000000000000001
R10: 000000000000bb2b R11: 0000000000000001 R12: ffff9939ceb23fd8
R13: ffff9939ceb23fd8 R14: ffff9939ceb23fd8 R15: ffff9939ccf25230
FS: 00007f582affd700(0000) GS:ffff9939d0080000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c422edef78 CR3: 0000000035ebc000 CR4: 00000000000007e0
Call Trace:
[<ffffffffb8c7a560>] ? sync_inodes_sb+0x1a0/0x3d0
[<ffffffffb8c7f3c6>] sync_filesystem+0x66/0xb0
[<ffffffffc05a92d0>] ovl_sync_fs+0x40/0x60 [overlay]
[<ffffffffb8c7f3e0>] sync_filesystem+0x80/0xb0
[<ffffffffb8c4c9c7>] generic_shutdown_super+0x27/0x100
[<ffffffffb8c4ce12>] kill_anon_super+0x12/0x20
[<ffffffffb8c4d1ee>] deactivate_locked_super+0x4e/0x70
[<ffffffffb8c4d976>] deactivate_super+0x46/0x60
[<ffffffffb8c6c4ef>] cleanup_mnt+0x3f/0x80
[<ffffffffb8c6c582>] __cleanup_mnt+0x12/0x20
[<ffffffffb8ac2d2b>] task_work_run+0xbb/0xe0
[<ffffffffb8a2cc65>] do_notify_resume+0xa5/0xc0
[<ffffffffb918d23b>] int_signal+0x12/0x17
Code: 5d c3 0f 1f 44 00 00 85 d2 74 e4 0f 1f 40 00 eb ed 66 0f 1f 44 00 00 b8 01 00 00 00 5d c3 90 66 66 66 66 90 31 c0 ba 01 00 00 00 <f0> 0f b1 17 85 c0 75 01 c3 55 89 c6 48 89 e5 e8 90 1f ff ff 5d