Complete report #1423605
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
_d_rehash
|
vmlinux |
0xffffffffbb076807
Build id: 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64
|
0x57
|
|
2
|
d_rehash
|
vmlinux |
0xffffffffbb076863
Build id: 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64
|
0x23
|
|
3
|
proc_fd_instantiate
|
vmlinux |
0xffffffffbb0e0c7b
Build id: 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64
|
0x6b
|
|
4
|
proc_fill_cache
|
vmlinux |
0xffffffffbb0dccec
Build id: 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64
|
0x14c
|
|
5
|
|
vmlinux |
0xffffffffbb0e0c10
Build id: 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64
|
0x1a0
|
|
6
|
proc_readfd_common
|
vmlinux |
0xffffffffbb0e0e35
Build id: 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64
|
0xf5
|
|
7
|
|
vmlinux |
0xffffffffbb0e0c10
Build id: 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64
|
0x1a0
|
|
8
|
|
vmlinux |
0xffffffffbb071f10
Build id: 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64
|
0x140
|
|
9
|
proc_readfd
|
vmlinux |
0xffffffffbb0e0f45
Build id: 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64
|
0x15
|
|
10
|
iterate_dir
|
vmlinux |
0xffffffffbb071e6f
Build id: 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64
|
0x9f
|
|
11
|
SyS_getdents
|
vmlinux |
0xffffffffbb07239c
Build id: 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64
|
0x9c
|
|
12
|
|
vmlinux |
0xffffffffbb071f10
Build id: 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64
|
0x140
|
|
13
|
system_call_fastpath
|
vmlinux |
0xffffffffbb5c539f
Build id: 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [StatusRequestDi:65195]
Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack libcrc32c ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd vmw_balloon pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables ext4 mbcache jbd2 sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix nfit libata mptspi serio_raw scsi_transport_spi mptscsih libnvdimm vmxnet3 mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 65195 Comm: StatusRequestDi Kdump: loaded Not tainted 3.10.0-1160.139.1.el7.tuxcare.els2.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9750ad86a100 ti: ffff974810710000 task.ti: ffff974810710000
RIP: 0010:[<ffffffffbb076807>] [<ffffffffbb076807>] _d_rehash+0x57/0x90
RSP: 0018:ffff974810713d60 EFLAGS: 00010282
RAX: ffffb1f9404efb68 RBX: ffff97453fd54800 RCX: ffff974712e94848
RDX: ffff9746417cefc8 RSI: ffff974712e94840 RDI: ffff974712e94840
RBP: ffff974810713d60 R08: ffff9751b8170e78 R09: 0000000000000000
R10: ffff9747f5f2aa50 R11: 0000000000000000 R12: ffffffffbb071f10
R13: 000000000000a000 R14: 0000000000000000 R15: ffffffffbb0795a0
FS: 00007fa7d0c64700(0000) GS:ffff9753bd600000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fdc641d1daf CR3: 0000000ffa8c0000 CR4: 00000000003607f0
Call Trace:
[<ffffffffbb076863>] d_rehash+0x23/0x40
[<ffffffffbb0e0c7b>] proc_fd_instantiate+0x6b/0xa0
[<ffffffffbb0dccec>] proc_fill_cache+0x14c/0x180
[<ffffffffbb0e0c10>] ? tid_fd_revalidate+0x1a0/0x1a0
[<ffffffffbb0e0e35>] proc_readfd_common+0xf5/0x1f0
[<ffffffffbb0e0c10>] ? tid_fd_revalidate+0x1a0/0x1a0
[<ffffffffbb071f10>] ? iterate_dir+0x140/0x140
[<ffffffffbb0e0f45>] proc_readfd+0x15/0x20
[<ffffffffbb071e6f>] iterate_dir+0x9f/0x140
[<ffffffffbb07239c>] SyS_getdents+0x9c/0x120
[<ffffffffbb071f10>] ? iterate_dir+0x140/0x140
[<ffffffffbb5c539f>] system_call_fastpath+0x25/0x2a
Code: 8b 15 c6 f2 ae 00 48 8d 04 c2 75 42 f0 0f ba 28 00 19 d2 85 d2 75 3d 48 8b 10 48 8d 4f 08 48 83 e2 fe 48 85 d2 48 89 57 08 74 04 <48> 89 4a 08 f6 c1 01 48 89 47 10 75 1a f6 00 01 74 13 48 83 c9
Complete report #993112
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
tid_fd_revalidate
|
vmlinux |
0xffffffffaeecf9c7
Build id: 3.10.0-1160.el7.x86_64
|
0x87
|
|
2
|
proc_fd_instantiate
|
vmlinux |
0xffffffffaeecfb45
Build id: 3.10.0-1160.el7.x86_64
|
0x75
|
|
3
|
proc_fill_cache
|
vmlinux |
0xffffffffaeecbccc
Build id: 3.10.0-1160.el7.x86_64
|
0x14c
|
|
4
|
|
vmlinux |
0xffffffffaeecfad0
Build id: 3.10.0-1160.el7.x86_64
|
0x190
|
|
5
|
proc_readfd_common
|
vmlinux |
0xffffffffaeecfcf5
Build id: 3.10.0-1160.el7.x86_64
|
0xf5
|
|
6
|
|
vmlinux |
0xffffffffaeecfad0
Build id: 3.10.0-1160.el7.x86_64
|
0x190
|
|
7
|
|
vmlinux |
0xffffffffaee636e0
Build id: 3.10.0-1160.el7.x86_64
|
0x130
|
|
8
|
proc_readfd
|
vmlinux |
0xffffffffaeecfe05
Build id: 3.10.0-1160.el7.x86_64
|
0x15
|
|
9
|
iterate_dir
|
vmlinux |
0xffffffffaee63647
Build id: 3.10.0-1160.el7.x86_64
|
0x97
|
|
10
|
|
vmlinux |
0xffffffffaf38e678
Build id: 3.10.0-1160.el7.x86_64
|
0x238
|
|
11
|
SyS_getdents
|
vmlinux |
0xffffffffaee63b62
Build id: 3.10.0-1160.el7.x86_64
|
0xa2
|
|
12
|
|
vmlinux |
0xffffffffaee636e0
Build id: 3.10.0-1160.el7.x86_64
|
0x130
|
|
13
|
|
vmlinux |
0xffffffffaf38e975
Build id: 3.10.0-1160.el7.x86_64
|
0x35
|
|
14
|
system_call_fastpath
|
vmlinux |
0xffffffffaf393f92
Build id: 3.10.0-1160.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 39s! [(d-anchor):776]
Modules linked in: vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel snd_ens1371 snd_rawmidi lrw gf128mul snd_ac97_codec glue_helper vmw_balloon ablk_helper ac97_bus cryptd snd_seq snd_seq_device snd_pcm pcspkr joydev snd_timer sg snd soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel nfit ata_piix libnvdimm libata mptspi serio_raw scsi_transport_spi e1000 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 776 Comm: (d-anchor) Not tainted 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff9f8b2e1c4200 ti: ffff9f8b2d964000 task.ti: ffff9f8b2d964000
RIP: 0010:[<ffffffffaeecf9c7>] [<ffffffffaeecf9c7>] tid_fd_revalidate+0x87/0x190
RSP: 0018:ffff9f8b2d967d58 EFLAGS: 00000286
RAX: ffff9f8ab9bb4d80 RBX: ffffffffaee636e0 RCX: ffffffffffffffff
RDX: ffff9f8abb17a500 RSI: 0000000000000009 RDI: ffff9f8b2e1c4a00
RBP: ffff9f8b2d967d80 R08: ffff9f8ab6fc3878 R09: 0000000000000000
R10: ffff9f8ab7be4410 R11: 0000000000000000 R12: 0000000000000000
R13: ffffffffaee6aa10 R14: ffff9f8b2d967cf8 R15: ffffffffaef082a4
FS: 00007f2cf525d940(0000) GS:ffff9f8b39600000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2cf3a59270 CR3: 000000012f9f0000 CR4: 00000000003607f0
Call Trace:
[<ffffffffaeecfb45>] proc_fd_instantiate+0x75/0xa0
[<ffffffffaeecbccc>] proc_fill_cache+0x14c/0x180
[<ffffffffaeecfad0>] ? tid_fd_revalidate+0x190/0x190
[<ffffffffaeecfcf5>] proc_readfd_common+0xf5/0x1f0
[<ffffffffaeecfad0>] ? tid_fd_revalidate+0x190/0x190
[<ffffffffaee636e0>] ? iterate_dir+0x130/0x130
[<ffffffffaeecfe05>] proc_readfd+0x15/0x20
[<ffffffffaee63647>] iterate_dir+0x97/0x130
[<ffffffffaf38e678>] ? __do_page_fault+0x238/0x500
[<ffffffffaee63b62>] SyS_getdents+0xa2/0x130
[<ffffffffaee636e0>] ? iterate_dir+0x130/0x130
[<ffffffffaf38e975>] ? do_page_fault+0x35/0x90
[<ffffffffaf393f92>] system_call_fastpath+0x25/0x2a
Code: cd 0f 83 e5 00 00 00 44 89 ee 48 39 ce 48 19 c9 48 8b 52 08 41 21 cd 4a 8d 14 ea 48 8b 12 48 85 d2 0f 84 c5 00 00 00 44 8b 72 44 <4c> 8d ab 00 08 00 00 48 89 c7 e8 ea f3 f9 ff 4c 89 ef e8 92 a0
Complete report #822918
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
_d_rehash
|
vmlinux |
0xffffffffa9467338
Build id: 3.10.0-1127.el7.x86_64
|
0x38
|
|
2
|
d_rehash
|
vmlinux |
0xffffffffa94673b3
Build id: 3.10.0-1127.el7.x86_64
|
0x23
|
|
3
|
proc_fd_instantiate
|
vmlinux |
0xffffffffa94cf02b
Build id: 3.10.0-1127.el7.x86_64
|
0x6b
|
|
4
|
proc_fill_cache
|
vmlinux |
0xffffffffa94cb1bc
Build id: 3.10.0-1127.el7.x86_64
|
0x14c
|
|
5
|
|
vmlinux |
0xffffffffa94cefc0
Build id: 3.10.0-1127.el7.x86_64
|
0x190
|
|
6
|
proc_readfd_common
|
vmlinux |
0xffffffffa94cf1e5
Build id: 3.10.0-1127.el7.x86_64
|
0xf5
|
|
7
|
|
vmlinux |
0xffffffffa94cefc0
Build id: 3.10.0-1127.el7.x86_64
|
0x190
|
|
8
|
|
vmlinux |
0xffffffffa9462c10
Build id: 3.10.0-1127.el7.x86_64
|
0x130
|
|
9
|
proc_readfd
|
vmlinux |
0xffffffffa94cf2f5
Build id: 3.10.0-1127.el7.x86_64
|
0x15
|
|
10
|
iterate_dir
|
vmlinux |
0xffffffffa9462b77
Build id: 3.10.0-1127.el7.x86_64
|
0x97
|
|
11
|
|
vmlinux |
0xffffffffa998d678
Build id: 3.10.0-1127.el7.x86_64
|
0x238
|
|
12
|
SyS_getdents
|
vmlinux |
0xffffffffa9463092
Build id: 3.10.0-1127.el7.x86_64
|
0xa2
|
|
13
|
|
vmlinux |
0xffffffffa9462c10
Build id: 3.10.0-1127.el7.x86_64
|
0x130
|
|
14
|
|
vmlinux |
0xffffffffa998d975
Build id: 3.10.0-1127.el7.x86_64
|
0x35
|
|
15
|
system_call_fastpath
|
vmlinux |
0xffffffffa9992ed2
Build id: 3.10.0-1127.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 25s! [ruby_sampler:10742]
Modules linked in: cmac arc4 md4 nls_utf8 xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 ipt_REJECT nf_reject_ipv4 bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables cifs ccm dns_resolver tun xt_conntrack iptable_filter xt_nat iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq crc32_pclmul snd_seq_device snd_pcm ppdev snd_timer vmw_balloon ghash_clmulni_intel aesni_intel snd lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr soundcore sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper
nfit libnvdimm syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata mptspi crct10dif_pclmul crct10dif_common scsi_transport_spi crc32c_intel mptscsih e1000 mptbase serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 10742 Comm: ruby_sampler Kdump: loaded Tainted: G L ------------ 3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff9a3dc1c89070 ti: ffff9a40ffde4000 task.ti: ffff9a40ffde4000
RIP: 0010:[<ffffffffa9467338>] [<ffffffffa9467338>] _d_rehash+0x38/0x90
RSP: 0018:ffff9a40ffde7d60 EFLAGS: 00010246
RAX: ffffaf6301b705c8 RBX: ffff9a3f3fd53800 RCX: 0000000000000016
RDX: ffffaf6300002000 RSI: ffff9a40f7200590 RDI: ffff9a42a3e53140
RBP: ffff9a40ffde7d60 R08: ffff9a42e4031e38 R09: 0000000000000001
R10: 000000000000000e R11: 0000000000000293 R12: ffffffffa9462c10
R13: 000000000000a000 R14: 0000000000000000 R15: ffffffffa9469f40
FS: 00007f85e6dfe700(0000) GS:ffff9a42e9600000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb268321ed8 CR3: 0000000528654000 CR4: 00000000003607f0
Call Trace:
[<ffffffffa94673b3>] d_rehash+0x23/0x40
[<ffffffffa94cf02b>] proc_fd_instantiate+0x6b/0xa0
[<ffffffffa94cb1bc>] proc_fill_cache+0x14c/0x180
[<ffffffffa94cefc0>] ? tid_fd_revalidate+0x190/0x190
[<ffffffffa94cf1e5>] proc_readfd_common+0xf5/0x1f0
[<ffffffffa94cefc0>] ? tid_fd_revalidate+0x190/0x190
[<ffffffffa9462c10>] ? iterate_dir+0x130/0x130
[<ffffffffa94cf2f5>] proc_readfd+0x15/0x20
[<ffffffffa9462b77>] iterate_dir+0x97/0x130
[<ffffffffa998d678>] ? __do_page_fault+0x238/0x500
[<ffffffffa9463092>] SyS_getdents+0xa2/0x130
[<ffffffffa9462c10>] ? iterate_dir+0x130/0x130
[<ffffffffa998d975>] ? do_page_fault+0x35/0x90
[<ffffffffa9992ed2>] system_call_fastpath+0x25/0x2a
Code: dd af 00 48 89 e5 48 c1 e8 06 03 47 20 89 c2 d3 ea 01 d0 23 05 8e dd af 00 48 83 7f 10 00 48 8b 15 76 dd af 00 48 8d 04 c2 75 3e <f0> 0f ba 28 00 19 d2 85 d2 75 39 48 8b 10 48 8d 4f 08 48 83 e2