Complete report #1132418
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
writeback_sb_inodes
|
vmlinux |
0xffffffff81e7ea94
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x1c4
|
|
2
|
__writeback_inodes_wb
|
vmlinux |
0xffffffff81e7ed9f
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x9f
|
|
3
|
wb_writeback
|
vmlinux |
0xffffffff81e7f273
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x263
|
|
4
|
bdi_writeback_workfn
|
vmlinux |
0xffffffff81e7fe6b
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x2cb
|
|
5
|
process_one_work
|
vmlinux |
0xffffffff81cbde8f
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x17f
|
|
6
|
worker_thread
|
vmlinux |
0xffffffff81cbefa6
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x126
|
|
7
|
|
vmlinux |
0xffffffff81cbee80
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x2a0
|
|
8
|
kthread
|
vmlinux |
0xffffffff81cc5e61
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0xd1
|
|
9
|
|
vmlinux |
0xffffffff81cc5d90
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff82395ddd
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x7
|
|
11
|
|
vmlinux |
0xffffffff81cc5d90
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 38s! [systemd:1]
[<ffffffff81e7ea94>] writeback_sb_inodes+0x1c4/0x430
[<ffffffff81e7ed9f>] __writeback_inodes_wb+0x9f/0xd0
[<ffffffff81e7f273>] wb_writeback+0x263/0x2f0
[<ffffffff81e7fe6b>] bdi_writeback_workfn+0x2cb/0x460
[<ffffffff81cbde8f>] process_one_work+0x17f/0x440
[<ffffffff81cbefa6>] worker_thread+0x126/0x3c0
[<ffffffff81cbee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff81cc5e61>] kthread+0xd1/0xe0
[<ffffffff81cc5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffff82395ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff81cc5d90>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #861582
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
xfs_vm_writepages
|
xfs |
0xffffffffc05ea3bf
Build id: 3.10.0-957.el7.x86_64
|
0x7f
|
|
2
|
do_writepages
|
vmlinux |
0xffffffff83bc3181
Build id: 3.10.0-957.el7.x86_64
|
0x21
|
|
3
|
__writeback_single_inode
|
vmlinux |
0xffffffff83c6f930
Build id: 3.10.0-957.el7.x86_64
|
0x40
|
|
4
|
writeback_sb_inodes
|
vmlinux |
0xffffffff83c703c4
Build id: 3.10.0-957.el7.x86_64
|
0x1c4
|
|
5
|
__writeback_inodes_wb
|
vmlinux |
0xffffffff83c7072f
Build id: 3.10.0-957.el7.x86_64
|
0x9f
|
|
6
|
wb_writeback
|
vmlinux |
0xffffffff83c70f63
Build id: 3.10.0-957.el7.x86_64
|
0x263
|
|
7
|
bdi_writeback_workfn
|
vmlinux |
0xffffffff83c718eb
Build id: 3.10.0-957.el7.x86_64
|
0x2cb
|
|
8
|
process_one_work
|
vmlinux |
0xffffffff83ab9d4f
Build id: 3.10.0-957.el7.x86_64
|
0x17f
|
|
9
|
worker_thread
|
vmlinux |
0xffffffff83abade6
Build id: 3.10.0-957.el7.x86_64
|
0x126
|
|
10
|
|
vmlinux |
0xffffffff83abacc0
Build id: 3.10.0-957.el7.x86_64
|
0x2a0
|
|
11
|
kthread
|
vmlinux |
0xffffffff83ac1c31
Build id: 3.10.0-957.el7.x86_64
|
0xd1
|
|
12
|
|
vmlinux |
0xffffffff83ac1b60
Build id: 3.10.0-957.el7.x86_64
|
0x40
|
|
13
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff84174c1d
Build id: 3.10.0-957.el7.x86_64
|
0x7
|
|
14
|
|
vmlinux |
0xffffffff83ac1b60
Build id: 3.10.0-957.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 24s! [kworker/0:0:82072]
[<ffffffffc05ea3bf>] xfs_vm_writepages+0x7f/0xa0 [xfs]
[<ffffffff83bc3181>] do_writepages+0x21/0x50
[<ffffffff83c6f930>] __writeback_single_inode+0x40/0x260
[<ffffffff83c703c4>] writeback_sb_inodes+0x1c4/0x490
[<ffffffff83c7072f>] __writeback_inodes_wb+0x9f/0xd0
[<ffffffff83c70f63>] wb_writeback+0x263/0x2f0
[<ffffffff83c718eb>] bdi_writeback_workfn+0x2cb/0x460
[<ffffffff83ab9d4f>] process_one_work+0x17f/0x440
[<ffffffff83abade6>] worker_thread+0x126/0x3c0
[<ffffffff83abacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff83ac1c31>] kthread+0xd1/0xe0
[<ffffffff83ac1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffff84174c1d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff83ac1b60>] ? insert_kthread_work+0x40/0x40
Complete report #23396
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
__writeback_single_inode
|
vmlinux |
0xffffffff812326d0
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x40
|
|
2
|
writeback_sb_inodes
|
vmlinux |
0xffffffff81233344
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x1c4
|
|
3
|
__writeback_inodes_wb
|
vmlinux |
0xffffffff812336af
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x9f
|
|
4
|
wb_writeback
|
vmlinux |
0xffffffff81233ee3
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x263
|
|
5
|
bdi_writeback_workfn
|
vmlinux |
0xffffffff8123438b
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x2cb
|
|
6
|
process_one_work
|
vmlinux |
0xffffffff810abe2f
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x17f
|
|
7
|
worker_thread
|
vmlinux |
0xffffffff810acaf6
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x126
|
|
8
|
|
vmlinux |
0xffffffff810ac9d0
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x2a0
|
|
9
|
kthread
|
vmlinux |
0xffffffff810b4031
Build id: 3.10.0-693.21.1.el7.x86_64
|
0xd1
|
|
10
|
|
vmlinux |
0xffffffff810b3f60
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x40
|
|
11
|
ret_from_fork
|
vmlinux |
0xffffffff816c0577
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x77
|
|
12
|
|
vmlinux |
0xffffffff810b3f60
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 21s! [xfsaild/dm-0:516]
[<ffffffff812326d0>] __writeback_single_inode+0x40/0x250
[<ffffffff81233344>] writeback_sb_inodes+0x1c4/0x490
[<ffffffff812336af>] __writeback_inodes_wb+0x9f/0xd0
[<ffffffff81233ee3>] wb_writeback+0x263/0x2f0
[<ffffffff8123438b>] bdi_writeback_workfn+0x2cb/0x460
[<ffffffff810abe2f>] process_one_work+0x17f/0x440
[<ffffffff810acaf6>] worker_thread+0x126/0x3c0
[<ffffffff810ac9d0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b4031>] kthread+0xd1/0xe0
[<ffffffff810b3f60>] ? insert_kthread_work+0x40/0x40
[<ffffffff816c0577>] ret_from_fork+0x77/0xb0
[<ffffffff810b3f60>] ? insert_kthread_work+0x40/0x40
Code: 65 8b 0d 71 a0 f7 7e c7 45 a4 0a 00 00 00 89 4d d0 48 89 45 c0 48 89 45 c8 0f 1f 00 65 c7 05 ad 40 f8 7e 00 00 00 00 fb 66 66 90 <66> 66 90 49 c7 c4 c0
Complete report #20066
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
xfs_vm_writepages
|
xfs |
0xffffffffc05f426f
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x7f
|
|
2
|
do_writepages
|
vmlinux |
0xffffffffa53cae21
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x21
|
|
3
|
__writeback_single_inode
|
vmlinux |
0xffffffffa547d730
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x40
|
|
4
|
writeback_sb_inodes
|
vmlinux |
0xffffffffa547e2b4
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x1c4
|
|
5
|
__writeback_inodes_wb
|
vmlinux |
0xffffffffa547e5bf
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x9f
|
|
6
|
wb_writeback
|
vmlinux |
0xffffffffa547ea93
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x263
|
|
7
|
bdi_writeback_workfn
|
vmlinux |
0xffffffffa547f68b
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x2cb
|
|
8
|
process_one_work
|
vmlinux |
0xffffffffa52bdc4f
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x17f
|
|
9
|
worker_thread
|
vmlinux |
0xffffffffa52bed66
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x126
|
|
10
|
|
vmlinux |
0xffffffffa52bec40
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x2a0
|
|
11
|
kthread
|
vmlinux |
0xffffffffa52c5c21
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0xd1
|
|
12
|
|
vmlinux |
0xffffffffa52c5b50
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x40
|
|
13
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffa5994df7
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x21
|
|
14
|
|
vmlinux |
0xffffffffa52c5b50
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [mysqld:62075]
[<ffffffffc05f426f>] xfs_vm_writepages+0x7f/0xa0 [xfs]
[<ffffffffa53cae21>] do_writepages+0x21/0x50
[<ffffffffa547d730>] __writeback_single_inode+0x40/0x260
[<ffffffffa547e2b4>] writeback_sb_inodes+0x1c4/0x430
[<ffffffffa547e5bf>] __writeback_inodes_wb+0x9f/0xd0
[<ffffffffa547ea93>] wb_writeback+0x263/0x2f0
[<ffffffffa547f68b>] bdi_writeback_workfn+0x2cb/0x460
[<ffffffffa52bdc4f>] process_one_work+0x17f/0x440
[<ffffffffa52bed66>] worker_thread+0x126/0x3c0
[<ffffffffa52bec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffa52c5c21>] kthread+0xd1/0xe0
[<ffffffffa52c5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffffa5994df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa52c5b50>] ? insert_kthread_work+0x40/0x40
Complete report #14596
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
do_writepages
|
vmlinux |
0xffffffff901a0dc1
Build id: 3.10.0-862.2.3.el7.x86_64
|
0x21
|
|
2
|
__writeback_single_inode
|
vmlinux |
0xffffffff90248a90
Build id: 3.10.0-862.2.3.el7.x86_64
|
0x40
|
|
3
|
writeback_sb_inodes
|
vmlinux |
0xffffffff90249524
Build id: 3.10.0-862.2.3.el7.x86_64
|
0x1c4
|
|
4
|
__writeback_inodes_wb
|
vmlinux |
0xffffffff9024988f
Build id: 3.10.0-862.2.3.el7.x86_64
|
0x9f
|
|
5
|
wb_writeback
|
vmlinux |
0xffffffff9024a0c3
Build id: 3.10.0-862.2.3.el7.x86_64
|
0x263
|
|
6
|
bdi_writeback_workfn
|
vmlinux |
0xffffffff9024aa4b
Build id: 3.10.0-862.2.3.el7.x86_64
|
0x2cb
|
|
7
|
process_one_work
|
vmlinux |
0xffffffff900b2dff
Build id: 3.10.0-862.2.3.el7.x86_64
|
0x17f
|
|
8
|
worker_thread
|
vmlinux |
0xffffffff900b3ac6
Build id: 3.10.0-862.2.3.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffff900b39a0
Build id: 3.10.0-862.2.3.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffff900bae31
Build id: 3.10.0-862.2.3.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffff900bad60
Build id: 3.10.0-862.2.3.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff9071f5f7
Build id: 3.10.0-862.2.3.el7.x86_64
|
0x21
|
|
13
|
|
vmlinux |
0xffffffff900bad60
Build id: 3.10.0-862.2.3.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [java:22221]
[<ffffffff901a0dc1>] do_writepages+0x21/0x50
[<ffffffff90248a90>] __writeback_single_inode+0x40/0x260
[<ffffffff90249524>] writeback_sb_inodes+0x1c4/0x490
[<ffffffff9024988f>] __writeback_inodes_wb+0x9f/0xd0
[<ffffffff9024a0c3>] wb_writeback+0x263/0x2f0
[<ffffffff9024aa4b>] bdi_writeback_workfn+0x2cb/0x460
[<ffffffff900b2dff>] process_one_work+0x17f/0x440
[<ffffffff900b3ac6>] worker_thread+0x126/0x3c0
[<ffffffff900b39a0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff900bae31>] kthread+0xd1/0xe0
[<ffffffff900bad60>] ? insert_kthread_work+0x40/0x40
[<ffffffff9071f5f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff900bad60>] ? insert_kthread_work+0x40/0x40
Complete report #1269007
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
do_writepages
|
vmlinux |
0xffffffff825cb9b1
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x21
|
|
2
|
__writeback_single_inode
|
vmlinux |
0xffffffff8267df10
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x40
|
|
3
|
writeback_sb_inodes
|
vmlinux |
0xffffffff8267ea94
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x1c4
|
|
4
|
__writeback_inodes_wb
|
vmlinux |
0xffffffff8267ed9f
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x9f
|
|
5
|
wb_writeback
|
vmlinux |
0xffffffff8267f273
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x263
|
|
6
|
bdi_writeback_workfn
|
vmlinux |
0xffffffff8267fd6c
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x1cc
|
|
7
|
process_one_work
|
vmlinux |
0xffffffff824bde8f
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x17f
|
|
8
|
worker_thread
|
vmlinux |
0xffffffff824befa6
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x126
|
|
9
|
|
vmlinux |
0xffffffff824bee80
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffff824c5e61
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffff824c5d90
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff82b95ddd
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x7
|
|
13
|
|
vmlinux |
0xffffffff824c5d90
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 28s! [python3:103269]
[<ffffffff825cb9b1>] do_writepages+0x21/0x50
[<ffffffff8267df10>] __writeback_single_inode+0x40/0x260
[<ffffffff8267ea94>] writeback_sb_inodes+0x1c4/0x430
[<ffffffff8267ed9f>] __writeback_inodes_wb+0x9f/0xd0
[<ffffffff8267f273>] wb_writeback+0x263/0x2f0
[<ffffffff8267fd6c>] bdi_writeback_workfn+0x1cc/0x460
[<ffffffff824bde8f>] process_one_work+0x17f/0x440
[<ffffffff824befa6>] worker_thread+0x126/0x3c0
[<ffffffff824bee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff824c5e61>] kthread+0xd1/0xe0
[<ffffffff824c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffff82b95ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff824c5d90>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48