Info

Permalink
Function
_raw_spin_unlock_irqrestore
First occurrence
2020-12-10
Last occurrence
2026-08-12
State
NEW
Components
kernel
Quality
-57

Statistics

Operating system Count
CentOS 7 152
Architecture Count
x86_64 152
Related packages Count
kernel 152
 0:3.10.0-1160.53.1.el7 50
 0:3.10.0-1160.41.1.el7 27
 0:3.10.0-1160.108.1.el7 27
 0:3.10.0-1160.102.1.el7 17
 0:3.10.0-1160.62.1.el7 9
 0:3.10.0-1160.66.1.el7 6
 0:3.10.0-1160.el7 4
 0:3.10.0-1160.45.1.el7 3
 0:3.10.0-1127.el7 2
 0:3.10.0-1160.119.1.el7 2
 0:3.10.0-1160.11.1.el7 1
 0:3.10.0-1160.49.1.el7 1
 0:3.10.0-1160.92.1.el7 1
 0:3.10.0-1160.99.1.el7 1
 0:3.10.0-1160.31.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #885766
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffb818b805
Build id: 3.10.0-1160.31.1.el7.x86_64
0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc008f632
Build id: 3.10.0-1160.31.1.el7.x86_64
0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffffb7eec830
Build id: 3.10.0-1160.31.1.el7.x86_64
0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffffb7ee4120
Build id: 3.10.0-1160.31.1.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffffb7eed84c
Build id: 3.10.0-1160.31.1.el7.x86_64
0x4ac
6
__blk_run_queue
vmlinux 0xffffffffb7d539f9
Build id: 3.10.0-1160.31.1.el7.x86_64
0x39
7
queue_unplugged
vmlinux 0xffffffffb7d53aba
Build id: 3.10.0-1160.31.1.el7.x86_64
0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffb7d57398
Build id: 3.10.0-1160.31.1.el7.x86_64
0x1d8
9
blk_queue_bio
vmlinux 0xffffffffb7d57572
Build id: 3.10.0-1160.31.1.el7.x86_64
0x182
10
generic_make_request
vmlinux 0xffffffffb7d55687
Build id: 3.10.0-1160.31.1.el7.x86_64
0x147
11
submit_bio
vmlinux 0xffffffffb7d55930
Build id: 3.10.0-1160.31.1.el7.x86_64
0x70
12
? bio_alloc_bioset
vmlinux 0xffffffffb7c8c485
Build id: 3.10.0-1160.31.1.el7.x86_64
0x115
13
_xfs_buf_ioapply
xfs 0xffffffffc0303283
Build id: 3.10.0-1160.31.1.el7.x86_64
0x2f3
14
? xfs_buf_delwri_submit_buffers
xfs 0xffffffffc03052e0
Build id: 3.10.0-1160.31.1.el7.x86_64
0x130
15
__xfs_buf_submit
xfs 0xffffffffc0304c72
Build id: 3.10.0-1160.31.1.el7.x86_64
0x72
16
xfs_buf_delwri_submit_buffers
xfs 0xffffffffc03052e0
Build id: 3.10.0-1160.31.1.el7.x86_64
0x130
17
? xfs_buf_delwri_submit_nowait
xfs 0xffffffffc0305bd0
Build id: 3.10.0-1160.31.1.el7.x86_64
0x10
18
? xfs_trans_ail_cursor_first
xfs 0xffffffffc0334a40
Build id: 3.10.0-1160.31.1.el7.x86_64
0x90
19
xfs_buf_delwri_submit_nowait
xfs 0xffffffffc0305bd0
Build id: 3.10.0-1160.31.1.el7.x86_64
0x10
20
xfsaild
xfs 0xffffffffc0334cca
Build id: 3.10.0-1160.31.1.el7.x86_64
0x28a
21
? xfs_trans_ail_cursor_first
xfs 0xffffffffc0334a40
Build id: 3.10.0-1160.31.1.el7.x86_64
0x90
22
kthread
vmlinux 0xffffffffb7ac5e31
Build id: 3.10.0-1160.31.1.el7.x86_64
0xd1
23
? insert_kthread_work
vmlinux 0xffffffffb7ac5d60
Build id: 3.10.0-1160.31.1.el7.x86_64
0x40
24
ret_from_fork_nospec_begin
vmlinux 0xffffffffb8195df7
Build id: 3.10.0-1160.31.1.el7.x86_64
0x21
25
? insert_kthread_work
vmlinux 0xffffffffb7ac5d60
Build id: 3.10.0-1160.31.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 48s! [xfsaild/sda5:434]
Modules linked in: tcp_lp xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr ppdev joydev vmw_balloon sg vmxnet3 parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod syscopyarea sysfillrect crc_t10dif sysimgblt crct10dif_generic fb_sys_fops ttm ahci drm crct10dif_pclmul ata_piix crct10dif_common libahci
crc32c_intel libata serio_raw e1000 vmw_pvscsi drm_panel_orientation_quirks fuse
CPU: 1 PID: 434 Comm: xfsaild/sda5 Kdump: loaded Tainted: G             L ------------   3.10.0-1160.31.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff884db8bf0000 ti: ffff884db7b84000 task.ti: ffff884db7b84000
RIP: 0010:[<ffffffffb818b805>]  [<ffffffffb818b805>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff884db7b879a8  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff884db7b87968 RCX: ffffffffb8634f40
RDX: ffffa4d8862b0000 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff884db7b879a8 R08: 0000000000000001 R09: 0000000000000000
R10: ffff884db8ca5400 R11: ffff884db8bbd800 R12: 0000000000000020
R13: ffff88401884cc00 R14: ffffffffb7eeb4e9 R15: ffff884db7b87920
FS:  0000000000000000(0000) GS:ffff884dbd640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000038dc6e74d000 CR3: 000000035b010000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc008f632>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffffb7eec830>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffffb7ee4120>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffb7eed84c>] scsi_request_fn+0x4ac/0x680
[<ffffffffb7d539f9>] __blk_run_queue+0x39/0x50
[<ffffffffb7d53aba>] queue_unplugged+0x2a/0xa0
[<ffffffffb7d57398>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffb7d57572>] blk_queue_bio+0x182/0x400
[<ffffffffb7d55687>] generic_make_request+0x147/0x380
[<ffffffffb7d55930>] submit_bio+0x70/0x150
[<ffffffffb7c8c485>] ? bio_alloc_bioset+0x115/0x310
[<ffffffffc0303283>] _xfs_buf_ioapply+0x2f3/0x460 [xfs]
[<ffffffffc03052e0>] ? xfs_buf_delwri_submit_buffers+0x130/0x240 [xfs]
[<ffffffffc0304c72>] __xfs_buf_submit+0x72/0x250 [xfs]
[<ffffffffc03052e0>] xfs_buf_delwri_submit_buffers+0x130/0x240 [xfs]
[<ffffffffc0305bd0>] ? xfs_buf_delwri_submit_nowait+0x10/0x20 [xfs]
[<ffffffffc0334a40>] ? xfs_trans_ail_cursor_first+0x90/0x90 [xfs]
[<ffffffffc0305bd0>] xfs_buf_delwri_submit_nowait+0x10/0x20 [xfs]
[<ffffffffc0334cca>] xfsaild+0x28a/0x780 [xfs]
[<ffffffffc0334a40>] ? xfs_trans_ail_cursor_first+0x90/0x90 [xfs]
[<ffffffffb7ac5e31>] kthread+0xd1/0xe0
[<ffffffffb7ac5d60>] ? insert_kthread_work+0x40/0x40
[<ffffffffb8195df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb7ac5d60>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48 
Complete report #814424
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff8698b7d5
Build id: 3.10.0-1160.53.1.el7.x86_64
0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc00e2632
Build id: 3.10.0-1160.53.1.el7.x86_64
0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffff866ecf70
Build id: 3.10.0-1160.53.1.el7.x86_64
0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffff866e4860
Build id: 3.10.0-1160.53.1.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffff866edf8c
Build id: 3.10.0-1160.53.1.el7.x86_64
0x4ac
6
__blk_run_queue
vmlinux 0xffffffff86553f39
Build id: 3.10.0-1160.53.1.el7.x86_64
0x39
7
queue_unplugged
vmlinux 0xffffffff86553ffa
Build id: 3.10.0-1160.53.1.el7.x86_64
0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff865578d8
Build id: 3.10.0-1160.53.1.el7.x86_64
0x1d8
9
blk_queue_bio
vmlinux 0xffffffff86557ab2
Build id: 3.10.0-1160.53.1.el7.x86_64
0x182
10
generic_make_request
vmlinux 0xffffffff86555bc7
Build id: 3.10.0-1160.53.1.el7.x86_64
0x147
11
submit_bio
vmlinux 0xffffffff86555e70
Build id: 3.10.0-1160.53.1.el7.x86_64
0x70
12
? bio_alloc_bioset
vmlinux 0xffffffff8648c9c5
Build id: 3.10.0-1160.53.1.el7.x86_64
0x115
13
_xfs_buf_ioapply
xfs 0xffffffffc036e283
Build id: 3.10.0-1160.53.1.el7.x86_64
0x2f3
14
? xfs_buf_delwri_submit_buffers
xfs 0xffffffffc03702e0
Build id: 3.10.0-1160.53.1.el7.x86_64
0x130
15
__xfs_buf_submit
xfs 0xffffffffc036fc72
Build id: 3.10.0-1160.53.1.el7.x86_64
0x72
16
xfs_buf_delwri_submit_buffers
xfs 0xffffffffc03702e0
Build id: 3.10.0-1160.53.1.el7.x86_64
0x130
17
? xfs_buf_delwri_submit_nowait
xfs 0xffffffffc0370bd0
Build id: 3.10.0-1160.53.1.el7.x86_64
0x10
18
? xfs_trans_ail_cursor_first
xfs 0xffffffffc039fa70
Build id: 3.10.0-1160.53.1.el7.x86_64
0x90
19
xfs_buf_delwri_submit_nowait
xfs 0xffffffffc0370bd0
Build id: 3.10.0-1160.53.1.el7.x86_64
0x10
20
xfsaild
xfs 0xffffffffc039fcfa
Build id: 3.10.0-1160.53.1.el7.x86_64
0x28a
21
? xfs_trans_ail_cursor_first
xfs 0xffffffffc039fa70
Build id: 3.10.0-1160.53.1.el7.x86_64
0x90
22
kthread
vmlinux 0xffffffff862c5e61
Build id: 3.10.0-1160.53.1.el7.x86_64
0xd1
23
? insert_kthread_work
vmlinux 0xffffffff862c5d90
Build id: 3.10.0-1160.53.1.el7.x86_64
0x40
24
ret_from_fork_nospec_begin
vmlinux 0xffffffff86995ddd
Build id: 3.10.0-1160.53.1.el7.x86_64
0x7
25
? insert_kthread_work
vmlinux 0xffffffff862c5d90
Build id: 3.10.0-1160.53.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 29s! [xfsaild/sda2:425]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter nfsv3 nfs_acl nfs lockd grace fscache vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd vmw_balloon sg joydev pcspkr vmw_vmci i2c_piix4 parport_pc parport auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod nfit syscopyarea sysfillrect sysimgblt crc_t10dif fb_sys_fops crct10dif_generic ttm libnvdimm
ahci libahci drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel serio_raw libata vmxnet3 vmw_pvscsi drm_panel_orientation_quirks fuse
CPU: 5 PID: 425 Comm: xfsaild/sda2 Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.53.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9ca6ee261080 ti: ffff9ca6ee23c000 task.ti: ffff9ca6ee23c000
RIP: 0010:[<ffffffff8698b7d5>]  [<ffffffff8698b7d5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9ca6ee23f9a8  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff9ca6ee23f968 RCX: ffff9ca5b8eb1060
RDX: ffffac6941ba0000 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff9ca6ee23f9a8 R08: 0000000000000000 R09: ffff9ca4506e7c00
R10: ffff9ca627c12000 R11: ffff9ca6280ad000 R12: 0000000000000020
R13: ffff9ca6f1752900 R14: ffffffff866ebc29 R15: ffff9ca6ee23f920
FS:  0000000000000000(0000) GS:ffff9ca6ffd40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5cb6d13ff8 CR3: 00000002b3cfc000 CR4: 00000000007607e0
PKRU: 00000000
Call Trace:
[<ffffffffc00e2632>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffff866ecf70>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffff866e4860>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff866edf8c>] scsi_request_fn+0x4ac/0x680
[<ffffffff86553f39>] __blk_run_queue+0x39/0x50
[<ffffffff86553ffa>] queue_unplugged+0x2a/0xa0
[<ffffffff865578d8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff86557ab2>] blk_queue_bio+0x182/0x400
[<ffffffff86555bc7>] generic_make_request+0x147/0x380
[<ffffffff86555e70>] submit_bio+0x70/0x150
[<ffffffff8648c9c5>] ? bio_alloc_bioset+0x115/0x310
[<ffffffffc036e283>] _xfs_buf_ioapply+0x2f3/0x460 [xfs]
[<ffffffffc03702e0>] ? xfs_buf_delwri_submit_buffers+0x130/0x240 [xfs]
[<ffffffffc036fc72>] __xfs_buf_submit+0x72/0x250 [xfs]
[<ffffffffc03702e0>] xfs_buf_delwri_submit_buffers+0x130/0x240 [xfs]
[<ffffffffc0370bd0>] ? xfs_buf_delwri_submit_nowait+0x10/0x20 [xfs]
[<ffffffffc039fa70>] ? xfs_trans_ail_cursor_first+0x90/0x90 [xfs]
[<ffffffffc0370bd0>] xfs_buf_delwri_submit_nowait+0x10/0x20 [xfs]
[<ffffffffc039fcfa>] xfsaild+0x28a/0x780 [xfs]
[<ffffffffc039fa70>] ? xfs_trans_ail_cursor_first+0x90/0x90 [xfs]
[<ffffffff862c5e61>] kthread+0xd1/0xe0
[<ffffffff862c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffff86995ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff862c5d90>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48 
Complete report #471793
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc02b83be
Build id: 3.10.0-1160.66.1.el7.x86_64
0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc029271e
Build id: 3.10.0-1160.66.1.el7.x86_64
0x24e
3
mptspi_qcmd
mptspi 0xffffffffc030c2e0
Build id: 3.10.0-1160.66.1.el7.x86_64
0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffa14e4650
Build id: 3.10.0-1160.66.1.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffffa14edd7c
Build id: 3.10.0-1160.66.1.el7.x86_64
0x4ac
6
__blk_run_queue
vmlinux 0xffffffffa1353d09
Build id: 3.10.0-1160.66.1.el7.x86_64
0x39
7
queue_unplugged
vmlinux 0xffffffffa1353dca
Build id: 3.10.0-1160.66.1.el7.x86_64
0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffa13576c8
Build id: 3.10.0-1160.66.1.el7.x86_64
0x1d8
9
blk_queue_bio
vmlinux 0xffffffffa13578a2
Build id: 3.10.0-1160.66.1.el7.x86_64
0x182
10
generic_make_request
vmlinux 0xffffffffa13559b7
Build id: 3.10.0-1160.66.1.el7.x86_64
0x147
11
submit_bio
vmlinux 0xffffffffa1355c60
Build id: 3.10.0-1160.66.1.el7.x86_64
0x70
12
? bio_alloc_bioset
vmlinux 0xffffffffa128c865
Build id: 3.10.0-1160.66.1.el7.x86_64
0x115
13
_xfs_buf_ioapply
xfs 0xffffffffc050c283
Build id: 3.10.0-1160.66.1.el7.x86_64
0x2f3
14
? xfs_buf_delwri_submit_buffers
xfs 0xffffffffc050e2e0
Build id: 3.10.0-1160.66.1.el7.x86_64
0x130
15
__xfs_buf_submit
xfs 0xffffffffc050dc72
Build id: 3.10.0-1160.66.1.el7.x86_64
0x72
16
xfs_buf_delwri_submit_buffers
xfs 0xffffffffc050e2e0
Build id: 3.10.0-1160.66.1.el7.x86_64
0x130
17
? xfs_buf_delwri_submit_nowait
xfs 0xffffffffc050ebd0
Build id: 3.10.0-1160.66.1.el7.x86_64
0x10
18
? xfs_trans_ail_cursor_first
xfs 0xffffffffc053da40
Build id: 3.10.0-1160.66.1.el7.x86_64
0x90
19
xfs_buf_delwri_submit_nowait
xfs 0xffffffffc050ebd0
Build id: 3.10.0-1160.66.1.el7.x86_64
0x10
20
xfsaild
xfs 0xffffffffc053dcca
Build id: 3.10.0-1160.66.1.el7.x86_64
0x28a
21
? xfs_trans_ail_cursor_first
xfs 0xffffffffc053da40
Build id: 3.10.0-1160.66.1.el7.x86_64
0x90
22
kthread
vmlinux 0xffffffffa10c5f91
Build id: 3.10.0-1160.66.1.el7.x86_64
0xd1
23
? insert_kthread_work
vmlinux 0xffffffffa10c5ec0
Build id: 3.10.0-1160.66.1.el7.x86_64
0x40
24
ret_from_fork_nospec_begin
vmlinux 0xffffffffa1799df7
Build id: 3.10.0-1160.66.1.el7.x86_64
0x21
25
? insert_kthread_work
vmlinux 0xffffffffa10c5ec0
Build id: 3.10.0-1160.66.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [xfsaild/sda2:297]
Modules linked in: ip6table_mangle ip6_tables iptable_mangle drbd(OE) vmw_vsock_vmci_transport vsock xt_limit iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw ppdev gf128mul glue_helper ablk_helper cryptd pcspkr joydev vmw_balloon sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common libata crc32c_intel mptspi serio_raw e1000 scsi_transport_spi mptscsih mptbase nfit libnvdimm drm_panel_orientation_quirks floppy
CPU: 0 PID: 297 Comm: xfsaild/sda2 Kdump: loaded Tainted: G           OE  ------------   3.10.0-1160.66.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9451f3ed5280 ti: ffff9450f5630000 task.ti: ffff9450f5630000
RIP: 0010:[<ffffffffc02b83be>]  [<ffffffffc02b83be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff9450f5633940  EFLAGS: 00000246
RAX: ffffa6de00780000 RBX: ffff9451571c7d20 RCX: 000000000000001e
RDX: ffff9450f5f33a00 RSI: ffff9451f3f6b000 RDI: 000000000000000e
RBP: ffff9450f5633950 R08: 0000000000000003 R09: 000000008eaf1fff
R10: ffff9450f569e800 R11: ffff9451cd2b4e00 R12: 0000000100000002
R13: ffff9451052d0a80 R14: ffff9450f56338b4 R15: ffffffffa135c6eb
FS:  0000000000000000(0000) GS:ffff9451ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005631ce299450 CR3: 000000008eb62000 CR4: 00000000003607f0
Call Trace:
[<ffffffffc029271e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc030c2e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffa14e4650>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffa14edd7c>] scsi_request_fn+0x4ac/0x680
[<ffffffffa1353d09>] __blk_run_queue+0x39/0x50
[<ffffffffa1353dca>] queue_unplugged+0x2a/0xa0
[<ffffffffa13576c8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffa13578a2>] blk_queue_bio+0x182/0x400
[<ffffffffa13559b7>] generic_make_request+0x147/0x380
[<ffffffffa1355c60>] submit_bio+0x70/0x150
[<ffffffffa128c865>] ? bio_alloc_bioset+0x115/0x310
[<ffffffffc050c283>] _xfs_buf_ioapply+0x2f3/0x460 [xfs]
[<ffffffffc050e2e0>] ? xfs_buf_delwri_submit_buffers+0x130/0x240 [xfs]
[<ffffffffc050dc72>] __xfs_buf_submit+0x72/0x250 [xfs]
[<ffffffffc050e2e0>] xfs_buf_delwri_submit_buffers+0x130/0x240 [xfs]
[<ffffffffc050ebd0>] ? xfs_buf_delwri_submit_nowait+0x10/0x20 [xfs]
[<ffffffffc053da40>] ? xfs_trans_ail_cursor_first+0x90/0x90 [xfs]
[<ffffffffc050ebd0>] xfs_buf_delwri_submit_nowait+0x10/0x20 [xfs]
[<ffffffffc053dcca>] xfsaild+0x28a/0x780 [xfs]
[<ffffffffc053da40>] ? xfs_trans_ail_cursor_first+0x90/0x90 [xfs]
[<ffffffffa10c5f91>] kthread+0xd1/0xe0
[<ffffffffa10c5ec0>] ? insert_kthread_work+0x40/0x40
[<ffffffffa1799df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa10c5ec0>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 63 2c 
Complete report #20762
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc01973be
Build id: 3.10.0-1127.el7.x86_64
0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc020d71e
Build id: 3.10.0-1127.el7.x86_64
0x24e
3
mptspi_qcmd
mptspi 0xffffffffc02452e0
Build id: 3.10.0-1127.el7.x86_64
0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffb7ee2850
Build id: 3.10.0-1127.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffffb7eebefc
Build id: 3.10.0-1127.el7.x86_64
0x4ac
6
__blk_run_queue
vmlinux 0xffffffffb7d526f9
Build id: 3.10.0-1127.el7.x86_64
0x39
7
queue_unplugged
vmlinux 0xffffffffb7d527ba
Build id: 3.10.0-1127.el7.x86_64
0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffb7d55ff8
Build id: 3.10.0-1127.el7.x86_64
0x1d8
9
blk_queue_bio
vmlinux 0xffffffffb7d561d2
Build id: 3.10.0-1127.el7.x86_64
0x182
10
generic_make_request
vmlinux 0xffffffffb7d54387
Build id: 3.10.0-1127.el7.x86_64
0x147
11
submit_bio
vmlinux 0xffffffffb7d54630
Build id: 3.10.0-1127.el7.x86_64
0x70
12
? bio_alloc_bioset
vmlinux 0xffffffffb7c8b7f5
Build id: 3.10.0-1127.el7.x86_64
0x115
13
_xfs_buf_ioapply
xfs 0xffffffffc04053b3
Build id: 3.10.0-1127.el7.x86_64
0x2f3
14
? xfs_buf_delwri_submit_buffers
xfs 0xffffffffc0407410
Build id: 3.10.0-1127.el7.x86_64
0x130
15
__xfs_buf_submit
xfs 0xffffffffc0406da2
Build id: 3.10.0-1127.el7.x86_64
0x72
16
xfs_buf_delwri_submit_buffers
xfs 0xffffffffc0407410
Build id: 3.10.0-1127.el7.x86_64
0x130
17
? xfs_buf_delwri_submit_nowait
xfs 0xffffffffc0407d00
Build id: 3.10.0-1127.el7.x86_64
0x10
18
? xfs_trans_ail_cursor_first
xfs 0xffffffffc0436a60
Build id: 3.10.0-1127.el7.x86_64
0x90
19
xfs_buf_delwri_submit_nowait
xfs 0xffffffffc0407d00
Build id: 3.10.0-1127.el7.x86_64
0x10
20
xfsaild
xfs 0xffffffffc0436cda
Build id: 3.10.0-1127.el7.x86_64
0x27a
21
? xfs_trans_ail_cursor_first
xfs 0xffffffffc0436a60
Build id: 3.10.0-1127.el7.x86_64
0x90
22
kthread
vmlinux 0xffffffffb7ac6691
Build id: 3.10.0-1127.el7.x86_64
0xd1
23
? insert_kthread_work
vmlinux 0xffffffffb7ac65c0
Build id: 3.10.0-1127.el7.x86_64
0x40
24
ret_from_fork_nospec_begin
vmlinux 0xffffffffb8192d37
Build id: 3.10.0-1127.el7.x86_64
0x21
25
? insert_kthread_work
vmlinux 0xffffffffb7ac65c0
Build id: 3.10.0-1127.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 32s! [xfsaild/sda3:294]
Modules linked in: veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink lp overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event coretemp snd_ens1371 iosf_mbi crc32_pclmul snd_rawmidi snd_ac97_codec ghash_clmulni_intel aesni_intel
ac97_bus lrw gf128mul snd_seq glue_helper ablk_helper snd_seq_device snd_pcm ppdev vmw_balloon cryptd snd_timer snd joydev pcspkr soundcore sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops pata_acpi ttm drm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw mptspi scsi_transport_spi e1000 ata_piix mptscsih libata mptbase drm_panel_orientation_quirks floppy
CPU: 1 PID: 294 Comm: xfsaild/sda3 Kdump: loaded Tainted: G               ------------ T 3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/20/2014
task: ffff8de2f5501070 ti: ffff8de2b4ba8000 task.ti: ffff8de2b4ba8000
RIP: 0010:[<ffffffffc01973be>]  [<ffffffffc01973be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0000:ffff8de2b4bab940  EFLAGS: 00000246
RAX: ffffadf3c03c0000 RBX: ffff8de2dae71b20 RCX: 0000000000000004
RDX: ffff8de2b599e000 RSI: ffff8de2b5924000 RDI: 000000000000000e
RBP: ffff8de2b4bab950 R08: 0000000000000002 R09: 00000000770e4dff
R10: ffff8de2b6066400 R11: ffff8de2e9422f40 R12: 0000000100000002
R13: ffff8de2a795a580 R14: ffff8de2b4bab8b4 R15: ffffffffb7d5b01b
FS:  0000000000000000(0000) GS:ffff8de2fb640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9c04003ea8 CR3: 000000005a81c000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc020d71e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc02452e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffb7ee2850>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffb7eebefc>] scsi_request_fn+0x4ac/0x660
[<ffffffffb7d526f9>] __blk_run_queue+0x39/0x50
[<ffffffffb7d527ba>] queue_unplugged+0x2a/0xa0
[<ffffffffb7d55ff8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffb7d561d2>] blk_queue_bio+0x182/0x400
[<ffffffffb7d54387>] generic_make_request+0x147/0x380
[<ffffffffb7d54630>] submit_bio+0x70/0x150
[<ffffffffb7c8b7f5>] ? bio_alloc_bioset+0x115/0x310
[<ffffffffc04053b3>] _xfs_buf_ioapply+0x2f3/0x460 [xfs]
[<ffffffffc0407410>] ? xfs_buf_delwri_submit_buffers+0x130/0x240 [xfs]
[<ffffffffc0406da2>] __xfs_buf_submit+0x72/0x250 [xfs]
[<ffffffffc0407410>] xfs_buf_delwri_submit_buffers+0x130/0x240 [xfs]
[<ffffffffc0407d00>] ? xfs_buf_delwri_submit_nowait+0x10/0x20 [xfs]
[<ffffffffc0436a60>] ? xfs_trans_ail_cursor_first+0x90/0x90 [xfs]
[<ffffffffc0407d00>] xfs_buf_delwri_submit_nowait+0x10/0x20 [xfs]
[<ffffffffc0436cda>] xfsaild+0x27a/0x760 [xfs]
[<ffffffffc0436a60>] ? xfs_trans_ail_cursor_first+0x90/0x90 [xfs]
[<ffffffffb7ac6691>] kthread+0xd1/0xe0
[<ffffffffb7ac65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb8192d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb7ac65c0>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 53 1a