Info

Permalink
Function
_raw_spin_unlock_irqrestore
First occurrence
2020-12-10
Last occurrence
2020-12-10
State
NEW
Components
kernel
Quality
-34

Statistics

Operating system Count
CentOS 7 8
Architecture Count
x86_64 8
Related packages Count
kernel 8
 0:3.10.0-693.el7 3
 0:3.10.0-1160.15.2.el7 2
 0:3.10.0-1127.18.2.el7 1
 0:3.10.0-693.5.2.el7 1
 0:3.10.0-1160.119.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

Report backtrace


Complete report #1416726
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff816ab845
Build id: 3.10.0-693.el7.x86_64
0x15
2
ata_scsi_queuecmd
libata 0xffffffffc0134b12
Build id: 3.10.0-693.el7.x86_64
0x142
3
? ata_scsiop_inq_std
libata 0xffffffffc0130c90
Build id: 3.10.0-693.el7.x86_64
0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffff8146540a
Build id: 3.10.0-693.el7.x86_64
0xaa
5
scsi_request_fn
vmlinux 0xffffffff8146e1cf
Build id: 3.10.0-693.el7.x86_64
0x4df
6
__blk_run_queue
vmlinux 0xffffffff812f71d3
Build id: 3.10.0-693.el7.x86_64
0x33
7
blk_run_queue
vmlinux 0xffffffff812f7246
Build id: 3.10.0-693.el7.x86_64
0x26
8
scsi_run_queue
vmlinux 0xffffffff8146c6e8
Build id: 3.10.0-693.el7.x86_64
0x258
9
scsi_run_host_queues
vmlinux 0xffffffff8146e5d1
Build id: 3.10.0-693.el7.x86_64
0x21
10
scsi_error_handler
vmlinux 0xffffffff8146a905
Build id: 3.10.0-693.el7.x86_64
0x1b5
11
? scsi_eh_get_sense
vmlinux 0xffffffff8146a750
Build id: 3.10.0-693.el7.x86_64
0x250
12
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64
0xcf
13
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
14
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64
0x58
15
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 30s! [scsi_eh_2:287]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter nls_utf8 isofs ext4 mbcache jbd2 ppdev pcspkr joydev sg shpchp virtio_balloon parport_pc i2c_piix4 parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi bochs_drm e1000 drm_kms_helper ata_piix libata syscopyarea sysfillrect sd_mod crc_t10dif
sysimgblt fb_sys_fops crct10dif_generic crct10dif_common ttm drm virtio_scsi serio_raw virtio_pci floppy i2c_core virtio_ring virtio dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 287 Comm: scsi_eh_2 Tainted: G             L ------------   3.10.0-693.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.10.2-0-g5f4c7b1-prebuilt.qemu-project.org 04/01/2014
task: ffff8800354d8000 ti: ffff8800354d4000 task.ti: ffff8800354d4000
RIP: 0010:[<ffffffff816ab845>]  [<ffffffff816ab845>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff8800354d7c98  EFLAGS: 00000282
RAX: 0000000000000001 RBX: ffff8800354d7c40 RCX: ffff88013fc1eb05
RDX: ffff88013fc16560 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff8800354d7c98 R08: 0000000000000001 R09: 0000000000000029
R10: ffff8800354e0198 R11: 6574656c706d6f63 R12: ffff8800354e0000
R13: ffff8800354e0158 R14: ffffffffc013dee3 R15: ffff8800354d7c10
FS:  0000000000000000(0000) GS:ffff88013fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00005608c5ff3cf8 CR3: 00000001383cf000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff8800354d7ce0 ffffffffc0134b12 ffff8800354e0000 ffffffffc0130c90
ffff880026363200 0000000000000000 ffff880134f3a000 ffff880134f3a848
ffff88009f257a80 ffff8800354d7d08 ffffffff8146540a ffff880134f3a800
Call Trace:
[<ffffffffc0134b12>] ata_scsi_queuecmd+0x142/0x420 [libata]
[<ffffffffc0130c90>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffff8146540a>] scsi_dispatch_cmd+0xaa/0x230
[<ffffffff8146e1cf>] scsi_request_fn+0x4df/0x680
[<ffffffff812f71d3>] __blk_run_queue+0x33/0x40
[<ffffffff812f7246>] blk_run_queue+0x26/0x40
[<ffffffff8146c6e8>] scsi_run_queue+0x258/0x2f0
[<ffffffff8146e5d1>] scsi_run_host_queues+0x21/0x40
[<ffffffff8146a905>] scsi_error_handler+0x1b5/0x8b0
[<ffffffff8146a750>] ? scsi_eh_get_sense+0x250/0x250
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 14 25 50 31 a1 81 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 ff 14 25 50 31 a1 81 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48 
Complete report #1000301
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffa2bba385
Build id: 3.10.0-1160.119.1.el7.x86_64
0x15
2
ata_scsi_queuecmd
libata 0xffffffffc024f275
Build id: 3.10.0-1160.119.1.el7.x86_64
0x155
3
? ata_scsiop_inq_std
libata 0xffffffffc024b1c0
Build id: 3.10.0-1160.119.1.el7.x86_64
0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffffa2903030
Build id: 3.10.0-1160.119.1.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffffa290cbdc
Build id: 3.10.0-1160.119.1.el7.x86_64
0x4ac
6
__blk_run_queue
vmlinux 0xffffffffa27687d9
Build id: 3.10.0-1160.119.1.el7.x86_64
0x39
7
blk_run_queue
vmlinux 0xffffffffa2768866
Build id: 3.10.0-1160.119.1.el7.x86_64
0x26
8
scsi_run_queue
vmlinux 0xffffffffa290b0b8
Build id: 3.10.0-1160.119.1.el7.x86_64
0x258
9
scsi_run_host_queues
vmlinux 0xffffffffa290d031
Build id: 3.10.0-1160.119.1.el7.x86_64
0x21
10
scsi_error_handler
vmlinux 0xffffffffa2908a95
Build id: 3.10.0-1160.119.1.el7.x86_64
0x1b5
11
? scsi_eh_get_sense
vmlinux 0xffffffffa29088e0
Build id: 3.10.0-1160.119.1.el7.x86_64
0x250
12
kthread
vmlinux 0xffffffffa24cb621
Build id: 3.10.0-1160.119.1.el7.x86_64
0xd1
13
? insert_kthread_work
vmlinux 0xffffffffa24cb550
Build id: 3.10.0-1160.119.1.el7.x86_64
0x40
14
ret_from_fork_nospec_begin
vmlinux 0xffffffffa2bc51f7
Build id: 3.10.0-1160.119.1.el7.x86_64
0x21
15
? insert_kthread_work
vmlinux 0xffffffffa24cb550
Build id: 3.10.0-1160.119.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [unix_chkpwd:23732]
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 31s! [scsi_eh_0:240]
Modules linked in: ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_multiport xt_set xt_conntrack nf_conntrack iptable_filter ip_tables kcare(OE) ip_set_hash_net ip_set_hash_ip bridge stp llc libcrc32c ip_set dm_mirror dm_region_hash dm_log dm_mod ppdev sg virtio_balloon pcspkr joydev parport_pc parport i2c_piix4 ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic crct10dif_common sr_mod cdrom virtio_net virtio_scsi ata_generic net_failover virtio_console failover pata_acpi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata floppy virtio_pci serio_raw virtio_ring virtio drm_panel_orientation_quirks [last unloaded: ip_tables]
CPU: 0 PID: 240 Comm: scsi_eh_0 Kdump: loaded Tainted: G           OEL ------------   3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 1.11.0-2.el7 04/01/2014
task: ffff8eaf364f3180 ti: ffff8eaf36988000 task.ti: ffff8eaf36988000
RIP: 0010:[<ffffffffa2bba385>]  [<ffffffffa2bba385>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0000:ffff8eaf3698bc98  EFLAGS: 00000282
RAX: 0000000000000001 RBX: ffff8eaf3698bc40 RCX: ffff8eaf7fc24205
RDX: ffff8eaf7fc1a560 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff8eaf3698bc98 R08: 0000000000000001 R09: 0000000036bbffff
R10: 00000000000012db R11: ffff8eaf3698ba3e R12: ffff8eaf36980000
R13: ffff8eaf36980158 R14: ffffffffc0258a53 R15: ffff8eaf3698bc10
FS:  0000000000000000(0000) GS:ffff8eaf7fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb87719a42c CR3: 000000004a610000 CR4: 00000000000006f0
Call Trace:
[<ffffffffc024f275>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc024b1c0>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffffa2903030>] scsi_dispatch_cmd+0xb0/0x250
[<ffffffffa290cbdc>] scsi_request_fn+0x4ac/0x680
[<ffffffffa27687d9>] __blk_run_queue+0x39/0x50
[<ffffffffa2768866>] blk_run_queue+0x26/0x40
[<ffffffffa290b0b8>] scsi_run_queue+0x258/0x2f0
[<ffffffffa290d031>] scsi_run_host_queues+0x21/0x40
[<ffffffffa2908a95>] scsi_error_handler+0x1b5/0x8b0
[<ffffffffa29088e0>] ? scsi_eh_get_sense+0x250/0x250
[<ffffffffa24cb621>] kthread+0xd1/0xe0
[<ffffffffa24cb550>] ? insert_kthread_work+0x40/0x40
[<ffffffffa2bc51f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa24cb550>] ? insert_kthread_work+0x40/0x40
Code: aa 42 96 ff 66 90 5d c3 cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 e8 8a 42 96 ff 66 90 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 cc cc cc cc 0f 1f 44 00 00 55 48 89 e5 48 
Complete report #233757
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff816ab905
Build id: 3.10.0-693.5.2.el7.x86_64
0x15
2
ata_scsi_queuecmd
libata 0xffffffffc00d7b12
Build id: 3.10.0-693.5.2.el7.x86_64
0x142
3
? ata_scsiop_inq_std
libata 0xffffffffc00d3c90
Build id: 3.10.0-693.5.2.el7.x86_64
0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffff814654da
Build id: 3.10.0-693.5.2.el7.x86_64
0xaa
5
scsi_request_fn
vmlinux 0xffffffff8146e29f
Build id: 3.10.0-693.5.2.el7.x86_64
0x4df
6
__blk_run_queue
vmlinux 0xffffffff812f7293
Build id: 3.10.0-693.5.2.el7.x86_64
0x33
7
blk_run_queue
vmlinux 0xffffffff812f7306
Build id: 3.10.0-693.5.2.el7.x86_64
0x26
8
scsi_run_queue
vmlinux 0xffffffff8146c7b8
Build id: 3.10.0-693.5.2.el7.x86_64
0x258
9
? scsi_device_get
vmlinux 0xffffffff81464843
Build id: 3.10.0-693.5.2.el7.x86_64
0x43
10
scsi_run_host_queues
vmlinux 0xffffffff8146e6a1
Build id: 3.10.0-693.5.2.el7.x86_64
0x21
11
scsi_error_handler
vmlinux 0xffffffff8146a9d5
Build id: 3.10.0-693.5.2.el7.x86_64
0x1b5
12
? scsi_eh_get_sense
vmlinux 0xffffffff8146a820
Build id: 3.10.0-693.5.2.el7.x86_64
0x250
13
kthread
vmlinux 0xffffffff810b099f
Build id: 3.10.0-693.5.2.el7.x86_64
0xcf
14
? insert_kthread_work
vmlinux 0xffffffff810b08d0
Build id: 3.10.0-693.5.2.el7.x86_64
0x40
15
ret_from_fork
vmlinux 0xffffffff816b4fd8
Build id: 3.10.0-693.5.2.el7.x86_64
0x58
16
? insert_kthread_work
vmlinux 0xffffffff810b08d0
Build id: 3.10.0-693.5.2.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 31s! [scsi_eh_1:285]
Modules linked in: ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd hv_utils joydev ptp pcspkr sg pps_core i2c_piix4 i2c_core ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi hv_storvsc scsi_transport_fc hv_netvsc ata_piix hyperv_keyboard hid_hyperv scsi_tgt libata crct10dif_pclmul
hyperv_fb crct10dif_common crc32c_intel floppy hv_vmbus serio_raw dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 285 Comm: scsi_eh_1 Tainted: G             L ------------   3.10.0-693.5.2.el7.x86_64 #1
Hardware name: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS 090006  05/23/2012
task: ffff8800366daf70 ti: ffff88003674c000 task.ti: ffff88003674c000
RIP: 0010:[<ffffffff816ab905>]  [<ffffffff816ab905>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff88003674fc98  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffff88003674fc40 RCX: ffff88010261eb05
RDX: ffff880102616560 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff88003674fc98 R08: 0000000000000001 R09: ffff8800366c0198
R10: ffff880036c28fc0 R11: ffffea0000db0a00 R12: ffff8800366c1e80
R13: ffff8800366c0000 R14: ffff8800366c0158 R15: ffffffffc00e3394
FS:  0000000000000000(0000) GS:ffff880102600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f622faf6000 CR3: 0000000036c02000 CR4: 00000000001406f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff88003674fce0 ffffffffc00d7b12 ffff8800366c0000 ffffffffc00d3c90
ffff880036c28fc0 0000000000000000 ffff880036d18800 ffff880036c0c848
ffff8800cf934a80 ffff88003674fd08 ffffffff814654da ffff880036c0c800
Call Trace:
[<ffffffffc00d7b12>] ata_scsi_queuecmd+0x142/0x420 [libata]
[<ffffffffc00d3c90>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffff814654da>] scsi_dispatch_cmd+0xaa/0x230
[<ffffffff8146e29f>] scsi_request_fn+0x4df/0x680
[<ffffffff812f7293>] __blk_run_queue+0x33/0x40
[<ffffffff812f7306>] blk_run_queue+0x26/0x40
[<ffffffff8146c7b8>] scsi_run_queue+0x258/0x2f0
[<ffffffff81464843>] ? scsi_device_get+0x43/0x60
[<ffffffff8146e6a1>] scsi_run_host_queues+0x21/0x40
[<ffffffff8146a9d5>] scsi_error_handler+0x1b5/0x8b0
[<ffffffff8146a820>] ? scsi_eh_get_sense+0x250/0x250
[<ffffffff810b099f>] kthread+0xcf/0xe0
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4fd8>] ret_from_fork+0x58/0x90
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48 
Complete report #157392
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff9998a3f5
Build id: 3.10.0-1160.15.2.el7.x86_64
0x15
2
ata_scsi_queuecmd
libata 0xffffffffc0144d45
Build id: 3.10.0-1160.15.2.el7.x86_64
0x155
3
? ata_scsiop_inq_std
libata 0xffffffffc0140d90
Build id: 3.10.0-1160.15.2.el7.x86_64
0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffff996e3e70
Build id: 3.10.0-1160.15.2.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffff996ed59c
Build id: 3.10.0-1160.15.2.el7.x86_64
0x4ac
6
__blk_run_queue
vmlinux 0xffffffff99553869
Build id: 3.10.0-1160.15.2.el7.x86_64
0x39
7
blk_run_queue
vmlinux 0xffffffff995538e6
Build id: 3.10.0-1160.15.2.el7.x86_64
0x26
8
scsi_run_queue
vmlinux 0xffffffff996ebaf8
Build id: 3.10.0-1160.15.2.el7.x86_64
0x258
9
scsi_run_host_queues
vmlinux 0xffffffff996ed9d1
Build id: 3.10.0-1160.15.2.el7.x86_64
0x21
10
scsi_error_handler
vmlinux 0xffffffff996e95e5
Build id: 3.10.0-1160.15.2.el7.x86_64
0x1b5
11
? scsi_eh_get_sense
vmlinux 0xffffffff996e9430
Build id: 3.10.0-1160.15.2.el7.x86_64
0x250
12
kthread
vmlinux 0xffffffff992c5e11
Build id: 3.10.0-1160.15.2.el7.x86_64
0xd1
13
? insert_kthread_work
vmlinux 0xffffffff992c5d40
Build id: 3.10.0-1160.15.2.el7.x86_64
0x40
14
ret_from_fork_nospec_begin
vmlinux 0xffffffff99994df7
Build id: 3.10.0-1160.15.2.el7.x86_64
0x21
15
? insert_kthread_work
vmlinux 0xffffffff992c5d40
Build id: 3.10.0-1160.15.2.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 29s! [scsi_eh_1:286]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink xenfs xen_privcmd nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ppdev joydev sg pcspkr i2c_piix4 parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom cirrus drm_kms_helper ata_generic syscopyarea sysfillrect pata_acpi sysimgblt fb_sys_fops
ttm xen_netfront xen_blkfront drm ata_piix libata serio_raw drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 286 Comm: scsi_eh_1 Kdump: loaded Tainted: G             L ------------   3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: Xen HVM domU, BIOS 4.13 11/12/2020
task: ffff88ff75b78000 ti: ffff88ff75054000 task.ti: ffff88ff75054000
RIP: 0010:[<ffffffff9998a3f5>]  [<ffffffff9998a3f5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff88ff75057c98  EFLAGS: 00000282
RAX: 0000000000000001 RBX: ffff88ff75057c40 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff88ff75057c98 R08: 0000000000000001 R09: ffff88ff75b78000
R10: 0000000000004c67 R11: ffff88ff75057a3e R12: ffff88ff75794000
R13: ffff88ff75794158 R14: ffffffffc014e273 R15: ffff88ff75057c10
FS:  0000000000000000(0000) GS:ffff890049200000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fdcdeb62000 CR3: 000000010f84c000 CR4: 00000000000006f0
Call Trace:
[<ffffffffc0144d45>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc0140d90>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffff996e3e70>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff996ed59c>] scsi_request_fn+0x4ac/0x680
[<ffffffff99553869>] __blk_run_queue+0x39/0x50
[<ffffffff995538e6>] blk_run_queue+0x26/0x40
[<ffffffff996ebaf8>] scsi_run_queue+0x258/0x2f0
[<ffffffff996ed9d1>] scsi_run_host_queues+0x21/0x40
[<ffffffff996e95e5>] scsi_error_handler+0x1b5/0x8b0
[<ffffffff996e9430>] ? scsi_eh_get_sense+0x250/0x250
[<ffffffff992c5e11>] kthread+0xd1/0xe0
[<ffffffff992c5d40>] ? insert_kthread_work+0x40/0x40
[<ffffffff99994df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff992c5d40>] ? insert_kthread_work+0x40/0x40
Code: 16 ce 98 ff 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 e8 f6 cd 98 ff 66 90 48 89 f7 57 9d <66> 66 90 66 90 5d c3 0f 1f 40 00 66 66 66 66 90 55 48 89 e5 48 
Complete report #81978
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff8d78a3f5
Build id: 3.10.0-1160.15.2.el7.x86_64
0x15
2
ata_scsi_queuecmd
libata 0xffffffffc0123d45
Build id: 3.10.0-1160.15.2.el7.x86_64
0x155
3
? ata_scsi_invalid_field
libata 0xffffffffc0120a20
Build id: 3.10.0-1160.15.2.el7.x86_64
0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff8d4e3e70
Build id: 3.10.0-1160.15.2.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffff8d4ed59c
Build id: 3.10.0-1160.15.2.el7.x86_64
0x4ac
6
? __wake_up_common_lock
vmlinux 0xffffffff8d0d32f1
Build id: 3.10.0-1160.15.2.el7.x86_64
0x91
7
__blk_run_queue
vmlinux 0xffffffff8d353869
Build id: 3.10.0-1160.15.2.el7.x86_64
0x39
8
blk_run_queue
vmlinux 0xffffffff8d3538e6
Build id: 3.10.0-1160.15.2.el7.x86_64
0x26
9
scsi_kick_queue
vmlinux 0xffffffff8d4e9fd5
Build id: 3.10.0-1160.15.2.el7.x86_64
0x25
10
scsi_run_queue
vmlinux 0xffffffff8d4eba59
Build id: 3.10.0-1160.15.2.el7.x86_64
0x1b9
11
scsi_run_host_queues
vmlinux 0xffffffff8d4ed9d1
Build id: 3.10.0-1160.15.2.el7.x86_64
0x21
12
scsi_error_handler
vmlinux 0xffffffff8d4e95e5
Build id: 3.10.0-1160.15.2.el7.x86_64
0x1b5
13
? scsi_eh_get_sense
vmlinux 0xffffffff8d4e9430
Build id: 3.10.0-1160.15.2.el7.x86_64
0x250
14
kthread
vmlinux 0xffffffff8d0c5e11
Build id: 3.10.0-1160.15.2.el7.x86_64
0xd1
15
? insert_kthread_work
vmlinux 0xffffffff8d0c5d40
Build id: 3.10.0-1160.15.2.el7.x86_64
0x40
16
ret_from_fork_nospec_begin
vmlinux 0xffffffff8d794df7
Build id: 3.10.0-1160.15.2.el7.x86_64
0x21
17
? insert_kthread_work
vmlinux 0xffffffff8d0c5d40
Build id: 3.10.0-1160.15.2.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 29s! [scsi_eh_2:275]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink sunrpc ext4 mbcache jbd2 dm_mirror dm_region_hash dm_log dm_mod iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev sg virtio_balloon joydev i2c_piix4 parport_pc parport pcspkr ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic ata_generic pata_acpi virtio_net bochs_drm net_failover failover drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm libahci crct10dif_pclmul crct10dif_common ata_piix crc32c_intel
virtio_pci libata virtio_ring virtio serio_raw drm_panel_orientation_quirks floppy fuse
CPU: 3 PID: 275 Comm: scsi_eh_2 Not tainted 3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.0-0-g63451fca13-prebuilt.qemu-project.org 04/01/2014
task: ffff8ad1b7b8c200 ti: ffff8ad1ba3b4000 task.ti: ffff8ad1ba3b4000
RIP: 0010:[<ffffffff8d78a3f5>]  [<ffffffff8d78a3f5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff8ad1ba3b7c88  EFLAGS: 00000282
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: ffff8ad1b5fe1c18 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff8ad1ba3b7c88 R08: 0000000000000000 R09: 00000001723fdfff
R10: 0000000000000000 R11: 0000000000000001 R12: ffff8ad1ba3b7c08
R13: ffff8ad1b6bb9f18 R14: ffff8ad076b60548 R15: ffff8ad477d93940
FS:  0000000000000000(0000) GS:ffff8ad477d80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8bf5b0b000 CR3: 0000000400cfc000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc0123d45>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc0120a20>] ? ata_scsi_invalid_field+0x50/0x50 [libata]
[<ffffffff8d4e3e70>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff8d4ed59c>] scsi_request_fn+0x4ac/0x680
[<ffffffff8d0d32f1>] ? __wake_up_common_lock+0x91/0xc0
[<ffffffff8d353869>] __blk_run_queue+0x39/0x50
[<ffffffff8d3538e6>] blk_run_queue+0x26/0x40
[<ffffffff8d4e9fd5>] scsi_kick_queue+0x25/0x30
[<ffffffff8d4eba59>] scsi_run_queue+0x1b9/0x2f0
[<ffffffff8d4ed9d1>] scsi_run_host_queues+0x21/0x40
[<ffffffff8d4e95e5>] scsi_error_handler+0x1b5/0x8b0
[<ffffffff8d4e9430>] ? scsi_eh_get_sense+0x250/0x250
[<ffffffff8d0c5e11>] kthread+0xd1/0xe0
[<ffffffff8d0c5d40>] ? insert_kthread_work+0x40/0x40
[<ffffffff8d794df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8d0c5d40>] ? insert_kthread_work+0x40/0x40
Code: 16 ce 98 ff 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 e8 f6 cd 98 ff 66 90 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48 
Complete report #20744
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffb55883c5
Build id: 3.10.0-1127.18.2.el7.x86_64
0x15
2
ata_scsi_queuecmd
libata 0xffffffffc011ad45
Build id: 3.10.0-1127.18.2.el7.x86_64
0x155
3
? ata_scsiop_inq_std
libata 0xffffffffc0116d90
Build id: 3.10.0-1127.18.2.el7.x86_64
0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffffb52e2950
Build id: 3.10.0-1127.18.2.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffffb52ec07c
Build id: 3.10.0-1127.18.2.el7.x86_64
0x4ac
6
__blk_run_queue
vmlinux 0xffffffffb5152769
Build id: 3.10.0-1127.18.2.el7.x86_64
0x39
7
blk_run_queue
vmlinux 0xffffffffb51527e6
Build id: 3.10.0-1127.18.2.el7.x86_64
0x26
8
scsi_run_queue
vmlinux 0xffffffffb52ea5d8
Build id: 3.10.0-1127.18.2.el7.x86_64
0x258
9
? scsi_device_get
vmlinux 0xffffffffb52e1ca3
Build id: 3.10.0-1127.18.2.el7.x86_64
0x43
10
scsi_run_host_queues
vmlinux 0xffffffffb52ec4b1
Build id: 3.10.0-1127.18.2.el7.x86_64
0x21
11
scsi_error_handler
vmlinux 0xffffffffb52e80c5
Build id: 3.10.0-1127.18.2.el7.x86_64
0x1b5
12
? scsi_eh_get_sense
vmlinux 0xffffffffb52e7f10
Build id: 3.10.0-1127.18.2.el7.x86_64
0x250
13
kthread
vmlinux 0xffffffffb4ec6691
Build id: 3.10.0-1127.18.2.el7.x86_64
0xd1
14
? insert_kthread_work
vmlinux 0xffffffffb4ec65c0
Build id: 3.10.0-1127.18.2.el7.x86_64
0x40
15
ret_from_fork_nospec_begin
vmlinux 0xffffffffb5592d37
Build id: 3.10.0-1127.18.2.el7.x86_64
0x21
16
? insert_kthread_work
vmlinux 0xffffffffb4ec65c0
Build id: 3.10.0-1127.18.2.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 43s! [scsi_eh_2:300]
Modules linked in: tcp_lp fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus aesni_intel snd_seq ppdev lrw gf128mul glue_helper ablk_helper cryptd snd_seq_device snd_pcm vmw_balloon
joydev pcspkr snd_timer snd soundcore sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel drm serio_raw libata mptspi nfit libnvdimm e1000 scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 300 Comm: scsi_eh_2 Tainted: G             L ------------   3.10.0-1127.18.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff9dad35015230 ti: ffff9dad353b0000 task.ti: ffff9dad353b0000
RIP: 0010:[<ffffffffb55883c5>]  [<ffffffffb55883c5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9dad353b3c98  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffff9dad353b3c40 RCX: ffff9dad7c664705
RDX: ffff9dad7c65a560 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff9dad353b3c98 R08: 0000000000000001 R09: 000000007604ffff
R10: ffff9dad353a4198 R11: 6574656c706d6f63 R12: ffff9dad353a4000
R13: ffff9dad353a4158 R14: ffffffffc0124273 R15: ffff9dad353b3c10
FS:  0000000000000000(0000) GS:ffff9dad7c640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005599e2a46640 CR3: 0000000079500000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc011ad45>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc0116d90>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffffb52e2950>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffb52ec07c>] scsi_request_fn+0x4ac/0x680
[<ffffffffb5152769>] __blk_run_queue+0x39/0x50
[<ffffffffb51527e6>] blk_run_queue+0x26/0x40
[<ffffffffb52ea5d8>] scsi_run_queue+0x258/0x2f0
[<ffffffffb52e1ca3>] ? scsi_device_get+0x43/0x60
[<ffffffffb52ec4b1>] scsi_run_host_queues+0x21/0x40
[<ffffffffb52e80c5>] scsi_error_handler+0x1b5/0x8b0
[<ffffffffb52e7f10>] ? scsi_eh_get_sense+0x250/0x250
[<ffffffffb4ec6691>] kthread+0xd1/0xe0
[<ffffffffb4ec65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb5592d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb4ec65c0>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48