Info

Permalink
Function
_raw_spin_unlock_irqrestore
First occurrence
2020-09-22
Last occurrence
2025-11-04
State
NEW
Components
kernel
Quality
-44

Statistics

Operating system Count
CentOS 7 2,421
Architecture Count
x86_64 2,421
Related packages Count
kernel 2,419
 0:3.10.0-1062.4.1.el7 357
 0:3.10.0-1160.el7 230
 0:3.10.0-1160.41.1.el7 106
 0:3.10.0-957.el7 106
 0:3.10.0-693.el7 80
 0:3.10.0-514.26.2.el7 78
 0:3.10.0-1062.el7 77
 0:3.10.0-862.el7 69
 0:3.10.0-1160.76.1.el7 63
 0:3.10.0-1160.15.2.el7 59
 0:3.10.0-1160.81.1.el7 55
 0:3.10.0-1160.71.1.el7 49
 0:3.10.0-1127.el7 48
 0:3.10.0-1127.19.1.el7 47
 0:3.10.0-1160.62.1.el7 46
 0:3.10.0-1160.49.1.el7 46
 0:3.10.0-1160.119.1.el7 44
 0:3.10.0-1062.9.1.el7 39
 0:3.10.0-957.12.1.el7 39
 0:3.10.0-1160.25.1.el7 38
 0:3.10.0-1127.13.1.el7 33
 0:3.10.0-1160.88.1.el7 32
 0:3.10.0-862.14.4.el7 31
 0:3.10.0-957.27.2.el7 31
 0:3.10.0-1062.12.1.el7 29
 0:3.10.0-1160.21.1.el7 29
 0:3.10.0-1127.8.2.el7 28
 0:3.10.0-1160.45.1.el7 24
 0:3.10.0-1127.18.2.el7 23
 0:3.10.0-1160.118.1.el7 23
 0:3.10.0-1062.18.1.el7 22
 0:3.10.0-514.el7 20
 0:3.10.0-327.el7 19
 0:3.10.0-1160.11.1.el7 18
 0:3.10.0-514.10.2.el7 17
 0:3.10.0-1160.108.1.el7 16
 0:3.10.0-1160.53.1.el7 16
 0:3.10.0-1160.59.1.el7 16
 0:3.10.0-1160.42.2.el7 15
 0:3.10.0-1160.6.1.el7 15
 0:3.10.0-957.10.1.el7 15
 0:3.10.0-693.2.2.el7 13
 0:3.10.0-1160.36.2.el7 13
 0:3.10.0-327.22.2.el7 13
 0:3.10.0-957.21.3.el7 13
 0:3.10.0-1160.102.1.el7 12
 0:3.10.0-1160.2.2.el7 12
 0:3.10.0-1160.90.1.el7 12
 0:3.10.0-1160.92.1.el7 12
 0:3.10.0-1160.31.1.el7 11
 0:3.10.0-1160.66.1.el7 10
 0:3.10.0-1160.80.1.el7 10
 0:3.10.0-693.21.1.el7 10
 0:3.10.0-1127.10.1.el7 9
 0:3.10.0-514.6.1.el7 8
 0:3.10.0-1160.83.1.el7 8
 0:3.10.0-327.4.5.el7 8
 0:3.10.0-693.5.2.el7 8
 0:3.10.0-957.1.3.el7 8
 0:3.10.0-957.12.2.el7 7
 0:3.10.0-1160.99.1.el7 7
 0:3.10.0-693.17.1.el7 6
 0:3.10.0-862.11.6.el7 5
 0:3.10.0-862.3.2.el7 5
 0:3.10.0-957.5.1.el7 5
 0:3.10.0-1062.1.2.el7 4
 0:3.10.0-1062.4.3.el7 4
 0:3.10.0-1160.105.1.el7 4
 0:3.10.0-1160.24.1.el7 4
 0:3.10.0-693.11.1.el7 4
 0:3.10.0-514.21.2.el7 4
 0:3.10.0-862.2.3.el7 3
 0:3.10.0-327.18.2.el7 3
 0:3.10.0-514.21.1.el7 3
 0:3.10.0-957.21.2.el7 3
 0:3.10.0-1062.1.1.el7 2
 0:3.10.0-1160.114.2.el7 2
 0:3.10.0-1160.95.1.el7 1
 0:3.10.0-327.10.1.el7 1
 0:3.10.0-327.36.3.el7 1
 0:3.10.0-514.16.1.el7 1
 0:3.10.0-862.3.3.el7 1
 0:3.10.0-862.6.3.el7 1
kernel-plus 2
 0:3.10.0-1160.88.1.el7.centos.plus 2

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #1388480
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff909ba385
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x15
2
ata_scsi_queuecmd
libata 0xffffffffc0197275
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x155
3
? ata_scsiop_inq_std
libata 0xffffffffc01931c0
Build id: 3.10.0-1160.83.1.el7.x86_64 		0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffff90702ae0
Build id: 3.10.0-1160.83.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff9070c68c
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffff90568159
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x39
7
blk_execute_rq_nowait
vmlinux 0xffffffff905706fd
Build id: 3.10.0-1160.83.1.el7.x86_64 		0xbd
8
blk_execute_rq
vmlinux 0xffffffff9057084b
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x8b
9
? bio_phys_segments
vmlinux 0xffffffff9049a03d
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x1d
10
? blk_rq_bio_prep
vmlinux 0xffffffff9056b9b1
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x31
11
? blk_rq_map_kern
vmlinux 0xffffffff90570547
Build id: 3.10.0-1160.83.1.el7.x86_64 		0xc7
12
scsi_execute
vmlinux 0xffffffff90708e73
Build id: 3.10.0-1160.83.1.el7.x86_64 		0xd3
13
scsi_execute_req_flags
vmlinux 0xffffffff9070ae7e
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x8e
14
sr_check_events
sr_mod 0xffffffffc034535c
Build id: 3.10.0-1160.83.1.el7.x86_64 		0xbc
15
cdrom_check_events
cdrom 0xffffffffc031e06e
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x1e
16
sr_block_check_events
sr_mod 0xffffffffc0346101
Build id: 3.10.0-1160.83.1.el7.x86_64 		0xb1
17
disk_check_events
vmlinux 0xffffffff9057ec16
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x66
18
disk_events_workfn
vmlinux 0xffffffff9057ed66
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x16
19
process_one_work
vmlinux 0xffffffff902c31df
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x17f
20
worker_thread
vmlinux 0xffffffff902c4326
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x126
21
? manage_workers.isra.26
vmlinux 0xffffffff902c4200
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x2b0
22
kthread
vmlinux 0xffffffff902cb511
Build id: 3.10.0-1160.83.1.el7.x86_64 		0xd1
23
? insert_kthread_work
vmlinux 0xffffffff902cb440
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x40
24
ret_from_fork_nospec_begin
vmlinux 0xffffffff909c51dd
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x7
25
? insert_kthread_work
vmlinux 0xffffffff902cb440
Build id: 3.10.0-1160.83.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 26s! [kworker/1:0:100904]
Modules linked in: bmsensor(OE) bmhook(OE) dsa_filter(POE) dsa_filter_hook(OE) binfmt_misc tmhook(OE) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack vmw_vsock_vmci_transport vsock ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev sg pcspkr joydev vmw_balloon parport_pc parport vmw_vmci i2c_piix4 sch_fq_codel
ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common drm_kms_helper crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm serio_raw ata_piix libata e1000 mptspi scsi_transport_spi mptscsih nfit mptbase vmxnet3 libnvdimm drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: bmsensor]
CPU: 1 PID: 100904 Comm: kworker/1:0 Kdump: loaded Tainted: P        W  OE  ------------ T 3.10.0-1160.83.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable disk_events_workfn
task: ffff9fd9a5a18000 ti: ffff9fda83d04000 task.ti: ffff9fda83d04000
RIP: 0010:[<ffffffff909ba385>]  [<ffffffff909ba385>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9fda83d07a68  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff9fda83d07a10 RCX: ffff9fdbb5664705
RDX: ffff9fdbb565a560 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff9fda83d07a68 R08: 0000000000000001 R09: 0008000000100000
R10: ffff9fdbb0d44198 R11: 0000000000000008 R12: ffff9fdbb0d45e80
R13: ffff9fdbb0d44000 R14: ffff9fdbb0d44158 R15: ffffffffc01a3110
FS:  0000000000000000(0000) GS:ffff9fdbb5640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f11abb38000 CR3: 000000011c39c000 CR4: 00000000000007e0
Call Trace:
[<ffffffffc0197275>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc01931c0>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffff90702ae0>] scsi_dispatch_cmd+0xb0/0x250
[<ffffffff9070c68c>] scsi_request_fn+0x4ac/0x680
[<ffffffff90568159>] __blk_run_queue+0x39/0x50
[<ffffffff905706fd>] blk_execute_rq_nowait+0xbd/0x180
[<ffffffff9057084b>] blk_execute_rq+0x8b/0x150
[<ffffffff9049a03d>] ? bio_phys_segments+0x1d/0x30
[<ffffffff9056b9b1>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff90570547>] ? blk_rq_map_kern+0xc7/0x190
[<ffffffff90708e73>] scsi_execute+0xd3/0x170
[<ffffffff9070ae7e>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc034535c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc031e06e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc0346101>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff9057ec16>] disk_check_events+0x66/0x1a0
[<ffffffff9057ed66>] disk_events_workfn+0x16/0x20
[<ffffffff902c31df>] process_one_work+0x17f/0x440
[<ffffffff902c4326>] worker_thread+0x126/0x3c0
[<ffffffff902c4200>] ? manage_workers.isra.26+0x2b0/0x2b0
[<ffffffff902cb511>] kthread+0xd1/0xe0
[<ffffffff902cb440>] ? insert_kthread_work+0x40/0x40
[<ffffffff909c51dd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff902cb440>] ? insert_kthread_work+0x40/0x40
Code: 07 00 66 66 66 90 5d c3 cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 c6 07 00 66 66 66 90 48 89 f7 57 9d <66> 66 90 66 90 5d c3 cc cc cc cc 66 66 66 66 90 55 48 89 e5 48
Complete report #1285493
Frame # Function Binary Source or offset Line
1
ata_scsi_simulate
libata 0xffffffffc00a49d0
Build id: 3.10.0-693.11.1.el7.x86_64 		0x310
2
? scsi_dispatch_cmd
vmlinux 0xffffffff8146535a
Build id: 3.10.0-693.11.1.el7.x86_64 		0xaa
3
scsi_request_fn
vmlinux 0xffffffff8146e11f
Build id: 3.10.0-693.11.1.el7.x86_64 		0x4df
4
__blk_run_queue
vmlinux 0xffffffff812f7113
Build id: 3.10.0-693.11.1.el7.x86_64 		0x33
5
blk_execute_rq_nowait
vmlinux 0xffffffff812fe895
Build id: 3.10.0-693.11.1.el7.x86_64 		0xb5
6
blk_execute_rq
vmlinux 0xffffffff812fe9db
Build id: 3.10.0-693.11.1.el7.x86_64 		0x8b
7
scsi_execute
vmlinux 0xffffffff8146b1e3
Build id: 3.10.0-693.11.1.el7.x86_64 		0xd3
8
scsi_execute_req_flags
vmlinux 0xffffffff8146c95e
Build id: 3.10.0-693.11.1.el7.x86_64 		0x8e
9
sr_check_events
sr_mod 0xffffffffc023b31c
Build id: 3.10.0-693.11.1.el7.x86_64 		0xbc
10
cdrom_check_events
cdrom 0xffffffffc022a058
Build id: 3.10.0-693.11.1.el7.x86_64 		0x18
11
sr_block_check_events
sr_mod 0xffffffffc023b7c9
Build id: 3.10.0-693.11.1.el7.x86_64 		0x39
12
disk_check_events
vmlinux 0xffffffff81309d00
Build id: 3.10.0-693.11.1.el7.x86_64 		0x60
13
disk_events_workfn
vmlinux 0xffffffff81309e36
Build id: 3.10.0-693.11.1.el7.x86_64 		0x16
14
process_one_work
vmlinux 0xffffffff810a882a
Build id: 3.10.0-693.11.1.el7.x86_64 		0x17a
15
worker_thread
vmlinux 0xffffffff810a94f6
Build id: 3.10.0-693.11.1.el7.x86_64 		0x126
16
? manage_workers.isra.24
vmlinux 0xffffffff810a93d0
Build id: 3.10.0-693.11.1.el7.x86_64 		0x2a0
17
kthread
vmlinux 0xffffffff810b099f
Build id: 3.10.0-693.11.1.el7.x86_64 		0xcf
18
? insert_kthread_work
vmlinux 0xffffffff810b08d0
Build id: 3.10.0-693.11.1.el7.x86_64 		0x40
19
ret_from_fork
vmlinux 0xffffffff816b4fd8
Build id: 3.10.0-693.11.1.el7.x86_64 		0x58
20
? insert_kthread_work
vmlinux 0xffffffff810b08d0
Build id: 3.10.0-693.11.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [kworker/0:0:62818]
Modules linked in: tcp_lp fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun binfmt_misc ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock ext4 mbcache jbd2 coretemp ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev vmw_balloon sg parport_pc parport vmw_vmci shpchp i2c_piix4 nfsd auth_rpcgss nfs_acl lockd
grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ahci ata_piix libahci serio_raw libata mptspi scsi_transport_spi mptscsih mptbase i2c_core vmxnet3 dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 62818 Comm: kworker/0:0 Tainted: G             L ------------   3.10.0-693.11.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable disk_events_workfn
task: ffff880095411fa0 ti: ffff880068400000 task.ti: ffff880068400000
RIP: 0010:[<ffffffffc00a49d0>]  [<ffffffffc00a49d0>] ata_scsi_simulate+0x310/0x310 [libata]
RSP: 0018:ffff880068403ac0  EFLAGS: 00010246
RAX: ffffffffc00da9e0 RBX: ffff880068403a60 RCX: 0000000000000000
RDX: 000000000000000a RSI: ffff880133a4f640 RDI: ffff880035e72800
RBP: ffff880068403ae0 R08: 0000000000000010 R09: ffff880035e728d8
R10: ffff880133a4f640 R11: 0000000000000008 R12: ffff880068403a40
R13: 00000001935e67d0 R14: ffff8801319d8e18 R15: ffffffff81e87180
FS:  0000000000000000(0000) GS:ffff880139600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007ff715ad2000 CR3: 00000000b0480000 CR4: 00000000001407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffffffff8146535a ffff880035dfa000 ffff880035e72800 ffff8801319d88d0
ffff880068403b48 ffffffff8146e11f ffff880068403b08 0000000000000018
ffff880035e72990 ffff880035dfa048 ffff8800bad59c80 ffff880133a4f640
Call Trace:
[<ffffffff8146535a>] ? scsi_dispatch_cmd+0xaa/0x230
[<ffffffff8146e11f>] scsi_request_fn+0x4df/0x680
[<ffffffff812f7113>] __blk_run_queue+0x33/0x40
[<ffffffff812fe895>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff812fe9db>] blk_execute_rq+0x8b/0x150
[<ffffffff8146b1e3>] scsi_execute+0xd3/0x170
[<ffffffff8146c95e>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc023b31c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc022a058>] cdrom_check_events+0x18/0x30 [cdrom]
[<ffffffffc023b7c9>] sr_block_check_events+0x39/0x50 [sr_mod]
[<ffffffff81309d00>] disk_check_events+0x60/0x180
[<ffffffff81309e36>] disk_events_workfn+0x16/0x20
[<ffffffff810a882a>] process_one_work+0x17a/0x440
[<ffffffff810a94f6>] worker_thread+0x126/0x3c0
[<ffffffff810a93d0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b099f>] kthread+0xcf/0xe0
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4fd8>] ret_from_fork+0x58/0x90
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
Code: a7 fd ff ff 48 8d 7d d0 48 c7 c6 f0 05 0a c0 e8 07 eb ff ff e9 92 fd ff ff e8 6d 2d fe c0 0f 1f 00 66 2e 0f 1f 84 00 00 00 00 00 <0f> 1f 44 00 00 55 48 89 e5 41 57 41 56 41 55 41 54 53 48 89 f3
Complete report #122
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff8e1883c5
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x15
2
ata_scsi_queuecmd
libata 0xffffffffc0330d45
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x155
3
? ata_scsiop_inq_std
libata 0xffffffffc032cd90
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffff8dee2950
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff8deec07c
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffff8dd52769
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x39
7
blk_execute_rq_nowait
vmlinux 0xffffffff8dd5a8a5
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xb5
8
blk_execute_rq
vmlinux 0xffffffff8dd5a9eb
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x8b
9
? bio_phys_segments
vmlinux 0xffffffff8dc8a239
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x19
10
? blk_rq_bio_prep
vmlinux 0xffffffff8dd55db1
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x31
11
? blk_rq_map_kern
vmlinux 0xffffffff8dd5a707
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xc7
12
scsi_execute
vmlinux 0xffffffff8dee89d3
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xd3
13
scsi_execute_req_flags
vmlinux 0xffffffff8deea8ae
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x8e
14
sr_check_events
sr_mod 0xffffffffc045b31c
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xbc
15
cdrom_check_events
cdrom 0xffffffffc044f05e
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x1e
16
sr_block_check_events
sr_mod 0xffffffffc045c091
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xb1
17
disk_check_events
vmlinux 0xffffffff8dd68676
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x66
18
disk_events_workfn
vmlinux 0xffffffff8dd687b6
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x16
19
process_one_work
vmlinux 0xffffffff8dabe6bf
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x17f
20
worker_thread
vmlinux 0xffffffff8dabf7d6
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x126
21
? manage_workers.isra.26
vmlinux 0xffffffff8dabf6b0
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x2a0
22
kthread
vmlinux 0xffffffff8dac6691
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xd1
23
? insert_kthread_work
vmlinux 0xffffffff8dac65c0
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x40
24
ret_from_fork_nospec_begin
vmlinux 0xffffffff8e192d37
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x21
25
? insert_kthread_work
vmlinux 0xffffffff8dac65c0
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 31s! [kworker/2:3:2675]
Modules linked in: nf_conntrack_netlink nfnetlink binfmt_misc vboxnetadp(OE) vboxnetflt(OE) xt_conntrack iptable_filter xt_REDIRECT nf_nat_redirect vboxdrv(OE) iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack ppdev sg virtio_balloon parport_pc parport i2c_piix4 pcspkr joydev auth_rpcgss sunrpc ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif crct10dif_generic cdrom crct10dif_common ata_generic pata_acpi virtio_net virtio_scsi net_failover virtio_console failover bochs_drm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata crc32c_intel serio_raw virtio_pci virtio_ring virtio drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 2675 Comm: kworker/2:3 Kdump: loaded Tainted: G           OEL ------------   3.10.0-1127.13.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.2-0-gf9626ccb91-prebuilt.qemu-project.org 04/01/2014
Workqueue: events_freezable disk_events_workfn
task: ffff8ed0a70041c0 ti: ffff8ed009e54000 task.ti: ffff8ed009e54000
RIP: 0010:[<ffffffff8e1883c5>]  [<ffffffff8e1883c5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff8ed009e57a68  EFLAGS: 00000286
RAX: 0000000000000001 RBX: ffff8ed009e57a10 RCX: ffff8ed1bfd24505
RDX: ffff8ed1bfd1a560 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff8ed009e57a68 R08: 0000000000000001 R09: ffff8ed1b14d4198
R10: ffff8ecf365ff500 R11: fffffffffffffffa R12: ffff8ed1b14d5e80
R13: ffff8ed1b14d4000 R14: ffff8ed1b14d4158 R15: ffffffffc033c860
FS:  0000000000000000(0000) GS:ffff8ed1bfd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0103907d28 CR3: 00000001aa8aa000 CR4: 00000000000007e0
Call Trace:
[<ffffffffc0330d45>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc032cd90>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffff8dee2950>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff8deec07c>] scsi_request_fn+0x4ac/0x680
[<ffffffff8dd52769>] __blk_run_queue+0x39/0x50
[<ffffffff8dd5a8a5>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff8dd5a9eb>] blk_execute_rq+0x8b/0x150
[<ffffffff8dc8a239>] ? bio_phys_segments+0x19/0x20
[<ffffffff8dd55db1>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff8dd5a707>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff8dee89d3>] scsi_execute+0xd3/0x170
[<ffffffff8deea8ae>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc045b31c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc044f05e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc045c091>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff8dd68676>] disk_check_events+0x66/0x190
[<ffffffff8dd687b6>] disk_events_workfn+0x16/0x20
[<ffffffff8dabe6bf>] process_one_work+0x17f/0x440
[<ffffffff8dabf7d6>] worker_thread+0x126/0x3c0
[<ffffffff8dabf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff8dac6691>] kthread+0xd1/0xe0
[<ffffffff8dac65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff8e192d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8dac65c0>] ? insert_kthread_work+0x40/0x40
Code: c6 f5 98 ff 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 e8 a6 f5 98 ff 66 90 48 89 f7 57 9d <66> 66 90 66 90 5d c3 0f 1f 40 00 66 66 66 66 90 55 48 89 e5 48
Complete report #759383
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffba1ba385
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x15
2
ata_scsi_queuecmd
libata 0xffffffffc00c0275
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x155
3
? ata_scsiop_inq_std
libata 0xffffffffc00bc1c0
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffffb9f02fe0
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffb9f0cb8c
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffffb9d68649
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x39
7
blk_execute_rq_nowait
vmlinux 0xffffffffb9d70bed
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xbd
8
blk_execute_rq
vmlinux 0xffffffffb9d70d3b
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x8b
9
? bio_phys_segments
vmlinux 0xffffffffb9c9a52d
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x1d
10
? blk_rq_bio_prep
vmlinux 0xffffffffb9d6bea1
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x31
11
scsi_execute
vmlinux 0xffffffffb9f09373
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xd3
12
scsi_execute_req_flags
vmlinux 0xffffffffb9f0b37e
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x8e
13
sr_check_events
sr_mod 0xffffffffc02a835c
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xbc
14
cdrom_check_events
cdrom 0xffffffffc028006e
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x1e
15
sr_block_check_events
sr_mod 0xffffffffc02a9101
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xb1
16
disk_check_events
vmlinux 0xffffffffb9d7f106
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x66
17
disk_events_workfn
vmlinux 0xffffffffb9d7f256
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x16
18
process_one_work
vmlinux 0xffffffffb9ac32ef
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x17f
19
worker_thread
vmlinux 0xffffffffb9ac4436
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x126
20
? manage_workers.isra.26
vmlinux 0xffffffffb9ac4310
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x2b0
21
kthread
vmlinux 0xffffffffb9acb621
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xd1
22
? insert_kthread_work
vmlinux 0xffffffffb9acb550
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x40
23
ret_from_fork_nospec_begin
vmlinux 0xffffffffba1c51f7
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x21
24
? insert_kthread_work
vmlinux 0xffffffffb9acb550
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [kworker/2:0:5789]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon pcspkr joydev sg parport_pc vmw_vmci i2c_piix4 parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic
vmwgfx pata_acpi drm_kms_helper syscopyarea mptspi sysfillrect sysimgblt fb_sys_fops scsi_transport_spi mptscsih ttm ata_piix crct10dif_pclmul crct10dif_common libata drm crc32c_intel serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 5789 Comm: kworker/2:0 Kdump: loaded Tainted: G             L ------------   3.10.0-1160.92.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable disk_events_workfn
task: ffff964b3a751080 ti: ffff964a5536c000 task.ti: ffff964a5536c000
RIP: 0010:[<ffffffffba1ba385>]  [<ffffffffba1ba385>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0000:ffff964a5536fa68  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff964a5536fa10 RCX: ffff964bffd24905
RDX: ffff964bffd1a560 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff964a5536fa68 R08: 0000000000000001 R09: 0008000000100000
R10: ffff964bf2198198 R11: 0000000000000008 R12: ffff964bf2199e80
R13: ffff964bf2198000 R14: ffff964bf2198158 R15: ffffffffc00cc110
FS:  0000000000000000(0000) GS:ffff964bffd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000556eb32b18c0 CR3: 00000001dc05c000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffc00c0275>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc00bc1c0>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffffb9f02fe0>] scsi_dispatch_cmd+0xb0/0x250
[<ffffffffb9f0cb8c>] scsi_request_fn+0x4ac/0x680
[<ffffffffb9d68649>] __blk_run_queue+0x39/0x50
[<ffffffffb9d70bed>] blk_execute_rq_nowait+0xbd/0x180
[<ffffffffb9d70d3b>] blk_execute_rq+0x8b/0x150
[<ffffffffb9c9a52d>] ? bio_phys_segments+0x1d/0x30
[<ffffffffb9d6bea1>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffffb9f09373>] scsi_execute+0xd3/0x170
[<ffffffffb9f0b37e>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc02a835c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc028006e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc02a9101>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffffb9d7f106>] disk_check_events+0x66/0x1a0
[<ffffffffb9d7f256>] disk_events_workfn+0x16/0x20
[<ffffffffb9ac32ef>] process_one_work+0x17f/0x440
[<ffffffffb9ac4436>] worker_thread+0x126/0x3c0
[<ffffffffb9ac4310>] ? manage_workers.isra.26+0x2b0/0x2b0
[<ffffffffb9acb621>] kthread+0xd1/0xe0
[<ffffffffb9acb550>] ? insert_kthread_work+0x40/0x40
[<ffffffffba1c51f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb9acb550>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 cc cc cc cc 0f 1f 44 00 00 55 48 89 e5 48
Complete report #669718
Frame # Function Binary Source or offset Line
1
scsi_dispatch_cmd
vmlinux 0xffffffff892e28e0
Build id: 3.10.0-1127.19.1.el7.x86_64 		-
2
? scsi_request_fn
vmlinux 0xffffffff892ec0bc
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x4ac
3
__blk_run_queue
vmlinux 0xffffffff891527a9
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x39
4
blk_execute_rq_nowait
vmlinux 0xffffffff8915a8e5
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xb5
5
blk_execute_rq
vmlinux 0xffffffff8915aa2b
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x8b
6
? bio_phys_segments
vmlinux 0xffffffff8908a229
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x19
7
? blk_rq_bio_prep
vmlinux 0xffffffff89155df1
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x31
8
? blk_rq_map_kern
vmlinux 0xffffffff8915a747
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xc7
9
scsi_execute
vmlinux 0xffffffff892e8a13
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xd3
10
scsi_execute_req_flags
vmlinux 0xffffffff892ea8ee
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x8e
11
sr_check_events
sr_mod 0xffffffffc029a31c
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xbc
12
cdrom_check_events
cdrom 0xffffffffc02d105e
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x1e
13
sr_block_check_events
sr_mod 0xffffffffc029b091
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xb1
14
disk_check_events
vmlinux 0xffffffff891686b6
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x66
15
disk_events_workfn
vmlinux 0xffffffff891687f6
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x16
16
process_one_work
vmlinux 0xffffffff88ebe6bf
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x17f
17
worker_thread
vmlinux 0xffffffff88ebf7d6
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x126
18
? manage_workers.isra.26
vmlinux 0xffffffff88ebf6b0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x2a0
19
kthread
vmlinux 0xffffffff88ec6691
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xd1
20
? insert_kthread_work
vmlinux 0xffffffff88ec65c0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x40
21
ret_from_fork_nospec_begin
vmlinux 0xffffffff89592d37
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x21
22
? insert_kthread_work
vmlinux 0xffffffff88ec65c0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/0:0:12994]
Modules linked in: uinput xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter sunrpc iosf_mbi kvm_intel kvm snd_hda_codec_generic snd_hda_intel irqbypass crc32_pclmul snd_hda_codec ghash_clmulni_intel snd_hda_core snd_hwdep ppdev aesni_intel snd_seq snd_seq_device lrw snd_pcm gf128mul glue_helper ablk_helper cryptd snd_timer parport_pc snd pcspkr joydev sg parport virtio_balloon soundcore i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net net_failover floppy virtio_console virtio_blk failover qxl drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel libata serio_raw virtio_pci virtio_ring virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 12994 Comm: kworker/0:0 Kdump: loaded Tainted: G             L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Workqueue: events_freezable disk_events_workfn
task: ffffa093f334a0e0 ti: ffffa0932e290000 task.ti: ffffa0932e290000
RIP: 0010:[<ffffffff892e28e0>]  [<ffffffff892e28e0>] scsi_dispatch_cmd+0x0/0x240
RSP: 0000:ffffa0932e293ae0  EFLAGS: 00010206
RAX: 0000000000000000 RBX: ffffa093f371d800 RCX: 0000000000000000
RDX: ffffa093f32e0520 RSI: ffffa093f353d340 RDI: ffffa093f353d340
RBP: ffffa0932e293b40 R08: 0000000000000000 R09: ffffa0932e2939a0
R10: ffffa093f32e0000 R11: 0000000000001000 R12: ffffa092f54f4800
R13: ffffa093f32e0000 R14: ffffa093f371d848 R15: ffffa093f353d340
FS:  0000000000000000(0000) GS:ffffa093ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000058043000 CR3: 00000000b7ce0000 CR4: 00000000003606f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff892ec0bc>] ? scsi_request_fn+0x4ac/0x680
[<ffffffff891527a9>] __blk_run_queue+0x39/0x50
[<ffffffff8915a8e5>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff8915aa2b>] blk_execute_rq+0x8b/0x150
[<ffffffff8908a229>] ? bio_phys_segments+0x19/0x20
[<ffffffff89155df1>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff8915a747>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff892e8a13>] scsi_execute+0xd3/0x170
[<ffffffff892ea8ee>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc029a31c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc02d105e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc029b091>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff891686b6>] disk_check_events+0x66/0x190
[<ffffffff891687f6>] disk_events_workfn+0x16/0x20
[<ffffffff88ebe6bf>] process_one_work+0x17f/0x440
[<ffffffff88ebf7d6>] worker_thread+0x126/0x3c0
[<ffffffff88ebf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff88ec6691>] kthread+0xd1/0xe0
[<ffffffff88ec65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff89592d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff88ec65c0>] ? insert_kthread_work+0x40/0x40
Code: dc 00 00 00 31 c0 e8 20 1a 01 00 5b 41 5c 5d c3 48 89 df e8 e3 25 01 00 eb c0 83 f8 01 75 92 eb ea 66 2e 0f 1f 84 00 00 00 00 00 <0f> 1f 44 00 00 55 48 89 e5 41 55 41 54 53 48 8b 07 48 89 fb 4c
Complete report #588584
Frame # Function Binary Source or offset Line
1
ata_scsi_queuecmd
libata 0xffffffffc0178d65
Build id: 3.10.0-957.12.2.el7.x86_64 		0x155
2
? ata_scsiop_inq_std
libata 0xffffffffc0174db0
Build id: 3.10.0-957.12.2.el7.x86_64 		0xf0
3
scsi_dispatch_cmd
vmlinux 0xffffffff8f6d1630
Build id: 3.10.0-957.12.2.el7.x86_64 		0xb0
4
scsi_request_fn
vmlinux 0xffffffff8f6dabcc
Build id: 3.10.0-957.12.2.el7.x86_64 		0x4cc
5
__blk_run_queue
vmlinux 0xffffffff8f543789
Build id: 3.10.0-957.12.2.el7.x86_64 		0x39
6
blk_execute_rq_nowait
vmlinux 0xffffffff8f54b7e5
Build id: 3.10.0-957.12.2.el7.x86_64 		0xb5
7
blk_execute_rq
vmlinux 0xffffffff8f54b92b
Build id: 3.10.0-957.12.2.el7.x86_64 		0x8b
8
? bio_phys_segments
vmlinux 0xffffffff8f47d479
Build id: 3.10.0-957.12.2.el7.x86_64 		0x19
9
? blk_rq_bio_prep
vmlinux 0xffffffff8f546dc1
Build id: 3.10.0-957.12.2.el7.x86_64 		0x31
10
? blk_rq_map_kern
vmlinux 0xffffffff8f54b647
Build id: 3.10.0-957.12.2.el7.x86_64 		0xc7
11
scsi_execute
vmlinux 0xffffffff8f6d76f3
Build id: 3.10.0-957.12.2.el7.x86_64 		0xd3
12
scsi_execute_req_flags
vmlinux 0xffffffff8f6d93de
Build id: 3.10.0-957.12.2.el7.x86_64 		0x8e
13
sr_check_events
sr_mod 0xffffffffc030b31c
Build id: 3.10.0-957.12.2.el7.x86_64 		0xbc
14
cdrom_check_events
cdrom 0xffffffffc02fa05e
Build id: 3.10.0-957.12.2.el7.x86_64 		0x1e
15
sr_block_check_events
sr_mod 0xffffffffc030c0b1
Build id: 3.10.0-957.12.2.el7.x86_64 		0xb1
16
disk_check_events
vmlinux 0xffffffff8f559386
Build id: 3.10.0-957.12.2.el7.x86_64 		0x66
17
disk_events_workfn
vmlinux 0xffffffff8f5594c6
Build id: 3.10.0-957.12.2.el7.x86_64 		0x16
18
process_one_work
vmlinux 0xffffffff8f2b9e3f
Build id: 3.10.0-957.12.2.el7.x86_64 		0x17f
19
worker_thread
vmlinux 0xffffffff8f2baed6
Build id: 3.10.0-957.12.2.el7.x86_64 		0x126
20
? manage_workers.isra.25
vmlinux 0xffffffff8f2badb0
Build id: 3.10.0-957.12.2.el7.x86_64 		0x2a0
21
kthread
vmlinux 0xffffffff8f2c1d21
Build id: 3.10.0-957.12.2.el7.x86_64 		0xd1
22
? insert_kthread_work
vmlinux 0xffffffff8f2c1c50
Build id: 3.10.0-957.12.2.el7.x86_64 		0x40
23
ret_from_fork_nospec_begin
vmlinux 0xffffffff8f975c37
Build id: 3.10.0-957.12.2.el7.x86_64 		0x21
24
? insert_kthread_work
vmlinux 0xffffffff8f2c1c50
Build id: 3.10.0-957.12.2.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 33s! [vminfo:4149]
[<ffffffffc0178d65>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc0174db0>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffff8f6d1630>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff8f6dabcc>] scsi_request_fn+0x4cc/0x680
[<ffffffff8f543789>] __blk_run_queue+0x39/0x50
[<ffffffff8f54b7e5>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff8f54b92b>] blk_execute_rq+0x8b/0x150
[<ffffffff8f47d479>] ? bio_phys_segments+0x19/0x20
[<ffffffff8f546dc1>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff8f54b647>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff8f6d76f3>] scsi_execute+0xd3/0x170
[<ffffffff8f6d93de>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc030b31c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc02fa05e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc030c0b1>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff8f559386>] disk_check_events+0x66/0x190
[<ffffffff8f5594c6>] disk_events_workfn+0x16/0x20
[<ffffffff8f2b9e3f>] process_one_work+0x17f/0x440
[<ffffffff8f2baed6>] worker_thread+0x126/0x3c0
[<ffffffff8f2badb0>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff8f2c1d21>] kthread+0xd1/0xe0
[<ffffffff8f2c1c50>] ? insert_kthread_work+0x40/0x40
[<ffffffff8f975c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8f2c1c50>] ? insert_kthread_work+0x40/0x40
Complete report #8895
Frame # Function Binary Source or offset Line
1
scsi_request_fn
vmlinux 0xffffffff85ae63d5
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x135
2
__blk_run_queue
vmlinux 0xffffffff8594d7b9
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x39
3
blk_execute_rq_nowait
vmlinux 0xffffffff85955835
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xb5
4
blk_execute_rq
vmlinux 0xffffffff8595597b
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x8b
5
? bio_phys_segments
vmlinux 0xffffffff85885579
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x19
6
? blk_rq_bio_prep
vmlinux 0xffffffff85950e11
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x31
7
? blk_rq_map_kern
vmlinux 0xffffffff85955697
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xc7
8
scsi_execute
vmlinux 0xffffffff85ae3233
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xd3
9
scsi_execute_req_flags
vmlinux 0xffffffff85ae4f7e
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x8e
10
sr_check_events
sr_mod 0xffffffffc062631c
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xbc
11
cdrom_check_events
cdrom 0xffffffffc061a05e
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x1e
12
sr_block_check_events
sr_mod 0xffffffffc06270b1
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xb1
13
disk_check_events
vmlinux 0xffffffff859634e6
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x66
14
disk_events_workfn
vmlinux 0xffffffff85963626
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x16
15
process_one_work
vmlinux 0xffffffff856bd1df
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x17f
16
worker_thread
vmlinux 0xffffffff856be2f6
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x126
17
? manage_workers.isra.26
vmlinux 0xffffffff856be1d0
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x2a0
18
kthread
vmlinux 0xffffffff856c51b1
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xd1
19
? insert_kthread_work
vmlinux 0xffffffff856c50e0
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x40
20
ret_from_fork_nospec_begin
vmlinux 0xffffffff85d8bd37
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x21
21
? insert_kthread_work
vmlinux 0xffffffff856c50e0
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [kworker/0:1:24851]
Modules linked in: nf_log_ipv4 nf_log_common xt_LOG xt_limit xt_multiport xt_comment ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_nat xt_conntrack iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack tun iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel libata mptspi scsi_transport_spi serio_raw mptscsih mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror
dm_region_hash dm_log dm_mod
CPU: 0 PID: 24851 Comm: kworker/0:1 Kdump: loaded Tainted: G             L ------------   3.10.0-1062.4.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
Workqueue: events_freezable disk_events_workfn
task: ffff899f36699070 ti: ffff899f09ecc000 task.ti: ffff899f09ecc000
RIP: 0010:[<ffffffff85ae63d5>]  [<ffffffff85ae63d5>] scsi_request_fn+0x135/0x680
RSP: 0000:ffff899f09ecfae8  EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffff899f79f84600 RCX: 0000000000000000
RDX: ffff899f36b9e510 RSI: ffff899f36b9e510 RDI: ffff899f36b9e440
RBP: ffff899f09ecfb40 R08: ffff899f36b9e510 R09: ffff899f09ecf9a0
R10: ffff899f36b9dff0 R11: 0000000000000008 R12: ffff899f09ecfa70
R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000001
FS:  0000000000000000(0000) GS:ffff899f7c600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc105c70000 CR3: 0000000078912000 CR4: 00000000001607f0
Call Trace:
[<ffffffff8594d7b9>] __blk_run_queue+0x39/0x50
[<ffffffff85955835>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff8595597b>] blk_execute_rq+0x8b/0x150
[<ffffffff85885579>] ? bio_phys_segments+0x19/0x20
[<ffffffff85950e11>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff85955697>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff85ae3233>] scsi_execute+0xd3/0x170
[<ffffffff85ae4f7e>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc062631c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc061a05e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc06270b1>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff859634e6>] disk_check_events+0x66/0x190
[<ffffffff85963626>] disk_events_workfn+0x16/0x20
[<ffffffff856bd1df>] process_one_work+0x17f/0x440
[<ffffffff856be2f6>] worker_thread+0x126/0x3c0
[<ffffffff856be1d0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff856c51b1>] kthread+0xd1/0xe0
[<ffffffff856c50e0>] ? insert_kthread_work+0x40/0x40
[<ffffffff85d8bd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff856c50e0>] ? insert_kthread_work+0x40/0x40
Code: 8b 85 40 04 00 00 a8 02 0f 85 18 01 00 00 4c 89 ff e8 d0 a5 e6 ff 49 8b bd 58 04 00 00 c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <4d> 8b b7 00 01 00 00 4d 85 f6 0f 84 5d 04 00 00 49 8b 85 40 04
Complete report #9579
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff85383025
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x15
2
ata_scsi_queuecmd
libata 0xffffffffc02d9d65
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x155
3
? ata_scsiop_inq_std
libata 0xffffffffc02d5db0
Build id: 3.10.0-1062.9.1.el7.x86_64 		0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffff850deab0
Build id: 3.10.0-1062.9.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff850e811c
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffff84f4f079
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x39
7
blk_execute_rq_nowait
vmlinux 0xffffffff84f570f5
Build id: 3.10.0-1062.9.1.el7.x86_64 		0xb5
8
blk_execute_rq
vmlinux 0xffffffff84f5723b
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x8b
9
? bio_phys_segments
vmlinux 0xffffffff84e86e49
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x19
10
? blk_rq_bio_prep
vmlinux 0xffffffff84f526d1
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x31
11
? blk_rq_map_kern
vmlinux 0xffffffff84f56f57
Build id: 3.10.0-1062.9.1.el7.x86_64 		0xc7
12
scsi_execute
vmlinux 0xffffffff850e4be3
Build id: 3.10.0-1062.9.1.el7.x86_64 		0xd3
13
scsi_execute_req_flags
vmlinux 0xffffffff850e692e
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x8e
14
sr_check_events
sr_mod 0xffffffffc034031c
Build id: 3.10.0-1062.9.1.el7.x86_64 		0xbc
15
cdrom_check_events
cdrom 0xffffffffc046e05e
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x1e
16
sr_block_check_events
sr_mod 0xffffffffc03410b1
Build id: 3.10.0-1062.9.1.el7.x86_64 		0xb1
17
disk_check_events
vmlinux 0xffffffff84f64e36
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x66
18
disk_events_workfn
vmlinux 0xffffffff84f64f76
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x16
19
process_one_work
vmlinux 0xffffffff84cbe21f
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x17f
20
worker_thread
vmlinux 0xffffffff84cbf336
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x126
21
? manage_workers.isra.26
vmlinux 0xffffffff84cbf210
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x2a0
22
kthread
vmlinux 0xffffffff84cc61f1
Build id: 3.10.0-1062.9.1.el7.x86_64 		0xd1
23
? insert_kthread_work
vmlinux 0xffffffff84cc6120
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x40
24
ret_from_fork_nospec_begin
vmlinux 0xffffffff8538dd37
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x21
25
? insert_kthread_work
vmlinux 0xffffffff84cc6120
Build id: 3.10.0-1062.9.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 28s! [kworker/0:1:24577]
Modules linked in: nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache veth nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev vmw_balloon sb_edac iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel
lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc vmw_vmci parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm nfit crct10dif_pclmul libata mptspi crct10dif_common crc32c_intel libnvdimm scsi_transport_spi serio_raw mptscsih mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 24577 Comm: kworker/0:1 Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
Workqueue: events_freezable disk_events_workfn
task: ffff97c6c9afd230 ti: ffff97c6c0ba4000 task.ti: ffff97c6c0ba4000
RIP: 0010:[<ffffffff85383025>]  [<ffffffff85383025>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff97c6c0ba7a68  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff97c6c0ba7a10 RCX: ffff97c6ffc24a05
RDX: ffff97c6ffc1a520 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff97c6c0ba7a68 R08: 0000000000000001 R09: 0008000000100000
R10: ffff97c6d873c198 R11: 0000000000000008 R12: ffff97c6d873de80
R13: ffff97c6d873c000 R14: ffff97c6d873c158 R15: ffffffffc02e58e0
FS:  0000000000000000(0000) GS:ffff97c6ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd09dab1b80 CR3: 0000000813e66000 CR4: 00000000001607f0
Call Trace:
[<ffffffffc02d9d65>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc02d5db0>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffff850deab0>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff850e811c>] scsi_request_fn+0x4cc/0x680
[<ffffffff84f4f079>] __blk_run_queue+0x39/0x50
[<ffffffff84f570f5>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff84f5723b>] blk_execute_rq+0x8b/0x150
[<ffffffff84e86e49>] ? bio_phys_segments+0x19/0x20
[<ffffffff84f526d1>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff84f56f57>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff850e4be3>] scsi_execute+0xd3/0x170
[<ffffffff850e692e>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc034031c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc046e05e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc03410b1>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff84f64e36>] disk_check_events+0x66/0x190
[<ffffffff84f64f76>] disk_events_workfn+0x16/0x20
[<ffffffff84cbe21f>] process_one_work+0x17f/0x440
[<ffffffff84cbf336>] worker_thread+0x126/0x3c0
[<ffffffff84cbf210>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff84cc61f1>] kthread+0xd1/0xe0
[<ffffffff84cc6120>] ? insert_kthread_work+0x40/0x40
[<ffffffff8538dd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff84cc6120>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #1252
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff816ab905
Build id: 3.10.0-693.5.2.el7.x86_64 		0x15
2
ata_scsi_queuecmd
libata 0xffffffffc005eb12
Build id: 3.10.0-693.5.2.el7.x86_64 		0x142
3
? ata_scsiop_inq_std
libata 0xffffffffc005ac90
Build id: 3.10.0-693.5.2.el7.x86_64 		0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffff814654da
Build id: 3.10.0-693.5.2.el7.x86_64 		0xaa
5
scsi_request_fn
vmlinux 0xffffffff8146e29f
Build id: 3.10.0-693.5.2.el7.x86_64 		0x4df
6
__blk_run_queue
vmlinux 0xffffffff812f7293
Build id: 3.10.0-693.5.2.el7.x86_64 		0x33
7
blk_execute_rq_nowait
vmlinux 0xffffffff812fea15
Build id: 3.10.0-693.5.2.el7.x86_64 		0xb5
8
blk_execute_rq
vmlinux 0xffffffff812feb5b
Build id: 3.10.0-693.5.2.el7.x86_64 		0x8b
9
? bio_phys_segments
vmlinux 0xffffffff8123a169
Build id: 3.10.0-693.5.2.el7.x86_64 		0x19
10
? blk_rq_bio_prep
vmlinux 0xffffffff812fa521
Build id: 3.10.0-693.5.2.el7.x86_64 		0x31
11
? blk_rq_map_kern
vmlinux 0xffffffff812fe877
Build id: 3.10.0-693.5.2.el7.x86_64 		0xc7
12
scsi_execute
vmlinux 0xffffffff8146b363
Build id: 3.10.0-693.5.2.el7.x86_64 		0xd3
13
scsi_execute_req_flags
vmlinux 0xffffffff8146cade
Build id: 3.10.0-693.5.2.el7.x86_64 		0x8e
14
sr_check_events
sr_mod 0xffffffffc01ab31c
Build id: 3.10.0-693.5.2.el7.x86_64 		0xbc
15
cdrom_check_events
cdrom 0xffffffffc019f058
Build id: 3.10.0-693.5.2.el7.x86_64 		0x18
16
sr_block_check_events
sr_mod 0xffffffffc01ab7c9
Build id: 3.10.0-693.5.2.el7.x86_64 		0x39
17
disk_check_events
vmlinux 0xffffffff81309e80
Build id: 3.10.0-693.5.2.el7.x86_64 		0x60
18
disk_events_workfn
vmlinux 0xffffffff81309fb6
Build id: 3.10.0-693.5.2.el7.x86_64 		0x16
19
process_one_work
vmlinux 0xffffffff810a882a
Build id: 3.10.0-693.5.2.el7.x86_64 		0x17a
20
worker_thread
vmlinux 0xffffffff810a94f6
Build id: 3.10.0-693.5.2.el7.x86_64 		0x126
21
? manage_workers.isra.24
vmlinux 0xffffffff810a93d0
Build id: 3.10.0-693.5.2.el7.x86_64 		0x2a0
22
kthread
vmlinux 0xffffffff810b099f
Build id: 3.10.0-693.5.2.el7.x86_64 		0xcf
23
? insert_kthread_work
vmlinux 0xffffffff810b08d0
Build id: 3.10.0-693.5.2.el7.x86_64 		0x40
24
ret_from_fork
vmlinux 0xffffffff816b4fd8
Build id: 3.10.0-693.5.2.el7.x86_64 		0x58
25
? insert_kthread_work
vmlinux 0xffffffff810b08d0
Build id: 3.10.0-693.5.2.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 84s! [kworker/0:2:120746]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter xt_set ip_set nfnetlink ip_vs nf_conntrack vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul snd_ens1371 glue_helper ablk_helper cryptd snd_rawmidi snd_ac97_codec ac97_bus snd_seq ppdev snd_seq_device snd_pcm vmw_balloon snd_timer snd pcspkr joydev soundcore i2c_piix4 sg vmw_vmci shpchp nfit libnvdimm parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs
libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm crc32c_intel serio_raw e1000 ata_piix libata mptspi scsi_transport_spi mptscsih mptbase i2c_core
CPU: 0 PID: 120746 Comm: kworker/0:2 Tainted: G             L ------------   3.10.0-693.5.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
Workqueue: events_freezable disk_events_workfn
task: ffff8801370c5ee0 ti: ffff880131a7c000 task.ti: ffff880131a7c000
RIP: 0010:[<ffffffff816ab905>]  [<ffffffff816ab905>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff880131a7fa70  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffffffffc006a483 RCX: ffff880139620605
RDX: ffff880139616560 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff880131a7fa70 R08: 0000000000000001 R09: 0008000000100000
R10: ffff880035044198 R11: 0000000000000008 R12: 0000000000000001
R13: ffff880035045e80 R14: ffff880035044000 R15: ffff880035044158
FS:  0000000000000000(0000) GS:ffff880139600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007efffd7b4000 CR3: 00000000b22fb000 CR4: 00000000000407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff880131a7fab8 ffffffffc005eb12 ffff880035044000 ffffffffc005ac90
ffff8800a707d880 0000000000000000 ffff880132364800 ffff880132364048
ffff8800b4bfba80 ffff880131a7fae0 ffffffff814654da ffff880132364000
Call Trace:
[<ffffffffc005eb12>] ata_scsi_queuecmd+0x142/0x420 [libata]
[<ffffffffc005ac90>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffff814654da>] scsi_dispatch_cmd+0xaa/0x230
[<ffffffff8146e29f>] scsi_request_fn+0x4df/0x680
[<ffffffff812f7293>] __blk_run_queue+0x33/0x40
[<ffffffff812fea15>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff812feb5b>] blk_execute_rq+0x8b/0x150
[<ffffffff8123a169>] ? bio_phys_segments+0x19/0x20
[<ffffffff812fa521>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff812fe877>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff8146b363>] scsi_execute+0xd3/0x170
[<ffffffff8146cade>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc01ab31c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc019f058>] cdrom_check_events+0x18/0x30 [cdrom]
[<ffffffffc01ab7c9>] sr_block_check_events+0x39/0x50 [sr_mod]
[<ffffffff81309e80>] disk_check_events+0x60/0x180
[<ffffffff81309fb6>] disk_events_workfn+0x16/0x20
[<ffffffff810a882a>] process_one_work+0x17a/0x440
[<ffffffff810a94f6>] worker_thread+0x126/0x3c0
[<ffffffff810a93d0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b099f>] kthread+0xcf/0xe0
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4fd8>] ret_from_fork+0x58/0x90
[<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
Code: 07 00 66 66 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 c6 07 00 66 66 66 90 48 89 f7 57 9d <66> 66 90 66 90 5d c3 0f 1f 40 00 66 66 66 66 90 55 48 89 e5 48
Complete report #559694
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff90989805
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x15
2
ata_scsi_queuecmd
libata 0xffffffffc02cbd45
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x155
3
? ata_scsiop_inq_std
libata 0xffffffffc02c7d90
Build id: 3.10.0-1160.2.2.el7.x86_64 		0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffff906e3980
Build id: 3.10.0-1160.2.2.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff906ed0ac
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffff905534d9
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x39
7
blk_execute_rq_nowait
vmlinux 0xffffffff9055b615
Build id: 3.10.0-1160.2.2.el7.x86_64 		0xb5
8
blk_execute_rq
vmlinux 0xffffffff9055b75b
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x8b
9
? blk_rq_map_kern
vmlinux 0xffffffff9055b477
Build id: 3.10.0-1160.2.2.el7.x86_64 		0xc7
10
scsi_execute
vmlinux 0xffffffff906e9a03
Build id: 3.10.0-1160.2.2.el7.x86_64 		0xd3
11
scsi_execute_req_flags
vmlinux 0xffffffff906eb8de
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x8e
12
sr_check_events
sr_mod 0xffffffffc02ab31c
Build id: 3.10.0-1160.2.2.el7.x86_64 		0xbc
13
cdrom_check_events
cdrom 0xffffffffc029a05e
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x1e
14
sr_block_check_events
sr_mod 0xffffffffc02ac091
Build id: 3.10.0-1160.2.2.el7.x86_64 		0xb1
15
disk_check_events
vmlinux 0xffffffff90569496
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x66
16
disk_events_workfn
vmlinux 0xffffffff905695d6
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x16
17
process_one_work
vmlinux 0xffffffff902bdc4f
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x17f
18
worker_thread
vmlinux 0xffffffff902bed66
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x126
19
? manage_workers.isra.26
vmlinux 0xffffffff902bec40
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x2a0
20
kthread
vmlinux 0xffffffff902c5c21
Build id: 3.10.0-1160.2.2.el7.x86_64 		0xd1
21
? insert_kthread_work
vmlinux 0xffffffff902c5b50
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x40
22
ret_from_fork_nospec_begin
vmlinux 0xffffffff90993df7
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x21
23
? insert_kthread_work
vmlinux 0xffffffff902c5b50
Build id: 3.10.0-1160.2.2.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 31s! [kworker/0:1:29977]
Modules linked in: nls_utf8 cifs ccm xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink tcp_lp nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache tcp_diag inet_diag nf_conntrack_netbios_ns nf_conntrack_broadcast nf_nat_ftp nf_conntrack_ftp ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd parport_pc
joydev parport sg pcspkr virtio_balloon i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c cirrus drm_kms_helper sr_mod cdrom syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_generic pata_acpi drm virtio_net net_failover virtio_console virtio_blk failover ata_piix crct10dif_pclmul crct10dif_common libata virtio_pci crc32c_intel floppy serio_raw virtio_ring virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 29977 Comm: kworker/0:1 Kdump: loaded Tainted: G             L ------------   3.10.0-1160.2.2.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Workqueue: events_freezable disk_events_workfn
task: ffff916414bce300 ti: ffff916c66e08000 task.ti: ffff916c66e08000
RIP: 0010:[<ffffffff90989805>]  [<ffffffff90989805>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0000:ffff916c66e0ba68  EFLAGS: 00000286
RAX: 0000000000000001 RBX: ffff916c66e0ba10 RCX: ffff9182bfc24405
RDX: ffff9182bfc1a560 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff916c66e0ba68 R08: 0000000000000001 R09: ffff916468fd4198
R10: ffff9164683e4e00 R11: 0000000000000003 R12: ffff916468fd5e80
R13: ffff916468fd4000 R14: ffff916468fd4158 R15: ffffffffc02d7860
FS:  0000000000000000(0000) GS:ffff9182bfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2c677b0000 CR3: 00000001907fa000 CR4: 00000000001606f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffc02cbd45>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc02c7d90>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffff906e3980>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff906ed0ac>] scsi_request_fn+0x4ac/0x680
[<ffffffff905534d9>] __blk_run_queue+0x39/0x50
[<ffffffff9055b615>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff9055b75b>] blk_execute_rq+0x8b/0x150
[<ffffffff9055b477>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff906e9a03>] scsi_execute+0xd3/0x170
[<ffffffff906eb8de>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc02ab31c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc029a05e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc02ac091>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff90569496>] disk_check_events+0x66/0x190
[<ffffffff905695d6>] disk_events_workfn+0x16/0x20
[<ffffffff902bdc4f>] process_one_work+0x17f/0x440
[<ffffffff902bed66>] worker_thread+0x126/0x3c0
[<ffffffff902bec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff902c5c21>] kthread+0xd1/0xe0
[<ffffffff902c5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffff90993df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff902c5b50>] ? insert_kthread_work+0x40/0x40
Code: c6 d7 98 ff 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 e8 a6 d7 98 ff 66 90 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #378323
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff816b6545
Build id: 3.10.0-693.21.1.el7.x86_64 		0x15
2
ata_scsi_queuecmd
libata 0xffffffffc006cbf8
Build id: 3.10.0-693.21.1.el7.x86_64 		0x148
3
? ata_scsiop_inq_std
libata 0xffffffffc0068d20
Build id: 3.10.0-693.21.1.el7.x86_64 		0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffff8146d8f0
Build id: 3.10.0-693.21.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff8147678f
Build id: 3.10.0-693.21.1.el7.x86_64 		0x4df
6
__blk_run_queue
vmlinux 0xffffffff812fd1d9
Build id: 3.10.0-693.21.1.el7.x86_64 		0x39
7
blk_execute_rq_nowait
vmlinux 0xffffffff81304a15
Build id: 3.10.0-693.21.1.el7.x86_64 		0xb5
8
blk_execute_rq
vmlinux 0xffffffff81304b5b
Build id: 3.10.0-693.21.1.el7.x86_64 		0x8b
9
? bio_phys_segments
vmlinux 0xffffffff8123f039
Build id: 3.10.0-693.21.1.el7.x86_64 		0x19
10
? blk_rq_bio_prep
vmlinux 0xffffffff813004c1
Build id: 3.10.0-693.21.1.el7.x86_64 		0x31
11
? blk_rq_map_kern
vmlinux 0xffffffff81304877
Build id: 3.10.0-693.21.1.el7.x86_64 		0xc7
12
scsi_execute
vmlinux 0xffffffff81473833
Build id: 3.10.0-693.21.1.el7.x86_64 		0xd3
13
scsi_execute_req_flags
vmlinux 0xffffffff81474fce
Build id: 3.10.0-693.21.1.el7.x86_64 		0x8e
14
sr_check_events
sr_mod 0xffffffffc01d431c
Build id: 3.10.0-693.21.1.el7.x86_64 		0xbc
15
cdrom_check_events
cdrom 0xffffffffc017f05e
Build id: 3.10.0-693.21.1.el7.x86_64 		0x1e
16
sr_block_check_events
sr_mod 0xffffffffc01d47c9
Build id: 3.10.0-693.21.1.el7.x86_64 		0x39
17
disk_check_events
vmlinux 0xffffffff8130ff36
Build id: 3.10.0-693.21.1.el7.x86_64 		0x66
18
disk_events_workfn
vmlinux 0xffffffff81310076
Build id: 3.10.0-693.21.1.el7.x86_64 		0x16
19
process_one_work
vmlinux 0xffffffff810abe2f
Build id: 3.10.0-693.21.1.el7.x86_64 		0x17f
20
worker_thread
vmlinux 0xffffffff810acaf6
Build id: 3.10.0-693.21.1.el7.x86_64 		0x126
21
? manage_workers.isra.24
vmlinux 0xffffffff810ac9d0
Build id: 3.10.0-693.21.1.el7.x86_64 		0x2a0
22
kthread
vmlinux 0xffffffff810b4031
Build id: 3.10.0-693.21.1.el7.x86_64 		0xd1
23
? insert_kthread_work
vmlinux 0xffffffff810b3f60
Build id: 3.10.0-693.21.1.el7.x86_64 		0x40
24
ret_from_fork
vmlinux 0xffffffff816c055d
Build id: 3.10.0-693.21.1.el7.x86_64 		0x5d
25
? insert_kthread_work
vmlinux 0xffffffff810b3f60
Build id: 3.10.0-693.21.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 38s! [TaniumClient:3185]
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 38s! [kworker/1:0:3244]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13109(E) nfsv3 nfsv4 dns_resolver nfs fscache rpcsec_gss_krb5 vmw_vsock_vmci_transport vsock falcon_lsm_pinned_13005(E) edac_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev nfit sg vmw_balloon pcspkr joydev libnvdimm parport_pc parport i2c_piix4 shpchp vmw_vmci nfsd nfs_acl lockd grace auth_rpcgss binfmt_misc sunrpc ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm ata_piix libata vmxnet3 i2c_core dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal]
CPU: 1 PID: 3244 Comm: kworker/1:0 Tainted: P            EL ------------   3.10.0-693.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
Workqueue: events_freezable disk_events_workfn
task: ffff880006dd4f10 ti: ffff880021340000 task.ti: ffff880021340000
RIP: 0010:[<ffffffff816b6545>]  [<ffffffff816b6545>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff880021343a70  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffffffffc0078733 RCX: ffff88033fca2705
RDX: ffff88033fc982e0 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff880021343a70 R08: 0000000000000001 R09: 0008000000100000
R10: ffff88033072c198 R11: 0000000000000008 R12: 0000000000000001
R13: ffff88033072de80 R14: ffff88033072c000 R15: ffff88033072c158
FS:  0000000000000000(0000) GS:ffff88033fc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2e57a5c000 CR3: 000000032b7a6000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffc006cbf8>] ata_scsi_queuecmd+0x148/0x440 [libata]
[<ffffffffc0068d20>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffff8146d8f0>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff8147678f>] scsi_request_fn+0x4df/0x680
[<ffffffff812fd1d9>] __blk_run_queue+0x39/0x50
[<ffffffff81304a15>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff81304b5b>] blk_execute_rq+0x8b/0x150
[<ffffffff8123f039>] ? bio_phys_segments+0x19/0x20
[<ffffffff813004c1>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff81304877>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff81473833>] scsi_execute+0xd3/0x170
[<ffffffff81474fce>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc01d431c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc017f05e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc01d47c9>] sr_block_check_events+0x39/0x50 [sr_mod]
[<ffffffff8130ff36>] disk_check_events+0x66/0x190
[<ffffffff81310076>] disk_events_workfn+0x16/0x20
[<ffffffff810abe2f>] process_one_work+0x17f/0x440
[<ffffffff810acaf6>] worker_thread+0x126/0x3c0
[<ffffffff810ac9d0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b4031>] kthread+0xd1/0xe0
[<ffffffff810b3f60>] ? insert_kthread_work+0x40/0x40
[<ffffffff816c055d>] ret_from_fork+0x5d/0xb0
[<ffffffff810b3f60>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #368542
Frame # Function Binary Source or offset Line
1
? ata_scsiop_inq_std
libata 0xffffffffc044cd90
Build id: 3.10.0-1160.el7.x86_64 		0xf0
2
scsi_dispatch_cmd
vmlinux 0xffffffff85ee3980
Build id: 3.10.0-1160.el7.x86_64 		0xb0
3
scsi_request_fn
vmlinux 0xffffffff85eed0ac
Build id: 3.10.0-1160.el7.x86_64 		0x4ac
4
__blk_run_queue
vmlinux 0xffffffff85d534d9
Build id: 3.10.0-1160.el7.x86_64 		0x39
5
blk_execute_rq_nowait
vmlinux 0xffffffff85d5b615
Build id: 3.10.0-1160.el7.x86_64 		0xb5
6
blk_execute_rq
vmlinux 0xffffffff85d5b75b
Build id: 3.10.0-1160.el7.x86_64 		0x8b
7
? bio_phys_segments
vmlinux 0xffffffff85c8acd9
Build id: 3.10.0-1160.el7.x86_64 		0x19
8
? blk_rq_bio_prep
vmlinux 0xffffffff85d56b21
Build id: 3.10.0-1160.el7.x86_64 		0x31
9
? blk_rq_map_kern
vmlinux 0xffffffff85d5b477
Build id: 3.10.0-1160.el7.x86_64 		0xc7
10
scsi_execute
vmlinux 0xffffffff85ee9a03
Build id: 3.10.0-1160.el7.x86_64 		0xd3
11
scsi_execute_req_flags
vmlinux 0xffffffff85eeb8de
Build id: 3.10.0-1160.el7.x86_64 		0x8e
12
sr_check_events
sr_mod 0xffffffffc05fd31c
Build id: 3.10.0-1160.el7.x86_64 		0xbc
13
cdrom_check_events
cdrom 0xffffffffc05a705e
Build id: 3.10.0-1160.el7.x86_64 		0x1e
14
sr_block_check_events
sr_mod 0xffffffffc05fe091
Build id: 3.10.0-1160.el7.x86_64 		0xb1
15
disk_check_events
vmlinux 0xffffffff85d69496
Build id: 3.10.0-1160.el7.x86_64 		0x66
16
disk_events_workfn
vmlinux 0xffffffff85d695d6
Build id: 3.10.0-1160.el7.x86_64 		0x16
17
process_one_work
vmlinux 0xffffffff85abdc4f
Build id: 3.10.0-1160.el7.x86_64 		0x17f
18
worker_thread
vmlinux 0xffffffff85abed66
Build id: 3.10.0-1160.el7.x86_64 		0x126
19
? manage_workers.isra.26
vmlinux 0xffffffff85abec40
Build id: 3.10.0-1160.el7.x86_64 		0x2a0
20
kthread
vmlinux 0xffffffff85ac5c21
Build id: 3.10.0-1160.el7.x86_64 		0xd1
21
? insert_kthread_work
vmlinux 0xffffffff85ac5b50
Build id: 3.10.0-1160.el7.x86_64 		0x40
22
ret_from_fork_nospec_begin
vmlinux 0xffffffff86193df7
Build id: 3.10.0-1160.el7.x86_64 		0x21 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [ksoftirqd/2:19]
[<ffffffffc044cd90>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffff85ee3980>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff85eed0ac>] scsi_request_fn+0x4ac/0x680
[<ffffffff85d534d9>] __blk_run_queue+0x39/0x50
[<ffffffff85d5b615>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff85d5b75b>] blk_execute_rq+0x8b/0x150
[<ffffffff85c8acd9>] ? bio_phys_segments+0x19/0x20
[<ffffffff85d56b21>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff85d5b477>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff85ee9a03>] scsi_execute+0xd3/0x170
[<ffffffff85eeb8de>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc05fd31c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc05a705e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc05fe091>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff85d69496>] disk_check_events+0x66/0x190
[<ffffffff85d695d6>] disk_events_workfn+0x16/0x20
[<ffffffff85abdc4f>] process_one_work+0x17f/0x440
[<ffffffff85abed66>] worker_thread+0x126/0x3c0
[<ffffffff85abec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff85ac5c21>] kthread+0xd1/0xe0
[<ffffffff85ac5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffff86193df7>] ret_from_fork_nospec_begin+0x21/0x21
Complete report #109513
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff9178a3f5
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x15
2
ata_scsi_queuecmd
libata 0xffffffffc0448d45
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x155
3
? ata_scsiop_inq_std
libata 0xffffffffc0444d90
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffff914e3e70
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff914ed59c
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x4ac
6
? kvm_async_pf_task_wake
vmlinux 0xffffffff9106ce66
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x96
7
__blk_run_queue
vmlinux 0xffffffff91353869
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x39
8
blk_execute_rq_nowait
vmlinux 0xffffffff9135baa5
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xb5
9
blk_execute_rq
vmlinux 0xffffffff9135bbeb
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x8b
10
scsi_execute
vmlinux 0xffffffff914e9ef3
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xd3
11
scsi_execute_req_flags
vmlinux 0xffffffff914ebdce
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x8e
12
sr_check_events
sr_mod 0xffffffffc048231c
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xbc
13
cdrom_check_events
cdrom 0xffffffffc04d805e
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x1e
14
sr_block_check_events
sr_mod 0xffffffffc0483091
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xb1
15
disk_check_events
vmlinux 0xffffffff91369936
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x66
16
disk_events_workfn
vmlinux 0xffffffff91369a76
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x16
17
process_one_work
vmlinux 0xffffffff910bde3f
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x17f
18
worker_thread
vmlinux 0xffffffff910bef56
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x126
19
? manage_workers.isra.26
vmlinux 0xffffffff910bee30
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x2a0
20
kthread
vmlinux 0xffffffff910c5e11
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xd1
21
? insert_kthread_work
vmlinux 0xffffffff910c5d40
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x40
22
ret_from_fork_nospec_begin
vmlinux 0xffffffff91794df7
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x21
23
? insert_kthread_work
vmlinux 0xffffffff910c5d40
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 30s! [kworker/1:1:15672]
Modules linked in: uinput xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc snd_hda_codec_generic snd_hda_intel snd_hda_codec iosf_mbi crc32_pclmul ghash_clmulni_intel snd_hda_core snd_hwdep snd_seq ppdev aesni_intel snd_seq_device lrw snd_pcm gf128mul glue_helper ablk_helper cryptd sg joydev pcspkr
virtio_balloon snd_timer snd parport_pc parport i2c_piix4 soundcore sch_fq_codel ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_gpu drm_kms_helper syscopyarea sysfillrect 8139too sysimgblt fb_sys_fops ttm drm virtio_console virtio_blk drm_panel_orientation_quirks ata_piix ahci libahci crct10dif_pclmul libata crct10dif_common crc32c_intel serio_raw virtio_pci virtio_ring virtio 8139cp mii floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 15672 Comm: kworker/1:1 Kdump: loaded Tainted: G             L ------------   3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 1.11.0-2.el7 04/01/2014
Workqueue: events_freezable disk_events_workfn
task: ffff9b01d3415280 ti: ffff9b00d7450000 task.ti: ffff9b00d7450000
RIP: 0010:[<ffffffff9178a3f5>]  [<ffffffff9178a3f5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0000:ffff9b00d7453a68  EFLAGS: 00000286
RAX: 0000000000000001 RBX: ffffffffc0491754 RCX: 0000000000000000
RDX: ffff9b00f66d2818 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff9b00d7453a68 R08: 0000000000000000 R09: 00000000367bffff
R10: ffff9b00f5d80000 R11: 0000000000000010 R12: ffffffff913b2803
R13: ffff9b00d7453a10 R14: ffffffff9178b7a8 R15: ffff9b00d7453ab0
FS:  0000000000000000(0000) GS:ffff9b01ffd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000fa544001 CR3: 0000000130a4a000 CR4: 00000000003606e0
Call Trace:
[<ffffffffc0448d45>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc0444d90>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffff914e3e70>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff914ed59c>] scsi_request_fn+0x4ac/0x680
[<ffffffff9106ce66>] ? kvm_async_pf_task_wake+0x96/0x110
[<ffffffff91353869>] __blk_run_queue+0x39/0x50
[<ffffffff9135baa5>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff9135bbeb>] blk_execute_rq+0x8b/0x150
[<ffffffff914e9ef3>] scsi_execute+0xd3/0x170
[<ffffffff914ebdce>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc048231c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc04d805e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc0483091>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff91369936>] disk_check_events+0x66/0x190
[<ffffffff91369a76>] disk_events_workfn+0x16/0x20
[<ffffffff910bde3f>] process_one_work+0x17f/0x440
[<ffffffff910bef56>] worker_thread+0x126/0x3c0
[<ffffffff910bee30>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff910c5e11>] kthread+0xd1/0xe0
[<ffffffff910c5d40>] ? insert_kthread_work+0x40/0x40
[<ffffffff91794df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff910c5d40>] ? insert_kthread_work+0x40/0x40
Code: 16 ce 98 ff 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 e8 f6 cd 98 ff 66 90 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #175020
Frame # Function Binary Source or offset Line
1
ata_scsi_queuecmd
libata 0xffffffffc002a9f3
Build id: 3.10.0-693.el7.x86_64 		0x23
2
scsi_dispatch_cmd
vmlinux 0xffffffff8146540a
Build id: 3.10.0-693.el7.x86_64 		0xaa
3
scsi_request_fn
vmlinux 0xffffffff8146e1cf
Build id: 3.10.0-693.el7.x86_64 		0x4df
4
__blk_run_queue
vmlinux 0xffffffff812f71d3
Build id: 3.10.0-693.el7.x86_64 		0x33
5
blk_execute_rq_nowait
vmlinux 0xffffffff812fe955
Build id: 3.10.0-693.el7.x86_64 		0xb5
6
blk_execute_rq
vmlinux 0xffffffff812fea9b
Build id: 3.10.0-693.el7.x86_64 		0x8b
7
? bio_phys_segments
vmlinux 0xffffffff8123a059
Build id: 3.10.0-693.el7.x86_64 		0x19
8
? blk_rq_bio_prep
vmlinux 0xffffffff812fa461
Build id: 3.10.0-693.el7.x86_64 		0x31
9
? blk_rq_map_kern
vmlinux 0xffffffff812fe7b7
Build id: 3.10.0-693.el7.x86_64 		0xc7
10
scsi_execute
vmlinux 0xffffffff8146b293
Build id: 3.10.0-693.el7.x86_64 		0xd3
11
scsi_execute_req_flags
vmlinux 0xffffffff8146ca0e
Build id: 3.10.0-693.el7.x86_64 		0x8e
12
sr_check_events
sr_mod 0xffffffffc013131c
Build id: 3.10.0-693.el7.x86_64 		0xbc
13
cdrom_check_events
cdrom 0xffffffffc01b5058
Build id: 3.10.0-693.el7.x86_64 		0x18
14
sr_block_check_events
sr_mod 0xffffffffc01317c9
Build id: 3.10.0-693.el7.x86_64 		0x39
15
disk_check_events
vmlinux 0xffffffff81309db0
Build id: 3.10.0-693.el7.x86_64 		0x60
16
disk_events_workfn
vmlinux 0xffffffff81309ee6
Build id: 3.10.0-693.el7.x86_64 		0x16
17
process_one_work
vmlinux 0xffffffff810a881a
Build id: 3.10.0-693.el7.x86_64 		0x17a
18
worker_thread
vmlinux 0xffffffff810a94e6
Build id: 3.10.0-693.el7.x86_64 		0x126
19
? manage_workers.isra.24
vmlinux 0xffffffff810a93c0
Build id: 3.10.0-693.el7.x86_64 		0x2a0
20
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64 		0xcf
21
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64 		0x40
22
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64 		0x58
23
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [kworker/0:0:1502]
Modules linked in: nls_utf8 isofs loop ip_set nfnetlink bridge stp llc vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod sb_edac edac_core iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg nfit libnvdimm vmw_vmci i2c_piix4 shpchp parport_pc parport xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci crct10dif_pclmul crct10dif_common crc32c_intel ata_piix vmxnet3 serio_raw libata vmw_pvscsi i2c_core [last unloaded: ip_tables]
CPU: 0 PID: 1502 Comm: kworker/0:0 Tainted: G             L ------------   3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/09/2019
Workqueue: events_freezable disk_events_workfn
task: ffff88041db7eeb0 ti: ffff880232600000 task.ti: ffff880232600000
RIP: 0010:[<ffffffffc002a9f3>]  [<ffffffffc002a9f3>] ata_scsi_queuecmd+0x23/0x420 [libata]
RSP: 0000:ffff880232603a80  EFLAGS: 00010282
RAX: ffffffffc00b69e0 RBX: ffff88041fe60f00 RCX: 0000000000000000
RDX: 000000000000000a RSI: ffff88041ef8efc0 RDI: ffff88042c052800
RBP: ffff880232603ab8 R08: 0000000000000010 R09: ffff88042c0528d8
R10: ffff88041ef8efc0 R11: 0000000000000008 R12: ffff880232603a18
R13: ffff88041fe60f00 R14: ffff88041ef8efc0 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff88043fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f81e1269000 CR3: 0000000423693000 CR4: 00000000001407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff880036b2bdb0 ffff8802326039a8 ffff88041ef8efc0 0000000000000000
ffff88042c052800 ffff88042c21f048 ffff88041fe60f00 ffff880232603ae0
ffffffff8146540a ffff88042c21f000 ffff88042c052800 ffff880036b2bdb0
Call Trace:
[<ffffffff8146540a>] scsi_dispatch_cmd+0xaa/0x230
[<ffffffff8146e1cf>] scsi_request_fn+0x4df/0x680
[<ffffffff812f71d3>] __blk_run_queue+0x33/0x40
[<ffffffff812fe955>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff812fea9b>] blk_execute_rq+0x8b/0x150
[<ffffffff8123a059>] ? bio_phys_segments+0x19/0x20
[<ffffffff812fa461>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff812fe7b7>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff8146b293>] scsi_execute+0xd3/0x170
[<ffffffff8146ca0e>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc013131c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc01b5058>] cdrom_check_events+0x18/0x30 [cdrom]
[<ffffffffc01317c9>] sr_block_check_events+0x39/0x50 [sr_mod]
[<ffffffff81309db0>] disk_check_events+0x60/0x180
[<ffffffff81309ee6>] disk_events_workfn+0x16/0x20
[<ffffffff810a881a>] process_one_work+0x17a/0x440
[<ffffffff810a94e6>] worker_thread+0x126/0x3c0
[<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 41 57 41 56 41 55 41 54 53 48 89 f3 48 83 ec 10 4c 8b a7 40 07 00 00 4c 8b 36 <49> 8b 7c 24 10 e8 a3 11 68 c1 4c 89 f6 4c 89 e7 49 89 c5 e8 a5
Complete report #166208
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffb4f81125
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x15
2
ata_scsi_queuecmd
libata 0xffffffffc0252d65
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x155
3
? ata_scsiop_inq_std
libata 0xffffffffc024edb0
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffffb4cdd100
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffb4ce676c
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffffb4b4d7b9
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x39
7
blk_execute_rq_nowait
vmlinux 0xffffffffb4b55835
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xb5
8
blk_execute_rq
vmlinux 0xffffffffb4b5597b
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x8b
9
scsi_execute
vmlinux 0xffffffffb4ce3233
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xd3
10
scsi_execute_req_flags
vmlinux 0xffffffffb4ce4f7e
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x8e
11
sr_check_events
sr_mod 0xffffffffc033d31c
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xbc
12
cdrom_check_events
cdrom 0xffffffffc032205e
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x1e
13
sr_block_check_events
sr_mod 0xffffffffc033e0b1
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xb1
14
disk_check_events
vmlinux 0xffffffffb4b634e6
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x66
15
disk_events_workfn
vmlinux 0xffffffffb4b63626
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x16
16
process_one_work
vmlinux 0xffffffffb48bd1df
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x17f
17
worker_thread
vmlinux 0xffffffffb48be2f6
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x126
18
? manage_workers.isra.26
vmlinux 0xffffffffb48be1d0
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x2a0
19
kthread
vmlinux 0xffffffffb48c51b1
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xd1
20
? insert_kthread_work
vmlinux 0xffffffffb48c50e0
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x40
21
ret_from_fork_nospec_begin
vmlinux 0xffffffffb4f8bd37
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x21
22
? insert_kthread_work
vmlinux 0xffffffffb48c50e0
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 39s! [kworker/7:1:15176]
Modules linked in: ebtable_filter ebtables devlink ip6table_filter ip6_tables binfmt_misc iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel snd_hda_codec_generic aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel joydev snd_hda_codec virtio_balloon snd_hda_core sg snd_hwdep snd_seq parport_pc snd_seq_device parport snd_pcm snd_timer snd pcspkr i2c_piix4 soundcore auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_blk cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata serio_raw crct10dif_pclmul crct10dif_common crc32c_intel
virtio_pci floppy virtio_ring virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 7 PID: 15176 Comm: kworker/7:1 Kdump: loaded Tainted: G             L ------------   3.10.0-1062.4.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Workqueue: events_freezable disk_events_workfn
task: ffff89e779e1d230 ti: ffff89e79ad54000 task.ti: ffff89e79ad54000
RIP: 0010:[<ffffffffb4f81125>]  [<ffffffffb4f81125>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0000:ffff89e79ad57a68  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff89e79ad57a10 RCX: ffff89e79f1e4405
RDX: ffff89e79f1da4a0 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff89e79ad57a68 R08: 0000000000000001 R09: ffff89e797088198
R10: ffff89e79a8728d8 R11: 0000000000000000 R12: ffff89e797089e80
R13: ffff89e797088000 R14: ffff89e797088158 R15: ffffffffc025e8e0
FS:  0000000000000000(0000) GS:ffff89e79f1c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000b582f007 CR3: 0000002f4937a000 CR4: 00000000001606e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffc0252d65>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc024edb0>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffffb4cdd100>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffb4ce676c>] scsi_request_fn+0x4cc/0x680
[<ffffffffb4b4d7b9>] __blk_run_queue+0x39/0x50
[<ffffffffb4b55835>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffffb4b5597b>] blk_execute_rq+0x8b/0x150
[<ffffffffb4ce3233>] scsi_execute+0xd3/0x170
[<ffffffffb4ce4f7e>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc033d31c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc032205e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc033e0b1>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffffb4b634e6>] disk_check_events+0x66/0x190
[<ffffffffb4b63626>] disk_events_workfn+0x16/0x20
[<ffffffffb48bd1df>] process_one_work+0x17f/0x440
[<ffffffffb48be2f6>] worker_thread+0x126/0x3c0
[<ffffffffb48be1d0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffb48c51b1>] kthread+0xd1/0xe0
[<ffffffffb48c50e0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb4f8bd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb48c50e0>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #120851
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff879883c5
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x15
2
ata_scsi_queuecmd
libata 0xffffffffc02dad45
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x155
3
? ata_scsiop_inq_std
libata 0xffffffffc02d6d90
Build id: 3.10.0-1127.10.1.el7.x86_64 		0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffff876e2920
Build id: 3.10.0-1127.10.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff876ec04c
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffff87552769
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x39
7
blk_execute_rq_nowait
vmlinux 0xffffffff8755a8a5
Build id: 3.10.0-1127.10.1.el7.x86_64 		0xb5
8
blk_execute_rq
vmlinux 0xffffffff8755a9eb
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x8b
9
? bio_phys_segments
vmlinux 0xffffffff8748a239
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x19
10
? blk_rq_bio_prep
vmlinux 0xffffffff87555db1
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x31
11
? blk_rq_map_kern
vmlinux 0xffffffff8755a707
Build id: 3.10.0-1127.10.1.el7.x86_64 		0xc7
12
scsi_execute
vmlinux 0xffffffff876e89a3
Build id: 3.10.0-1127.10.1.el7.x86_64 		0xd3
13
scsi_execute_req_flags
vmlinux 0xffffffff876ea87e
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x8e
14
sr_check_events
sr_mod 0xffffffffc041a31c
Build id: 3.10.0-1127.10.1.el7.x86_64 		0xbc
15
cdrom_check_events
cdrom 0xffffffffc03bd05e
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x1e
16
sr_block_check_events
sr_mod 0xffffffffc041b091
Build id: 3.10.0-1127.10.1.el7.x86_64 		0xb1
17
disk_check_events
vmlinux 0xffffffff87568676
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x66
18
disk_events_workfn
vmlinux 0xffffffff875687b6
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x16
19
process_one_work
vmlinux 0xffffffff872be6bf
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x17f
20
worker_thread
vmlinux 0xffffffff872bf7d6
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x126
21
? manage_workers.isra.26
vmlinux 0xffffffff872bf6b0
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x2a0
22
kthread
vmlinux 0xffffffff872c6691
Build id: 3.10.0-1127.10.1.el7.x86_64 		0xd1
23
? insert_kthread_work
vmlinux 0xffffffff872c65c0
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x40
24
ret_from_fork_nospec_begin
vmlinux 0xffffffff87992d37
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x21
25
? insert_kthread_work
vmlinux 0xffffffff872c65c0
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 31s! [kworker/0:0:2557]
Modules linked in: event_collector_1_10_9431(POE) vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd pcspkr sg joydev vmw_balloon vmw_vmci parport_pc parport i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix serio_raw libata vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 2557 Comm: kworker/0:0 Kdump: loaded Tainted: P           OEL ------------ T 3.10.0-1127.10.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 10/22/2013
Workqueue: events_freezable disk_events_workfn
task: ffff967c61a1a0e0 ti: ffff967c0e700000 task.ti: ffff967c0e700000
RIP: 0010:[<ffffffff879883c5>]  [<ffffffff879883c5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff967c0e703a68  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff967c0e703a10 RCX: ffff967c7fc24605
RDX: ffff967c7fc1a560 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff967c0e703a68 R08: 0000000000000001 R09: 0008000000100000
R10: ffff967c36224198 R11: 0000000000000008 R12: ffff967c36225e80
R13: ffff967c36224000 R14: ffff967c36224158 R15: ffffffffc02e6860
FS:  0000000000000000(0000) GS:ffff967c7fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f187703a024 CR3: 000000007b40c000 CR4: 00000000000407f0
Call Trace:
[<ffffffffc02dad45>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc02d6d90>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffff876e2920>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff876ec04c>] scsi_request_fn+0x4ac/0x680
[<ffffffff87552769>] __blk_run_queue+0x39/0x50
[<ffffffff8755a8a5>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff8755a9eb>] blk_execute_rq+0x8b/0x150
[<ffffffff8748a239>] ? bio_phys_segments+0x19/0x20
[<ffffffff87555db1>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff8755a707>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff876e89a3>] scsi_execute+0xd3/0x170
[<ffffffff876ea87e>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc041a31c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc03bd05e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc041b091>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff87568676>] disk_check_events+0x66/0x190
[<ffffffff875687b6>] disk_events_workfn+0x16/0x20
[<ffffffff872be6bf>] process_one_work+0x17f/0x440
[<ffffffff872bf7d6>] worker_thread+0x126/0x3c0
[<ffffffff872bf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff872c6691>] kthread+0xd1/0xe0
[<ffffffff872c65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff87992d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff872c65c0>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #48438
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffb7b883c5
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x15
2
ata_scsi_queuecmd
libata 0xffffffffc02cdd45
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x155
3
? ata_scsiop_inq_std
libata 0xffffffffc02c9d90
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xf0
4
scsi_dispatch_cmd
vmlinux 0xffffffffb78e2990
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffb78ec0bc
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffffb77527a9
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x39
7
blk_execute_rq_nowait
vmlinux 0xffffffffb775a8e5
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xb5
8
blk_execute_rq
vmlinux 0xffffffffb775aa2b
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x8b
9
? bio_phys_segments
vmlinux 0xffffffffb768a229
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x19
10
? blk_rq_bio_prep
vmlinux 0xffffffffb7755df1
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x31
11
? blk_rq_map_kern
vmlinux 0xffffffffb775a747
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xc7
12
scsi_execute
vmlinux 0xffffffffb78e8a13
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xd3
13
scsi_execute_req_flags
vmlinux 0xffffffffb78ea8ee
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x8e
14
sr_check_events
sr_mod 0xffffffffc041931c
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xbc
15
cdrom_check_events
cdrom 0xffffffffc040d05e
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x1e
16
sr_block_check_events
sr_mod 0xffffffffc041a091
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xb1
17
disk_check_events
vmlinux 0xffffffffb77686b6
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x66
18
disk_events_workfn
vmlinux 0xffffffffb77687f6
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x16
19
process_one_work
vmlinux 0xffffffffb74be6bf
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x17f
20
worker_thread
vmlinux 0xffffffffb74bf7d6
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x126
21
? manage_workers.isra.26
vmlinux 0xffffffffb74bf6b0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x2a0
22
kthread
vmlinux 0xffffffffb74c6691
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xd1
23
? insert_kthread_work
vmlinux 0xffffffffb74c65c0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x40
24
ret_from_fork_nospec_begin
vmlinux 0xffffffffb7b92d37
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x21
25
? insert_kthread_work
vmlinux 0xffffffffb74c65c0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 23s! [kworker/5:0:3430]
ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel mptspi scsi_transport_spi libata mptscsih serio_raw mptbase e1000 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
CPU: 5 PID: 3430 Comm: kworker/5:0 Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
Workqueue: events_freezable disk_events_workfn
task: ffff89a93f105230 ti: ffff89a932e34000 task.ti: ffff89a932e34000
RIP: 0010:[<ffffffffb7b883c5>]  [<ffffffffb7b883c5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff89a932e37a68  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff89a932e37a10 RCX: ffff89aaffd64805
RDX: ffff89aaffd5a560 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff89a932e37a68 R08: 0000000000000001 R09: 0008000000100000
R10: ffff89aaf1ea0198 R11: 0000000000000008 R12: ffff89aaf1ea1e80
R13: ffff89aaf1ea0000 R14: ffff89aaf1ea0158 R15: ffffffffc02d9860
FS:  0000000000000000(0000) GS:ffff89aaffd40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8ba6af4000 CR3: 000000019959c000 CR4: 00000000000407e0
Call Trace:
[<ffffffffc02cdd45>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc02c9d90>] ? ata_scsiop_inq_std+0xf0/0xf0 [libata]
[<ffffffffb78e2990>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffb78ec0bc>] scsi_request_fn+0x4ac/0x680
[<ffffffffb77527a9>] __blk_run_queue+0x39/0x50
[<ffffffffb775a8e5>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffffb775aa2b>] blk_execute_rq+0x8b/0x150
[<ffffffffb768a229>] ? bio_phys_segments+0x19/0x20
[<ffffffffb7755df1>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffffb775a747>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffffb78e8a13>] scsi_execute+0xd3/0x170
[<ffffffffb78ea8ee>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc041931c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc040d05e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc041a091>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffffb77686b6>] disk_check_events+0x66/0x190
[<ffffffffb77687f6>] disk_events_workfn+0x16/0x20
[<ffffffffb74be6bf>] process_one_work+0x17f/0x440
[<ffffffffb74bf7d6>] worker_thread+0x126/0x3c0
[<ffffffffb74bf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffb74c6691>] kthread+0xd1/0xe0
[<ffffffffb74c65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb7b92d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb74c65c0>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #12653
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc01de3be
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc028971e
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc02fb2e0
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffa8ce2950
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffa8cec07c
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffffa8b52769
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x39
7
blk_execute_rq_nowait
vmlinux 0xffffffffa8b5a8a5
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xb5
8
blk_execute_rq
vmlinux 0xffffffffa8b5a9eb
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x8b
9
? bio_phys_segments
vmlinux 0xffffffffa8a8a239
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x19
10
? blk_rq_bio_prep
vmlinux 0xffffffffa8b55db1
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x31
11
? blk_rq_map_kern
vmlinux 0xffffffffa8b5a707
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xc7
12
scsi_execute
vmlinux 0xffffffffa8ce89d3
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xd3
13
scsi_execute_req_flags
vmlinux 0xffffffffa8cea8ae
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x8e
14
sr_check_events
sr_mod 0xffffffffc02f431c
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xbc
15
cdrom_check_events
cdrom 0xffffffffc038105e
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x1e
16
sr_block_check_events
sr_mod 0xffffffffc02f5091
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xb1
17
disk_check_events
vmlinux 0xffffffffa8b68676
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x66
18
disk_events_workfn
vmlinux 0xffffffffa8b687b6
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x16
19
process_one_work
vmlinux 0xffffffffa88be6bf
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x17f
20
worker_thread
vmlinux 0xffffffffa88bf7d6
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x126
21
? manage_workers.isra.26
vmlinux 0xffffffffa88bf6b0
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x2a0
22
kthread
vmlinux 0xffffffffa88c6691
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xd1
23
? insert_kthread_work
vmlinux 0xffffffffa88c65c0
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x40
24
ret_from_fork_nospec_begin
vmlinux 0xffffffffa8f92d1d
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x7
25
? insert_kthread_work
vmlinux 0xffffffffa88c65c0
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 21s! [kworker/2:1:34198]
Modules linked in: devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock fuse vmhgfs(OE) sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 iosf_mbi snd_rawmidi kvm_intel snd_ac97_codec ac97_bus snd_seq kvm snd_seq_device snd_pcm irqbypass crc32_pclmul ghash_clmulni_intel snd_timer aesni_intel ppdev snd lrw gf128mul soundcore glue_helper
ablk_helper cryptd joydev pcspkr vmw_balloon sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common mptspi crc32c_intel nfit ata_piix libnvdimm scsi_transport_spi serio_raw mptscsih libata e1000 drm_panel_orientation_quirks mptbase
CPU: 2 PID: 34198 Comm: kworker/2:1 Kdump: loaded Tainted: G           OEL ------------   3.10.0-1127.13.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
Workqueue: events_freezable disk_events_workfn
task: ffff9f54c3d35230 ti: ffff9f54e2a30000 task.ti: ffff9f54e2a30000
RIP: 0010:[<ffffffffc01de3be>]  [<ffffffffc01de3be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff9f54e2a339d0  EFLAGS: 00000246
RAX: ffffac0600700000 RBX: ffffffffa8b9a45a RCX: 000000000000001b
RDX: ffff9f54754a2c00 RSI: ffff9f55721c4000 RDI: 000000000000000e
RBP: ffff9f54e2a339e0 R08: 0000000000000002 R09: 0000000009bb0007
R10: ffff9f5474bc89c0 R11: 0000000000000008 R12: ffff9f54e56455d8
R13: 0000000000000000 R14: 0000000000000000 R15: 00000000a3633d5e
FS:  0000000000000000(0000) GS:ffff9f5579680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f938208a000 CR3: 00000001314c8000 CR4: 00000000003607e0
Call Trace:
[<ffffffffc028971e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc02fb2e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffa8ce2950>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffa8cec07c>] scsi_request_fn+0x4ac/0x680
[<ffffffffa8b52769>] __blk_run_queue+0x39/0x50
[<ffffffffa8b5a8a5>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffffa8b5a9eb>] blk_execute_rq+0x8b/0x150
[<ffffffffa8a8a239>] ? bio_phys_segments+0x19/0x20
[<ffffffffa8b55db1>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffffa8b5a707>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffffa8ce89d3>] scsi_execute+0xd3/0x170
[<ffffffffa8cea8ae>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc02f431c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc038105e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc02f5091>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffffa8b68676>] disk_check_events+0x66/0x190
[<ffffffffa8b687b6>] disk_events_workfn+0x16/0x20
[<ffffffffa88be6bf>] process_one_work+0x17f/0x440
[<ffffffffa88bf7d6>] worker_thread+0x126/0x3c0
[<ffffffffa88bf6b0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffa88c6691>] kthread+0xd1/0xe0
[<ffffffffa88c65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffa8f92d1d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffa88c65c0>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 c3 1e