Info

Permalink
Function
blk_execute_rq_nowait
First occurrence
2021-01-11
Last occurrence
2021-01-11
State
NEW
Components
kernel
Quality
-35

Statistics

Operating system Count
CentOS 7 10
Architecture Count
x86_64 10
Related packages Count
kernel 10
 0:3.10.0-1160.15.2.el7 2
 0:3.10.0-957.el7 1
 0:3.10.0-1062.4.3.el7 1
 0:3.10.0-1160.76.1.el7 1
 0:3.10.0-1160.el7 1
 0:3.10.0-1160.42.2.el7 1
 0:3.10.0-1062.1.1.el7 1
 0:3.10.0-1160.49.1.el7 1
 0:3.10.0-862.3.2.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

Report backtrace


Complete report #1423009
Frame # Function Binary Source or offset Line
1
blk_execute_rq_nowait
vmlinux 0xffffffff88d20f35
Build id: 3.10.0-862.3.2.el7.x86_64 		0xd5
2
blk_execute_rq
vmlinux 0xffffffff88d2106b
Build id: 3.10.0-862.3.2.el7.x86_64 		0x8b
3
? bio_phys_segments
vmlinux 0xffffffff88c56119
Build id: 3.10.0-862.3.2.el7.x86_64 		0x19
4
? blk_rq_bio_prep
vmlinux 0xffffffff88d1c4e1
Build id: 3.10.0-862.3.2.el7.x86_64 		0x31
5
? blk_rq_map_kern
vmlinux 0xffffffff88d20d77
Build id: 3.10.0-862.3.2.el7.x86_64 		0xc7
6
scsi_execute
vmlinux 0xffffffff88ea1583
Build id: 3.10.0-862.3.2.el7.x86_64 		0xd3
7
scsi_execute_req_flags
vmlinux 0xffffffff88ea325e
Build id: 3.10.0-862.3.2.el7.x86_64 		0x8e
8
sr_check_events
sr_mod 0xffffffffc02e531c
Build id: 3.10.0-862.3.2.el7.x86_64 		0xbc
9
cdrom_check_events
cdrom 0xffffffffc02d905e
Build id: 3.10.0-862.3.2.el7.x86_64 		0x1e
10
sr_block_check_events
sr_mod 0xffffffffc02e57c9
Build id: 3.10.0-862.3.2.el7.x86_64 		0x39
11
disk_check_events
vmlinux 0xffffffff88d2e9b6
Build id: 3.10.0-862.3.2.el7.x86_64 		0x66
12
disk_events_workfn
vmlinux 0xffffffff88d2eaf6
Build id: 3.10.0-862.3.2.el7.x86_64 		0x16
13
process_one_work
vmlinux 0xffffffff88ab312f
Build id: 3.10.0-862.3.2.el7.x86_64 		0x17f
14
worker_thread
vmlinux 0xffffffff88ab3df6
Build id: 3.10.0-862.3.2.el7.x86_64 		0x126
15
? manage_workers.isra.24
vmlinux 0xffffffff88ab3cd0
Build id: 3.10.0-862.3.2.el7.x86_64 		0x2a0
16
kthread
vmlinux 0xffffffff88abb161
Build id: 3.10.0-862.3.2.el7.x86_64 		0xd1
17
? insert_kthread_work
vmlinux 0xffffffff88abb090
Build id: 3.10.0-862.3.2.el7.x86_64 		0x40
18
ret_from_fork_nospec_begin
vmlinux 0xffffffff89120677
Build id: 3.10.0-862.3.2.el7.x86_64 		0x21
19
? insert_kthread_work
vmlinux 0xffffffff88abb090
Build id: 3.10.0-862.3.2.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [kworker/1:1:4400]
Modules linked in: nfsv3 nfs_acl nfs lockd grace fscache vmw_vsock_vmci_transport vsock sunrpc coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev joydev vmw_balloon pcspkr sg parport_pc parport shpchp vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm mptspi crct10dif_pclmul crct10dif_common scsi_transport_spi libata crc32c_intel serio_raw mptscsih mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 4400 Comm: kworker/1:1 Tainted: G             L ------------   3.10.0-862.3.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
Workqueue: events_freezable disk_events_workfn
task: ffff904096ee0fd0 ti: ffff904480820000 task.ti: ffff904480820000
RIP: 0010:[<ffffffff88d20f35>]  [<ffffffff88d20f35>] blk_execute_rq_nowait+0xd5/0x180
RSP: 0018:ffff904480823b70  EFLAGS: 00000293
RAX: 0000000000000000 RBX: ffffffff89b98580 RCX: ffff9044a96b6fa0
RDX: ffff9044a96b6f90 RSI: 0000000000000000 RDI: ffff9044a8830dc8
RBP: ffff904480823ba0 R08: 0000000000000001 R09: 0008000000100000
R10: ffff9044a882c198 R11: 0000000000000008 R12: ffff904480823b48
R13: ffff9044a8830978 R14: ffff90444415f800 R15: ffff9044aa7c4800
FS:  0000000000000000(0000) GS:ffff9044bfc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f543b6f2540 CR3: 00000000bb728000 CR4: 00000000000007e0
Call Trace:
[<ffffffff88d2106b>] blk_execute_rq+0x8b/0x150
[<ffffffff88c56119>] ? bio_phys_segments+0x19/0x20
[<ffffffff88d1c4e1>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff88d20d77>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff88ea1583>] scsi_execute+0xd3/0x170
[<ffffffff88ea325e>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc02e531c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc02d905e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc02e57c9>] sr_block_check_events+0x39/0x50 [sr_mod]
[<ffffffff88d2e9b6>] disk_check_events+0x66/0x190
[<ffffffff88d2eaf6>] disk_events_workfn+0x16/0x20
[<ffffffff88ab312f>] process_one_work+0x17f/0x440
[<ffffffff88ab3df6>] worker_thread+0x126/0x3c0
[<ffffffff88ab3cd0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff88abb161>] kthread+0xd1/0xe0
[<ffffffff88abb090>] ? insert_kthread_work+0x40/0x40
[<ffffffff89120677>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff88abb090>] ? insert_kthread_work+0x40/0x40
Code: 48 89 de 4c 89 ef e8 eb 37 ff ff 4c 89 ef e8 c3 7f ff ff 41 83 fe 05 74 25 49 8b bd 58 04 00 00 c6 07 00 66 66 66 90 fb 66 66 90 <66> 66 90 48 83 c4 10 5b 41 5c 41 5d 41 5e 5d c3 0f 1f 00 4c 89
Complete report #1121432
Frame # Function Binary Source or offset Line
1
blk_rq_map_kern
vmlinux 0xffffffff8e754d60
Build id: 3.10.0-1062.1.1.el7.x86_64 		-
2
? scsi_execute
vmlinux 0xffffffff8e8e2a27
Build id: 3.10.0-1062.1.1.el7.x86_64 		0x137
3
scsi_execute_req_flags
vmlinux 0xffffffff8e8e470e
Build id: 3.10.0-1062.1.1.el7.x86_64 		0x8e
4
sr_check_events
sr_mod 0xffffffffc028331c
Build id: 3.10.0-1062.1.1.el7.x86_64 		0xbc
5
cdrom_check_events
cdrom 0xffffffffc027705e
Build id: 3.10.0-1062.1.1.el7.x86_64 		0x1e
6
sr_block_check_events
sr_mod 0xffffffffc02840b1
Build id: 3.10.0-1062.1.1.el7.x86_64 		0xb1
7
disk_check_events
vmlinux 0xffffffff8e762c76
Build id: 3.10.0-1062.1.1.el7.x86_64 		0x66
8
disk_events_workfn
vmlinux 0xffffffff8e762db6
Build id: 3.10.0-1062.1.1.el7.x86_64 		0x16
9
process_one_work
vmlinux 0xffffffff8e4bd0ff
Build id: 3.10.0-1062.1.1.el7.x86_64 		0x17f
10
worker_thread
vmlinux 0xffffffff8e4be216
Build id: 3.10.0-1062.1.1.el7.x86_64 		0x126
11
? manage_workers.isra.26
vmlinux 0xffffffff8e4be0f0
Build id: 3.10.0-1062.1.1.el7.x86_64 		0x2a0
12
kthread
vmlinux 0xffffffff8e4c50d1
Build id: 3.10.0-1062.1.1.el7.x86_64 		0xd1
13
? insert_kthread_work
vmlinux 0xffffffff8e4c5000
Build id: 3.10.0-1062.1.1.el7.x86_64 		0x40
14
ret_from_fork_nospec_begin
vmlinux 0xffffffff8eb8cd37
Build id: 3.10.0-1062.1.1.el7.x86_64 		0x21
15
? insert_kthread_work
vmlinux 0xffffffff8e4c5000
Build id: 3.10.0-1062.1.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/0:1:3672]
Modules linked in: rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver ip6t_rpfilter ebtable_nat ip6table_nat nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ip_set nfnetlink ebtable_filter ebtables nfsv3 nfs_acl nfs lockd grace fscache ip6t_REJECT nf_reject_ipv6 nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack vmw_vsock_vmci_transport vsock iptable_filter sunrpc sb_edac ppdev coretemp vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc i2c_piix4 parport vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod
crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw e1000 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ipmi_msghandler]
CPU: 0 PID: 3672 Comm: kworker/0:1 Tainted: G        W    L ------------   3.10.0-1062.1.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
Workqueue: events_freezable disk_events_workfn
task: ffff8d648fcf1070 ti: ffff8d5b11c34000 task.ti: ffff8d5b11c34000
RIP: 0010:[<ffffffff8e754d60>]  [<ffffffff8e754d60>] blk_rq_map_kern+0x0/0x180
RSP: 0018:ffff8d5b11c37c58  EFLAGS: 00010202
RAX: ffff8d5e428e2600 RBX: ffff8d5b11c37bd0 RCX: 0000000000000008
RDX: ffff8d5b11c37d36 RSI: ffff8d5e428e2600 RDI: ffff8d648e910000
RBP: ffff8d5b11c37c90 R08: 0000000000000010 R09: ffff8d5bf5990f00
R10: ffffffff8e74bfbd R11: 0000000000000000 R12: ffff8d648fcf1070
R13: 0000000000000000 R14: ffff8d648e910030 R15: ffff8d5b11c37bd0
FS:  0000000000000000(0000) GS:ffff8d64bfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f096b544000 CR3: 00000009b5b62000 CR4: 00000000001607f0
Call Trace:
[<ffffffff8e8e2a27>] ? scsi_execute+0x137/0x170
[<ffffffff8e8e470e>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc028331c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc027705e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc02840b1>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff8e762c76>] disk_check_events+0x66/0x190
[<ffffffff8e762db6>] disk_events_workfn+0x16/0x20
[<ffffffff8e4bd0ff>] process_one_work+0x17f/0x440
[<ffffffff8e4be216>] worker_thread+0x126/0x3c0
[<ffffffff8e4be0f0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff8e4c50d1>] kthread+0xd1/0xe0
[<ffffffff8e4c5000>] ? insert_kthread_work+0x40/0x40
[<ffffffff8eb8cd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8e4c5000>] ? insert_kthread_work+0x40/0x40
Code: 00 00 00 48 85 d2 74 0b 8b 52 18 85 d2 0f 85 96 fd ff ff 41 be ea ff ff ff e9 0b ff ff ff e8 78 58 d4 ff 0f 1f 84 00 00 00 00 00 <0f> 1f 44 00 00 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 f4
Complete report #1415798
Frame # Function Binary Source or offset Line
1
? blk_rq_bio_prep
vmlinux 0xffffffffbb957621
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x31
2
? blk_rq_map_kern
vmlinux 0xffffffffbb95bf77
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xc7
3
scsi_execute
vmlinux 0xffffffffbbaea8e3
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xd3
4
scsi_execute_req_flags
vmlinux 0xffffffffbbaec7be
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x8e
5
sr_check_events
sr_mod 0xffffffffc02c831c
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xbc
6
cdrom_check_events
cdrom 0xffffffffc047905e
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x1e
7
sr_block_check_events
sr_mod 0xffffffffc02c9091
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xb1
8
disk_check_events
vmlinux 0xffffffffbb96a056
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x66
9
disk_events_workfn
vmlinux 0xffffffffbb96a196
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x16
10
process_one_work
vmlinux 0xffffffffbb6bde8f
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x17f
11
worker_thread
vmlinux 0xffffffffbb6befa6
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x126
12
? manage_workers.isra.26
vmlinux 0xffffffffbb6bee80
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x2a0
13
kthread
vmlinux 0xffffffffbb6c5e61
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xd1
14
? insert_kthread_work
vmlinux 0xffffffffbb6c5d90
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x40
15
ret_from_fork_nospec_begin
vmlinux 0xffffffffbbd95df7
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x21
16
? insert_kthread_work
vmlinux 0xffffffffbb6c5d90
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [mysqld:6636]
[<ffffffffbb957621>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffffbb95bf77>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffffbbaea8e3>] scsi_execute+0xd3/0x170
[<ffffffffbbaec7be>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc02c831c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc047905e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc02c9091>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffffbb96a056>] disk_check_events+0x66/0x190
[<ffffffffbb96a196>] disk_events_workfn+0x16/0x20
[<ffffffffbb6bde8f>] process_one_work+0x17f/0x440
[<ffffffffbb6befa6>] worker_thread+0x126/0x3c0
[<ffffffffbb6bee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffbb6c5e61>] kthread+0xd1/0xe0
[<ffffffffbb6c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffffbbd95df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffbb6c5d90>] ? insert_kthread_work+0x40/0x40
Complete report #830389
Frame # Function Binary Source or offset Line
1
blk_execute_rq
vmlinux 0xffffffff9715c23b
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x8b
2
? bio_phys_segments
vmlinux 0xffffffff9708b4d9
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x19
3
? blk_rq_bio_prep
vmlinux 0xffffffff97157601
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x31
4
scsi_execute
vmlinux 0xffffffff972ea8c3
Build id: 3.10.0-1160.42.2.el7.x86_64 		0xd3
5
scsi_execute_req_flags
vmlinux 0xffffffff972ec79e
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x8e
6
sr_check_events
sr_mod 0xffffffffc04b031c
Build id: 3.10.0-1160.42.2.el7.x86_64 		0xbc
7
cdrom_check_events
cdrom 0xffffffffc04c105e
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x1e
8
sr_block_check_events
sr_mod 0xffffffffc04b1091
Build id: 3.10.0-1160.42.2.el7.x86_64 		0xb1
9
disk_check_events
vmlinux 0xffffffff9716a036
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x66
10
disk_events_workfn
vmlinux 0xffffffff9716a176
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x16
11
process_one_work
vmlinux 0xffffffff96ebde8f
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x17f
12
worker_thread
vmlinux 0xffffffff96ebefa6
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x126
13
? manage_workers.isra.26
vmlinux 0xffffffff96ebee80
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x2a0
14
kthread
vmlinux 0xffffffff96ec5e61
Build id: 3.10.0-1160.42.2.el7.x86_64 		0xd1
15
? insert_kthread_work
vmlinux 0xffffffff96ec5d90
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x40
16
ret_from_fork_nospec_begin
vmlinux 0xffffffff97595ddd
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x7
17
? insert_kthread_work
vmlinux 0xffffffff96ec5d90
Build id: 3.10.0-1160.42.2.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 38s! [HangDetector:884]
[<ffffffff9715c23b>] blk_execute_rq+0x8b/0x150
[<ffffffff9708b4d9>] ? bio_phys_segments+0x19/0x20
[<ffffffff97157601>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff972ea8c3>] scsi_execute+0xd3/0x170
[<ffffffff972ec79e>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc04b031c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc04c105e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc04b1091>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff9716a036>] disk_check_events+0x66/0x190
[<ffffffff9716a176>] disk_events_workfn+0x16/0x20
[<ffffffff96ebde8f>] process_one_work+0x17f/0x440
[<ffffffff96ebefa6>] worker_thread+0x126/0x3c0
[<ffffffff96ebee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff96ec5e61>] kthread+0xd1/0xe0
[<ffffffff96ec5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffff97595ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff96ec5d90>] ? insert_kthread_work+0x40/0x40
Complete report #571933
Frame # Function Binary Source or offset Line
1
? bio_phys_segments
vmlinux 0xffffffff9f48acd9
Build id: 3.10.0-1160.el7.x86_64 		0x19
2
? blk_rq_bio_prep
vmlinux 0xffffffff9f556b21
Build id: 3.10.0-1160.el7.x86_64 		0x31
3
? blk_rq_map_kern
vmlinux 0xffffffff9f55b477
Build id: 3.10.0-1160.el7.x86_64 		0xc7
4
scsi_execute
vmlinux 0xffffffff9f6e9a03
Build id: 3.10.0-1160.el7.x86_64 		0xd3
5
scsi_execute_req_flags
vmlinux 0xffffffff9f6eb8de
Build id: 3.10.0-1160.el7.x86_64 		0x8e
6
sr_check_events
sr_mod 0xffffffffc038331c
Build id: 3.10.0-1160.el7.x86_64 		0xbc
7
cdrom_check_events
cdrom 0xffffffffc04d705e
Build id: 3.10.0-1160.el7.x86_64 		0x1e
8
sr_block_check_events
sr_mod 0xffffffffc0384091
Build id: 3.10.0-1160.el7.x86_64 		0xb1
9
disk_check_events
vmlinux 0xffffffff9f569496
Build id: 3.10.0-1160.el7.x86_64 		0x66
10
disk_events_workfn
vmlinux 0xffffffff9f5695d6
Build id: 3.10.0-1160.el7.x86_64 		0x16
11
process_one_work
vmlinux 0xffffffff9f2bdc4f
Build id: 3.10.0-1160.el7.x86_64 		0x17f
12
worker_thread
vmlinux 0xffffffff9f2bed66
Build id: 3.10.0-1160.el7.x86_64 		0x126
13
? manage_workers.isra.26
vmlinux 0xffffffff9f2bec40
Build id: 3.10.0-1160.el7.x86_64 		0x2a0
14
kthread
vmlinux 0xffffffff9f2c5c21
Build id: 3.10.0-1160.el7.x86_64 		0xd1
15
? insert_kthread_work
vmlinux 0xffffffff9f2c5b50
Build id: 3.10.0-1160.el7.x86_64 		0x40
16
ret_from_fork_nospec_begin
vmlinux 0xffffffff9f993df7
Build id: 3.10.0-1160.el7.x86_64 		0x21
17
? insert_kthread_work
vmlinux 0xffffffff9f2c5b50
Build id: 3.10.0-1160.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [kworker/3:0:17670]
[<ffffffff9f48acd9>] ? bio_phys_segments+0x19/0x20
[<ffffffff9f556b21>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff9f55b477>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff9f6e9a03>] scsi_execute+0xd3/0x170
[<ffffffff9f6eb8de>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc038331c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc04d705e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc0384091>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff9f569496>] disk_check_events+0x66/0x190
[<ffffffff9f5695d6>] disk_events_workfn+0x16/0x20
[<ffffffff9f2bdc4f>] process_one_work+0x17f/0x440
[<ffffffff9f2bed66>] worker_thread+0x126/0x3c0
[<ffffffff9f2bec40>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff9f2c5c21>] kthread+0xd1/0xe0
[<ffffffff9f2c5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffff9f993df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9f2c5b50>] ? insert_kthread_work+0x40/0x40
Complete report #175528
Frame # Function Binary Source or offset Line
1
blk_execute_rq_nowait
vmlinux 0xffffffff9755baa5
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xb5
2
blk_execute_rq
vmlinux 0xffffffff9755bbeb
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x8b
3
? bio_phys_segments
vmlinux 0xffffffff9748aeb9
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x19
4
? blk_rq_bio_prep
vmlinux 0xffffffff97556fb1
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x31
5
? blk_rq_map_kern
vmlinux 0xffffffff9755b907
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xc7
6
scsi_execute
vmlinux 0xffffffff976e9ef3
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xd3
7
scsi_execute_req_flags
vmlinux 0xffffffff976ebdce
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x8e
8
sr_check_events
sr_mod 0xffffffffc02d731c
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xbc
9
cdrom_check_events
cdrom 0xffffffffc032905e
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x1e
10
sr_block_check_events
sr_mod 0xffffffffc02d8091
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xb1
11
disk_check_events
vmlinux 0xffffffff97569936
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x66
12
disk_events_workfn
vmlinux 0xffffffff97569a76
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x16
13
process_one_work
vmlinux 0xffffffff972bde3f
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x17f
14
worker_thread
vmlinux 0xffffffff972bef56
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x126
15
? manage_workers.isra.26
vmlinux 0xffffffff972bee30
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x2a0
16
kthread
vmlinux 0xffffffff972c5e11
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xd1
17
? insert_kthread_work
vmlinux 0xffffffff972c5d40
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x40
18
ret_from_fork_nospec_begin
vmlinux 0xffffffff97994df7
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x21
19
? insert_kthread_work
vmlinux 0xffffffff972c5d40
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#17 stuck for 21s! [vmtoolsd:16724]
[<ffffffff9755baa5>] blk_execute_rq_nowait+0xb5/0x170
[<ffffffff9755bbeb>] blk_execute_rq+0x8b/0x150
[<ffffffff9748aeb9>] ? bio_phys_segments+0x19/0x20
[<ffffffff97556fb1>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffff9755b907>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffff976e9ef3>] scsi_execute+0xd3/0x170
[<ffffffff976ebdce>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc02d731c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc032905e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc02d8091>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffff97569936>] disk_check_events+0x66/0x190
[<ffffffff97569a76>] disk_events_workfn+0x16/0x20
[<ffffffff972bde3f>] process_one_work+0x17f/0x440
[<ffffffff972bef56>] worker_thread+0x126/0x3c0
[<ffffffff972bee30>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff972c5e11>] kthread+0xd1/0xe0
[<ffffffff972c5d40>] ? insert_kthread_work+0x40/0x40
[<ffffffff97994df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff972c5d40>] ? insert_kthread_work+0x40/0x40
Complete report #32123
Frame # Function Binary Source or offset Line
1
? blk_rq_bio_prep
vmlinux 0xffffffffb6346631
Build id: 3.10.0-957.el7.x86_64 		0x31
2
? blk_rq_map_kern
vmlinux 0xffffffffb634aeb7
Build id: 3.10.0-957.el7.x86_64 		0xc7
3
scsi_execute
vmlinux 0xffffffffb64d6a23
Build id: 3.10.0-957.el7.x86_64 		0xd3
4
scsi_execute_req_flags
vmlinux 0xffffffffb64d870e
Build id: 3.10.0-957.el7.x86_64 		0x8e
5
sr_check_events
sr_mod 0xffffffffc064e31c
Build id: 3.10.0-957.el7.x86_64 		0xbc
6
cdrom_check_events
cdrom 0xffffffffc064205e
Build id: 3.10.0-957.el7.x86_64 		0x1e
7
sr_block_check_events
sr_mod 0xffffffffc064f0b1
Build id: 3.10.0-957.el7.x86_64 		0xb1
8
disk_check_events
vmlinux 0xffffffffb6358be6
Build id: 3.10.0-957.el7.x86_64 		0x66
9
disk_events_workfn
vmlinux 0xffffffffb6358d26
Build id: 3.10.0-957.el7.x86_64 		0x16
10
process_one_work
vmlinux 0xffffffffb60b9d4f
Build id: 3.10.0-957.el7.x86_64 		0x17f
11
worker_thread
vmlinux 0xffffffffb60bade6
Build id: 3.10.0-957.el7.x86_64 		0x126
12
? manage_workers.isra.25
vmlinux 0xffffffffb60bacc0
Build id: 3.10.0-957.el7.x86_64 		0x2a0
13
kthread
vmlinux 0xffffffffb60c1c31
Build id: 3.10.0-957.el7.x86_64 		0xd1
14
? insert_kthread_work
vmlinux 0xffffffffb60c1b60
Build id: 3.10.0-957.el7.x86_64 		0x40
15
ret_from_fork_nospec_begin
vmlinux 0xffffffffb6774c37
Build id: 3.10.0-957.el7.x86_64 		0x21
16
? insert_kthread_work
vmlinux 0xffffffffb60c1b60
Build id: 3.10.0-957.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 110s! [kworker/2:2:8840]
[<ffffffffb6346631>] ? blk_rq_bio_prep+0x31/0xb0
[<ffffffffb634aeb7>] ? blk_rq_map_kern+0xc7/0x180
[<ffffffffb64d6a23>] scsi_execute+0xd3/0x170
[<ffffffffb64d870e>] scsi_execute_req_flags+0x8e/0x100
[<ffffffffc064e31c>] sr_check_events+0xbc/0x2d0 [sr_mod]
[<ffffffffc064205e>] cdrom_check_events+0x1e/0x40 [cdrom]
[<ffffffffc064f0b1>] sr_block_check_events+0xb1/0x120 [sr_mod]
[<ffffffffb6358be6>] disk_check_events+0x66/0x190
[<ffffffffb6358d26>] disk_events_workfn+0x16/0x20
[<ffffffffb60b9d4f>] process_one_work+0x17f/0x440
[<ffffffffb60bade6>] worker_thread+0x126/0x3c0
[<ffffffffb60bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffffb60c1c31>] kthread+0xd1/0xe0
[<ffffffffb60c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffffb6774c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb60c1b60>] ? insert_kthread_work+0x40/0x40