Info

Permalink
Function
mpt_put_msg_frame
First occurrence
2021-04-19
Last occurrence
2026-07-12
State
NEW
Components
kernel
Quality
-51

Statistics

Operating system Count
CentOS 7 152
Architecture Count
x86_64 152
Related packages Count
kernel 152
 0:3.10.0-1160.15.2.el7 39
 0:3.10.0-1127.19.1.el7 38
 0:3.10.0-1160.53.1.el7 16
 0:3.10.0-957.el7 8
 0:3.10.0-1160.88.1.el7 6
 0:3.10.0-1160.119.1.el7 5
 0:3.10.0-1160.49.1.el7 4
 0:3.10.0-1160.59.1.el7 4
 0:3.10.0-1160.25.1.el7 4
 0:3.10.0-1160.83.1.el7 3
 0:3.10.0-1160.62.1.el7 3
 0:3.10.0-1160.80.1.el7 3
 0:3.10.0-1160.el7 3
 0:3.10.0-1127.el7 2
 0:3.10.0-1062.1.1.el7 2
 0:3.10.0-1160.11.1.el7 1
 0:3.10.0-1160.31.1.el7 1
 0:3.10.0-1160.99.1.el7 1
 0:3.10.0-1160.108.1.el7 1
 0:3.10.0-1160.41.1.el7 1
 0:3.10.0-1160.81.1.el7 1
 0:3.10.0-1062.el7 1
 0:3.10.0-862.el7 1
 0:3.10.0-1160.102.1.el7 1
 0:3.10.0-1160.95.1.el7 1
 0:3.10.0-862.11.6.el7 1
 0:3.10.0-862.6.3.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

Report backtrace


Complete report #436175
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc01153be
Build id: 3.10.0-957.el7.x86_64
0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc015b71e
Build id: 3.10.0-957.el7.x86_64
0x24e
3
mptspi_qcmd
mptspi 0xffffffffc016f2e0
Build id: 3.10.0-957.el7.x86_64
0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff8a0d0960
Build id: 3.10.0-957.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffff8a0d9efc
Build id: 3.10.0-957.el7.x86_64
0x4cc
6
? deadline_add_request
vmlinux 0xffffffff89f675fe
Build id: 3.10.0-957.el7.x86_64
0x6e
7
__blk_run_queue
vmlinux 0xffffffff89f42ff9
Build id: 3.10.0-957.el7.x86_64
0x39
8
blk_queue_bio
vmlinux 0xffffffff89f46cf3
Build id: 3.10.0-957.el7.x86_64
0x3b3
9
generic_make_request
vmlinux 0xffffffff89f44c87
Build id: 3.10.0-957.el7.x86_64
0x147
10
submit_bio
vmlinux 0xffffffff89f44f30
Build id: 3.10.0-957.el7.x86_64
0x70
11
? bio_alloc_bioset
vmlinux 0xffffffff89e7e2e5
Build id: 3.10.0-957.el7.x86_64
0x115
12
_submit_bh
vmlinux 0xffffffff89e79f27
Build id: 3.10.0-957.el7.x86_64
0x127
13
ll_rw_block
vmlinux 0xffffffff89e7a979
Build id: 3.10.0-957.el7.x86_64
0xa9
14
__block_write_begin_int
vmlinux 0xffffffff89e7acb6
Build id: 3.10.0-957.el7.x86_64
0x246
15
? __inc_zone_page_state
vmlinux 0xffffffff89dd7d42
Build id: 3.10.0-957.el7.x86_64
0x32
16
iomap_write_begin
vmlinux 0xffffffff89eabec1
Build id: 3.10.0-957.el7.x86_64
0x81
17
iomap_write_actor
vmlinux 0xffffffff89eac20f
Build id: 3.10.0-957.el7.x86_64
0xcf
18
? iomap_write_end
vmlinux 0xffffffff89eac140
Build id: 3.10.0-957.el7.x86_64
0x80
19
iomap_apply
vmlinux 0xffffffff89eac817
Build id: 3.10.0-957.el7.x86_64
0xb7
20
iomap_file_buffered_write
vmlinux 0xffffffff89eac951
Build id: 3.10.0-957.el7.x86_64
0xa1
21
? iomap_write_end
vmlinux 0xffffffff89eac140
Build id: 3.10.0-957.el7.x86_64
0x80
22
xfs_file_buffered_aio_write
xfs 0xffffffffc033ba4d
Build id: 3.10.0-957.el7.x86_64
0x12d
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 30s! [php-fpm:179253]
Modules linked in: dattobd(OE) sfs(OE) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc nfit libnvdimm iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr vmw_balloon joydev sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom
crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm mptspi scsi_transport_spi mptscsih ahci vmxnet3 libahci mptbase drm_panel_orientation_quirks ata_piix libata dm_mirror dm_region_hash dm_log dm_mod [last unloaded: dattobd]
CPU: 6 PID: 179253 Comm: php-fpm Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff9867c6668000 ti: ffff986854708000 task.ti: ffff986854708000
RIP: 0010:[<ffffffffc01153be>]  [<ffffffffc01153be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff98685470b708  EFLAGS: 00000246
RAX: ffffb85b03700000 RBX: ffff9869fbb4b3a0 RCX: 0000000000000034
RDX: ffff986ebf787400 RSI: ffff986c1ed8c000 RDI: 000000000000000e
RBP: ffff98685470b718 R08: 0000000000000002 R09: 0000000302d1ffff
R10: ffff98685bd870d8 R11: ffff9866de3ff9c0 R12: ffff9869acd98900
R13: ffff98685470b67c R14: ffffffff89f4b83b R15: ffff98685470b6c0
FS:  00007f8d5a547880(0000) GS:ffff9869fc800000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8d579e2000 CR3: 000000044c936000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffc015b71e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc016f2e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffff8a0d0960>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff8a0d9efc>] scsi_request_fn+0x4cc/0x680
[<ffffffff89f675fe>] ? deadline_add_request+0x6e/0x90
[<ffffffff89f42ff9>] __blk_run_queue+0x39/0x50
[<ffffffff89f46cf3>] blk_queue_bio+0x3b3/0x400
[<ffffffff89f44c87>] generic_make_request+0x147/0x380
[<ffffffff89f44f30>] submit_bio+0x70/0x150
[<ffffffff89e7e2e5>] ? bio_alloc_bioset+0x115/0x310
[<ffffffff89e79f27>] _submit_bh+0x127/0x160
[<ffffffff89e7a979>] ll_rw_block+0xa9/0xb0
[<ffffffff89e7acb6>] __block_write_begin_int+0x246/0x5f0
[<ffffffff89dd7d42>] ? __inc_zone_page_state+0x32/0x60
[<ffffffff89eabec1>] iomap_write_begin+0x81/0x100
[<ffffffff89eac20f>] iomap_write_actor+0xcf/0x1d0
[<ffffffff89eac140>] ? iomap_write_end+0x80/0x80
[<ffffffff89eac817>] iomap_apply+0xb7/0x150
[<ffffffff89eac951>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff89eac140>] ? iomap_write_end+0x80/0x80
[<ffffffffc033ba4d>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
Complete report #992952
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc04023be
Build id: 3.10.0-1127.el7.x86_64
0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc04cc71e
Build id: 3.10.0-1127.el7.x86_64
0x24e
3
mptsas_qcmd
mptsas 0xffffffffc0526cc9
Build id: 3.10.0-1127.el7.x86_64
0x79
4
? blk_add_timer
vmlinux 0xffffffff9055c7ac
Build id: 3.10.0-1127.el7.x86_64
0x7c
5
scsi_dispatch_cmd
vmlinux 0xffffffff906e2850
Build id: 3.10.0-1127.el7.x86_64
0xb0
6
scsi_request_fn
vmlinux 0xffffffff906ebefc
Build id: 3.10.0-1127.el7.x86_64
0x4ac
7
? deadline_add_request
vmlinux 0xffffffff9057709e
Build id: 3.10.0-1127.el7.x86_64
0x6e
8
__blk_run_queue
vmlinux 0xffffffff905526f9
Build id: 3.10.0-1127.el7.x86_64
0x39
9
blk_queue_bio
vmlinux 0xffffffff90556403
Build id: 3.10.0-1127.el7.x86_64
0x3b3
10
generic_make_request
vmlinux 0xffffffff90554387
Build id: 3.10.0-1127.el7.x86_64
0x147
11
submit_bio
vmlinux 0xffffffff90554630
Build id: 3.10.0-1127.el7.x86_64
0x70
12
? bio_alloc_bioset
vmlinux 0xffffffff9048b7f5
Build id: 3.10.0-1127.el7.x86_64
0x115
13
_submit_bh
vmlinux 0xffffffff90487217
Build id: 3.10.0-1127.el7.x86_64
0x127
14
ll_rw_block
vmlinux 0xffffffff90487d19
Build id: 3.10.0-1127.el7.x86_64
0xa9
15
__block_write_begin_int
vmlinux 0xffffffff90488056
Build id: 3.10.0-1127.el7.x86_64
0x246
16
iomap_write_begin
vmlinux 0xffffffff904ba009
Build id: 3.10.0-1127.el7.x86_64
0xc9
17
iomap_write_actor
vmlinux 0xffffffff904ba435
Build id: 3.10.0-1127.el7.x86_64
0xd5
18
? iomap_dirty_actor
vmlinux 0xffffffff904ba360
Build id: 3.10.0-1127.el7.x86_64
0x1d0
19
iomap_apply
vmlinux 0xffffffff904ba81a
Build id: 3.10.0-1127.el7.x86_64
0xba
20
iomap_file_buffered_write
vmlinux 0xffffffff904ba961
Build id: 3.10.0-1127.el7.x86_64
0xa1
21
? iomap_dirty_actor
vmlinux 0xffffffff904ba360
Build id: 3.10.0-1127.el7.x86_64
0x1d0
22
xfs_file_buffered_aio_write
xfs 0xffffffffc06f38ad
Build id: 3.10.0-1127.el7.x86_64
0x12d
23
xfs_file_aio_write
xfs 0xffffffffc06f3bcd
Build id: 3.10.0-1127.el7.x86_64
0x18d
24
do_sync_write
vmlinux 0xffffffff9044c663
Build id: 3.10.0-1127.el7.x86_64
0x93
25
vfs_write
vmlinux 0xffffffff9044d150
Build id: 3.10.0-1127.el7.x86_64
0xc0
26
SyS_write
vmlinux 0xffffffff9044df1f
Build id: 3.10.0-1127.el7.x86_64
0x7f
27
system_call_fastpath
vmlinux 0xffffffff90992ed2
Build id: 3.10.0-1127.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 48s! [abrt-hook-ccpp:2990]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc vfat fat snd_hda_codec_generic snd_hda_intel snd_hda_codec ppdev snd_hda_core snd_hwdep iosf_mbi snd_seq crc32_pclmul snd_seq_device vmw_balloon snd_pcm ghash_clmulni_intel cryptd sg snd_timer joydev pcspkr snd soundcore vmw_vmci i2c_piix4 tpm_crb parport_pc parport sch_fq_codel ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common ata_generic vmwgfx pata_acpi drm_kms_helper crc32c_intel syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm ahci ata_piix drm nfit e1000e serio_raw libahci mptsas libnvdimm scsi_transport_sas mptscsih libata mptbase ptp pps_core drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 2990 Comm: abrt-hook-ccpp Kdump: loaded Not tainted 3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.12343141.B64.1902160724 02/16/2019
task: ffff96db14209070 ti: ffff96db36be0000 task.ti: ffff96db36be0000
RIP: 0010:[<ffffffffc04023be>]  [<ffffffffc04023be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff96db36be3778  EFLAGS: 00000246
RAX: ffffab57c03c8000 RBX: 000000005e34cc7f RCX: 0000000000000019
RDX: ffff96dacd99ea00 RSI: ffff96dacd291000 RDI: 000000000000000e
RBP: ffff96db36be3788 R08: 0000000000000002 R09: 0000000054a92fff
R10: ffff96daccf87400 R11: ffff96db1ecfba40 R12: ffff96db118a8fa0
R13: 0000000100000001 R14: ffff96db335f0180 R15: ffff96db36be36dc
FS:  00007f9c1acda900(0000) GS:ffff96db3fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9c1a8f61f0 CR3: 0000000076be4000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc04cc71e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc0526cc9>] mptsas_qcmd+0x79/0xa0 [mptsas]
[<ffffffff9055c7ac>] ? blk_add_timer+0x7c/0x110
[<ffffffff906e2850>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff906ebefc>] scsi_request_fn+0x4ac/0x660
[<ffffffff9057709e>] ? deadline_add_request+0x6e/0x90
[<ffffffff905526f9>] __blk_run_queue+0x39/0x50
[<ffffffff90556403>] blk_queue_bio+0x3b3/0x400
[<ffffffff90554387>] generic_make_request+0x147/0x380
[<ffffffff90554630>] submit_bio+0x70/0x150
[<ffffffff9048b7f5>] ? bio_alloc_bioset+0x115/0x310
[<ffffffff90487217>] _submit_bh+0x127/0x160
[<ffffffff90487d19>] ll_rw_block+0xa9/0xb0
[<ffffffff90488056>] __block_write_begin_int+0x246/0x650
[<ffffffff904ba009>] iomap_write_begin+0xc9/0x250
[<ffffffff904ba435>] iomap_write_actor+0xd5/0x1f0
[<ffffffff904ba360>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff904ba81a>] iomap_apply+0xba/0x160
[<ffffffff904ba961>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff904ba360>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc06f38ad>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc06f3bcd>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff9044c663>] do_sync_write+0x93/0xe0
[<ffffffff9044d150>] vfs_write+0xc0/0x1f0
[<ffffffff9044df1f>] SyS_write+0x7f/0xf0
[<ffffffff90992ed2>] system_call_fastpath+0x25/0x2a
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 03 41 
Complete report #854087
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc01503be
Build id: 3.10.0-957.el7.x86_64
0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc016b71e
Build id: 3.10.0-957.el7.x86_64
0x24e
3
mptsas_qcmd
mptsas 0xffffffffc01b7cc9
Build id: 3.10.0-957.el7.x86_64
0x79
4
? blk_add_timer
vmlinux 0xffffffff9454d01c
Build id: 3.10.0-957.el7.x86_64
0x7c
5
scsi_dispatch_cmd
vmlinux 0xffffffff946d0960
Build id: 3.10.0-957.el7.x86_64
0xb0
6
scsi_request_fn
vmlinux 0xffffffff946d9efc
Build id: 3.10.0-957.el7.x86_64
0x4cc
7
? deadline_add_request
vmlinux 0xffffffff945675fe
Build id: 3.10.0-957.el7.x86_64
0x6e
8
__blk_run_queue
vmlinux 0xffffffff94542ff9
Build id: 3.10.0-957.el7.x86_64
0x39
9
blk_queue_bio
vmlinux 0xffffffff94546cf3
Build id: 3.10.0-957.el7.x86_64
0x3b3
10
generic_make_request
vmlinux 0xffffffff94544c87
Build id: 3.10.0-957.el7.x86_64
0x147
11
submit_bio
vmlinux 0xffffffff94544f30
Build id: 3.10.0-957.el7.x86_64
0x70
12
? bio_alloc_bioset
vmlinux 0xffffffff9447e2e5
Build id: 3.10.0-957.el7.x86_64
0x115
13
_submit_bh
vmlinux 0xffffffff94479f27
Build id: 3.10.0-957.el7.x86_64
0x127
14
ll_rw_block
vmlinux 0xffffffff9447a979
Build id: 3.10.0-957.el7.x86_64
0xa9
15
__block_write_begin_int
vmlinux 0xffffffff9447acb6
Build id: 3.10.0-957.el7.x86_64
0x246
16
? __inc_zone_page_state
vmlinux 0xffffffff943d7d42
Build id: 3.10.0-957.el7.x86_64
0x32
17
iomap_write_begin
vmlinux 0xffffffff944abec1
Build id: 3.10.0-957.el7.x86_64
0x81
18
iomap_write_actor
vmlinux 0xffffffff944ac20f
Build id: 3.10.0-957.el7.x86_64
0xcf
19
? iomap_write_end
vmlinux 0xffffffff944ac140
Build id: 3.10.0-957.el7.x86_64
0x80
20
iomap_apply
vmlinux 0xffffffff944ac817
Build id: 3.10.0-957.el7.x86_64
0xb7
21
iomap_file_buffered_write
vmlinux 0xffffffff944ac951
Build id: 3.10.0-957.el7.x86_64
0xa1
22
? iomap_write_end
vmlinux 0xffffffff944ac140
Build id: 3.10.0-957.el7.x86_64
0x80
23
xfs_file_buffered_aio_write
xfs 0xffffffffc0446a4d
Build id: 3.10.0-957.el7.x86_64
0x12d
24
xfs_file_aio_write
xfs 0xffffffffc0446d6d
Build id: 3.10.0-957.el7.x86_64
0x18d
25
do_sync_write
vmlinux 0xffffffff944405b3
Build id: 3.10.0-957.el7.x86_64
0x93
26
vfs_write
vmlinux 0xffffffff944410a0
Build id: 3.10.0-957.el7.x86_64
0xc0
27
SyS_write
vmlinux 0xffffffff94441ebf
Build id: 3.10.0-957.el7.x86_64
0x7f
28
system_call_fastpath
vmlinux 0xffffffff94974ddb
Build id: 3.10.0-957.el7.x86_64
0x22
NMI watchdog: BUG: soft lockup - CPU#18 stuck for 62s! [jsvc:4371]
Modules linked in: nfsv3 nfs_acl nfs lockd grace fscache binfmt_misc vmw_vsock_vmci_transport vsock sunrpc vfat fat sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg parport_pc parport tpm_crb vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea crct10dif_pclmul sysfillrect crct10dif_common sysimgblt crc32c_intel fb_sys_fops ttm ahci e1000e drm ata_piix mptsas libahci serio_raw scsi_transport_sas libata mptscsih mptbase ptp pps_core nfit libnvdimm drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 18 PID: 4371 Comm: jsvc Kdump: loaded Tainted: G             L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.17369862.B64.2012240522 12/24/2020
task: ffff94c493e0e180 ti: ffff94bca142c000 task.ti: ffff94bca142c000
RIP: 0010:[<ffffffffc01503be>]  [<ffffffffc01503be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff94bca142f788  EFLAGS: 00000246
RAX: ffffb495031b8000 RBX: 00000000f0af9155 RCX: 0000000000000003
RDX: ffff94bdf3cdea00 RSI: ffff94c49f56e000 RDI: 000000000000000e
RBP: ffff94bca142f798 R08: 0000000000000000 R09: 0000000515811fff
R10: ffff94c4bf7b70d8 R11: ffff94bc9789cc40 R12: ffff94c2f0278860
R13: 0000000100000007 R14: ffff94bc8a7d7900 R15: ffff94bca142f6ec
FS:  00007f3cede99700(0000) GS:ffff94c49da80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f36282b2d9c CR3: 000000079aaba000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc016b71e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc01b7cc9>] mptsas_qcmd+0x79/0xa0 [mptsas]
[<ffffffff9454d01c>] ? blk_add_timer+0x7c/0x110
[<ffffffff946d0960>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff946d9efc>] scsi_request_fn+0x4cc/0x680
[<ffffffff945675fe>] ? deadline_add_request+0x6e/0x90
[<ffffffff94542ff9>] __blk_run_queue+0x39/0x50
[<ffffffff94546cf3>] blk_queue_bio+0x3b3/0x400
[<ffffffff94544c87>] generic_make_request+0x147/0x380
[<ffffffff94544f30>] submit_bio+0x70/0x150
[<ffffffff9447e2e5>] ? bio_alloc_bioset+0x115/0x310
[<ffffffff94479f27>] _submit_bh+0x127/0x160
[<ffffffff9447a979>] ll_rw_block+0xa9/0xb0
[<ffffffff9447acb6>] __block_write_begin_int+0x246/0x5f0
[<ffffffff943d7d42>] ? __inc_zone_page_state+0x32/0x60
[<ffffffff944abec1>] iomap_write_begin+0x81/0x100
[<ffffffff944ac20f>] iomap_write_actor+0xcf/0x1d0
[<ffffffff944ac140>] ? iomap_write_end+0x80/0x80
[<ffffffff944ac817>] iomap_apply+0xb7/0x150
[<ffffffff944ac951>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff944ac140>] ? iomap_write_end+0x80/0x80
[<ffffffffc0446a4d>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc0446d6d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff944405b3>] do_sync_write+0x93/0xe0
[<ffffffff944410a0>] vfs_write+0xc0/0x1f0
[<ffffffff94441ebf>] SyS_write+0x7f/0xf0
[<ffffffff94974ddb>] system_call_fastpath+0x22/0x27
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 e3 15 
Complete report #462393
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff963164f5
Build id: 3.10.0-862.6.3.el7.x86_64
0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc0376622
Build id: 3.10.0-862.6.3.el7.x86_64
0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffff960a4050
Build id: 3.10.0-862.6.3.el7.x86_64
0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffff9609bb60
Build id: 3.10.0-862.6.3.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffff960a50cc
Build id: 3.10.0-862.6.3.el7.x86_64
0x4cc
6
? deadline_add_request
vmlinux 0xffffffff95f3d28e
Build id: 3.10.0-862.6.3.el7.x86_64
0x6e
7
__blk_run_queue
vmlinux 0xffffffff95f19519
Build id: 3.10.0-862.6.3.el7.x86_64
0x39
8
blk_queue_bio
vmlinux 0xffffffff95f1d1a3
Build id: 3.10.0-862.6.3.el7.x86_64
0x3b3
9
generic_make_request
vmlinux 0xffffffff95f1b0fb
Build id: 3.10.0-862.6.3.el7.x86_64
0x10b
10
submit_bio
vmlinux 0xffffffff95f1b380
Build id: 3.10.0-862.6.3.el7.x86_64
0x70
11
? bio_alloc_bioset
vmlinux 0xffffffff95e57b05
Build id: 3.10.0-862.6.3.el7.x86_64
0x115
12
_submit_bh
vmlinux 0xffffffff95e53737
Build id: 3.10.0-862.6.3.el7.x86_64
0x127
13
ll_rw_block
vmlinux 0xffffffff95e54189
Build id: 3.10.0-862.6.3.el7.x86_64
0xa9
14
__block_write_begin_int
vmlinux 0xffffffff95e544c6
Build id: 3.10.0-862.6.3.el7.x86_64
0x246
15
? __inc_zone_page_state
vmlinux 0xffffffff95db59c2
Build id: 3.10.0-862.6.3.el7.x86_64
0x32
16
iomap_write_begin
vmlinux 0xffffffff95e85171
Build id: 3.10.0-862.6.3.el7.x86_64
0x81
17
iomap_write_actor
vmlinux 0xffffffff95e854bf
Build id: 3.10.0-862.6.3.el7.x86_64
0xcf
18
? iomap_write_end
vmlinux 0xffffffff95e853f0
Build id: 3.10.0-862.6.3.el7.x86_64
0x80
19
iomap_apply
vmlinux 0xffffffff95e85ac7
Build id: 3.10.0-862.6.3.el7.x86_64
0xb7
20
iomap_file_buffered_write
vmlinux 0xffffffff95e85c01
Build id: 3.10.0-862.6.3.el7.x86_64
0xa1
21
? iomap_write_end
vmlinux 0xffffffff95e853f0
Build id: 3.10.0-862.6.3.el7.x86_64
0x80
22
xfs_file_buffered_aio_write
xfs 0xffffffffc05b725d
Build id: 3.10.0-862.6.3.el7.x86_64
0x12d
23
xfs_file_aio_write
xfs 0xffffffffc05b757d
Build id: 3.10.0-862.6.3.el7.x86_64
0x18d
24
do_sync_write
vmlinux 0xffffffff95e1a9b3
Build id: 3.10.0-862.6.3.el7.x86_64
0x93
25
vfs_write
vmlinux 0xffffffff95e1b490
Build id: 3.10.0-862.6.3.el7.x86_64
0xc0
26
SyS_pwrite64
vmlinux 0xffffffff95e1c482
Build id: 3.10.0-862.6.3.el7.x86_64
0x92
27
? system_call_after_swapgs
vmlinux 0xffffffff963206d5
Build id: 3.10.0-862.6.3.el7.x86_64
0xa2
28
system_call_fastpath
vmlinux 0xffffffff96320795
Build id: 3.10.0-862.6.3.el7.x86_64
0x1c
29
? system_call_after_swapgs
vmlinux 0xffffffff963206e1
Build id: 3.10.0-862.6.3.el7.x86_64
0xae
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [mysqld:3491]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev vmw_balloon pcspkr joydev sg i2c_piix4 parport_pc parport vmw_vmci shpchp ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops sd_mod ttm crc_t10dif crct10dif_generic
drm ata_piix crct10dif_common ahci libahci libata crc32c_intel serio_raw i2c_core vmxnet3 vmw_pvscsi dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 3491 Comm: mysqld Kdump: loaded Tainted: G             L ------------   3.10.0-862.6.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff97f9ba710000 ti: ffff97f9b4fc8000 task.ti: ffff97f9b4fc8000
RIP: 0010:[<ffffffff963164f5>]  [<ffffffff963164f5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff97f9b4fcb7d0  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffffffff95f754d3 RCX: ffffffff96830880
RDX: ffffb22101b80000 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff97f9b4fcb7d0 R08: 0000000000000001 R09: 0000000000000000
R10: ffff97f9f08c90d8 R11: ffff97f775cce000 R12: 0000000000000000
R13: 0000000000000020 R14: ffff97f9daa6d200 R15: ffffffff960a2da9
FS:  00007f4a605ff700(0000) GS:ffff97f9ffd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb922231000 CR3: 0000000274e14000 CR4: 00000000000007e0
Call Trace:
[<ffffffffc0376622>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffff960a4050>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffff9609bb60>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff960a50cc>] scsi_request_fn+0x4cc/0x680
[<ffffffff95f3d28e>] ? deadline_add_request+0x6e/0x90
[<ffffffff95f19519>] __blk_run_queue+0x39/0x50
[<ffffffff95f1d1a3>] blk_queue_bio+0x3b3/0x400
[<ffffffff95f1b0fb>] generic_make_request+0x10b/0x320
[<ffffffff95f1b380>] submit_bio+0x70/0x150
[<ffffffff95e57b05>] ? bio_alloc_bioset+0x115/0x310
[<ffffffff95e53737>] _submit_bh+0x127/0x160
[<ffffffff95e54189>] ll_rw_block+0xa9/0xb0
[<ffffffff95e544c6>] __block_write_begin_int+0x246/0x5f0
[<ffffffff95db59c2>] ? __inc_zone_page_state+0x32/0x60
[<ffffffff95e85171>] iomap_write_begin+0x81/0x100
[<ffffffff95e854bf>] iomap_write_actor+0xcf/0x1d0
[<ffffffff95e853f0>] ? iomap_write_end+0x80/0x80
[<ffffffff95e85ac7>] iomap_apply+0xb7/0x150
[<ffffffff95e85c01>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff95e853f0>] ? iomap_write_end+0x80/0x80
[<ffffffffc05b725d>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc05b757d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff95e1a9b3>] do_sync_write+0x93/0xe0
[<ffffffff95e1b490>] vfs_write+0xc0/0x1f0
[<ffffffff95e1c482>] SyS_pwrite64+0x92/0xc0
[<ffffffff963206d5>] ? system_call_after_swapgs+0xa2/0x146
[<ffffffff96320795>] system_call_fastpath+0x1c/0x21
[<ffffffff963206e1>] ? system_call_after_swapgs+0xae/0x146
Code: 07 00 66 66 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 c6 07 00 66 66 66 90 48 89 f7 57 9d <66> 66 90 66 90 5d c3 0f 1f 40 00 66 66 66 66 90 55 48 89 e5 48 
Complete report #456603
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc04193be
Build id: 3.10.0-1160.62.1.el7.x86_64
0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc043471e
Build id: 3.10.0-1160.62.1.el7.x86_64
0x24e
3
mptspi_qcmd
mptspi 0xffffffffc04a62e0
Build id: 3.10.0-1160.62.1.el7.x86_64
0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff95ae4640
Build id: 3.10.0-1160.62.1.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffff95aedd6c
Build id: 3.10.0-1160.62.1.el7.x86_64
0x4ac
6
? deadline_add_request
vmlinux 0xffffffff959789ce
Build id: 3.10.0-1160.62.1.el7.x86_64
0x6e
7
__blk_run_queue
vmlinux 0xffffffff95953cf9
Build id: 3.10.0-1160.62.1.el7.x86_64
0x39
8
blk_queue_bio
vmlinux 0xffffffff95957ac3
Build id: 3.10.0-1160.62.1.el7.x86_64
0x3b3
9
generic_make_request
vmlinux 0xffffffff959559a7
Build id: 3.10.0-1160.62.1.el7.x86_64
0x147
10
submit_bio
vmlinux 0xffffffff95955c50
Build id: 3.10.0-1160.62.1.el7.x86_64
0x70
11
? bio_alloc_bioset
vmlinux 0xffffffff9588c855
Build id: 3.10.0-1160.62.1.el7.x86_64
0x115
12
_submit_bh
vmlinux 0xffffffff958883d7
Build id: 3.10.0-1160.62.1.el7.x86_64
0x127
13
ll_rw_block
vmlinux 0xffffffff95888ec9
Build id: 3.10.0-1160.62.1.el7.x86_64
0xa9
14
__block_write_begin_int
vmlinux 0xffffffff95889206
Build id: 3.10.0-1160.62.1.el7.x86_64
0x246
15
iomap_write_begin
vmlinux 0xffffffff958bb319
Build id: 3.10.0-1160.62.1.el7.x86_64
0xc9
16
iomap_write_actor
vmlinux 0xffffffff958bb745
Build id: 3.10.0-1160.62.1.el7.x86_64
0xd5
17
? iomap_dirty_actor
vmlinux 0xffffffff958bb670
Build id: 3.10.0-1160.62.1.el7.x86_64
0x1d0
18
iomap_apply
vmlinux 0xffffffff958bbb2a
Build id: 3.10.0-1160.62.1.el7.x86_64
0xba
19
iomap_file_buffered_write
vmlinux 0xffffffff958bbc71
Build id: 3.10.0-1160.62.1.el7.x86_64
0xa1
20
? iomap_dirty_actor
vmlinux 0xffffffff958bb670
Build id: 3.10.0-1160.62.1.el7.x86_64
0x1d0
21
xfs_file_buffered_aio_write
xfs 0xffffffffc06577bd
Build id: 3.10.0-1160.62.1.el7.x86_64
0x12d
22
xfs_file_aio_write
xfs 0xffffffffc0657add
Build id: 3.10.0-1160.62.1.el7.x86_64
0x18d
23
do_sync_write
vmlinux 0xffffffff9584da03
Build id: 3.10.0-1160.62.1.el7.x86_64
0x93
24
vfs_write
vmlinux 0xffffffff9584e490
Build id: 3.10.0-1160.62.1.el7.x86_64
0xc0
25
SyS_write
vmlinux 0xffffffff9584f215
Build id: 3.10.0-1160.62.1.el7.x86_64
0x55
26
? system_call_after_swapgs
vmlinux 0xffffffff95d99ed5
Build id: 3.10.0-1160.62.1.el7.x86_64
0xa2
27
system_call_fastpath
vmlinux 0xffffffff95d99f92
Build id: 3.10.0-1160.62.1.el7.x86_64
0x25
28
? system_call_after_swapgs
vmlinux 0xffffffff95d99ed5
Build id: 3.10.0-1160.62.1.el7.x86_64
0xa2
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 32s! [vmtoolsd:938]
Modules linked in: splxmod(OE) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink scsi_transport_iscsi ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_multipath sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon pcspkr joydev sg parport_pc parport i2c_piix4 vmw_vmci sch_fq_codel ip_tables
xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm ata_piix serio_raw mptspi libata scsi_transport_spi mptscsih mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 938 Comm: vmtoolsd Kdump: loaded Tainted: G           OEL ------------   3.10.0-1160.62.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
task: ffff9e4bb5dfc200 ti: ffff9e4bb49ec000 task.ti: ffff9e4bb49ec000
RIP: 0010:[<ffffffffc04193be>]  [<ffffffffc04193be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff9e4bb49ef768  EFLAGS: 00000246
RAX: ffffaf8e00ec0000 RBX: 0000000000000003 RCX: 0000000000000009
RDX: ffff9e4db27b0c00 RSI: ffff9e4bb5f1a000 RDI: 000000000000000e
RBP: ffff9e4bb49ef778 R08: 0000000000000003 R09: 0000000085d78fff
R10: ffff9e4bb5e576f8 R11: 0000000000001000 R12: 00000001002a12d0
R13: 00800002956e8604 R14: ffff9e4bb5fa0000 R15: ffffffff95953baf
FS:  00007f8f6d3ad780(0000) GS:ffff9e4dbfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007efdb696edb0 CR3: 0000000034a12000 CR4: 00000000000407f0
Call Trace:
[<ffffffffc043471e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc04a62e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffff95ae4640>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff95aedd6c>] scsi_request_fn+0x4ac/0x680
[<ffffffff959789ce>] ? deadline_add_request+0x6e/0x90
[<ffffffff95953cf9>] __blk_run_queue+0x39/0x50
[<ffffffff95957ac3>] blk_queue_bio+0x3b3/0x400
[<ffffffff959559a7>] generic_make_request+0x147/0x380
[<ffffffff95955c50>] submit_bio+0x70/0x150
[<ffffffff9588c855>] ? bio_alloc_bioset+0x115/0x310
[<ffffffff958883d7>] _submit_bh+0x127/0x160
[<ffffffff95888ec9>] ll_rw_block+0xa9/0xb0
[<ffffffff95889206>] __block_write_begin_int+0x246/0x650
[<ffffffff958bb319>] iomap_write_begin+0xc9/0x250
[<ffffffff958bb745>] iomap_write_actor+0xd5/0x1f0
[<ffffffff958bb670>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff958bbb2a>] iomap_apply+0xba/0x160
[<ffffffff958bbc71>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff958bb670>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc06577bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc0657add>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff9584da03>] do_sync_write+0x93/0xe0
[<ffffffff9584e490>] vfs_write+0xc0/0x1f0
[<ffffffff9584f215>] SyS_write+0x55/0xd0
[<ffffffff95d99ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff95d99f92>] system_call_fastpath+0x25/0x2a
[<ffffffff95d99ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 73 42 
Complete report #386088
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc014f3be
Build id: 3.10.0-957.el7.x86_64
0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc01a771e
Build id: 3.10.0-957.el7.x86_64
0x24e
3
mptspi_qcmd
mptspi 0xffffffffc02182e0
Build id: 3.10.0-957.el7.x86_64
0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffa02d0960
Build id: 3.10.0-957.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffffa02d9efc
Build id: 3.10.0-957.el7.x86_64
0x4cc
6
? deadline_add_request
vmlinux 0xffffffffa01675fe
Build id: 3.10.0-957.el7.x86_64
0x6e
7
__blk_run_queue
vmlinux 0xffffffffa0142ff9
Build id: 3.10.0-957.el7.x86_64
0x39
8
blk_queue_bio
vmlinux 0xffffffffa0146cf3
Build id: 3.10.0-957.el7.x86_64
0x3b3
9
generic_make_request
vmlinux 0xffffffffa0144c87
Build id: 3.10.0-957.el7.x86_64
0x147
10
submit_bio
vmlinux 0xffffffffa0144f30
Build id: 3.10.0-957.el7.x86_64
0x70
11
? bio_alloc_bioset
vmlinux 0xffffffffa007e2e5
Build id: 3.10.0-957.el7.x86_64
0x115
12
_submit_bh
vmlinux 0xffffffffa0079f27
Build id: 3.10.0-957.el7.x86_64
0x127
13
ll_rw_block
vmlinux 0xffffffffa007a979
Build id: 3.10.0-957.el7.x86_64
0xa9
14
__block_write_begin_int
vmlinux 0xffffffffa007acb6
Build id: 3.10.0-957.el7.x86_64
0x246
15
? __inc_zone_page_state
vmlinux 0xffffffff9ffd7d42
Build id: 3.10.0-957.el7.x86_64
0x32
16
iomap_write_begin
vmlinux 0xffffffffa00abec1
Build id: 3.10.0-957.el7.x86_64
0x81
17
iomap_write_actor
vmlinux 0xffffffffa00ac20f
Build id: 3.10.0-957.el7.x86_64
0xcf
18
? iomap_write_end
vmlinux 0xffffffffa00ac140
Build id: 3.10.0-957.el7.x86_64
0x80
19
iomap_apply
vmlinux 0xffffffffa00ac817
Build id: 3.10.0-957.el7.x86_64
0xb7
20
iomap_file_buffered_write
vmlinux 0xffffffffa00ac951
Build id: 3.10.0-957.el7.x86_64
0xa1
21
? iomap_write_end
vmlinux 0xffffffffa00ac140
Build id: 3.10.0-957.el7.x86_64
0x80
22
xfs_file_buffered_aio_write
xfs 0xffffffffc03f9a4d
Build id: 3.10.0-957.el7.x86_64
0x12d
23
xfs_file_aio_write
xfs 0xffffffffc03f9d6d
Build id: 3.10.0-957.el7.x86_64
0x18d
24
do_sync_write
vmlinux 0xffffffffa00405b3
Build id: 3.10.0-957.el7.x86_64
0x93
25
vfs_write
vmlinux 0xffffffffa00410a0
Build id: 3.10.0-957.el7.x86_64
0xc0
26
SyS_write
vmlinux 0xffffffffa0041ebf
Build id: 3.10.0-957.el7.x86_64
0x7f
27
system_call_fastpath
vmlinux 0xffffffffa0574ddb
Build id: 3.10.0-957.el7.x86_64
0x22
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 188s! [abrt-hook-ccpp:19047]
Modules linked in: tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmhgfs(OE) vmw_vsock_vmci_transport vsock iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr sg vmw_balloon joydev parport_pc parport i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod crct10dif_generic cdrom crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi
ata_piix e1000 scsi_transport_spi mptscsih libata drm_panel_orientation_quirks mptbase nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 19047 Comm: abrt-hook-ccpp Kdump: loaded Tainted: G           OEL ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff95a0ac266180 ti: ffff959fe8ea8000 task.ti: ffff959fe8ea8000
RIP: 0010:[<ffffffffc014f3be>]  [<ffffffffc014f3be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff959fe8eab778  EFLAGS: 00000246
RAX: ffffbf4143580000 RBX: ffff95a0d91bcba0 RCX: 0000000000000006
RDX: ffff95a0d7d96e00 RSI: ffff95a0d7c71000 RDI: 000000000000000e
RBP: ffff959fe8eab788 R08: 0000000000000002 R09: 0000000507007fff
R10: ffff95a0d827b0d8 R11: ffff95a04d7f7b80 R12: ffff959fab3a6100
R13: ffff959fe8eab6ec R14: ffffffffa014b83b R15: ffff959fe8eab730
FS:  00007f8b1bcee900(0000) GS:ffff95a0dd680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8b1ba76000 CR3: 0000000072996000 CR4: 00000000003607e0
Call Trace:
[<ffffffffc01a771e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc02182e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffa02d0960>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffa02d9efc>] scsi_request_fn+0x4cc/0x680
[<ffffffffa01675fe>] ? deadline_add_request+0x6e/0x90
[<ffffffffa0142ff9>] __blk_run_queue+0x39/0x50
[<ffffffffa0146cf3>] blk_queue_bio+0x3b3/0x400
[<ffffffffa0144c87>] generic_make_request+0x147/0x380
[<ffffffffa0144f30>] submit_bio+0x70/0x150
[<ffffffffa007e2e5>] ? bio_alloc_bioset+0x115/0x310
[<ffffffffa0079f27>] _submit_bh+0x127/0x160
[<ffffffffa007a979>] ll_rw_block+0xa9/0xb0
[<ffffffffa007acb6>] __block_write_begin_int+0x246/0x5f0
[<ffffffff9ffd7d42>] ? __inc_zone_page_state+0x32/0x60
[<ffffffffa00abec1>] iomap_write_begin+0x81/0x100
[<ffffffffa00ac20f>] iomap_write_actor+0xcf/0x1d0
[<ffffffffa00ac140>] ? iomap_write_end+0x80/0x80
[<ffffffffa00ac817>] iomap_apply+0xb7/0x150
[<ffffffffa00ac951>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffffa00ac140>] ? iomap_write_end+0x80/0x80
[<ffffffffc03f9a4d>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc03f9d6d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffffa00405b3>] do_sync_write+0x93/0xe0
[<ffffffffa00410a0>] vfs_write+0xc0/0x1f0
[<ffffffffa0041ebf>] SyS_write+0x7f/0xf0
[<ffffffffa0574ddb>] system_call_fastpath+0x22/0x27
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 d3 15 
Complete report #282075
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc015f3be
Build id: 3.10.0-1160.25.1.el7.x86_64
0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc00e671e
Build id: 3.10.0-1160.25.1.el7.x86_64
0x24e
3
mptspi_qcmd
mptspi 0xffffffffc019b2e0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffa18e3fa0
Build id: 3.10.0-1160.25.1.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffffa18ed6cc
Build id: 3.10.0-1160.25.1.el7.x86_64
0x4ac
6
? deadline_add_request
vmlinux 0xffffffffa177853e
Build id: 3.10.0-1160.25.1.el7.x86_64
0x6e
7
__blk_run_queue
vmlinux 0xffffffffa1753939
Build id: 3.10.0-1160.25.1.el7.x86_64
0x39
8
blk_queue_bio
vmlinux 0xffffffffa1757743
Build id: 3.10.0-1160.25.1.el7.x86_64
0x3b3
9
generic_make_request
vmlinux 0xffffffffa17555c7
Build id: 3.10.0-1160.25.1.el7.x86_64
0x147
10
submit_bio
vmlinux 0xffffffffa1755870
Build id: 3.10.0-1160.25.1.el7.x86_64
0x70
11
? bio_alloc_bioset
vmlinux 0xffffffffa168c455
Build id: 3.10.0-1160.25.1.el7.x86_64
0x115
12
_submit_bh
vmlinux 0xffffffffa1687fc7
Build id: 3.10.0-1160.25.1.el7.x86_64
0x127
13
ll_rw_block
vmlinux 0xffffffffa1688ac9
Build id: 3.10.0-1160.25.1.el7.x86_64
0xa9
14
__block_write_begin_int
vmlinux 0xffffffffa1688e06
Build id: 3.10.0-1160.25.1.el7.x86_64
0x246
15
iomap_write_begin
vmlinux 0xffffffffa16baf59
Build id: 3.10.0-1160.25.1.el7.x86_64
0xc9
16
iomap_write_actor
vmlinux 0xffffffffa16bb385
Build id: 3.10.0-1160.25.1.el7.x86_64
0xd5
17
? iomap_dirty_actor
vmlinux 0xffffffffa16bb2b0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x1d0
18
iomap_apply
vmlinux 0xffffffffa16bb76a
Build id: 3.10.0-1160.25.1.el7.x86_64
0xba
19
iomap_file_buffered_write
vmlinux 0xffffffffa16bb8b1
Build id: 3.10.0-1160.25.1.el7.x86_64
0xa1
20
? iomap_dirty_actor
vmlinux 0xffffffffa16bb2b0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x1d0
21
xfs_file_buffered_aio_write
xfs 0xffffffffc03667bd
Build id: 3.10.0-1160.25.1.el7.x86_64
0x12d
22
? xfs_iunlock
xfs 0xffffffffc03733dc
Build id: 3.10.0-1160.25.1.el7.x86_64
0xfc
23
xfs_file_aio_write
xfs 0xffffffffc0366add
Build id: 3.10.0-1160.25.1.el7.x86_64
0x18d
24
do_sync_write
vmlinux 0xffffffffa164d313
Build id: 3.10.0-1160.25.1.el7.x86_64
0x93
25
vfs_write
vmlinux 0xffffffffa164de00
Build id: 3.10.0-1160.25.1.el7.x86_64
0xc0
26
SyS_write
vmlinux 0xffffffffa164ebdf
Build id: 3.10.0-1160.25.1.el7.x86_64
0x7f
27
system_call_fastpath
vmlinux 0xffffffffa1b95f92
Build id: 3.10.0-1160.25.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [QueuingRrdStrat:93905]
Modules linked in: binfmt_misc ip6t_REJECT nf_reject_ipv6 nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 ipt_REJECT nf_reject_ipv4 xt_limit xt_conntrack nf_conntrack vmw_vsock_vmci_transport vsock iptable_filter sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev sg pcspkr joydev vmw_balloon parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common syscopyarea sysfillrect sysimgblt crc32c_intel fb_sys_fops ttm drm ahci serio_raw mptspi scsi_transport_spi libahci ata_piix mptscsih nfit mptbase libata vmxnet3 libnvdimm drm_panel_orientation_quirks
dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 93905 Comm: QueuingRrdStrat Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/19/2018
task: ffff8be67a825280 ti: ffff8be67a7f4000 task.ti: ffff8be67a7f4000
RIP: 0010:[<ffffffffc015f3be>]  [<ffffffffc015f3be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff8be67a7f7768  EFLAGS: 00000246
RAX: ffff9969806c0000 RBX: ffff8be5cd1a18d0 RCX: 0000000000000006
RDX: ffff8be5f671aa00 RSI: ffff8be5f65ce000 RDI: 000000000000000e
RBP: ffff8be67a7f7778 R08: 0000000000000003 R09: 00000000ba778fff
R10: ffff8be6ed31dc00 R11: ffff8be5f6698a80 R12: ffff8be6755c6280
R13: ffff8be67a7f76dc R14: ffffffffa175c35b R15: ffff8be67a7f7720
FS:  00007fcd9c955700(0000) GS:ffff8be6f9640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3bf295d4b1 CR3: 00000000ae928000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc00e671e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc019b2e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffa18e3fa0>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffa18ed6cc>] scsi_request_fn+0x4ac/0x680
[<ffffffffa177853e>] ? deadline_add_request+0x6e/0x90
[<ffffffffa1753939>] __blk_run_queue+0x39/0x50
[<ffffffffa1757743>] blk_queue_bio+0x3b3/0x400
[<ffffffffa17555c7>] generic_make_request+0x147/0x380
[<ffffffffa1755870>] submit_bio+0x70/0x150
[<ffffffffa168c455>] ? bio_alloc_bioset+0x115/0x310
[<ffffffffa1687fc7>] _submit_bh+0x127/0x160
[<ffffffffa1688ac9>] ll_rw_block+0xa9/0xb0
[<ffffffffa1688e06>] __block_write_begin_int+0x246/0x650
[<ffffffffa16baf59>] iomap_write_begin+0xc9/0x250
[<ffffffffa16bb385>] iomap_write_actor+0xd5/0x1f0
[<ffffffffa16bb2b0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffa16bb76a>] iomap_apply+0xba/0x160
[<ffffffffa16bb8b1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffffa16bb2b0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc03667bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc03733dc>] ? xfs_iunlock+0xfc/0x120 [xfs]
[<ffffffffc0366add>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffffa164d313>] do_sync_write+0x93/0xe0
[<ffffffffa164de00>] vfs_write+0xc0/0x1f0
[<ffffffffa164ebdf>] SyS_write+0x7f/0xf0
[<ffffffffa1b95f92>] system_call_fastpath+0x25/0x2a
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 d3 16 
Complete report #250503
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff8438b565
Build id: 3.10.0-1160.25.1.el7.x86_64
0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc0210632
Build id: 3.10.0-1160.25.1.el7.x86_64
0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffff840ec6b0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffff840e3fa0
Build id: 3.10.0-1160.25.1.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffff840ed6cc
Build id: 3.10.0-1160.25.1.el7.x86_64
0x4ac
6
? deadline_add_request
vmlinux 0xffffffff83f7853e
Build id: 3.10.0-1160.25.1.el7.x86_64
0x6e
7
__blk_run_queue
vmlinux 0xffffffff83f53939
Build id: 3.10.0-1160.25.1.el7.x86_64
0x39
8
blk_queue_bio
vmlinux 0xffffffff83f57743
Build id: 3.10.0-1160.25.1.el7.x86_64
0x3b3
9
generic_make_request
vmlinux 0xffffffff83f555c7
Build id: 3.10.0-1160.25.1.el7.x86_64
0x147
10
submit_bio
vmlinux 0xffffffff83f55870
Build id: 3.10.0-1160.25.1.el7.x86_64
0x70
11
? bio_alloc_bioset
vmlinux 0xffffffff83e8c455
Build id: 3.10.0-1160.25.1.el7.x86_64
0x115
12
_submit_bh
vmlinux 0xffffffff83e87fc7
Build id: 3.10.0-1160.25.1.el7.x86_64
0x127
13
ll_rw_block
vmlinux 0xffffffff83e88ac9
Build id: 3.10.0-1160.25.1.el7.x86_64
0xa9
14
__block_write_begin_int
vmlinux 0xffffffff83e88e06
Build id: 3.10.0-1160.25.1.el7.x86_64
0x246
15
iomap_write_begin
vmlinux 0xffffffff83ebaf59
Build id: 3.10.0-1160.25.1.el7.x86_64
0xc9
16
iomap_write_actor
vmlinux 0xffffffff83ebb385
Build id: 3.10.0-1160.25.1.el7.x86_64
0xd5
17
? iomap_dirty_actor
vmlinux 0xffffffff83ebb2b0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x1d0
18
iomap_apply
vmlinux 0xffffffff83ebb76a
Build id: 3.10.0-1160.25.1.el7.x86_64
0xba
19
iomap_file_buffered_write
vmlinux 0xffffffff83ebb8b1
Build id: 3.10.0-1160.25.1.el7.x86_64
0xa1
20
? iomap_dirty_actor
vmlinux 0xffffffff83ebb2b0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x1d0
21
xfs_file_buffered_aio_write
xfs 0xffffffffc046e7bd
Build id: 3.10.0-1160.25.1.el7.x86_64
0x12d
22
xfs_file_aio_write
xfs 0xffffffffc046eadd
Build id: 3.10.0-1160.25.1.el7.x86_64
0x18d
23
do_sync_write
vmlinux 0xffffffff83e4d313
Build id: 3.10.0-1160.25.1.el7.x86_64
0x93
24
vfs_write
vmlinux 0xffffffff83e4de00
Build id: 3.10.0-1160.25.1.el7.x86_64
0xc0
25
? system_call_after_swapgs
vmlinux 0xffffffff84395ed5
Build id: 3.10.0-1160.25.1.el7.x86_64
0xa2
26
SyS_write
vmlinux 0xffffffff83e4ebdf
Build id: 3.10.0-1160.25.1.el7.x86_64
0x7f
27
? system_call_after_swapgs
vmlinux 0xffffffff84395ed5
Build id: 3.10.0-1160.25.1.el7.x86_64
0xa2
28
system_call_fastpath
vmlinux 0xffffffff84395f92
Build id: 3.10.0-1160.25.1.el7.x86_64
0x25
29
? system_call_after_swapgs
vmlinux 0xffffffff84395ed5
Build id: 3.10.0-1160.25.1.el7.x86_64
0xa2
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 40s! [oracle:28304]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_12104(E) vmw_vsock_vmci_transport vsock falcon_lsm_pinned_11906(E) sunrpc ppdev crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper vmw_balloon cryptd pcspkr joydev sg i2c_piix4 vmw_vmci parport_pc parport binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci crct10dif_pclmul crct10dif_common drm ata_piix libahci crc32c_intel serio_raw libata vmxnet3 nfit vmw_pvscsi libnvdimm drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: falcon_kal]
CPU: 0 PID: 28304 Comm: oracle Tainted: P            EL ------------   3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8ef511c35280 ti: ffff8ef50dba0000 task.ti: ffff8ef50dba0000
RIP: 0010:[<ffffffff8438b565>]  [<ffffffff8438b565>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff8ef50dba37d0  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffffffff83fb28d3 RCX: ffffffff84834f40
RDX: ffff9fd141b80000 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff8ef50dba37d0 R08: 0000000000000001 R09: 0000000000000000
R10: ffff8ef85eda8400 R11: ffff8ef67abd7800 R12: 0000000000000000
R13: 0000000000000020 R14: ffff8ef61928e480 R15: ffffffff840eb369
FS:  00007fbbab3d2740(0000) GS:ffff8ef93fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000002db9123 CR3: 000000002f2c0000 CR4: 00000000000007f0
Call Trace:
[<ffffffffc0210632>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffff840ec6b0>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffff840e3fa0>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff840ed6cc>] scsi_request_fn+0x4ac/0x680
[<ffffffff83f7853e>] ? deadline_add_request+0x6e/0x90
[<ffffffff83f53939>] __blk_run_queue+0x39/0x50
[<ffffffff83f57743>] blk_queue_bio+0x3b3/0x400
[<ffffffff83f555c7>] generic_make_request+0x147/0x380
[<ffffffff83f55870>] submit_bio+0x70/0x150
[<ffffffff83e8c455>] ? bio_alloc_bioset+0x115/0x310
[<ffffffff83e87fc7>] _submit_bh+0x127/0x160
[<ffffffff83e88ac9>] ll_rw_block+0xa9/0xb0
[<ffffffff83e88e06>] __block_write_begin_int+0x246/0x650
[<ffffffff83ebaf59>] iomap_write_begin+0xc9/0x250
[<ffffffff83ebb385>] iomap_write_actor+0xd5/0x1f0
[<ffffffff83ebb2b0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff83ebb76a>] iomap_apply+0xba/0x160
[<ffffffff83ebb8b1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff83ebb2b0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc046e7bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc046eadd>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff83e4d313>] do_sync_write+0x93/0xe0
[<ffffffff83e4de00>] vfs_write+0xc0/0x1f0
[<ffffffff84395ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff83e4ebdf>] SyS_write+0x7f/0xf0
[<ffffffff84395ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff84395f92>] system_call_fastpath+0x25/0x2a
[<ffffffff84395ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: 07 00 66 66 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 c6 07 00 66 66 66 90 48 89 f7 57 9d <66> 66 90 66 90 5d c3 0f 1f 40 00 66 66 66 66 90 55 48 89 e5 48 
Complete report #216489
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff8b78b565
Build id: 3.10.0-1160.25.1.el7.x86_64
0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc0239632
Build id: 3.10.0-1160.25.1.el7.x86_64
0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffff8b4ec6b0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffff8b4e3fa0
Build id: 3.10.0-1160.25.1.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffff8b4ed6cc
Build id: 3.10.0-1160.25.1.el7.x86_64
0x4ac
6
? deadline_add_request
vmlinux 0xffffffff8b37853e
Build id: 3.10.0-1160.25.1.el7.x86_64
0x6e
7
__blk_run_queue
vmlinux 0xffffffff8b353939
Build id: 3.10.0-1160.25.1.el7.x86_64
0x39
8
blk_queue_bio
vmlinux 0xffffffff8b357743
Build id: 3.10.0-1160.25.1.el7.x86_64
0x3b3
9
generic_make_request
vmlinux 0xffffffff8b3555c7
Build id: 3.10.0-1160.25.1.el7.x86_64
0x147
10
submit_bio
vmlinux 0xffffffff8b355870
Build id: 3.10.0-1160.25.1.el7.x86_64
0x70
11
? bio_alloc_bioset
vmlinux 0xffffffff8b28c455
Build id: 3.10.0-1160.25.1.el7.x86_64
0x115
12
_submit_bh
vmlinux 0xffffffff8b287fc7
Build id: 3.10.0-1160.25.1.el7.x86_64
0x127
13
ll_rw_block
vmlinux 0xffffffff8b288ac9
Build id: 3.10.0-1160.25.1.el7.x86_64
0xa9
14
__block_write_begin_int
vmlinux 0xffffffff8b288e06
Build id: 3.10.0-1160.25.1.el7.x86_64
0x246
15
iomap_write_begin
vmlinux 0xffffffff8b2baf59
Build id: 3.10.0-1160.25.1.el7.x86_64
0xc9
16
iomap_write_actor
vmlinux 0xffffffff8b2bb385
Build id: 3.10.0-1160.25.1.el7.x86_64
0xd5
17
? iomap_dirty_actor
vmlinux 0xffffffff8b2bb2b0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x1d0
18
iomap_apply
vmlinux 0xffffffff8b2bb76a
Build id: 3.10.0-1160.25.1.el7.x86_64
0xba
19
iomap_file_buffered_write
vmlinux 0xffffffff8b2bb8b1
Build id: 3.10.0-1160.25.1.el7.x86_64
0xa1
20
? iomap_dirty_actor
vmlinux 0xffffffff8b2bb2b0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x1d0
21
xfs_file_buffered_aio_write
xfs 0xffffffffc046e7bd
Build id: 3.10.0-1160.25.1.el7.x86_64
0x12d
22
xfs_file_aio_write
xfs 0xffffffffc046eadd
Build id: 3.10.0-1160.25.1.el7.x86_64
0x18d
23
do_sync_write
vmlinux 0xffffffff8b24d313
Build id: 3.10.0-1160.25.1.el7.x86_64
0x93
24
vfs_write
vmlinux 0xffffffff8b24de00
Build id: 3.10.0-1160.25.1.el7.x86_64
0xc0
25
SyS_pwrite64
vmlinux 0xffffffff8b24eda2
Build id: 3.10.0-1160.25.1.el7.x86_64
0x92
26
system_call_fastpath
vmlinux 0xffffffff8b795f92
Build id: 3.10.0-1160.25.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 24s! [ora_lg01_xe:867]
Modules linked in: vsock_diag tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg ppdev joydev pcspkr vmw_balloon i2c_piix4 parport_pc parport vmw_vmci binfmt_misc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common e1000e syscopyarea sysfillrect
crc32c_intel serio_raw sysimgblt ahci fb_sys_fops ttm libahci ptp pps_core drm nfit ata_piix vmw_pvscsi libnvdimm libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 867 Comm: ora_lg01_xe Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/28/2017
task: ffff94d3027fa100 ti: ffff94d33bb80000 task.ti: ffff94d33bb80000
RIP: 0010:[<ffffffff8b78b565>]  [<ffffffff8b78b565>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff94d33bb837c0  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffffffff8b3b28d3 RCX: ffffffff8bc34f40
RDX: ffffbcc8036c0000 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff94d33bb837c0 R08: 0000000000000001 R09: 0000000000000000
R10: ffff94d329fac800 R11: ffff94d9ffca9800 R12: 0000000000000000
R13: 0000000000000020 R14: ffff94d3ffdb6000 R15: ffffffff8b4eb369
FS:  00007effe7e01f40(0000) GS:ffff94d9ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000013989e8 CR3: 000000017a7de000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffc0239632>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffff8b4ec6b0>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffff8b4e3fa0>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff8b4ed6cc>] scsi_request_fn+0x4ac/0x680
[<ffffffff8b37853e>] ? deadline_add_request+0x6e/0x90
[<ffffffff8b353939>] __blk_run_queue+0x39/0x50
[<ffffffff8b357743>] blk_queue_bio+0x3b3/0x400
[<ffffffff8b3555c7>] generic_make_request+0x147/0x380
[<ffffffff8b355870>] submit_bio+0x70/0x150
[<ffffffff8b28c455>] ? bio_alloc_bioset+0x115/0x310
[<ffffffff8b287fc7>] _submit_bh+0x127/0x160
[<ffffffff8b288ac9>] ll_rw_block+0xa9/0xb0
[<ffffffff8b288e06>] __block_write_begin_int+0x246/0x650
[<ffffffff8b2baf59>] iomap_write_begin+0xc9/0x250
[<ffffffff8b2bb385>] iomap_write_actor+0xd5/0x1f0
[<ffffffff8b2bb2b0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff8b2bb76a>] iomap_apply+0xba/0x160
[<ffffffff8b2bb8b1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff8b2bb2b0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc046e7bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc046eadd>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff8b24d313>] do_sync_write+0x93/0xe0
[<ffffffff8b24de00>] vfs_write+0xc0/0x1f0
[<ffffffff8b24eda2>] SyS_pwrite64+0x92/0xc0
[<ffffffff8b795f92>] system_call_fastpath+0x25/0x2a
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48 
Complete report #169212
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc01643be
Build id: 3.10.0-1062.1.1.el7.x86_64
0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc017f71e
Build id: 3.10.0-1062.1.1.el7.x86_64
0x24e
3
mptspi_qcmd
mptspi 0xffffffffc01fe2e0
Build id: 3.10.0-1062.1.1.el7.x86_64
0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff866dc890
Build id: 3.10.0-1062.1.1.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffff866e5efc
Build id: 3.10.0-1062.1.1.el7.x86_64
0x4cc
6
? deadline_add_request
vmlinux 0xffffffff865716de
Build id: 3.10.0-1062.1.1.el7.x86_64
0x6e
7
__blk_run_queue
vmlinux 0xffffffff8654cf59
Build id: 3.10.0-1062.1.1.el7.x86_64
0x39
8
blk_queue_bio
vmlinux 0xffffffff86550c63
Build id: 3.10.0-1062.1.1.el7.x86_64
0x3b3
9
generic_make_request
vmlinux 0xffffffff8654ebf7
Build id: 3.10.0-1062.1.1.el7.x86_64
0x147
10
submit_bio
vmlinux 0xffffffff8654eea0
Build id: 3.10.0-1062.1.1.el7.x86_64
0x70
11
? bio_alloc_bioset
vmlinux 0xffffffff86486325
Build id: 3.10.0-1062.1.1.el7.x86_64
0x115
12
_submit_bh
vmlinux 0xffffffff86481d47
Build id: 3.10.0-1062.1.1.el7.x86_64
0x127
13
ll_rw_block
vmlinux 0xffffffff86482849
Build id: 3.10.0-1062.1.1.el7.x86_64
0xa9
14
__block_write_begin_int
vmlinux 0xffffffff86482b86
Build id: 3.10.0-1062.1.1.el7.x86_64
0x246
15
? __inc_zone_page_state
vmlinux 0xffffffff863ddd72
Build id: 3.10.0-1062.1.1.el7.x86_64
0x32
16
iomap_write_begin
vmlinux 0xffffffff864b4520
Build id: 3.10.0-1062.1.1.el7.x86_64
0x90
17
iomap_write_actor
vmlinux 0xffffffff864b4a05
Build id: 3.10.0-1062.1.1.el7.x86_64
0xd5
18
? iomap_write_end
vmlinux 0xffffffff864b4930
Build id: 3.10.0-1062.1.1.el7.x86_64
0x1f0
19
iomap_apply
vmlinux 0xffffffff864b4fba
Build id: 3.10.0-1062.1.1.el7.x86_64
0xba
20
iomap_file_buffered_write
vmlinux 0xffffffff864b5101
Build id: 3.10.0-1062.1.1.el7.x86_64
0xa1
21
? iomap_write_end
vmlinux 0xffffffff864b4930
Build id: 3.10.0-1062.1.1.el7.x86_64
0x1f0
22
xfs_file_buffered_aio_write
xfs 0xffffffffc03d33bd
Build id: 3.10.0-1062.1.1.el7.x86_64
0x12d
23
? __sb_end_write
vmlinux 0xffffffff8644b631
Build id: 3.10.0-1062.1.1.el7.x86_64
0x31
24
xfs_file_aio_write
xfs 0xffffffffc03d36dd
Build id: 3.10.0-1062.1.1.el7.x86_64
0x18d
25
do_sync_write
vmlinux 0xffffffff86447ba3
Build id: 3.10.0-1062.1.1.el7.x86_64
0x93
26
vfs_write
vmlinux 0xffffffff86448690
Build id: 3.10.0-1062.1.1.el7.x86_64
0xc0
27
? system_call_after_swapgs
vmlinux 0xffffffff8698ce21
Build id: 3.10.0-1062.1.1.el7.x86_64
0xae
28
SyS_write
vmlinux 0xffffffff864494af
Build id: 3.10.0-1062.1.1.el7.x86_64
0x7f
29
? system_call_after_swapgs
vmlinux 0xffffffff8698ce21
Build id: 3.10.0-1062.1.1.el7.x86_64
0xae
30
system_call_fastpath
vmlinux 0xffffffff8698cede
Build id: 3.10.0-1062.1.1.el7.x86_64
0x25
31
? system_call_after_swapgs
vmlinux 0xffffffff8698ce21
Build id: 3.10.0-1062.1.1.el7.x86_64
0xae
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 31s! [denzo_3d:10683]
Modules linked in: vfat fat uas usb_storage tcp_lp lp ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter fuse vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 nfit snd_rawmidi snd_ac97_codec libnvdimm ac97_bus snd_seq ppdev snd_seq_device snd_pcm snd_timer snd vmw_balloon coretemp pcspkr soundcore joydev sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod
crc_t10dif crct10dif_generic sr_mod cdrom ata_generic crct10dif_common pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crc32c_intel drm ata_piix e1000 mptspi scsi_transport_spi libata mptscsih serio_raw mptbase drm_panel_orientation_quirks
CPU: 3 PID: 10683 Comm: denzo_3d Kdump: loaded Tainted: G             L ------------   3.10.0-1062.1.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff930ff34941c0 ti: ffff9312a3f50000 task.ti: ffff9312a3f50000
RIP: 0010:[<ffffffffc01643be>]  [<ffffffffc01643be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff9312a3f53768  EFLAGS: 00000246
RAX: ffffab1601900000 RBX: ffff9312a6aaa688 RCX: 000000000000000c
RDX: ffff930f75d62200 RSI: ffff931369ed0000 RDI: 000000000000000e
RBP: ffff9312a3f53778 R08: 0000000000000002 R09: 00000002f7c9dfff
R10: ffff93136f5e90d8 R11: ffff9312f63a5340 R12: ffff9312ccf60300
R13: ffff9312a3f536dc R14: ffffffff865557ab R15: ffff9312a3f53720
FS:  00007f10b4384740(0000) GS:ffff93136d6c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5e673d4000 CR3: 00000003b1e78000 CR4: 00000000000007e0
Call Trace:
[<ffffffffc017f71e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc01fe2e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffff866dc890>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff866e5efc>] scsi_request_fn+0x4cc/0x680
[<ffffffff865716de>] ? deadline_add_request+0x6e/0x90
[<ffffffff8654cf59>] __blk_run_queue+0x39/0x50
[<ffffffff86550c63>] blk_queue_bio+0x3b3/0x400
[<ffffffff8654ebf7>] generic_make_request+0x147/0x380
[<ffffffff8654eea0>] submit_bio+0x70/0x150
[<ffffffff86486325>] ? bio_alloc_bioset+0x115/0x310
[<ffffffff86481d47>] _submit_bh+0x127/0x160
[<ffffffff86482849>] ll_rw_block+0xa9/0xb0
[<ffffffff86482b86>] __block_write_begin_int+0x246/0x650
[<ffffffff863ddd72>] ? __inc_zone_page_state+0x32/0x60
[<ffffffff864b4520>] iomap_write_begin+0x90/0x210
[<ffffffff864b4a05>] iomap_write_actor+0xd5/0x1f0
[<ffffffff864b4930>] ? iomap_write_end+0x1f0/0x1f0
[<ffffffff864b4fba>] iomap_apply+0xba/0x160
[<ffffffff864b5101>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff864b4930>] ? iomap_write_end+0x1f0/0x1f0
[<ffffffffc03d33bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffff8644b631>] ? __sb_end_write+0x31/0x70
[<ffffffffc03d36dd>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff86447ba3>] do_sync_write+0x93/0xe0
[<ffffffff86448690>] vfs_write+0xc0/0x1f0
[<ffffffff8698ce21>] ? system_call_after_swapgs+0xae/0x146
[<ffffffff864494af>] SyS_write+0x7f/0xf0
[<ffffffff8698ce21>] ? system_call_after_swapgs+0xae/0x146
[<ffffffff8698cede>] system_call_fastpath+0x25/0x2a
[<ffffffff8698ce21>] ? system_call_after_swapgs+0xae/0x146
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 23 17 
Complete report #142811
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc027e3be
Build id: 3.10.0-1160.15.2.el7.x86_64
0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc02d571e
Build id: 3.10.0-1160.15.2.el7.x86_64
0x24e
3
mptspi_qcmd
mptspi 0xffffffffc033c2e0
Build id: 3.10.0-1160.15.2.el7.x86_64
0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff94ae3e70
Build id: 3.10.0-1160.15.2.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffff94aed59c
Build id: 3.10.0-1160.15.2.el7.x86_64
0x4ac
6
? deadline_add_request
vmlinux 0xffffffff9497846e
Build id: 3.10.0-1160.15.2.el7.x86_64
0x6e
7
__blk_run_queue
vmlinux 0xffffffff94953869
Build id: 3.10.0-1160.15.2.el7.x86_64
0x39
8
blk_queue_bio
vmlinux 0xffffffff94957673
Build id: 3.10.0-1160.15.2.el7.x86_64
0x3b3
9
generic_make_request
vmlinux 0xffffffff949554f7
Build id: 3.10.0-1160.15.2.el7.x86_64
0x147
10
submit_bio
vmlinux 0xffffffff949557a0
Build id: 3.10.0-1160.15.2.el7.x86_64
0x70
11
? bio_alloc_bioset
vmlinux 0xffffffff9488c385
Build id: 3.10.0-1160.15.2.el7.x86_64
0x115
12
_submit_bh
vmlinux 0xffffffff94887ef7
Build id: 3.10.0-1160.15.2.el7.x86_64
0x127
13
ll_rw_block
vmlinux 0xffffffff948889f9
Build id: 3.10.0-1160.15.2.el7.x86_64
0xa9
14
__block_write_begin_int
vmlinux 0xffffffff94888d36
Build id: 3.10.0-1160.15.2.el7.x86_64
0x246
15
iomap_write_begin
vmlinux 0xffffffff948bae89
Build id: 3.10.0-1160.15.2.el7.x86_64
0xc9
16
iomap_write_actor
vmlinux 0xffffffff948bb2b5
Build id: 3.10.0-1160.15.2.el7.x86_64
0xd5
17
? iomap_dirty_actor
vmlinux 0xffffffff948bb1e0
Build id: 3.10.0-1160.15.2.el7.x86_64
0x1d0
18
iomap_apply
vmlinux 0xffffffff948bb69a
Build id: 3.10.0-1160.15.2.el7.x86_64
0xba
19
iomap_file_buffered_write
vmlinux 0xffffffff948bb7e1
Build id: 3.10.0-1160.15.2.el7.x86_64
0xa1
20
? iomap_dirty_actor
vmlinux 0xffffffff948bb1e0
Build id: 3.10.0-1160.15.2.el7.x86_64
0x1d0
21
xfs_file_buffered_aio_write
xfs 0xffffffffc05207bd
Build id: 3.10.0-1160.15.2.el7.x86_64
0x12d
22
xfs_file_aio_write
xfs 0xffffffffc0520add
Build id: 3.10.0-1160.15.2.el7.x86_64
0x18d
23
do_sync_write
vmlinux 0xffffffff9484d243
Build id: 3.10.0-1160.15.2.el7.x86_64
0x93
24
vfs_write
vmlinux 0xffffffff9484dd30
Build id: 3.10.0-1160.15.2.el7.x86_64
0xc0
25
SyS_write
vmlinux 0xffffffff9484eb0f
Build id: 3.10.0-1160.15.2.el7.x86_64
0x7f
26
system_call_fastpath
vmlinux 0xffffffff94d94f92
Build id: 3.10.0-1160.15.2.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 30s! [logasio:1711]
Modules linked in: lp xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock bnep sunrpc dm_mirror dm_region_hash dm_log dm_mod iosf_mbi crc32_pclmul snd_seq_midi snd_seq_midi_event ghash_clmulni_intel ppdev aesni_intel lrw gf128mul vmw_balloon glue_helper snd_ens1371 ablk_helper snd_rawmidi cryptd snd_ac97_codec btusb ac97_bus
btrtl snd_seq btbcm btintel bluetooth snd_seq_device joydev pcspkr snd_pcm rfkill snd_timer snd soundcore sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel nfit drm ata_piix libnvdimm mptspi serio_raw libata scsi_transport_spi mptscsih e1000 drm_panel_orientation_quirks mptbase fuse
CPU: 1 PID: 1711 Comm: logasio Kdump: loaded Not tainted 3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff8fb558544200 ti: ffff8fb55c83c000 task.ti: ffff8fb55c83c000
RIP: 0010:[<ffffffffc027e3be>]  [<ffffffffc027e3be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff8fb55c83f768  EFLAGS: 00000246
RAX: ffffa90280440000 RBX: ffff8fb552f97c88 RCX: 0000000000000019
RDX: ffff8fb534c1a000 RSI: ffff8fb534c38000 RDI: 000000000000000e
RBP: ffff8fb55c83f778 R08: 0000000000000002 R09: 0000000059618fff
R10: ffff8fb572a80400 R11: ffff8fb5666e3d40 R12: ffff8fb519907300
R13: ffff8fb55c83f6dc R14: ffffffff9495c28b R15: ffff8fb55c83f720
FS:  00007f3a346b7740(0000) GS:ffff8fb57b640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00003a1a6c173000 CR3: 000000005cb34000 CR4: 00000000003607e0
Call Trace:
[<ffffffffc02d571e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc033c2e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffff94ae3e70>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff94aed59c>] scsi_request_fn+0x4ac/0x680
[<ffffffff9497846e>] ? deadline_add_request+0x6e/0x90
[<ffffffff94953869>] __blk_run_queue+0x39/0x50
[<ffffffff94957673>] blk_queue_bio+0x3b3/0x400
[<ffffffff949554f7>] generic_make_request+0x147/0x380
[<ffffffff949557a0>] submit_bio+0x70/0x150
[<ffffffff9488c385>] ? bio_alloc_bioset+0x115/0x310
[<ffffffff94887ef7>] _submit_bh+0x127/0x160
[<ffffffff948889f9>] ll_rw_block+0xa9/0xb0
[<ffffffff94888d36>] __block_write_begin_int+0x246/0x650
[<ffffffff948bae89>] iomap_write_begin+0xc9/0x250
[<ffffffff948bb2b5>] iomap_write_actor+0xd5/0x1f0
[<ffffffff948bb1e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff948bb69a>] iomap_apply+0xba/0x160
[<ffffffff948bb7e1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff948bb1e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc05207bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc0520add>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff9484d243>] do_sync_write+0x93/0xe0
[<ffffffff9484dd30>] vfs_write+0xc0/0x1f0
[<ffffffff9484eb0f>] SyS_write+0x7f/0xf0
[<ffffffff94d94f92>] system_call_fastpath+0x25/0x2a
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 c3 28 
Complete report #134086
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffbb1883c5
Build id: 3.10.0-1127.19.1.el7.x86_64
0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc005d632
Build id: 3.10.0-1127.19.1.el7.x86_64
0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffffbaeeb0a0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffffbaee2990
Build id: 3.10.0-1127.19.1.el7.x86_64
0xb0
5
scsi_request_fn
vmlinux 0xffffffffbaeec0bc
Build id: 3.10.0-1127.19.1.el7.x86_64
0x4ac
6
? deadline_add_request
vmlinux 0xffffffffbad771ae
Build id: 3.10.0-1127.19.1.el7.x86_64
0x6e
7
__blk_run_queue
vmlinux 0xffffffffbad527a9
Build id: 3.10.0-1127.19.1.el7.x86_64
0x39
8
blk_queue_bio
vmlinux 0xffffffffbad564b3
Build id: 3.10.0-1127.19.1.el7.x86_64
0x3b3
9
generic_make_request
vmlinux 0xffffffffbad54437
Build id: 3.10.0-1127.19.1.el7.x86_64
0x147
10
submit_bio
vmlinux 0xffffffffbad546e0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x70
11
? bio_alloc_bioset
vmlinux 0xffffffffbac8b845
Build id: 3.10.0-1127.19.1.el7.x86_64
0x115
12
_submit_bh
vmlinux 0xffffffffbac87267
Build id: 3.10.0-1127.19.1.el7.x86_64
0x127
13
ll_rw_block
vmlinux 0xffffffffbac87d69
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa9
14
__block_write_begin_int
vmlinux 0xffffffffbac880a6
Build id: 3.10.0-1127.19.1.el7.x86_64
0x246
15
iomap_write_begin
vmlinux 0xffffffffbacba089
Build id: 3.10.0-1127.19.1.el7.x86_64
0xc9
16
iomap_write_actor
vmlinux 0xffffffffbacba4b5
Build id: 3.10.0-1127.19.1.el7.x86_64
0xd5
17
? iomap_dirty_actor
vmlinux 0xffffffffbacba3e0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1d0
18
iomap_apply
vmlinux 0xffffffffbacba89a
Build id: 3.10.0-1127.19.1.el7.x86_64
0xba
19
iomap_file_buffered_write
vmlinux 0xffffffffbacba9e1
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa1
20
? iomap_dirty_actor
vmlinux 0xffffffffbacba3e0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1d0
21
xfs_file_buffered_aio_write
xfs 0xffffffffc032b7ed
Build id: 3.10.0-1127.19.1.el7.x86_64
0x12d
22
xfs_file_aio_write
xfs 0xffffffffc032bb0d
Build id: 3.10.0-1127.19.1.el7.x86_64
0x18d
23
do_sync_write
vmlinux 0xffffffffbac4c713
Build id: 3.10.0-1127.19.1.el7.x86_64
0x93
24
vfs_write
vmlinux 0xffffffffbac4d200
Build id: 3.10.0-1127.19.1.el7.x86_64
0xc0
25
SyS_write
vmlinux 0xffffffffbac4dfcf
Build id: 3.10.0-1127.19.1.el7.x86_64
0x7f
26
system_call_fastpath
vmlinux 0xffffffffbb192ed2
Build id: 3.10.0-1127.19.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [ora_lg01_xe:10043]
Modules linked in: vsock_diag tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw ppdev gf128mul glue_helper ablk_helper cryptd pcspkr joydev vmw_balloon sg parport_pc parport i2c_piix4 vmw_vmci binfmt_misc ip_tables xfs libcrc32c ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix ahci
drm libahci crct10dif_pclmul crct10dif_common e1000e nfit crc32c_intel libnvdimm libata serio_raw ptp pps_core vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 10043 Comm: ora_lg01_xe Kdump: loaded Tainted: G             L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8e7846315230 ti: ffff8e77fa0ac000 task.ti: ffff8e77fa0ac000
RIP: 0010:[<ffffffffbb1883c5>]  [<ffffffffbb1883c5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff8e77fa0af7d0  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffffffffbadb14b3 RCX: ffff8e7639dc1060
RDX: ffffa64701b90000 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff8e77fa0af7d0 R08: 0000000000000000 R09: ffff8e784a898900
R10: ffff8e78e9709c00 R11: ffff8e78e9928000 R12: 0000000000000000
R13: 0000000000000020 R14: ffff8e76ff9fea80 R15: ffffffffbaee9d59
FS:  00007f6155c2ef40(0000) GS:ffff8e78ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f34aa23f000 CR3: 00000003c09de000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffc005d632>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffffbaeeb0a0>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffffbaee2990>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffbaeec0bc>] scsi_request_fn+0x4ac/0x680
[<ffffffffbad771ae>] ? deadline_add_request+0x6e/0x90
[<ffffffffbad527a9>] __blk_run_queue+0x39/0x50
[<ffffffffbad564b3>] blk_queue_bio+0x3b3/0x400
[<ffffffffbad54437>] generic_make_request+0x147/0x380
[<ffffffffbad546e0>] submit_bio+0x70/0x150
[<ffffffffbac8b845>] ? bio_alloc_bioset+0x115/0x310
[<ffffffffbac87267>] _submit_bh+0x127/0x160
[<ffffffffbac87d69>] ll_rw_block+0xa9/0xb0
[<ffffffffbac880a6>] __block_write_begin_int+0x246/0x650
[<ffffffffbacba089>] iomap_write_begin+0xc9/0x250
[<ffffffffbacba4b5>] iomap_write_actor+0xd5/0x1f0
[<ffffffffbacba3e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffbacba89a>] iomap_apply+0xba/0x160
[<ffffffffbacba9e1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffffbacba3e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc032b7ed>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc032bb0d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffffbac4c713>] do_sync_write+0x93/0xe0
[<ffffffffbac4d200>] vfs_write+0xc0/0x1f0
[<ffffffffbac4dfcf>] SyS_write+0x7f/0xf0
[<ffffffffbb192ed2>] system_call_fastpath+0x25/0x2a
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48