Info

Permalink
Function
mpt_put_msg_frame
First occurrence
2020-09-26
Last occurrence
2024-04-08
State
NEW
Components
kernel
Quality
-64

Statistics

Operating system Count
CentOS 7 75
Architecture Count
x86_64 75
Related packages Count
kernel 75
 0:3.10.0-1062.4.1.el7 15
 0:3.10.0-1160.el7 12
 0:3.10.0-862.el7 8
 0:3.10.0-957.el7 8
 0:3.10.0-1160.62.1.el7 6
 0:3.10.0-1062.el7 4
 0:3.10.0-1127.el7 4
 0:3.10.0-1160.108.1.el7 3
 0:3.10.0-1160.45.1.el7 2
 0:3.10.0-1127.19.1.el7 1
 0:3.10.0-1160.6.1.el7 1
 0:3.10.0-1160.71.1.el7 1
 0:3.10.0-1160.76.1.el7 1
 0:3.10.0-1160.80.1.el7 1
 0:3.10.0-1160.92.1.el7 1
 0:3.10.0-514.26.2.el7 1
 0:3.10.0-514.el7 1
 0:3.10.0-1127.10.1.el7 1
 0:3.10.0-1160.21.1.el7 1
 0:3.10.0-1160.31.1.el7 1
 0:3.10.0-1160.66.1.el7 1
 0:3.10.0-1160.53.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #76803
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffa006c3be
Build id: 3.10.0-514.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffa00aa729
Build id: 3.10.0-514.el7.x86_64 		0x249
3
mptspi_qcmd
mptspi 0xffffffffa00442b0
Build id: 3.10.0-514.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff814518da
Build id: 3.10.0-514.el7.x86_64 		0xaa
5
scsi_request_fn
vmlinux 0xffffffff8145a9e1
Build id: 3.10.0-514.el7.x86_64 		0x501
6
__blk_run_queue
vmlinux 0xffffffff812eb053
Build id: 3.10.0-514.el7.x86_64 		0x33
7
queue_unplugged
vmlinux 0xffffffff812eb10a
Build id: 3.10.0-514.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff812eff68
Build id: 3.10.0-514.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffff812f01da
Build id: 3.10.0-514.el7.x86_64 		0x21a
10
generic_make_request
vmlinux 0xffffffff812ee4f9
Build id: 3.10.0-514.el7.x86_64 		0x109
11
submit_bio
vmlinux 0xffffffff812ee641
Build id: 3.10.0-514.el7.x86_64 		0x71
12
? lru_cache_add
vmlinux 0xffffffff8118f89e
Build id: 3.10.0-514.el7.x86_64 		0xe
13
mpage_readpages
vmlinux 0xffffffff8123fce4
Build id: 3.10.0-514.el7.x86_64 		0x124
14
? __xfs_get_blocks
xfs 0xffffffffa0287880
Build id: 3.10.0-514.el7.x86_64 		0x7e0
15
? __xfs_get_blocks
xfs 0xffffffffa0287880
Build id: 3.10.0-514.el7.x86_64 		0x7e0
16
? alloc_pages_current
vmlinux 0xffffffff811cf10a
Build id: 3.10.0-514.el7.x86_64 		0xaa
17
xfs_vm_readpages
xfs 0xffffffffa0286578
Build id: 3.10.0-514.el7.x86_64 		0x38
18
__do_page_cache_readahead
vmlinux 0xffffffff8118d62c
Build id: 3.10.0-514.el7.x86_64 		0x1cc
19
ra_submit
vmlinux 0xffffffff8118dcc1
Build id: 3.10.0-514.el7.x86_64 		0x21
20
filemap_fault
vmlinux 0xffffffff81182ff5
Build id: 3.10.0-514.el7.x86_64 		0x105
21
xfs_filemap_fault
xfs 0xffffffffa029263f
Build id: 3.10.0-514.el7.x86_64 		0x5f
22
__do_fault
vmlinux 0xffffffff811ac19c
Build id: 3.10.0-514.el7.x86_64 		0x4c
23
? mem_cgroup_charge_common
vmlinux 0xffffffff811f23d7
Build id: 3.10.0-514.el7.x86_64 		0x77
24
do_cow_fault
vmlinux 0xffffffff811acbe1
Build id: 3.10.0-514.el7.x86_64 		0xa1
25
handle_mm_fault
vmlinux 0xffffffff811b09d6
Build id: 3.10.0-514.el7.x86_64 		0x2c6
26
? do_mmap_pgoff
vmlinux 0xffffffff811b76d5
Build id: 3.10.0-514.el7.x86_64 		0x305
27
__do_page_fault
vmlinux 0xffffffff81691a94
Build id: 3.10.0-514.el7.x86_64 		0x154
28
do_page_fault
vmlinux 0xffffffff81691dc5
Build id: 3.10.0-514.el7.x86_64 		0x35
29
page_fault
vmlinux 0xffffffff8168e088
Build id: 3.10.0-514.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 26s! [nm-dispatcher:3156]
Modules linked in: nls_utf8 isofs fuse tun ip_set nfnetlink bridge stp llc vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event snd_ens1371 crc32_pclmul ghash_clmulni_intel snd_rawmidi aesni_intel snd_ac97_codec ac97_bus lrw gf128mul snd_seq glue_helper ablk_helper snd_seq_device cryptd snd_pcm snd_timer ppdev snd soundcore vmw_balloon sg pcspkr nfit libnvdimm parport_pc parport i2c_piix4 shpchp vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel vmwgfx serio_raw drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm mptspi scsi_transport_spi libata mptscsih e1000 mptbase i2c_core fjes dm_mirror dm_region_hash dm_log dm_mod
[last unloaded: ip_tables]
CPU: 1 PID: 3156 Comm: nm-dispatcher Not tainted 3.10.0-514.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff88001281de20 ti: ffff880039170000 task.ti: ffff880039170000
RIP: 0010:[<ffffffffa006c3be>]  [<ffffffffa006c3be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0000:ffff880039173800  EFLAGS: 00000246
RAX: ffffc90000200000 RBX: ffff8800373ea600 RCX: 000000000000001b
RDX: ffff880036299800 RSI: ffff880036229000 RDI: 000000000000000e
RBP: ffff880039173810 R08: 0000000000000002 R09: 000000003fc92fff
R10: ffff880034cf9dc0 R11: ffff880034cf9dc0 R12: 0000000100000001
R13: ffff88000e716400 R14: ffff880039173774 R15: ffffffff812f4a0b
FS:  00007f4f24108940(0000) GS:ffff88003c640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007ffa66acb578 CR3: 000000000e687000 CR4: 00000000000407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff880036229d30 0000000000000038 ffff8800391738b8 ffffffffa00aa729
ffff880036229008 0000000039173878 000000000000001b ffff880034cf9dc0
000000000000006c ffff880036229188 000000600000001b ffff880034c43250
Call Trace:
[<ffffffffa00aa729>] mptscsih_qcmd+0x249/0x820 [mptscsih]
[<ffffffffa00442b0>] mptspi_qcmd+0x50/0xe0 [mptspi]
[<ffffffff814518da>] scsi_dispatch_cmd+0xaa/0x230
[<ffffffff8145a9e1>] scsi_request_fn+0x501/0x770
[<ffffffff812eb053>] __blk_run_queue+0x33/0x40
[<ffffffff812eb10a>] queue_unplugged+0x2a/0xa0
[<ffffffff812eff68>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff812f01da>] blk_queue_bio+0x21a/0x3a0
[<ffffffff812ee4f9>] generic_make_request+0x109/0x1e0
[<ffffffff812ee641>] submit_bio+0x71/0x150
[<ffffffff8118f89e>] ? lru_cache_add+0xe/0x10
[<ffffffff8123fce4>] mpage_readpages+0x124/0x160
[<ffffffffa0287880>] ? __xfs_get_blocks+0x7e0/0x7e0 [xfs]
[<ffffffffa0287880>] ? __xfs_get_blocks+0x7e0/0x7e0 [xfs]
[<ffffffff811cf10a>] ? alloc_pages_current+0xaa/0x170
[<ffffffffa0286578>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffff8118d62c>] __do_page_cache_readahead+0x1cc/0x250
[<ffffffff8118dcc1>] ra_submit+0x21/0x30
[<ffffffff81182ff5>] filemap_fault+0x105/0x410
[<ffffffffa029263f>] xfs_filemap_fault+0x5f/0xf0 [xfs]
[<ffffffff811ac19c>] __do_fault+0x4c/0xc0
[<ffffffff811f23d7>] ? mem_cgroup_charge_common+0x77/0xc0
[<ffffffff811acbe1>] do_cow_fault+0xa1/0x270
[<ffffffff811b09d6>] handle_mm_fault+0x2c6/0xfe0
[<ffffffff811b76d5>] ? do_mmap_pgoff+0x305/0x3c0
[<ffffffff81691a94>] __do_page_fault+0x154/0x450
[<ffffffff81691dc5>] do_page_fault+0x35/0x90
[<ffffffff8168e088>] page_fault+0x28/0x30
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 a3 07
Complete report #1139053
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffa4781125
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x15
2
ata_scsi_queuecmd
libata 0xffffffffc0409d65
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x155
3
? ata_scsi_invalid_field
libata 0xffffffffc0406a40
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffa44dd100
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffa44e676c
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffffa434d7b9
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffa434d87a
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffa43510c8
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffffa43512a2
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffffa434f467
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x147
11
? __xfs_get_blocks
xfs 0xffffffffc04bca80
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x6d0
12
submit_bio
vmlinux 0xffffffffa434f710
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x70
13
? __add_to_page_cache_locked
vmlinux 0xffffffffa41bc9bc
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xec
14
mpage_bio_submit
vmlinux 0xffffffffa428dd3a
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x2a
15
mpage_readpages
vmlinux 0xffffffffa428eedf
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x13f
16
? __xfs_get_blocks
xfs 0xffffffffc04bca80
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x6d0
17
? __xfs_get_blocks
xfs 0xffffffffc04bca80
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x6d0
18
? alloc_pages_current
vmlinux 0xffffffffa4215258
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x98
19
xfs_vm_readpages
xfs 0xffffffffc04bbdf8
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x38
20
__do_page_cache_readahead
vmlinux 0xffffffffa41c975f
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x1cf
21
ra_submit
vmlinux 0xffffffffa41c9dc1
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x21
22
filemap_fault
vmlinux 0xffffffffa41be775
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x105
23
? down_read
vmlinux 0xffffffffa477dc82
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x12
24
__xfs_filemap_fault
xfs 0xffffffffc04c755e
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x7e
25
xfs_filemap_fault
xfs 0xffffffffc04c775c
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x2c
26
__do_fault.isra.61
vmlinux 0xffffffffa41ea88a
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x8a
27
do_read_fault.isra.63
vmlinux 0xffffffffa41eae3c
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x4c
28
handle_pte_fault
vmlinux 0xffffffffa41ef8ea
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x22a
29
handle_mm_fault
vmlinux 0xffffffffa41f25fd
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x39d
30
__do_page_fault
vmlinux 0xffffffffa4786653
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x213
31
do_page_fault
vmlinux 0xffffffffa4786975
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x35
32
? error_swapgs
vmlinux 0xffffffffa4782ac9
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xaa
33
page_fault
vmlinux 0xffffffffa4782778
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [Chrome_IOThread:26221]
Modules linked in: tcp_lp binfmt_misc fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc vboxvideo(OE) crc32_pclmul ghash_clmulni_intel ttm ppdev drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel vboxguest(OE) lrw gf128mul glue_helper ablk_helper cryptd drm joydev sg pcspkr parport_pc parport video i2c_piix4 drm_panel_orientation_quirks
ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic ahci libahci crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw e1000 dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 26221 Comm: Chrome_IOThread Kdump: loaded Tainted: G           OEL ------------   3.10.0-1062.4.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff99a938a220e0 ti: ffff99a91f8c8000 task.ti: ffff99a91f8c8000
RIP: 0010:[<ffffffffa4781125>]  [<ffffffffa4781125>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0000:ffff99a91f8cb708  EFLAGS: 00010286
RAX: 0000000000000001 RBX: ffffffffc03f2754 RCX: 0000000000000000
RDX: ffff99a8f5eec418 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff99a91f8cb708 R08: ffffffffffffffff R09: 0000000055681fff
R10: ffff99a8f60840d8 R11: ffff99a93836c700 R12: ffff99a8f632dc80
R13: ffff99a8f5838000 R14: ffff99a8f6084000 R15: ffffffffa44e44ce
FS:  00007fe8455e2700(0000) GS:ffff99a93fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f42b0f3f160 CR3: 0000000001926000 CR4: 00000000000206f0
Call Trace:
[<ffffffffc0409d65>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc0406a40>] ? ata_scsi_invalid_field+0x50/0x50 [libata]
[<ffffffffa44dd100>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffa44e676c>] scsi_request_fn+0x4cc/0x680
[<ffffffffa434d7b9>] __blk_run_queue+0x39/0x50
[<ffffffffa434d87a>] queue_unplugged+0x2a/0xa0
[<ffffffffa43510c8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffa43512a2>] blk_queue_bio+0x182/0x400
[<ffffffffa434f467>] generic_make_request+0x147/0x380
[<ffffffffc04bca80>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffa434f710>] submit_bio+0x70/0x150
[<ffffffffa41bc9bc>] ? __add_to_page_cache_locked+0xec/0x190
[<ffffffffa428dd3a>] mpage_bio_submit+0x2a/0x40
[<ffffffffa428eedf>] mpage_readpages+0x13f/0x170
[<ffffffffc04bca80>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc04bca80>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffa4215258>] ? alloc_pages_current+0x98/0x110
[<ffffffffc04bbdf8>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffffa41c975f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffffa41c9dc1>] ra_submit+0x21/0x30
[<ffffffffa41be775>] filemap_fault+0x105/0x490
[<ffffffffa477dc82>] ? down_read+0x12/0x40
[<ffffffffc04c755e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc04c775c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffffa41ea88a>] __do_fault.isra.61+0x8a/0x100
[<ffffffffa41eae3c>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffffa41ef8ea>] handle_pte_fault+0x22a/0xe20
[<ffffffffa41f25fd>] handle_mm_fault+0x39d/0x9b0
[<ffffffffa4786653>] __do_page_fault+0x213/0x500
[<ffffffffa4786975>] do_page_fault+0x35/0x90
[<ffffffffa4782ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffa4782778>] page_fault+0x28/0x30
Code: 36 44 99 ff 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 e8 16 44 99 ff 66 90 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #997493
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff8df8b7d5
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc017c632
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffff8dcecf70
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffff8dce4860
Build id: 3.10.0-1160.53.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff8dcedf8c
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffff8db53f39
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffff8db53ffa
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff8db578d8
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffff8db57ab2
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffff8db55bc7
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x147
11
? __xfs_get_blocks
xfs 0xffffffffc03e6ce0
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x6d0
12
submit_bio
vmlinux 0xffffffff8db55e70
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x70
13
mpage_bio_submit
vmlinux 0xffffffff8da93eea
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x2a
14
mpage_readpages
vmlinux 0xffffffff8da9508f
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x13f
15
? __xfs_get_blocks
xfs 0xffffffffc03e6ce0
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x6d0
16
? __xfs_get_blocks
xfs 0xffffffffc03e6ce0
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x6d0
17
? alloc_pages_current
vmlinux 0xffffffff8da193b8
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x98
18
xfs_vm_readpages
xfs 0xffffffffc03e6058
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x38
19
__do_page_cache_readahead
vmlinux 0xffffffff8d9cbe1f
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x1cf
20
ra_submit
vmlinux 0xffffffff8d9cc451
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x21
21
filemap_fault
vmlinux 0xffffffff8d9c0e35
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x105
22
? tlb_finish_mmu
vmlinux 0xffffffff8d9f0263
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x23
23
__xfs_filemap_fault
xfs 0xffffffffc03f191e
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x7e
24
xfs_filemap_fault
xfs 0xffffffffc03f1b1c
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x2c
25
__do_fault.isra.61
vmlinux 0xffffffff8d9ee7aa
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x8a
26
do_cow_fault
vmlinux 0xffffffff8d9ef664
Build id: 3.10.0-1160.53.1.el7.x86_64 		0xb4
27
handle_mm_fault
vmlinux 0xffffffff8d9f667e
Build id: 3.10.0-1160.53.1.el7.x86_64 		0xafe
28
? do_mmap
vmlinux 0xffffffff8d9fd36c
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x39c
29
? mprotect_fixup
vmlinux 0xffffffff8d9fed49
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x1b9
30
__do_page_fault
vmlinux 0xffffffff8df90653
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x213
31
do_page_fault
vmlinux 0xffffffff8df90975
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x35
32
page_fault
vmlinux 0xffffffff8df8c778
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 29s! [abrt-action-sav:24153]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter tun bridge stp llc nfsv3 nfs_acl nfs lockd grace fscache vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr joydev vmw_balloon sg i2c_piix4 parport_pc parport vmw_vmci auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ahci ttm sd_mod nfit crc_t10dif crct10dif_generic libahci libnvdimm
drm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel libata serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks fuse
CPU: 4 PID: 24153 Comm: abrt-action-sav Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.53.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff99e0b0e3d280 ti: ffff99df194b8000 task.ti: ffff99df194b8000
RIP: 0010:[<ffffffff8df8b7d5>]  [<ffffffff8df8b7d5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0000:ffff99df194bb758  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffff99df194bb718 RCX: ffffffff8e434f40
RDX: ffffbc0b81ba0000 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff99df194bb758 R08: 0000000000000001 R09: 0000000000000000
R10: ffff99de35efd000 R11: ffff99df78d9e000 R12: 0000000000000020
R13: ffff99e0b0c5d800 R14: ffffffff8dcebc29 R15: ffff99df194bb6d0
FS:  00007fc1f5c4e900(0000) GS:ffff99e0bfd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc1e79eb138 CR3: 0000000010b7e000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffffc017c632>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffff8dcecf70>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffff8dce4860>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff8dcedf8c>] scsi_request_fn+0x4ac/0x680
[<ffffffff8db53f39>] __blk_run_queue+0x39/0x50
[<ffffffff8db53ffa>] queue_unplugged+0x2a/0xa0
[<ffffffff8db578d8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff8db57ab2>] blk_queue_bio+0x182/0x400
[<ffffffff8db55bc7>] generic_make_request+0x147/0x380
[<ffffffffc03e6ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffff8db55e70>] submit_bio+0x70/0x150
[<ffffffff8da93eea>] mpage_bio_submit+0x2a/0x40
[<ffffffff8da9508f>] mpage_readpages+0x13f/0x170
[<ffffffffc03e6ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc03e6ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffff8da193b8>] ? alloc_pages_current+0x98/0x110
[<ffffffffc03e6058>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffff8d9cbe1f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffff8d9cc451>] ra_submit+0x21/0x30
[<ffffffff8d9c0e35>] filemap_fault+0x105/0x420
[<ffffffff8d9f0263>] ? tlb_finish_mmu+0x23/0x30
[<ffffffffc03f191e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc03f1b1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffff8d9ee7aa>] __do_fault.isra.61+0x8a/0x100
[<ffffffff8d9ef664>] do_cow_fault+0xb4/0x320
[<ffffffff8d9f667e>] handle_mm_fault+0xafe/0xfb0
[<ffffffff8d9fd36c>] ? do_mmap+0x39c/0x590
[<ffffffff8d9fed49>] ? mprotect_fixup+0x1b9/0x3a0
[<ffffffff8df90653>] __do_page_fault+0x213/0x500
[<ffffffff8df90975>] do_page_fault+0x35/0x90
[<ffffffff8df8c778>] page_fault+0x28/0x30
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #460743
Frame # Function Binary Source or offset Line
1
mptscsih_qcmd
mptscsih 0xffffffffc0296725
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x255
2
mptspi_qcmd
mptspi 0xffffffffc028f2e0
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x50
3
scsi_dispatch_cmd
vmlinux 0xffffffff8bce4650
Build id: 3.10.0-1160.66.1.el7.x86_64 		0xb0
4
scsi_request_fn
vmlinux 0xffffffff8bcedd7c
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x4ac
5
__blk_run_queue
vmlinux 0xffffffff8bb53d09
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x39
6
queue_unplugged
vmlinux 0xffffffff8bb53dca
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x2a
7
blk_flush_plug_list
vmlinux 0xffffffff8bb576c8
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x1d8
8
blk_queue_bio
vmlinux 0xffffffff8bb578a2
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x182
9
generic_make_request
vmlinux 0xffffffff8bb559b7
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x147
10
submit_bio
vmlinux 0xffffffff8bb55c60
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x70
11
? __add_to_page_cache_locked
vmlinux 0xffffffff8b9bed47
Build id: 3.10.0-1160.66.1.el7.x86_64 		0xd7
12
mpage_bio_submit
vmlinux 0xffffffff8ba93d8a
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x2a
13
mpage_readpages
vmlinux 0xffffffff8ba94f2f
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x13f
14
? __xfs_get_blocks
xfs 0xffffffffc0512ce0
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x6d0
15
? __xfs_get_blocks
xfs 0xffffffffc0512ce0
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x6d0
16
? alloc_pages_current
vmlinux 0xffffffff8ba193b8
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x98
17
xfs_vm_readpages
xfs 0xffffffffc0512058
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x38
18
__do_page_cache_readahead
vmlinux 0xffffffff8b9cbe3f
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x1cf
19
ra_submit
vmlinux 0xffffffff8b9cc471
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x21
20
filemap_fault
vmlinux 0xffffffff8b9c0e75
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x105
21
? __xfs_trans_commit
xfs 0xffffffffc0538ed7
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x157
22
__xfs_filemap_fault
xfs 0xffffffffc051d91e
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x7e
23
xfs_filemap_fault
xfs 0xffffffffc051db1c
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x2c
24
__do_fault.isra.61
vmlinux 0xffffffff8b9ee7aa
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x8a
25
? mmap_region
vmlinux 0xffffffff8b9fcb6c
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x20c
26
do_read_fault.isra.63
vmlinux 0xffffffff8b9eed5c
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x4c
27
handle_mm_fault
vmlinux 0xffffffff8b9f65a0
Build id: 3.10.0-1160.66.1.el7.x86_64 		0xa20
28
? do_mmap
vmlinux 0xffffffff8b9fd36c
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x39c
29
__do_page_fault
vmlinux 0xffffffff8bf94653
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x213
30
do_page_fault
vmlinux 0xffffffff8bf94975
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x35
31
page_fault
vmlinux 0xffffffff8bf90778
Build id: 3.10.0-1160.66.1.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 52s! [firefox:4501]
Modules linked in: tcp_lp nls_utf8 isofs xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq aesni_intel snd_seq_device lrw gf128mul glue_helper ablk_helper vmw_balloon snd_pcm cryptd joydev
pcspkr snd_timer snd sg soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit ata_piix crct10dif_pclmul crct10dif_common crc32c_intel libnvdimm drm mptspi serio_raw libata scsi_transport_spi e1000 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 4501 Comm: firefox Not tainted 3.10.0-1160.66.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff98254892d280 ti: ffff982579e94000 task.ti: ffff982579e94000
RIP: 0010:[<ffffffffc0296725>]  [<ffffffffc0296725>] mptscsih_qcmd+0x255/0x830 [mptscsih]
RSP: 0000:ffff982579e97720  EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffff982579e976d0 RCX: 0000000000000004
RDX: ffff982576297a00 RSI: ffff982576035000 RDI: 000000000000000e
RBP: ffff982579e977b8 R08: 0000000000000003 R09: 00000000124effff
R10: ffff98257460b800 R11: ffff9825606ba840 R12: ffff9825606ba918
R13: 00000000b9ee9f6a R14: ffff982577c38fe0 R15: ffff982577c387f0
FS:  00007f478f979780(0000) GS:ffff98257c600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4759a78000 CR3: 0000000002be0000 CR4: 00000000003607f0
Call Trace:
[<ffffffffc028f2e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffff8bce4650>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff8bcedd7c>] scsi_request_fn+0x4ac/0x680
[<ffffffff8bb53d09>] __blk_run_queue+0x39/0x50
[<ffffffff8bb53dca>] queue_unplugged+0x2a/0xa0
[<ffffffff8bb576c8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff8bb578a2>] blk_queue_bio+0x182/0x400
[<ffffffff8bb559b7>] generic_make_request+0x147/0x380
[<ffffffff8bb55c60>] submit_bio+0x70/0x150
[<ffffffff8b9bed47>] ? __add_to_page_cache_locked+0xd7/0x1b0
[<ffffffff8ba93d8a>] mpage_bio_submit+0x2a/0x40
[<ffffffff8ba94f2f>] mpage_readpages+0x13f/0x170
[<ffffffffc0512ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc0512ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffff8ba193b8>] ? alloc_pages_current+0x98/0x110
[<ffffffffc0512058>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffff8b9cbe3f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffff8b9cc471>] ra_submit+0x21/0x30
[<ffffffff8b9c0e75>] filemap_fault+0x105/0x420
[<ffffffffc0538ed7>] ? __xfs_trans_commit+0x157/0x260 [xfs]
[<ffffffffc051d91e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc051db1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffff8b9ee7aa>] __do_fault.isra.61+0x8a/0x100
[<ffffffff8b9fcb6c>] ? mmap_region+0x20c/0x670
[<ffffffff8b9eed5c>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffff8b9f65a0>] handle_mm_fault+0xa20/0xfb0
[<ffffffff8b9fd36c>] ? do_mmap+0x39c/0x590
[<ffffffff8bf94653>] __do_page_fault+0x213/0x500
[<ffffffff8bf94975>] do_page_fault+0x35/0x90
[<ffffffff8bf90778>] page_fault+0x28/0x30
Code: ff ff 48 89 c6 48 89 df 4c 89 3c ca e8 d5 82 cf cb 41 0f b6 be ab 05 00 00 4c 89 ea 4c 89 f6 e8 42 dc fd ff 41 8b 86 e0 00 00 00 <83> e0 02 0f 84 ec fd ff ff 44 8b 45 98 48 8b 4d b0 49 8d 76 08
Complete report #372623
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc03b03be
Build id: 3.10.0-862.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc03f371e
Build id: 3.10.0-862.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc04a92e0
Build id: 3.10.0-862.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffa3a9b050
Build id: 3.10.0-862.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffa3aa45bc
Build id: 3.10.0-862.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffffa3918ad9
Build id: 3.10.0-862.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffa3918b9a
Build id: 3.10.0-862.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffa391c358
Build id: 3.10.0-862.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffffa391c532
Build id: 3.10.0-862.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffffa391a6bb
Build id: 3.10.0-862.el7.x86_64 		0x10b
11
? __xfs_get_blocks
xfs 0xffffffffc06252e0
Build id: 3.10.0-862.el7.x86_64 		0x870
12
submit_bio
vmlinux 0xffffffffa391a940
Build id: 3.10.0-862.el7.x86_64 		0x70
13
? __add_to_page_cache_locked
vmlinux 0xffffffffa3794624
Build id: 3.10.0-862.el7.x86_64 		0xe4
14
mpage_bio_submit
vmlinux 0xffffffffa385e3ea
Build id: 3.10.0-862.el7.x86_64 		0x2a
15
mpage_readpages
vmlinux 0xffffffffa385ee1f
Build id: 3.10.0-862.el7.x86_64 		0x13f
16
? __xfs_get_blocks
xfs 0xffffffffc06252e0
Build id: 3.10.0-862.el7.x86_64 		0x870
17
? __xfs_get_blocks
xfs 0xffffffffc06252e0
Build id: 3.10.0-862.el7.x86_64 		0x870
18
? alloc_pages_current
vmlinux 0xffffffffa37e8528
Build id: 3.10.0-862.el7.x86_64 		0x98
19
xfs_vm_readpages
xfs 0xffffffffc0624238
Build id: 3.10.0-862.el7.x86_64 		0x38
20
__do_page_cache_readahead
vmlinux 0xffffffffa37a122f
Build id: 3.10.0-862.el7.x86_64 		0x1cf
21
ra_submit
vmlinux 0xffffffffa37a18e1
Build id: 3.10.0-862.el7.x86_64 		0x21
22
filemap_fault
vmlinux 0xffffffffa3796265
Build id: 3.10.0-862.el7.x86_64 		0x105
23
? down_read
vmlinux 0xffffffffa3d12062
Build id: 3.10.0-862.el7.x86_64 		0x12
24
xfs_filemap_fault
xfs 0xffffffffc062f85f
Build id: 3.10.0-862.el7.x86_64 		0x5f
25
__do_fault.isra.58
vmlinux 0xffffffffa37c05fa
Build id: 3.10.0-862.el7.x86_64 		0x8a
26
do_read_fault.isra.60
vmlinux 0xffffffffa37c0b5c
Build id: 3.10.0-862.el7.x86_64 		0x4c
27
handle_pte_fault
vmlinux 0xffffffffa37c52dc
Build id: 3.10.0-862.el7.x86_64 		0x2dc
28
handle_mm_fault
vmlinux 0xffffffffa37c747d
Build id: 3.10.0-862.el7.x86_64 		0x39d
29
? vma_merge
vmlinux 0xffffffffa37cbd12
Build id: 3.10.0-862.el7.x86_64 		0x252
30
__do_page_fault
vmlinux 0xffffffffa3d1a597
Build id: 3.10.0-862.el7.x86_64 		0x197
31
do_page_fault
vmlinux 0xffffffffa3d1a925
Build id: 3.10.0-862.el7.x86_64 		0x35
32
page_fault
vmlinux 0xffffffffa3d16768
Build id: 3.10.0-862.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#14 stuck for 21s! [mandb:4805]
Modules linked in: tcp_lp fuse vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq crc32_pclmul ghash_clmulni_intel aesni_intel snd_seq_device lrw snd_pcm snd_timer snd gf128mul soundcore joydev pcspkr nfit ppdev glue_helper ablk_helper sg cryptd parport_pc parport libnvdimm vmw_balloon shpchp vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common libata mptspi crc32c_intel scsi_transport_spi e1000 mptscsih serio_raw mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 14 PID: 4805 Comm: mandb Kdump: loaded Tainted: G        W    L ------------   3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff9f2833ae8000 ti: ffff9f2802784000 task.ti: ffff9f2802784000
RIP: 0010:[<ffffffffc03b03be>]  [<ffffffffc03b03be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0000:ffff9f28027876c0  EFLAGS: 00000246
RAX: ffffb1d1c03c0000 RBX: ffff9f2814e46e80 RCX: 000000000000001c
RDX: ffff9f27f546f200 RSI: ffff9f2839a42000 RDI: 000000000000000e
RBP: ffff9f28027876d0 R08: 0000000000000003 R09: 000000002021afff
R10: ffff9f2839a450d8 R11: ffff9f2833aa9f80 R12: 0000000100000035
R13: ffff9f28381adc80 R14: ffff9f2802787634 R15: ffffffffa39212cb
FS:  00007fa781298740(0000) GS:ffff9f283b980000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa7810f7000 CR3: 000000001afc4000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffffc03f371e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc04a92e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffa3a9b050>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffa3aa45bc>] scsi_request_fn+0x4cc/0x680
[<ffffffffa3918ad9>] __blk_run_queue+0x39/0x50
[<ffffffffa3918b9a>] queue_unplugged+0x2a/0xa0
[<ffffffffa391c358>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffa391c532>] blk_queue_bio+0x182/0x400
[<ffffffffa391a6bb>] generic_make_request+0x10b/0x320
[<ffffffffc06252e0>] ? __xfs_get_blocks+0x870/0x870 [xfs]
[<ffffffffa391a940>] submit_bio+0x70/0x150
[<ffffffffa3794624>] ? __add_to_page_cache_locked+0xe4/0x190
[<ffffffffa385e3ea>] mpage_bio_submit+0x2a/0x40
[<ffffffffa385ee1f>] mpage_readpages+0x13f/0x170
[<ffffffffc06252e0>] ? __xfs_get_blocks+0x870/0x870 [xfs]
[<ffffffffc06252e0>] ? __xfs_get_blocks+0x870/0x870 [xfs]
[<ffffffffa37e8528>] ? alloc_pages_current+0x98/0x110
[<ffffffffc0624238>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffffa37a122f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffffa37a18e1>] ra_submit+0x21/0x30
[<ffffffffa3796265>] filemap_fault+0x105/0x490
[<ffffffffa3d12062>] ? down_read+0x12/0x40
[<ffffffffc062f85f>] xfs_filemap_fault+0x5f/0xe0 [xfs]
[<ffffffffa37c05fa>] __do_fault.isra.58+0x8a/0x100
[<ffffffffa37c0b5c>] do_read_fault.isra.60+0x4c/0x1a0
[<ffffffffa37c52dc>] handle_pte_fault+0x2dc/0xc30
[<ffffffffa37c747d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffa37cbd12>] ? vma_merge+0x252/0x370
[<ffffffffa3d1a597>] __do_page_fault+0x197/0x4f0
[<ffffffffa3d1a925>] do_page_fault+0x35/0x90
[<ffffffffa3d16768>] page_fault+0x28/0x30
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 e3 3b
Complete report #209201
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc02c33be
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc031271e
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc037e2e0
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffa50e4120
Build id: 3.10.0-1160.31.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffa50ed84c
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffffa4f539f9
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffa4f53aba
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffa4f57398
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffffa4f57572
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffffa4f55687
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x147
11
submit_bio
vmlinux 0xffffffffa4f55930
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x70
12
? __add_to_page_cache_locked
vmlinux 0xffffffffa4dbe807
Build id: 3.10.0-1160.31.1.el7.x86_64 		0xc7
13
mpage_bio_submit
vmlinux 0xffffffffa4e939aa
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x2a
14
mpage_readpages
vmlinux 0xffffffffa4e94b4f
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x13f
15
? __xfs_get_blocks
xfs 0xffffffffc0564ce0
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x6d0
16
? __xfs_get_blocks
xfs 0xffffffffc0564ce0
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x6d0
17
? alloc_pages_current
vmlinux 0xffffffffa4e18ea8
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x98
18
xfs_vm_readpages
xfs 0xffffffffc0564058
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x38
19
__do_page_cache_readahead
vmlinux 0xffffffffa4dcb91f
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x1cf
20
ra_submit
vmlinux 0xffffffffa4dcbf51
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x21
21
filemap_fault
vmlinux 0xffffffffa4dc0935
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x105
22
? touch_atime
vmlinux 0xffffffffa4e6c080
Build id: 3.10.0-1160.31.1.el7.x86_64 		0xb0
23
__xfs_filemap_fault
xfs 0xffffffffc056f91e
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x7e
24
xfs_filemap_fault
xfs 0xffffffffc056fb1c
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x2c
25
__do_fault.isra.61
vmlinux 0xffffffffa4dee2aa
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x8a
26
? mmap_region
vmlinux 0xffffffffa4dfc66c
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x20c
27
do_read_fault.isra.63
vmlinux 0xffffffffa4dee85c
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x4c
28
handle_mm_fault
vmlinux 0xffffffffa4df60a0
Build id: 3.10.0-1160.31.1.el7.x86_64 		0xa20
29
? do_mmap
vmlinux 0xffffffffa4dfce6c
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x39c
30
__do_page_fault
vmlinux 0xffffffffa5390653
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x213
31
do_page_fault
vmlinux 0xffffffffa5390975
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x35
32
page_fault
vmlinux 0xffffffffa538c778
Build id: 3.10.0-1160.31.1.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [java:3153]
<EOI> 
Modules linked in:
xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul snd_ens1371 ghash_clmulni_intel aesni_intel snd_rawmidi lrw gf128mul glue_helper ablk_helper snd_ac97_codec cryptd ppdev ac97_bus snd_seq vmw_balloon snd_seq_device snd_pcm snd_timer snd soundcore pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit libnvdimm
drm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix mptspi libata serio_raw scsi_transport_spi mptscsih e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 3153 Comm: java Not tainted 3.10.0-1160.31.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff8cbaeca53180 ti: ffff8cbaeca0c000 task.ti: ffff8cbaeca0c000
RIP: 0010:[<ffffffffc02c33be>]  [<ffffffffc02c33be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0000:ffff8cbaeca0f700  EFLAGS: 00000246
RAX: ffffad5a80380000 RBX: ffff8cbb1332efe0 RCX: 0000000000000012
RDX: ffff8cbaf5b95400 RSI: ffff8cbaf5039000 RDI: 000000000000000e
RBP: ffff8cbaeca0f710 R08: 0000000000000003 R09: 0000000023b50fff
R10: ffff8cbaf5ba6400 R11: ffff8cbb3759b480 R12: 0000000100000008
R13: ffff8cbb1303a700 R14: ffff8cbaeca0f674 R15: ffffffffa4f5c3bb
FS:  00007ff821637700(0000) GS:ffff8cbb3b600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff81cc9aa8a CR3: 000000002c996000 CR4: 00000000003607f0
Call Trace:
[<ffffffffc031271e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc037e2e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffa50e4120>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffa50ed84c>] scsi_request_fn+0x4ac/0x680
[<ffffffffa4f539f9>] __blk_run_queue+0x39/0x50
[<ffffffffa4f53aba>] queue_unplugged+0x2a/0xa0
[<ffffffffa4f57398>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffa4f57572>] blk_queue_bio+0x182/0x400
[<ffffffffa4f55687>] generic_make_request+0x147/0x380
[<ffffffffa4f55930>] submit_bio+0x70/0x150
[<ffffffffa4dbe807>] ? __add_to_page_cache_locked+0xc7/0x1a0
[<ffffffffa4e939aa>] mpage_bio_submit+0x2a/0x40
[<ffffffffa4e94b4f>] mpage_readpages+0x13f/0x170
[<ffffffffc0564ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc0564ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffa4e18ea8>] ? alloc_pages_current+0x98/0x110
[<ffffffffc0564058>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffffa4dcb91f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffffa4dcbf51>] ra_submit+0x21/0x30
[<ffffffffa4dc0935>] filemap_fault+0x105/0x420
[<ffffffffa4e6c080>] ? touch_atime+0xb0/0x220
[<ffffffffc056f91e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc056fb1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffffa4dee2aa>] __do_fault.isra.61+0x8a/0x100
[<ffffffffa4dfc66c>] ? mmap_region+0x20c/0x670
[<ffffffffa4dee85c>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffffa4df60a0>] handle_mm_fault+0xa20/0xfb0
[<ffffffffa4dfce6c>] ? do_mmap+0x39c/0x590
[<ffffffffa5390653>] __do_page_fault+0x213/0x500
[<ffffffffa5390975>] do_page_fault+0x35/0x90
[<ffffffffa538c778>] page_fault+0x28/0x30
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 13 2d
Complete report #186079
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffb43883c5
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc0188632
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffffb40eb030
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffffb40e2920
Build id: 3.10.0-1127.10.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffb40ec04c
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffffb3f52769
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffb3f5282a
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffb3f56068
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffffb3f56242
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffffb3f543f7
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x147
11
submit_bio
vmlinux 0xffffffffb3f546a0
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x70
12
? __lru_cache_add
vmlinux 0xffffffffb3dcd574
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x64
13
mpage_bio_submit
vmlinux 0xffffffffb3e92a7a
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x2a
14
mpage_readpages
vmlinux 0xffffffffb3e93c1f
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x13f
15
? __xfs_get_blocks
xfs 0xffffffffc03f6d60
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x6d0
16
? __xfs_get_blocks
xfs 0xffffffffc03f6d60
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x6d0
17
? alloc_pages_current
vmlinux 0xffffffffb3e18e78
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x98
18
xfs_vm_readpages
xfs 0xffffffffc03f60d8
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x38
19
__do_page_cache_readahead
vmlinux 0xffffffffb3dcb67f
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x1cf
20
ra_submit
vmlinux 0xffffffffb3dcbce1
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x21
21
filemap_fault
vmlinux 0xffffffffb3dc0e25
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x105
22
? __inode_permission
vmlinux 0xffffffffb3e58e92
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x52
23
__xfs_filemap_fault
xfs 0xffffffffc040198e
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x7e
24
xfs_filemap_fault
xfs 0xffffffffc0401b8c
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x2c
25
__do_fault.isra.61
vmlinux 0xffffffffb3dedf4a
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x8a
26
do_read_fault.isra.63
vmlinux 0xffffffffb3dee4fc
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x4c
27
handle_mm_fault
vmlinux 0xffffffffb3df5d60
Build id: 3.10.0-1127.10.1.el7.x86_64 		0xa20
28
__do_page_fault
vmlinux 0xffffffffb438d653
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x213
29
do_page_fault
vmlinux 0xffffffffb438d975
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x35
30
? error_swapgs
vmlinux 0xffffffffb4389ac9
Build id: 3.10.0-1127.10.1.el7.x86_64 		0xaa
31
page_fault
vmlinux 0xffffffffb4389778
Build id: 3.10.0-1127.10.1.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [runlevel:30469]
Modules linked in: xt_CHECKSUM ebtable_filter ebtables ip6table_filter ip6_tables xt_dscp nfnetlink_queue nfnetlink_log bluetooth rfkill xt_multiport iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_policy xt_nat ipt_REJECT nf_reject_ipv4 xt_geoip(OE) xt_conntrack iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack ip_tables tcp_lp fuse devlink tun bridge stp llc ip_set nfnetlink vmw_vsock_vmci_transport vsock ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg vmw_balloon parport_pc i2c_piix4 parport vmw_vmci xfs libcrc32c ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt sd_mod fb_sys_fops crc_t10dif crct10dif_generic ttm ahci drm nfit crct10dif_pclmul
 crct10dif_common crc32c_intel libnvdimm ata_piix libahci serio_raw libata vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
CPU: 0 PID: 30469 Comm: runlevel Kdump: loaded Tainted: G           OEL ------------   3.10.0-1127.10.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff95f13799c1c0 ti: ffff95f0c11e0000 task.ti: ffff95f0c11e0000
RIP: 0010:[<ffffffffb43883c5>]  [<ffffffffb43883c5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0000:ffff95f0c11e3768  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff95f0c11e3728 RCX: ffffffffb482f0a0
RDX: ffffba5dc0420000 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff95f0c11e3768 R08: ffffffffffffffff R09: 0000000035961fff
R10: ffff95f0f5a4b000 R11: ffff95f0f59dc000 R12: 0000000000000020
R13: ffff95f0c1bf0000 R14: ffffffffb40e9ce9 R15: ffff95f0c11e36e0
FS:  0000000000000000(0000) GS:ffff95f13fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055ff602c5bb9 CR3: 000000003eca0000 CR4: 00000000000607f0
Call Trace:
 [<ffffffffc0188632>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
 [<ffffffffb40eb030>] ? scsi_test_unit_ready+0x170/0x170
 [<ffffffffb40e2920>] scsi_dispatch_cmd+0xb0/0x240
 [<ffffffffb40ec04c>] scsi_request_fn+0x4ac/0x680
 [<ffffffffb3f52769>] __blk_run_queue+0x39/0x50
 [<ffffffffb3f5282a>] queue_unplugged+0x2a/0xa0
 [<ffffffffb3f56068>] blk_flush_plug_list+0x1d8/0x230
 [<ffffffffb3f56242>] blk_queue_bio+0x182/0x400
 [<ffffffffb3f543f7>] generic_make_request+0x147/0x380
 [<ffffffffb3f546a0>] submit_bio+0x70/0x150
 [<ffffffffb3dcd574>] ? __lru_cache_add+0x64/0x90
 [<ffffffffb3e92a7a>] mpage_bio_submit+0x2a/0x40
 [<ffffffffb3e93c1f>] mpage_readpages+0x13f/0x170
 [<ffffffffc03f6d60>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
 [<ffffffffc03f6d60>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
 [<ffffffffb3e18e78>] ? alloc_pages_current+0x98/0x110
 [<ffffffffc03f60d8>] xfs_vm_readpages+0x38/0x80 [xfs]
 [<ffffffffb3dcb67f>] __do_page_cache_readahead+0x1cf/0x260
 [<ffffffffb3dcbce1>] ra_submit+0x21/0x30
 [<ffffffffb3dc0e25>] filemap_fault+0x105/0x420
 [<ffffffffb3e58e92>] ? __inode_permission+0x52/0xd0
 [<ffffffffc040198e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
 [<ffffffffc0401b8c>] xfs_filemap_fault+0x2c/0x30 [xfs]
 [<ffffffffb3dedf4a>] __do_fault.isra.61+0x8a/0x100
 [<ffffffffb3dee4fc>] do_read_fault.isra.63+0x4c/0x1b0
 [<ffffffffb3df5d60>] handle_mm_fault+0xa20/0xfb0
 [<ffffffffb438d653>] __do_page_fault+0x213/0x500
 [<ffffffffb438d975>] do_page_fault+0x35/0x90
 [<ffffffffb4389ac9>] ? error_swapgs+0xaa/0xc0
 [<ffffffffb4389778>] page_fault+0x28/0x30
Code: 07 00 66 66 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 c6 07 00 66 66 66 90 48 89 f7 57 9d <66> 66 90 66 90 5d c3 0f 1f 40 00 66 66 66 66 90 55 48 89 e5 48
Complete report #19860
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc04203be
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc044271e
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc04872e0
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff9bae39d0
Build id: 3.10.0-1160.6.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff9baed0fc
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffff9b953519
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffff9b9535da
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff9b956e18
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffff9b956ff2
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffff9b9551a7
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x147
11
submit_bio
vmlinux 0xffffffff9b955450
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x70
12
mpage_bio_submit
vmlinux 0xffffffff9b89357a
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x2a
13
mpage_readpages
vmlinux 0xffffffff9b89471f
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x13f
14
? __xfs_get_blocks
xfs 0xffffffffc06cdce0
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x6d0
15
? __xfs_get_blocks
xfs 0xffffffffc06cdce0
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x6d0
16
? alloc_pages_current
vmlinux 0xffffffff9b818a18
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x98
17
xfs_vm_readpages
xfs 0xffffffffc06cd058
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x38
18
__do_page_cache_readahead
vmlinux 0xffffffff9b7cb28f
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x1cf
19
ra_submit
vmlinux 0xffffffff9b7cb8c1
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x21
20
filemap_fault
vmlinux 0xffffffff9b7c09b5
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x105
21
__xfs_filemap_fault
xfs 0xffffffffc06d891e
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x7e
22
xfs_filemap_fault
xfs 0xffffffffc06d8b1c
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x2c
23
__do_fault.isra.61
vmlinux 0xffffffff9b7ede7a
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x8a
24
do_read_fault.isra.63
vmlinux 0xffffffff9b7ee42c
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x4c
25
handle_mm_fault
vmlinux 0xffffffff9b7f5c70
Build id: 3.10.0-1160.6.1.el7.x86_64 		0xa20
26
? hrtimer_start_range_ns
vmlinux 0xffffffff9b6c9d0c
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x1dc
27
? __enqueue_entity
vmlinux 0xffffffff9b6dfb98
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x78
28
__do_page_fault
vmlinux 0xffffffff9bd8f653
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x213
29
do_page_fault
vmlinux 0xffffffff9bd8f975
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x35
30
page_fault
vmlinux 0xffffffff9bd8b778
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [gnome-shell:2501]
Modules linked in: nls_utf8 isofs tcp_lp rfcomm xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bnep vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel btusb snd_ens1371 lrw btrtl snd_rawmidi btbcm gf128mul btintel glue_helper snd_ac97_codec ablk_helper cryptd bluetooth
vmw_balloon ac97_bus snd_seq snd_seq_device snd_pcm pcspkr joydev snd_timer rfkill snd sg soundcore parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c vmwgfx sr_mod cdrom drm_kms_helper ata_generic pata_acpi syscopyarea sd_mod sysfillrect sysimgblt fb_sys_fops crc_t10dif crct10dif_generic ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix nfit libnvdimm libata serio_raw mptspi scsi_transport_spi e1000 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 2501 Comm: gnome-shell Not tainted 3.10.0-1160.6.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff937c074a9080 ti: ffff937c1693c000 task.ti: ffff937c1693c000
RIP: 0010:[<ffffffffc04203be>]  [<ffffffffc04203be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff937c1693f700  EFLAGS: 00000246
RAX: ffffa0fdc0140000 RBX: ffff937c1522d6c0 RCX: 000000000000000b
RDX: ffff937c1f1a2800 RSI: ffff937c1e668000 RDI: 000000000000000e
RBP: ffff937c1693f710 R08: 0000000000000003 R09: 000000000734dfff
R10: ffff937c1e5bac00 R11: ffff937c1f015c00 R12: 0000000100000037
R13: ffff937c18a4c900 R14: ffff937c1693f674 R15: ffffffff9b95be3b
FS:  00007f5baabe5a80(0000) GS:ffff937c1aa00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5b4f244f97 CR3: 00000000169be000 CR4: 00000000003607f0
Call Trace:
[<ffffffffc044271e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc04872e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffff9bae39d0>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff9baed0fc>] scsi_request_fn+0x4ac/0x680
[<ffffffff9b953519>] __blk_run_queue+0x39/0x50
[<ffffffff9b9535da>] queue_unplugged+0x2a/0xa0
[<ffffffff9b956e18>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff9b956ff2>] blk_queue_bio+0x182/0x400
[<ffffffff9b9551a7>] generic_make_request+0x147/0x380
[<ffffffff9b955450>] submit_bio+0x70/0x150
[<ffffffff9b89357a>] mpage_bio_submit+0x2a/0x40
[<ffffffff9b89471f>] mpage_readpages+0x13f/0x170
[<ffffffffc06cdce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc06cdce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffff9b818a18>] ? alloc_pages_current+0x98/0x110
[<ffffffffc06cd058>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffff9b7cb28f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffff9b7cb8c1>] ra_submit+0x21/0x30
[<ffffffff9b7c09b5>] filemap_fault+0x105/0x420
[<ffffffffc06d891e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc06d8b1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffff9b7ede7a>] __do_fault.isra.61+0x8a/0x100
[<ffffffff9b7ee42c>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffff9b7f5c70>] handle_mm_fault+0xa20/0xfb0
[<ffffffff9b6c9d0c>] ? hrtimer_start_range_ns+0x1dc/0x3c0
[<ffffffff9b6dfb98>] ? __enqueue_entity+0x78/0x80
[<ffffffff9bd8f653>] __do_page_fault+0x213/0x500
[<ffffffff9bd8f975>] do_page_fault+0x35/0x90
[<ffffffff9bd8b778>] page_fault+0x28/0x30
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 e3 42
Complete report #2451
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc039d3be
Build id: 3.10.0-957.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc03c771e
Build id: 3.10.0-957.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc04262e0
Build id: 3.10.0-957.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff974d0960
Build id: 3.10.0-957.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff974d9efc
Build id: 3.10.0-957.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffff97342ff9
Build id: 3.10.0-957.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffff973430ba
Build id: 3.10.0-957.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff973468e8
Build id: 3.10.0-957.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffff97346ac2
Build id: 3.10.0-957.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffff97344c87
Build id: 3.10.0-957.el7.x86_64 		0x147
11
? __xfs_get_blocks
xfs 0xffffffffc05ec000
Build id: 3.10.0-957.el7.x86_64 		0x6d0
12
submit_bio
vmlinux 0xffffffff97344f30
Build id: 3.10.0-957.el7.x86_64 		0x70
13
? __add_to_page_cache_locked
vmlinux 0xffffffff971b6de4
Build id: 3.10.0-957.el7.x86_64 		0xe4
14
mpage_bio_submit
vmlinux 0xffffffff972854aa
Build id: 3.10.0-957.el7.x86_64 		0x2a
15
mpage_readpages
vmlinux 0xffffffff97285edf
Build id: 3.10.0-957.el7.x86_64 		0x13f
16
? __xfs_get_blocks
xfs 0xffffffffc05ec000
Build id: 3.10.0-957.el7.x86_64 		0x6d0
17
? __xfs_get_blocks
xfs 0xffffffffc05ec000
Build id: 3.10.0-957.el7.x86_64 		0x6d0
18
? alloc_pages_current
vmlinux 0xffffffff9720dcf8
Build id: 3.10.0-957.el7.x86_64 		0x98
19
xfs_vm_readpages
xfs 0xffffffffc05eb0d8
Build id: 3.10.0-957.el7.x86_64 		0x38
20
__do_page_cache_readahead
vmlinux 0xffffffff971c35ef
Build id: 3.10.0-957.el7.x86_64 		0x1cf
21
ra_submit
vmlinux 0xffffffff971c3c51
Build id: 3.10.0-957.el7.x86_64 		0x21
22
filemap_fault
vmlinux 0xffffffff971b8ba5
Build id: 3.10.0-957.el7.x86_64 		0x105
23
? security_inode_permission
vmlinux 0xffffffff972f8b92
Build id: 3.10.0-957.el7.x86_64 		0x22
24
? down_read
vmlinux 0xffffffff97766e72
Build id: 3.10.0-957.el7.x86_64 		0x12
25
__xfs_filemap_fault
xfs 0xffffffffc05f6d0e
Build id: 3.10.0-957.el7.x86_64 		0x7e
26
xfs_filemap_fault
xfs 0xffffffffc05f6f0c
Build id: 3.10.0-957.el7.x86_64 		0x2c
27
__do_fault.isra.59
vmlinux 0xffffffff971e41da
Build id: 3.10.0-957.el7.x86_64 		0x8a
28
do_read_fault.isra.61
vmlinux 0xffffffff971e478c
Build id: 3.10.0-957.el7.x86_64 		0x4c
29
handle_pte_fault
vmlinux 0xffffffff971e9134
Build id: 3.10.0-957.el7.x86_64 		0x2f4
30
? user_path_at_empty
vmlinux 0xffffffff97253cd2
Build id: 3.10.0-957.el7.x86_64 		0x72
31
handle_mm_fault
vmlinux 0xffffffff971ebc6d
Build id: 3.10.0-957.el7.x86_64 		0x39d
32
__do_page_fault
vmlinux 0xffffffff9776f5e3
Build id: 3.10.0-957.el7.x86_64 		0x203
33
do_page_fault
vmlinux 0xffffffff9776f915
Build id: 3.10.0-957.el7.x86_64 		0x35
34
page_fault
vmlinux 0xffffffff9776b758
Build id: 3.10.0-957.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 25s! [abrt-dump-oops:39894]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock bnep sunrpc ppdev vmw_balloon iosf_mbi crc32_pclmul snd_seq_midi ghash_clmulni_intel snd_seq_midi_event aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus pcspkr snd_seq snd_seq_device joydev snd_pcm snd_timer snd btusb btrtl btbcm btintel bluetooth soundcore rfkill sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod cdrom crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel
serio_raw ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix e1000 drm mptspi libata scsi_transport_spi mptscsih nfit mptbase drm_panel_orientation_quirks libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 39894 Comm: abrt-dump-oops Kdump: loaded Tainted: G             L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffffa056b3d330c0 ti: ffffa0559f014000 task.ti: ffffa0559f014000
RIP: 0010:[<ffffffffc039d3be>]  [<ffffffffc039d3be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffffa0559f017680  EFLAGS: 00000246
RAX: ffffb0c440a00000 RBX: ffffa0563549bfe0 RCX: 000000000000001a
RDX: ffffa055b5cc4600 RSI: ffffa055b5cfc000 RDI: 000000000000000e
RBP: ffffa0559f017690 R08: 0000000000000003 R09: 00000000b0f05fff
R10: ffffa056b73970d8 R11: ffffa055b5cc9c00 R12: 0000000100000080
R13: ffffa05627119f80 R14: ffffa0559f0175f4 R15: ffffffff9734b83b
FS:  00007f4268b85900(0000) GS:ffffa056b9640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000fa7018 CR3: 000000000c0fa000 CR4: 00000000003607e0
Call Trace:
[<ffffffffc03c771e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc04262e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffff974d0960>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff974d9efc>] scsi_request_fn+0x4cc/0x680
[<ffffffff97342ff9>] __blk_run_queue+0x39/0x50
[<ffffffff973430ba>] queue_unplugged+0x2a/0xa0
[<ffffffff973468e8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff97346ac2>] blk_queue_bio+0x182/0x400
[<ffffffff97344c87>] generic_make_request+0x147/0x380
[<ffffffffc05ec000>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffff97344f30>] submit_bio+0x70/0x150
[<ffffffff971b6de4>] ? __add_to_page_cache_locked+0xe4/0x190
[<ffffffff972854aa>] mpage_bio_submit+0x2a/0x40
[<ffffffff97285edf>] mpage_readpages+0x13f/0x170
[<ffffffffc05ec000>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc05ec000>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffff9720dcf8>] ? alloc_pages_current+0x98/0x110
[<ffffffffc05eb0d8>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffff971c35ef>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffff971c3c51>] ra_submit+0x21/0x30
[<ffffffff971b8ba5>] filemap_fault+0x105/0x490
[<ffffffff972f8b92>] ? security_inode_permission+0x22/0x30
[<ffffffff97766e72>] ? down_read+0x12/0x40
[<ffffffffc05f6d0e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc05f6f0c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffff971e41da>] __do_fault.isra.59+0x8a/0x100
[<ffffffff971e478c>] do_read_fault.isra.61+0x4c/0x1b0
[<ffffffff971e9134>] handle_pte_fault+0x2f4/0xd10
[<ffffffff97253cd2>] ? user_path_at_empty+0x72/0xc0
[<ffffffff971ebc6d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff9776f5e3>] __do_page_fault+0x203/0x500
[<ffffffff9776f915>] do_page_fault+0x35/0x90
[<ffffffff9776b758>] page_fault+0x28/0x30
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 b3 3a