Complete report #992935
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
mpt_put_msg_frame
|
mptbase |
0xffffffffc01e13be
Build id: 3.10.0-1127.el7.x86_64
|
0x5e
|
|
2
|
mptscsih_qcmd
|
mptscsih |
0xffffffffc02f471e
Build id: 3.10.0-1127.el7.x86_64
|
0x24e
|
|
3
|
mptsas_qcmd
|
mptsas |
0xffffffffc0279cc9
Build id: 3.10.0-1127.el7.x86_64
|
0x79
|
|
4
|
|
vmlinux |
0xffffffffbb35c7ac
Build id: 3.10.0-1127.el7.x86_64
|
0x7c
|
|
5
|
scsi_dispatch_cmd
|
vmlinux |
0xffffffffbb4e2850
Build id: 3.10.0-1127.el7.x86_64
|
0xb0
|
|
6
|
scsi_request_fn
|
vmlinux |
0xffffffffbb4ebefc
Build id: 3.10.0-1127.el7.x86_64
|
0x4ac
|
|
7
|
|
vmlinux |
0xffffffffbb37709e
Build id: 3.10.0-1127.el7.x86_64
|
0x6e
|
|
8
|
__blk_run_queue
|
vmlinux |
0xffffffffbb3526f9
Build id: 3.10.0-1127.el7.x86_64
|
0x39
|
|
9
|
blk_queue_bio
|
vmlinux |
0xffffffffbb356403
Build id: 3.10.0-1127.el7.x86_64
|
0x3b3
|
|
10
|
generic_make_request
|
vmlinux |
0xffffffffbb354387
Build id: 3.10.0-1127.el7.x86_64
|
0x147
|
|
11
|
submit_bio
|
vmlinux |
0xffffffffbb354630
Build id: 3.10.0-1127.el7.x86_64
|
0x70
|
|
12
|
xfs_submit_ioend.isra.12
|
xfs |
0xffffffffc04ab071
Build id: 3.10.0-1127.el7.x86_64
|
0x61
|
|
13
|
xfs_vm_writepages
|
xfs |
0xffffffffc04ab3af
Build id: 3.10.0-1127.el7.x86_64
|
0x7f
|
|
14
|
do_writepages
|
vmlinux |
0xffffffffbb1cb1b1
Build id: 3.10.0-1127.el7.x86_64
|
0x21
|
|
15
|
__filemap_fdatawrite_range
|
vmlinux |
0xffffffffbb1bfbd5
Build id: 3.10.0-1127.el7.x86_64
|
0x65
|
|
16
|
filemap_write_and_wait_range
|
vmlinux |
0xffffffffbb1bfd21
Build id: 3.10.0-1127.el7.x86_64
|
0x41
|
|
17
|
xfs_file_fsync
|
xfs |
0xffffffffc04b5e96
Build id: 3.10.0-1127.el7.x86_64
|
0x66
|
|
18
|
do_fsync
|
vmlinux |
0xffffffffbb282f07
Build id: 3.10.0-1127.el7.x86_64
|
0x67
|
|
19
|
SyS_fsync
|
vmlinux |
0xffffffffbb2831f0
Build id: 3.10.0-1127.el7.x86_64
|
0x10
|
|
20
|
system_call_fastpath
|
vmlinux |
0xffffffffbb792ed2
Build id: 3.10.0-1127.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [SSL Cert #1:4865]
Modules linked in: tcp_lp nls_utf8 isofs fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc vfat fat snd_hda_codec_generic ppdev snd_hda_intel snd_hda_codec iosf_mbi snd_hda_core crc32_pclmul snd_hwdep snd_seq snd_seq_device snd_pcm vmw_balloon ghash_clmulni_intel cryptd pcspkr joydev sg snd_timer snd i2c_piix4 vmw_vmci soundcore tpm_crb parport_pc parport sch_fq_codel ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops
e1000e ttm nfit ahci mptsas ata_piix libahci libnvdimm scsi_transport_sas mptscsih libata drm crct10dif_pclmul crct10dif_common mptbase crc32c_intel ptp serio_raw pps_core drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 4865 Comm: SSL Cert #1 Kdump: loaded Tainted: G L ------------ 3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.12343141.B64.1902160724 02/16/2019
task: ffff9f9c198e1070 ti: ffff9f9c35034000 task.ti: ffff9f9c35034000
RIP: 0010:[<ffffffffc01e13be>] [<ffffffffc01e13be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff9f9c35037b08 EFLAGS: 00000246
RAX: ffffb721003f0000 RBX: 00000000e7aeb226 RCX: 0000000000000019
RDX: ffff9f9bcdf76600 RSI: ffff9f9bcd9a0000 RDI: 000000000000000e
RBP: ffff9f9c35037b18 R08: 0000000000000000 R09: 0000000043727fff
R10: ffff9f9bcc936000 R11: ffff9f9c344756c0 R12: ffff9f9c3358d380
R13: 0000000100000035 R14: ffff9f9c02ea0300 R15: ffff9f9c35037a6c
FS: 00007f8139e69700(0000) GS:ffff9f9c3fd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f81473d7000 CR3: 0000000077368000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc02f471e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc0279cc9>] mptsas_qcmd+0x79/0xa0 [mptsas]
[<ffffffffbb35c7ac>] ? blk_add_timer+0x7c/0x110
[<ffffffffbb4e2850>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffbb4ebefc>] scsi_request_fn+0x4ac/0x660
[<ffffffffbb37709e>] ? deadline_add_request+0x6e/0x90
[<ffffffffbb3526f9>] __blk_run_queue+0x39/0x50
[<ffffffffbb356403>] blk_queue_bio+0x3b3/0x400
[<ffffffffbb354387>] generic_make_request+0x147/0x380
[<ffffffffbb354630>] submit_bio+0x70/0x150
[<ffffffffc04ab071>] xfs_submit_ioend.isra.12+0x61/0xe0 [xfs]
[<ffffffffc04ab3af>] xfs_vm_writepages+0x7f/0xa0 [xfs]
[<ffffffffbb1cb1b1>] do_writepages+0x21/0x50
[<ffffffffbb1bfbd5>] __filemap_fdatawrite_range+0x65/0x80
[<ffffffffbb1bfd21>] filemap_write_and_wait_range+0x41/0x90
[<ffffffffc04b5e96>] xfs_file_fsync+0x66/0x1c0 [xfs]
[<ffffffffbb282f07>] do_fsync+0x67/0xb0
[<ffffffffbb2831f0>] SyS_fsync+0x10/0x20
[<ffffffffbb792ed2>] system_call_fastpath+0x25/0x2a
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 f3 1e
Complete report #629778
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
mpt_put_msg_frame
|
mptbase |
0xffffffffc00a53be
Build id: 3.10.0-957.el7.x86_64
|
0x5e
|
|
2
|
mptscsih_qcmd
|
mptscsih |
0xffffffffc013171e
Build id: 3.10.0-957.el7.x86_64
|
0x24e
|
|
3
|
mptsas_qcmd
|
mptsas |
0xffffffffc0148cc9
Build id: 3.10.0-957.el7.x86_64
|
0x79
|
|
4
|
|
vmlinux |
0xffffffff9574d01c
Build id: 3.10.0-957.el7.x86_64
|
0x7c
|
|
5
|
scsi_dispatch_cmd
|
vmlinux |
0xffffffff958d0960
Build id: 3.10.0-957.el7.x86_64
|
0xb0
|
|
6
|
scsi_request_fn
|
vmlinux |
0xffffffff958d9efc
Build id: 3.10.0-957.el7.x86_64
|
0x4cc
|
|
7
|
|
vmlinux |
0xffffffff957675fe
Build id: 3.10.0-957.el7.x86_64
|
0x6e
|
|
8
|
__blk_run_queue
|
vmlinux |
0xffffffff95742ff9
Build id: 3.10.0-957.el7.x86_64
|
0x39
|
|
9
|
blk_queue_bio
|
vmlinux |
0xffffffff95746cf3
Build id: 3.10.0-957.el7.x86_64
|
0x3b3
|
|
10
|
generic_make_request
|
vmlinux |
0xffffffff95744c87
Build id: 3.10.0-957.el7.x86_64
|
0x147
|
|
11
|
submit_bio
|
vmlinux |
0xffffffff95744f30
Build id: 3.10.0-957.el7.x86_64
|
0x70
|
|
12
|
xfs_submit_ioend.isra.12
|
xfs |
0xffffffffc0390251
Build id: 3.10.0-957.el7.x86_64
|
0x61
|
|
13
|
xfs_vm_writepages
|
xfs |
0xffffffffc03903bf
Build id: 3.10.0-957.el7.x86_64
|
0x7f
|
|
14
|
do_writepages
|
vmlinux |
0xffffffff955c3181
Build id: 3.10.0-957.el7.x86_64
|
0x21
|
|
15
|
__filemap_fdatawrite_range
|
vmlinux |
0xffffffff955b79b5
Build id: 3.10.0-957.el7.x86_64
|
0x65
|
|
16
|
filemap_write_and_wait_range
|
vmlinux |
0xffffffff955b7b01
Build id: 3.10.0-957.el7.x86_64
|
0x41
|
|
17
|
xfs_file_fsync
|
xfs |
0xffffffffc039b156
Build id: 3.10.0-957.el7.x86_64
|
0x66
|
|
18
|
do_fsync
|
vmlinux |
0xffffffff95675c77
Build id: 3.10.0-957.el7.x86_64
|
0x67
|
|
19
|
|
vmlinux |
0xffffffff95641ee4
Build id: 3.10.0-957.el7.x86_64
|
0xa4
|
|
20
|
SyS_fsync
|
vmlinux |
0xffffffff95675f60
Build id: 3.10.0-957.el7.x86_64
|
0x10
|
|
21
|
system_call_fastpath
|
vmlinux |
0xffffffff95b74ddb
Build id: 3.10.0-957.el7.x86_64
|
0x22
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 68s! [java:124699]
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 68s! [java:124695]
Modules linked in: vmw_vsock_vmci_transport vsock vfat fat sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd vmw_balloon joydev sg pcspkr parport_pc parport tpm_crb vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx crct10dif_pclmul crct10dif_common crc32c_intel drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm serio_raw e1000e ahci libahci ata_piix drm mptsas scsi_transport_sas mptscsih libata ptp pps_core nfit mptbase libnvdimm drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 124695 Comm: java Kdump: loaded Tainted: G W L ------------ 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.17369862.B64.2012240522 12/24/2020
task: ffff97e7885b5140 ti: ffff97e7f3620000 task.ti: ffff97e7f3620000
RIP: 0010:[<ffffffffc00a53be>] [<ffffffffc00a53be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff97e7f3623b08 EFLAGS: 00000246
RAX: ffffbd7343238000 RBX: 000000009ad055a5 RCX: 000000000000006d
RDX: ffff97ef97b5ea00 RSI: ffff97ef9aebb000 RDI: 000000000000000e
RBP: ffff97e7f3623b18 R08: 0000000000000003 R09: 000000062d257fff
R10: ffff97e78db130d8 R11: ffff97e790c86140 R12: ffff97e7e8dbf010
R13: 0000000100000002 R14: ffff97ead2db2580 R15: ffff97e7f3623a6c
FS: 00007f6d403f3700(0000) GS:ffff97ef9d680000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0c94064838 CR3: 0000000464282000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc013171e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc0148cc9>] mptsas_qcmd+0x79/0xa0 [mptsas]
[<ffffffff9574d01c>] ? blk_add_timer+0x7c/0x110
[<ffffffff958d0960>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff958d9efc>] scsi_request_fn+0x4cc/0x680
[<ffffffff957675fe>] ? deadline_add_request+0x6e/0x90
[<ffffffff95742ff9>] __blk_run_queue+0x39/0x50
[<ffffffff95746cf3>] blk_queue_bio+0x3b3/0x400
[<ffffffff95744c87>] generic_make_request+0x147/0x380
[<ffffffff95744f30>] submit_bio+0x70/0x150
[<ffffffffc0390251>] xfs_submit_ioend.isra.12+0x61/0xe0 [xfs]
[<ffffffffc03903bf>] xfs_vm_writepages+0x7f/0xa0 [xfs]
[<ffffffff955c3181>] do_writepages+0x21/0x50
[<ffffffff955b79b5>] __filemap_fdatawrite_range+0x65/0x80
[<ffffffff955b7b01>] filemap_write_and_wait_range+0x41/0x90
[<ffffffffc039b156>] xfs_file_fsync+0x66/0x1c0 [xfs]
[<ffffffff95675c77>] do_fsync+0x67/0xb0
[<ffffffff95641ee4>] ? SyS_write+0xa4/0xf0
[<ffffffff95675f60>] SyS_fsync+0x10/0x20
[<ffffffff95b74ddb>] system_call_fastpath+0x22/0x27
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 33 0b