Info

Permalink
Function
mpt_put_msg_frame
First occurrence
2020-12-06
Last occurrence
2020-12-06
State
NEW
Components
kernel
Quality
-32

Statistics

Operating system Count
CentOS 7 45
Architecture Count
x86_64 45
Related packages Count
kernel 45
 0:3.10.0-1160.88.1.el7 6
 0:3.10.0-514.el7 5
 0:3.10.0-957.27.2.el7 5
 0:3.10.0-1160.el7 4
 0:3.10.0-1160.36.2.el7 3
 0:3.10.0-693.el7 3
 0:3.10.0-1160.99.1.el7 2
 0:3.10.0-1062.el7 2
 0:3.10.0-862.el7 2
 0:3.10.0-957.el7 2
 0:3.10.0-1160.15.2.el7 2
 0:3.10.0-1127.19.1.el7 1
 0:3.10.0-1160.45.1.el7 1
 0:3.10.0-1160.90.1.el7 1
 0:3.10.0-327.28.3.el7 1
 0:3.10.0-327.el7 1
 0:3.10.0-1160.21.1.el7 1
 0:3.10.0-1062.12.1.el7 1
 0:3.10.0-1160.59.1.el7 1
 0:3.10.0-1160.119.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #1368930
Frame # Function Binary Source or offset Line
1
scsi_request_fn
vmlinux 0xffffffff8c90c865
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x135
2
__blk_run_queue
vmlinux 0xffffffff8c7687d9
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x39
3
queue_unplugged
vmlinux 0xffffffff8c7688aa
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x2a
4
blk_flush_plug_list
vmlinux 0xffffffff8c76c2f8
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x1d8
5
blk_finish_plug
vmlinux 0xffffffff8c76c764
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x14
6
jbd2_journal_commit_transaction
jbd2 0xffffffffc0685fe1
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xe31
7
? __switch_to
vmlinux 0xffffffff8c42c5ee
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xce
8
kjournald2
jbd2 0xffffffffc068c1d9
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xc9
9
? wake_up_atomic_t
vmlinux 0xffffffff8c4cc790
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x40
10
? commit_timeout
jbd2 0xffffffffc068c110
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x20
11
kthread
vmlinux 0xffffffff8c4cb621
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xd1
12
? insert_kthread_work
vmlinux 0xffffffff8c4cb550
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x40
13
ret_from_fork_nospec_begin
vmlinux 0xffffffff8cbc51f7
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x21
14
? insert_kthread_work
vmlinux 0xffffffff8c4cb550
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [jbd2/dm-0-8:511]
Modules linked in: tcp_lp xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c xt_addrtype iptable_filter br_netfilter bridge stp llc event_collector_3_1_1777950(OE) nfsv3 nfs fscache overlay(T) vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper vmw_balloon cryptd joydev pcspkr sg vmw_vmci parport_pc parport i2c_piix4 nfsd nfs_acl lockd grace auth_rpcgss sunrpc ip_tables ext4 mbcache jbd2 sd_mod ata_generic crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ahci ttm nfit crct10dif_pclmul crct10dif_common vmw_pvscsi ata_piix libahci drm libnvdimm
vmxnet3 crc32c_intel serio_raw libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 511 Comm: jbd2/dm-0-8 Kdump: loaded Tainted: G           OE  ------------ T 3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff923a56204200 ti: ffff923a560a8000 task.ti: ffff923a560a8000
RIP: 0010:[<ffffffff8c90c865>]  [<ffffffff8c90c865>] scsi_request_fn+0x135/0x680
RSP: 0000:ffff923a560abb80  EFLAGS: 00000202
RAX: 0000000123e25220 RBX: ffff9239c9acde00 RCX: 0000000123e25b8d
RDX: 0000000123e24805 RSI: ffff9239ab429f50 RDI: ffff923a56630450
RBP: ffff923a560abbd8 R08: ffff923a56630598 R09: 0000000000000000
R10: ffff923a561a7c00 R11: ffff9238ed413180 R12: ffff923a560abb10
R13: ffffffffc05fe04f R14: ffff923a560abaf0 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff923a7fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f67e62f72b0 CR3: 000000089aa34000 CR4: 00000000001607f0
Call Trace:
[<ffffffff8c7687d9>] __blk_run_queue+0x39/0x50
[<ffffffff8c7688aa>] queue_unplugged+0x2a/0xa0
[<ffffffff8c76c2f8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff8c76c764>] blk_finish_plug+0x14/0x50
[<ffffffffc0685fe1>] jbd2_journal_commit_transaction+0xe31/0x19d0 [jbd2]
[<ffffffff8c42c5ee>] ? __switch_to+0xce/0x590
[<ffffffffc068c1d9>] kjournald2+0xc9/0x260 [jbd2]
[<ffffffff8c4cc790>] ? wake_up_atomic_t+0x40/0x40
[<ffffffffc068c110>] ? commit_timeout+0x20/0x20 [jbd2]
[<ffffffff8c4cb621>] kthread+0xd1/0xe0
[<ffffffff8c4cb550>] ? insert_kthread_work+0x40/0x40
[<ffffffff8cbc51f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8c4cb550>] ? insert_kthread_work+0x40/0x40
Code: 8b 85 40 04 00 00 a8 02 0f 85 18 01 00 00 4c 89 f7 e8 40 f3 e5 ff 49 8b bd 58 04 00 00 c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <4d> 8b be 00 01 00 00 4d 85 ff 0f 84 3d 04 00 00 49 8b 85 40 04
Complete report #1091010
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc01163be
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc014271e
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc01b02e0
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff9f4e3e70
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff9f4ed59c
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffff9f353869
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffff9f35392a
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff9f357268
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x1d8
9
blk_finish_plug
vmlinux 0xffffffff9f3576d4
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x14
10
jbd2_journal_commit_transaction
jbd2 0xffffffffc046cf31
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xe31
11
kjournald2
jbd2 0xffffffffc0472f89
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xc9
12
? wake_up_atomic_t
vmlinux 0xffffffff9f0c6f00
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x30
13
? commit_timeout
jbd2 0xffffffffc0472ec0
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x10
14
kthread
vmlinux 0xffffffff9f0c5e11
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xd1
15
? insert_kthread_work
vmlinux 0xffffffff9f0c5d40
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x40
16
ret_from_fork_nospec_begin
vmlinux 0xffffffff9f794df7
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x21
17
? insert_kthread_work
vmlinux 0xffffffff9f0c5d40
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#10 stuck for 26s! [jbd2/sdb2-8:904]
Modules linked in: binfmt_misc resguard_linux(OE) secmodel_linux(OE) syshook_linux(OE) secmodel3(OE) xt_set ip_set_hash_net xt_NFLOG nfnetlink_log ip_set xt_CHECKSUM iptable_raw ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat iptable_mangle xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock nf_conntrack_netlink nfnetlink nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack sunrpc ext4 mbcache jbd2 iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev joydev vmw_balloon pcspkr sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx
drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common crc32c_intel mptspi libata scsi_transport_spi mptscsih serio_raw mptbase vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 10 PID: 904 Comm: jbd2/sdb2-8 Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff8d2583fdb180 ti: ffff8d2583be0000 task.ti: ffff8d2583be0000
RIP: 0010:[<ffffffffc01163be>]  [<ffffffffc01163be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff8d2583be3a68  EFLAGS: 00000246
RAX: ffff9d74c6580000 RBX: ffff8d24b578c788 RCX: 000000000000003a
RDX: ffff8d259ffab200 RSI: ffff8d347f4f0000 RDI: 000000000000000e
RBP: ffff8d2583be3a78 R08: 0000000000000003 R09: 0000000cad373fff
R10: ffff8d259d79e800 R11: ffff8d24ba117480 R12: ffff8d273b10cd80
R13: ffff8d2583be39dc R14: ffffffff9f35c28b R15: ffff8d2583be3a20
FS:  0000000000000000(0000) GS:ffff8d347d880000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000fd28c000 CR3: 000000017c382000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc014271e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc01b02e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffff9f4e3e70>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff9f4ed59c>] scsi_request_fn+0x4ac/0x680
[<ffffffff9f353869>] __blk_run_queue+0x39/0x50
[<ffffffff9f35392a>] queue_unplugged+0x2a/0xa0
[<ffffffff9f357268>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff9f3576d4>] blk_finish_plug+0x14/0x40
[<ffffffffc046cf31>] jbd2_journal_commit_transaction+0xe31/0x19c0 [jbd2]
[<ffffffffc0472f89>] kjournald2+0xc9/0x260 [jbd2]
[<ffffffff9f0c6f00>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffc0472ec0>] ? commit_timeout+0x10/0x10 [jbd2]
[<ffffffff9f0c5e11>] kthread+0xd1/0xe0
[<ffffffff9f0c5d40>] ? insert_kthread_work+0x40/0x40
[<ffffffff9f794df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9f0c5d40>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 43 12
Complete report #718460
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc024944e
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc020f74e
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc01f22f0
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffa2102fe0
Build id: 3.10.0-1160.88.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffa210cb8c
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffffa1f68649
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffa1f6871a
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffa1f6c168
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x1d8
9
blk_finish_plug
vmlinux 0xffffffffa1f6c5d4
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x14
10
jbd2_journal_commit_transaction
jbd2 0xffffffffc05f9fe1
Build id: 3.10.0-1160.88.1.el7.x86_64 		0xe31
11
? __switch_to
vmlinux 0xffffffffa1c2c5ee
Build id: 3.10.0-1160.88.1.el7.x86_64 		0xce
12
? _raw_spin_unlock_irqrestore
vmlinux 0xffffffffa23ba385
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x15
13
kjournald2
jbd2 0xffffffffc06001d9
Build id: 3.10.0-1160.88.1.el7.x86_64 		0xc9
14
? wake_up_atomic_t
vmlinux 0xffffffffa1ccc790
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x40
15
? commit_timeout
jbd2 0xffffffffc0600110
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x20
16
kthread
vmlinux 0xffffffffa1ccb621
Build id: 3.10.0-1160.88.1.el7.x86_64 		0xd1
17
? insert_kthread_work
vmlinux 0xffffffffa1ccb550
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x40
18
ret_from_fork_nospec_begin
vmlinux 0xffffffffa23c51f7
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x21
19
? insert_kthread_work
vmlinux 0xffffffffa1ccb550
Build id: 3.10.0-1160.88.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [jbd2/sdb-8:879]
Modules linked in: vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 nfit libnvdimm coretemp iosf_mbi ppdev crc32_pclmul vmw_balloon ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr sg joydev parport_pc vmw_vmci i2c_piix4 parport ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm pata_acpi drm mptspi ata_piix scsi_transport_spi mptscsih crct10dif_pclmul crct10dif_common libata mptbase crc32c_intel serio_raw vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 879 Comm: jbd2/sdb-8 Kdump: loaded Tainted: G             L ------------   3.10.0-1160.88.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff925b3805d280 ti: ffff925a353a8000 task.ti: ffff925a353a8000
RIP: 0010:[<ffffffffc024944e>]  [<ffffffffc024944e>] mpt_put_msg_frame+0x5e/0x90 [mptbase]
RSP: 0018:ffff925a353aba68  EFLAGS: 00000246
RAX: ffffbb6581c00000 RBX: ffff925c34079588 RCX: 0000000000000029
RDX: ffff925bbdbc4a00 RSI: ffff925c3bc54000 RDI: 000000000000000e
RBP: ffff925a353aba78 R08: 0000000000000003 R09: 000000033695cfff
R10: ffff925c3aa66000 R11: ffff925a3f190e00 R12: ffff925c07d7e100
R13: ffff925a353ab9dc R14: ffffffffa1f713fb R15: ffff925a353aba20
FS:  0000000000000000(0000) GS:ffff925b3bc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000060252384 CR3: 000000023b5be000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffc020f74e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc01f22f0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffa2102fe0>] scsi_dispatch_cmd+0xb0/0x250
[<ffffffffa210cb8c>] scsi_request_fn+0x4ac/0x680
[<ffffffffa1f68649>] __blk_run_queue+0x39/0x50
[<ffffffffa1f6871a>] queue_unplugged+0x2a/0xa0
[<ffffffffa1f6c168>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffa1f6c5d4>] blk_finish_plug+0x14/0x50
[<ffffffffc05f9fe1>] jbd2_journal_commit_transaction+0xe31/0x19d0 [jbd2]
[<ffffffffa1c2c5ee>] ? __switch_to+0xce/0x590
[<ffffffffa23ba385>] ? _raw_spin_unlock_irqrestore+0x15/0x20
[<ffffffffc06001d9>] kjournald2+0xc9/0x260 [jbd2]
[<ffffffffa1ccc790>] ? wake_up_atomic_t+0x40/0x40
[<ffffffffc0600110>] ? commit_timeout+0x20/0x20 [jbd2]
[<ffffffffa1ccb621>] kthread+0xd1/0xe0
[<ffffffffa1ccb550>] ? insert_kthread_work+0x40/0x40
[<ffffffffa23c51f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa1ccb550>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 14 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 cc cc cc cc 48 8d 76 08 0f b7 c8 44 89 e2 48 c7
Complete report #710367
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc01633be
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc010471e
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc01902e0
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffb3ce4870
Build id: 3.10.0-1160.59.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffb3cedf9c
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffffb3b53f29
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffb3b53fea
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffb3b578e8
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x1d8
9
blk_finish_plug
vmlinux 0xffffffffb3b57d54
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x14
10
jbd2_journal_commit_transaction
jbd2 0xffffffffc0392f31
Build id: 3.10.0-1160.59.1.el7.x86_64 		0xe31
11
? __switch_to
vmlinux 0xffffffffb382b59e
Build id: 3.10.0-1160.59.1.el7.x86_64 		0xce
12
kjournald2
jbd2 0xffffffffc0398f89
Build id: 3.10.0-1160.59.1.el7.x86_64 		0xc9
13
? wake_up_atomic_t
vmlinux 0xffffffffb38c6f50
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x30
14
? commit_timeout
jbd2 0xffffffffc0398ec0
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x10
15
kthread
vmlinux 0xffffffffb38c5e61
Build id: 3.10.0-1160.59.1.el7.x86_64 		0xd1
16
? ext4_mark_inode_dirty
ext4 0xffffffffc03b7a00
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x270
17
? insert_kthread_work
vmlinux 0xffffffffb38c5d90
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x40
18
ret_from_fork_nospec_begin
vmlinux 0xffffffffb3f99ddd
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x7
19
? insert_kthread_work
vmlinux 0xffffffffb38c5d90
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [jbd2/sdb1-8:384]
Modules linked in: vmw_vsock_vmci_transport vmw_vmci vsock dm_mirror dm_region_hash dm_log dm_mod iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr vmw_balloon joydev parport_pc sg parport i2c_piix4 ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ahci libahci ata_piix ttm drm libata crct10dif_pclmul crct10dif_common mptspi crc32c_intel e1000 nfit serio_raw scsi_transport_spi mptscsih mptbase libnvdimm drm_panel_orientation_quirks floppy fuse
CPU: 0 PID: 384 Comm: jbd2/sdb1-8 Tainted: G             L ------------   3.10.0-1160.59.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff93a777be6300 ti: ffff93a777bfc000 task.ti: ffff93a777bfc000
RIP: 0010:[<ffffffffc01633be>]  [<ffffffffc01633be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0000:ffff93a777bffa68  EFLAGS: 00000246
RAX: ffffa76d00680000 RBX: ffff93a77a613588 RCX: 0000000000000015
RDX: ffff93a73673f400 RSI: ffff93a736158000 RDI: 000000000000000e
RBP: ffff93a777bffa78 R08: 0000000000000003 R09: 0000000052117fff
R10: ffff93a778048400 R11: ffff93a777bfaa80 R12: ffff93a73676d800
R13: ffff93a777bff9dc R14: ffffffffb3b5c90b R15: ffff93a777bffa20
FS:  0000000000000000(0000) GS:ffff93a77fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f293c653000 CR3: 00000000793b4000 CR4: 00000000003607f0
Call Trace:
[<ffffffffc010471e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc01902e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffb3ce4870>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffb3cedf9c>] scsi_request_fn+0x4ac/0x680
[<ffffffffb3b53f29>] __blk_run_queue+0x39/0x50
[<ffffffffb3b53fea>] queue_unplugged+0x2a/0xa0
[<ffffffffb3b578e8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffb3b57d54>] blk_finish_plug+0x14/0x40
[<ffffffffc0392f31>] jbd2_journal_commit_transaction+0xe31/0x19c0 [jbd2]
[<ffffffffb382b59e>] ? __switch_to+0xce/0x580
[<ffffffffc0398f89>] kjournald2+0xc9/0x260 [jbd2]
[<ffffffffb38c6f50>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffc0398ec0>] ? commit_timeout+0x10/0x10 [jbd2]
[<ffffffffb38c5e61>] kthread+0xd1/0xe0
[<ffffffffc03b7a00>] ? ext4_mark_inode_dirty+0x270/0x270 [ext4]
[<ffffffffb38c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffffb3f99ddd>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffb38c5d90>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 13 17
Complete report #506449
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc044e3be
Build id: 3.10.0-1160.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc047a71e
Build id: 3.10.0-1160.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc048f2e0
Build id: 3.10.0-1160.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff922e3980
Build id: 3.10.0-1160.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff922ed0ac
Build id: 3.10.0-1160.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffff921534d9
Build id: 3.10.0-1160.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffff9215359a
Build id: 3.10.0-1160.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff92156dd8
Build id: 3.10.0-1160.el7.x86_64 		0x1d8
9
blk_finish_plug
vmlinux 0xffffffff92157244
Build id: 3.10.0-1160.el7.x86_64 		0x14
10
jbd2_journal_commit_transaction
jbd2 0xffffffffc0678f31
Build id: 3.10.0-1160.el7.x86_64 		0xe31
11
? finish_task_switch
vmlinux 0xffffffff91ed4acf
Build id: 3.10.0-1160.el7.x86_64 		0x14f
12
kjournald2
jbd2 0xffffffffc067ef89
Build id: 3.10.0-1160.el7.x86_64 		0xc9
13
? wake_up_atomic_t
vmlinux 0xffffffff91ec6d10
Build id: 3.10.0-1160.el7.x86_64 		0x30
14
? commit_timeout
jbd2 0xffffffffc067eec0
Build id: 3.10.0-1160.el7.x86_64 		0x10
15
kthread
vmlinux 0xffffffff91ec5c21
Build id: 3.10.0-1160.el7.x86_64 		0xd1
16
? insert_kthread_work
vmlinux 0xffffffff91ec5b50
Build id: 3.10.0-1160.el7.x86_64 		0x40
17
ret_from_fork_nospec_begin
vmlinux 0xffffffff92593df7
Build id: 3.10.0-1160.el7.x86_64 		0x21
18
? insert_kthread_work
vmlinux 0xffffffff91ec5b50
Build id: 3.10.0-1160.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 25s! [jbd2/dm-0-8:411]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter binfmt_misc vmw_vsock_vmci_transport vsock bnep sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 aesni_intel snd_rawmidi snd_ac97_codec lrw gf128mul ac97_bus glue_helper snd_seq ablk_helper btusb cryptd joydev pcspkr snd_seq_device ppdev snd_pcm btrtl btbcm btintel bluetooth snd_timer snd soundcore rfkill vmw_balloon parport_pc parport sg vmw_vmci i2c_piix4 ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic
pata_acpi vmwgfx nfit drm_kms_helper libnvdimm syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm ata_piix libata mptspi scsi_transport_spi mptscsih serio_raw mptbase e1000 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 411 Comm: jbd2/dm-0-8 Kdump: loaded Not tainted 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff956eb597d280 ti: ffff956ef09f4000 task.ti: ffff956ef09f4000
RIP: 0010:[<ffffffffc044e3be>]  [<ffffffffc044e3be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff956ef09f7a68  EFLAGS: 00000246
RAX: ffffb1f7003c0000 RBX: ffff956e8e2511a0 RCX: 000000000000000f
RDX: ffff956eb555f400 RSI: ffff956eb581a000 RDI: 000000000000000e
RBP: ffff956ef09f7a78 R08: 0000000000000003 R09: 000000000171dfff
R10: ffff956eb5b04c00 R11: ffff956eb5a50c40 R12: ffff956ef2e3f000
R13: ffff956ef09f79dc R14: ffffffff9215bdfb R15: ffff956ef09f7a20
FS:  0000000000000000(0000) GS:ffff956efb600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa0c9f64000 CR3: 000000007243a000 CR4: 00000000003607f0
Call Trace:
[<ffffffffc047a71e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc048f2e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffff922e3980>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff922ed0ac>] scsi_request_fn+0x4ac/0x680
[<ffffffff921534d9>] __blk_run_queue+0x39/0x50
[<ffffffff9215359a>] queue_unplugged+0x2a/0xa0
[<ffffffff92156dd8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff92157244>] blk_finish_plug+0x14/0x40
[<ffffffffc0678f31>] jbd2_journal_commit_transaction+0xe31/0x19c0 [jbd2]
[<ffffffff91ed4acf>] ? finish_task_switch+0x14f/0x1c0
[<ffffffffc067ef89>] kjournald2+0xc9/0x260 [jbd2]
[<ffffffff91ec6d10>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffc067eec0>] ? commit_timeout+0x10/0x10 [jbd2]
[<ffffffff91ec5c21>] kthread+0xd1/0xe0
[<ffffffff91ec5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffff92593df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff91ec5b50>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 c3 45
Complete report #394121
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc04323be
Build id: 3.10.0-957.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc044d71e
Build id: 3.10.0-957.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc041b2e0
Build id: 3.10.0-957.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffbd6d0960
Build id: 3.10.0-957.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffbd6d9efc
Build id: 3.10.0-957.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffffbd542ff9
Build id: 3.10.0-957.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffbd5430ba
Build id: 3.10.0-957.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffbd5468e8
Build id: 3.10.0-957.el7.x86_64 		0x1d8
9
blk_finish_plug
vmlinux 0xffffffffbd546d54
Build id: 3.10.0-957.el7.x86_64 		0x14
10
jbd2_journal_commit_transaction
jbd2 0xffffffffc05cdec6
Build id: 3.10.0-957.el7.x86_64 		0xe46
11
kjournald2
jbd2 0xffffffffc05d3e89
Build id: 3.10.0-957.el7.x86_64 		0xc9
12
? wake_up_atomic_t
vmlinux 0xffffffffbd2c2d00
Build id: 3.10.0-957.el7.x86_64 		0x30
13
? commit_timeout
jbd2 0xffffffffc05d3dc0
Build id: 3.10.0-957.el7.x86_64 		0x10
14
kthread
vmlinux 0xffffffffbd2c1c31
Build id: 3.10.0-957.el7.x86_64 		0xd1
15
? insert_kthread_work
vmlinux 0xffffffffbd2c1b60
Build id: 3.10.0-957.el7.x86_64 		0x40
16
ret_from_fork_nospec_begin
vmlinux 0xffffffffbd974c37
Build id: 3.10.0-957.el7.x86_64 		0x21
17
? insert_kthread_work
vmlinux 0xffffffffbd2c1b60
Build id: 3.10.0-957.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [node_exporter:7376]
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [jbd2/dm-0-8:3736]
Modules linked in: binfmt_misc nfsv3 nfs_acl ip_vs nf_conntrack libcrc32c rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache vmw_vsock_vmci_transport vsock sunrpc ppdev coretemp vmw_balloon pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif sr_mod crct10dif_generic cdrom crct10dif_common ata_generic pata_acpi serio_raw vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm vmxnet3 drm ata_piix mptspi scsi_transport_spi mptscsih mptbase libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 3736 Comm: jbd2/dm-0-8 Tainted: G        W    L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff91ccb65b1040 ti: ffff91cdb519c000 task.ti: ffff91cdb519c000
RIP: 0010:[<ffffffffc04323be>]  [<ffffffffc04323be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff91cdb519fa68  EFLAGS: 00000246
RAX: ffffb543806c0000 RBX: 0000000000000000 RCX: 0000000000000019
RDX: ffff91ccb64b9000 RSI: ffff91cdb5a7a000 RDI: 000000000000000e
RBP: ffff91cdb519fa78 R08: 0000000000000003 R09: 0000000129729fff
R10: ffff91cdb5a7d0d8 R11: ffff91cc8abc2700 R12: ffff91cdb5a7d0d8
R13: ffff91cc8abc2700 R14: ffffffffbd54b83b R15: ffff91cdb519fa78
FS:  0000000000000000(0000) GS:ffff91cdbfd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5c925db906 CR3: 00000000b8e3a000 CR4: 00000000000007e0
Call Trace:
[<ffffffffc044d71e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc041b2e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffbd6d0960>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffbd6d9efc>] scsi_request_fn+0x4cc/0x680
[<ffffffffbd542ff9>] __blk_run_queue+0x39/0x50
[<ffffffffbd5430ba>] queue_unplugged+0x2a/0xa0
[<ffffffffbd5468e8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffbd546d54>] blk_finish_plug+0x14/0x40
[<ffffffffc05cdec6>] jbd2_journal_commit_transaction+0xe46/0x19b0 [jbd2]
[<ffffffffc05d3e89>] kjournald2+0xc9/0x260 [jbd2]
[<ffffffffbd2c2d00>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffc05d3dc0>] ? commit_timeout+0x10/0x10 [jbd2]
[<ffffffffbd2c1c31>] kthread+0xd1/0xe0
[<ffffffffbd2c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffffbd974c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffbd2c1b60>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 03 44
Complete report #386057
Frame # Function Binary Source or offset Line
1
scsi_dispatch_cmd
vmlinux 0xffffffff936d0960
Build id: 3.10.0-957.el7.x86_64 		0xb0
2
scsi_request_fn
vmlinux 0xffffffff936d9efc
Build id: 3.10.0-957.el7.x86_64 		0x4cc
3
__blk_run_queue
vmlinux 0xffffffff93542ff9
Build id: 3.10.0-957.el7.x86_64 		0x39
4
queue_unplugged
vmlinux 0xffffffff935430ba
Build id: 3.10.0-957.el7.x86_64 		0x2a
5
blk_flush_plug_list
vmlinux 0xffffffff935468e8
Build id: 3.10.0-957.el7.x86_64 		0x1d8
6
blk_finish_plug
vmlinux 0xffffffff93546d54
Build id: 3.10.0-957.el7.x86_64 		0x14
7
jbd2_journal_commit_transaction
jbd2 0xffffffffc0467ec6
Build id: 3.10.0-957.el7.x86_64 		0xe46
8
kjournald2
jbd2 0xffffffffc046de89
Build id: 3.10.0-957.el7.x86_64 		0xc9
9
? wake_up_atomic_t
vmlinux 0xffffffff932c2d00
Build id: 3.10.0-957.el7.x86_64 		0x30
10
? commit_timeout
jbd2 0xffffffffc046ddc0
Build id: 3.10.0-957.el7.x86_64 		0x10
11
kthread
vmlinux 0xffffffff932c1c31
Build id: 3.10.0-957.el7.x86_64 		0xd1
12
? insert_kthread_work
vmlinux 0xffffffff932c1b60
Build id: 3.10.0-957.el7.x86_64 		0x40
13
ret_from_fork_nospec_begin
vmlinux 0xffffffff93974c1d
Build id: 3.10.0-957.el7.x86_64 		0x7
14
? insert_kthread_work
vmlinux 0xffffffff932c1b60
Build id: 3.10.0-957.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 36s! [kworker/3:1:115625]
[<ffffffff936d0960>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff936d9efc>] scsi_request_fn+0x4cc/0x680
[<ffffffff93542ff9>] __blk_run_queue+0x39/0x50
[<ffffffff935430ba>] queue_unplugged+0x2a/0xa0
[<ffffffff935468e8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff93546d54>] blk_finish_plug+0x14/0x40
[<ffffffffc0467ec6>] jbd2_journal_commit_transaction+0xe46/0x19b0 [jbd2]
[<ffffffffc046de89>] kjournald2+0xc9/0x260 [jbd2]
[<ffffffff932c2d00>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffc046ddc0>] ? commit_timeout+0x10/0x10 [jbd2]
[<ffffffff932c1c31>] kthread+0xd1/0xe0
[<ffffffff932c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffff93974c1d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff932c1b60>] ? insert_kthread_work+0x40/0x40
Complete report #268347
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc01e73be
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc01cd71e
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc020b2e0
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffb4edeb10
Build id: 3.10.0-1062.12.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffb4ee817c
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffffb4d4f0c9
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffb4d4f18a
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffb4d529d8
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x1d8
9
blk_finish_plug
vmlinux 0xffffffffb4d52e44
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x14
10
jbd2_journal_commit_transaction
jbd2 0xffffffffc05c2f01
Build id: 3.10.0-1062.12.1.el7.x86_64 		0xe61
11
kjournald2
jbd2 0xffffffffc05c8ee9
Build id: 3.10.0-1062.12.1.el7.x86_64 		0xc9
12
? wake_up_atomic_t
vmlinux 0xffffffffb4ac72e0
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x30
13
? commit_timeout
jbd2 0xffffffffc05c8e20
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x10
14
kthread
vmlinux 0xffffffffb4ac61f1
Build id: 3.10.0-1062.12.1.el7.x86_64 		0xd1
15
? insert_kthread_work
vmlinux 0xffffffffb4ac6120
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x40
16
ret_from_fork_nospec_begin
vmlinux 0xffffffffb518dd1d
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x7
17
? insert_kthread_work
vmlinux 0xffffffffb4ac6120
Build id: 3.10.0-1062.12.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 74s! [jbd2/sdb-8:2399]
Modules linked in: cts rpcsec_gss_krb5 veth nfsd nfsv3 nfs_acl nfs lockd grace fscache openafs(POE) xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) nls_utf8 isofs vmw_vsock_vmci_transport vsock ext4 mbcache jbd2 ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg joydev pcspkr i2c_piix4 parport_pc vmw_vmci parport binfmt_misc auth_rpcgss sunrpc ip_tables xfs libcrc32c vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nfit crc32c_intel serio_raw libnvdimm vmxnet3 ata_generic drm_panel_orientation_quirks pata_acpi sd_mod
crc_t10dif crct10dif_generic sr_mod crct10dif_pclmul crct10dif_common cdrom mptspi scsi_transport_spi mptscsih mptbase ata_piix libata dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 2399 Comm: jbd2/sdb-8 Kdump: loaded Tainted: P           OEL ------------ T 3.10.0-1062.12.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8c7b4bf7d230 ti: ffff8c7ec96c0000 task.ti: ffff8c7ec96c0000
RIP: 0010:[<ffffffffc01e73be>]  [<ffffffffc01e73be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff8c7ec96c3a70  EFLAGS: 00000246
RAX: ffffa769869c0000 RBX: ffff8c74111a3300 RCX: 000000000000001c
RDX: ffff8c7b4bbce200 RSI: ffff8c7effceb000 RDI: 000000000000000e
RBP: ffff8c7ec96c3a80 R08: 0000000000000003 R09: 0000000a292c0fff
R10: ffff8c7ecbf740d8 R11: ffff8c7688e33180 R12: 0000000100000019
R13: ffff8c77ecd74a80 R14: ffff8c7ec96c39e4 R15: ffffffffb4d5792b
FS:  0000000000000000(0000) GS:ffff8c7effc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007efe08a8af00 CR3: 000000093f60a000 CR4: 00000000007607e0
PKRU: 00000000
Call Trace:
[<ffffffffc01cd71e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc020b2e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffb4edeb10>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffb4ee817c>] scsi_request_fn+0x4cc/0x680
[<ffffffffb4d4f0c9>] __blk_run_queue+0x39/0x50
[<ffffffffb4d4f18a>] queue_unplugged+0x2a/0xa0
[<ffffffffb4d529d8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffb4d52e44>] blk_finish_plug+0x14/0x40
[<ffffffffc05c2f01>] jbd2_journal_commit_transaction+0xe61/0x19f0 [jbd2]
[<ffffffffc05c8ee9>] kjournald2+0xc9/0x260 [jbd2]
[<ffffffffb4ac72e0>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffc05c8e20>] ? commit_timeout+0x10/0x10 [jbd2]
[<ffffffffb4ac61f1>] kthread+0xd1/0xe0
[<ffffffffb4ac6120>] ? insert_kthread_work+0x40/0x40
[<ffffffffb518dd1d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffb4ac6120>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 53 1f
Complete report #238471
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc020d3be
Build id: 3.10.0-957.27.2.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc029271e
Build id: 3.10.0-957.27.2.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc02ca2e0
Build id: 3.10.0-957.27.2.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffa9ad2ee0
Build id: 3.10.0-957.27.2.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffa9adc47c
Build id: 3.10.0-957.27.2.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffffa9944e59
Build id: 3.10.0-957.27.2.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffa9944f1a
Build id: 3.10.0-957.27.2.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffa9948758
Build id: 3.10.0-957.27.2.el7.x86_64 		0x1d8
9
blk_finish_plug
vmlinux 0xffffffffa9948bc4
Build id: 3.10.0-957.27.2.el7.x86_64 		0x14
10
jbd2_journal_commit_transaction
jbd2 0xffffffffc0421ec6
Build id: 3.10.0-957.27.2.el7.x86_64 		0xe46
11
kjournald2
jbd2 0xffffffffc0427e89
Build id: 3.10.0-957.27.2.el7.x86_64 		0xc9
12
? wake_up_atomic_t
vmlinux 0xffffffffa96c3f50
Build id: 3.10.0-957.27.2.el7.x86_64 		0x30
13
? commit_timeout
jbd2 0xffffffffc0427dc0
Build id: 3.10.0-957.27.2.el7.x86_64 		0x10
14
kthread
vmlinux 0xffffffffa96c2e81
Build id: 3.10.0-957.27.2.el7.x86_64 		0xd1
15
? insert_kthread_work
vmlinux 0xffffffffa96c2db0
Build id: 3.10.0-957.27.2.el7.x86_64 		0x40
16
ret_from_fork_nospec_begin
vmlinux 0xffffffffa9d76c37
Build id: 3.10.0-957.27.2.el7.x86_64 		0x21
17
? insert_kthread_work
vmlinux 0xffffffffa96c2db0
Build id: 3.10.0-957.27.2.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [jbd2/sdb1-8:1129]
Modules linked in: udp_diag tcp_diag inet_diag binfmt_misc ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter dm_mirror dm_region_hash dm_log dm_mod ppdev vmw_balloon sb_edac iosf_mbi crc32_pclmul nfit ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper libnvdimm cryptd joydev pcspkr sg parport_pc parport i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache
jbd2 sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi ata_piix scsi_transport_spi crct10dif_pclmul crct10dif_common e1000 mptscsih crc32c_intel libata mptbase serio_raw drm_panel_orientation_quirks
CPU: 0 PID: 1129 Comm: jbd2/sdb1-8 Kdump: loaded Not tainted 3.10.0-957.27.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9426222530c0 ti: ffff942621bdc000 task.ti: ffff942621bdc000
RIP: 0010:[<ffffffffc020d3be>]  [<ffffffffc020d3be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff942621bdfa68  EFLAGS: 00000246
RAX: ffffb0fb03640000 RBX: ffff942435313488 RCX: 0000000000000007
RDX: ffff942628653200 RSI: ffff942628bbd000 RDI: 000000000000000e
RBP: ffff942621bdfa78 R08: 0000000000000003 R09: 00000001efd42fff
R10: ffff942628bb80d8 R11: ffff94210ad24e00 R12: ffff94262857f200
R13: ffff942621bdf9dc R14: ffffffffa994d6ab R15: ffff942621bdfa20
FS:  0000000000000000(0000) GS:ffff94263fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f659f186000 CR3: 0000000212766000 CR4: 00000000003607f0
Call Trace:
[<ffffffffc029271e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc02ca2e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffa9ad2ee0>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffa9adc47c>] scsi_request_fn+0x4cc/0x680
[<ffffffffa9944e59>] __blk_run_queue+0x39/0x50
[<ffffffffa9944f1a>] queue_unplugged+0x2a/0xa0
[<ffffffffa9948758>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffa9948bc4>] blk_finish_plug+0x14/0x40
[<ffffffffc0421ec6>] jbd2_journal_commit_transaction+0xe46/0x19b0 [jbd2]
[<ffffffffc0427e89>] kjournald2+0xc9/0x260 [jbd2]
[<ffffffffa96c3f50>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffc0427dc0>] ? commit_timeout+0x10/0x10 [jbd2]
[<ffffffffa96c2e81>] kthread+0xd1/0xe0
[<ffffffffa96c2db0>] ? insert_kthread_work+0x40/0x40
[<ffffffffa9d76c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa96c2db0>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 b3 21
Complete report #192782
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffa01883be
Build id: 3.10.0-327.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffa00a8729
Build id: 3.10.0-327.el7.x86_64 		0x249
3
mptspi_qcmd
mptspi 0xffffffffa005f2b0
Build id: 3.10.0-327.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff81417b1a
Build id: 3.10.0-327.el7.x86_64 		0xaa
5
scsi_request_fn
vmlinux 0xffffffff81420aa1
Build id: 3.10.0-327.el7.x86_64 		0x501
6
__blk_run_queue
vmlinux 0xffffffff812c73e3
Build id: 3.10.0-327.el7.x86_64 		0x33
7
queue_unplugged
vmlinux 0xffffffff812c749a
Build id: 3.10.0-327.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff812cbd18
Build id: 3.10.0-327.el7.x86_64 		0x1d8
9
blk_finish_plug
vmlinux 0xffffffff812cc124
Build id: 3.10.0-327.el7.x86_64 		0x14
10
jbd2_journal_commit_transaction
jbd2 0xffffffffa020ed1b
Build id: 3.10.0-327.el7.x86_64 		0xe4b
11
? __switch_to
vmlinux 0xffffffff81013588
Build id: 3.10.0-327.el7.x86_64 		0xf8
12
kjournald2
jbd2 0xffffffffa0213d79
Build id: 3.10.0-327.el7.x86_64 		0xc9
13
? wake_up_atomic_t
vmlinux 0xffffffff810a6ae0
Build id: 3.10.0-327.el7.x86_64 		0x30
14
? commit_timeout
jbd2 0xffffffffa0213cb0
Build id: 3.10.0-327.el7.x86_64 		0x10
15
kthread
vmlinux 0xffffffff810a5aef
Build id: 3.10.0-327.el7.x86_64 		0xcf
16
? kthread_create_on_node
vmlinux 0xffffffff810a5a20
Build id: 3.10.0-327.el7.x86_64 		0x140
17
ret_from_fork
vmlinux 0xffffffff81645858
Build id: 3.10.0-327.el7.x86_64 		0x58
18
? kthread_create_on_node
vmlinux 0xffffffff810a5a20
Build id: 3.10.0-327.el7.x86_64 		0x140 
BUG: soft lockup - CPU#0 stuck for 22s! [jbd2/dm-2-8:8191]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock bnep snd_seq_midi snd_seq_midi_event ppdev crc32_pclmul vmw_balloon ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr btusb bluetooth rfkill snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm sg snd_timer snd soundcore vmw_vmci i2c_piix4 shpchp parport_pc parport binfmt_misc nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_pclmul crct10dif_common crc32c_intel
ata_generic pata_acpi serio_raw e1000 mptspi scsi_transport_spi mptscsih mptbase vmwgfx drm_kms_helper ttm ata_piix drm libata i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 8191 Comm: jbd2/dm-2-8 Tainted: G             L ------------   3.10.0-327.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff880330256780 ti: ffff88033223c000 task.ti: ffff88033223c000
RIP: 0010:[<ffffffffa01883be>]  [<ffffffffa01883be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff88033223fa68  EFLAGS: 00000246
RAX: ffffc90009a40000 RBX: ffff880331bb04a0 RCX: 0000000000000004
RDX: ffff880035cb9600 RSI: ffff88032edf9000 RDI: 000000000000000e
RBP: ffff88033223fa78 R08: 0000000000000003 R09: ffff88032edfe0d8
R10: ffff880035371500 R11: ffff880035371500 R12: ffff8802390de700
R13: ffff88033223f9dc R14: ffffffff812d06bb R15: ffff88033223fa20
FS:  0000000000000000(0000) GS:ffff88033ac00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f87061b3000 CR3: 00000000b0973000 CR4: 00000000001407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff88032edf9d30 0000000000000054 ffff88033223fb20 ffffffffa00a8729
ffff88032edf9008 040000003223fae0 0000000000000004 ffff880035371500
0000000000000010 ffff88032edf9188 0000006000000004 ffff8800351029b0
Call Trace:
[<ffffffffa00a8729>] mptscsih_qcmd+0x249/0x820 [mptscsih]
[<ffffffffa005f2b0>] mptspi_qcmd+0x50/0xe0 [mptspi]
[<ffffffff81417b1a>] scsi_dispatch_cmd+0xaa/0x230
[<ffffffff81420aa1>] scsi_request_fn+0x501/0x770
[<ffffffff812c73e3>] __blk_run_queue+0x33/0x40
[<ffffffff812c749a>] queue_unplugged+0x2a/0xa0
[<ffffffff812cbd18>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff812cc124>] blk_finish_plug+0x14/0x40
[<ffffffffa020ed1b>] jbd2_journal_commit_transaction+0xe4b/0x19a0 [jbd2]
[<ffffffff81013588>] ? __switch_to+0xf8/0x4b0
[<ffffffffa0213d79>] kjournald2+0xc9/0x260 [jbd2]
[<ffffffff810a6ae0>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffa0213cb0>] ? commit_timeout+0x10/0x10 [jbd2]
[<ffffffff810a5aef>] kthread+0xcf/0xe0
[<ffffffff810a5a20>] ? kthread_create_on_node+0x140/0x140
[<ffffffff81645858>] ret_from_fork+0x58/0x90
[<ffffffff810a5a20>] ? kthread_create_on_node+0x140/0x140
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 63 19
Complete report #122938
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc00753be
Build id: 3.10.0-693.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc00ce729
Build id: 3.10.0-693.el7.x86_64 		0x249
3
mptspi_qcmd
mptspi 0xffffffffc00902b0
Build id: 3.10.0-693.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff8146540a
Build id: 3.10.0-693.el7.x86_64 		0xaa
5
scsi_request_fn
vmlinux 0xffffffff8146e1cf
Build id: 3.10.0-693.el7.x86_64 		0x4df
6
__blk_run_queue
vmlinux 0xffffffff812f71d3
Build id: 3.10.0-693.el7.x86_64 		0x33
7
queue_unplugged
vmlinux 0xffffffff812f728a
Build id: 3.10.0-693.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff812fa718
Build id: 3.10.0-693.el7.x86_64 		0x1d8
9
blk_finish_plug
vmlinux 0xffffffff812fab24
Build id: 3.10.0-693.el7.x86_64 		0x14
10
jbd2_journal_commit_transaction
jbd2 0xffffffffc023de86
Build id: 3.10.0-693.el7.x86_64 		0xe46
11
? __switch_to
vmlinux 0xffffffff81029557
Build id: 3.10.0-693.el7.x86_64 		0xd7
12
kjournald2
jbd2 0xffffffffc0243a79
Build id: 3.10.0-693.el7.x86_64 		0xc9
13
? wake_up_atomic_t
vmlinux 0xffffffff810b1910
Build id: 3.10.0-693.el7.x86_64 		0x30
14
? commit_timeout
jbd2 0xffffffffc02439b0
Build id: 3.10.0-693.el7.x86_64 		0x10
15
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.el7.x86_64 		0xcf
16
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64 		0x40
17
ret_from_fork
vmlinux 0xffffffff816b4f18
Build id: 3.10.0-693.el7.x86_64 		0x58
18
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 33s! [jbd2/dm-0-8:422]
Modules linked in: fuse vmw_vsock_vmci_transport vsock iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev nfit pcspkr sg joydev vmw_balloon libnvdimm parport_pc parport shpchp i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata mptspi scsi_transport_spi mptscsih crct10dif_pclmul crct10dif_common crc32c_intel mptbase e1000 serio_raw i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 422 Comm: jbd2/dm-0-8 Tainted: G             L ------------   3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff880131da5ee0 ti: ffff8800346d4000 task.ti: ffff8800346d4000
RIP: 0010:[<ffffffffc00753be>]  [<ffffffffc00753be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff8800346d7a68  EFLAGS: 00000246
RAX: ffffc900006c0000 RBX: ffff880011c8f5a0 RCX: 000000000000000c
RDX: ffff880131f2ee00 RSI: ffff880131c77000 RDI: 000000000000000e
RBP: ffff8800346d7a78 R08: 0000000000000003 R09: ffff880131c430d8
R10: ffff880131e43640 R11: ffff880131e43640 R12: ffff88008b216d00
R13: ffff8800346d79dc R14: ffffffff812ff13b R15: ffff8800346d7a20
FS:  0000000000000000(0000) GS:ffff8801396c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f16efd69000 CR3: 00000000b79cc000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff880131c77d30 0000000000000060 ffff8800346d7b20 ffffffffc00ce729
ffff880131c77008 04000000346d7ae0 000000000000000c ffff880131e43640
0000000000000030 ffff880131c77188 000000600000000c ffff880000000007
Call Trace:
[<ffffffffc00ce729>] mptscsih_qcmd+0x249/0x820 [mptscsih]
[<ffffffffc00902b0>] mptspi_qcmd+0x50/0xe0 [mptspi]
[<ffffffff8146540a>] scsi_dispatch_cmd+0xaa/0x230
[<ffffffff8146e1cf>] scsi_request_fn+0x4df/0x680
[<ffffffff812f71d3>] __blk_run_queue+0x33/0x40
[<ffffffff812f728a>] queue_unplugged+0x2a/0xa0
[<ffffffff812fa718>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff812fab24>] blk_finish_plug+0x14/0x40
[<ffffffffc023de86>] jbd2_journal_commit_transaction+0xe46/0x19a0 [jbd2]
[<ffffffff81029557>] ? __switch_to+0xd7/0x510
[<ffffffffc0243a79>] kjournald2+0xc9/0x260 [jbd2]
[<ffffffff810b1910>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffc02439b0>] ? commit_timeout+0x10/0x10 [jbd2]
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f18>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 33 08
Complete report #20138
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc03933be
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc03e971e
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc03ae2e0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff9cce2990
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff9ccec0bc
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffff9cb527a9
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffff9cb5286a
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff9cb560a8
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x1d8
9
blk_finish_plug
vmlinux 0xffffffff9cb56514
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x14
10
jbd2_journal_commit_transaction
jbd2 0xffffffffc05b0f01
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xe31
11
kjournald2
jbd2 0xffffffffc05b6f39
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xc9
12
? wake_up_atomic_t
vmlinux 0xffffffff9c8c7780
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x30
13
? commit_timeout
jbd2 0xffffffffc05b6e70
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x10
14
kthread
vmlinux 0xffffffff9c8c6691
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xd1
15
? insert_kthread_work
vmlinux 0xffffffff9c8c65c0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x40
16
ret_from_fork_nospec_begin
vmlinux 0xffffffff9cf92d37
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x21
17
? insert_kthread_work
vmlinux 0xffffffff9c8c65c0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 37s! [jbd2/dm-0-8:444]
Modules linked in: vsock_diag unix_diag af_packet_diag netlink_diag udp_diag tcp_diag inet_diag binfmt_misc ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack libcrc32c ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock ppdev iosf_mbi crc32_pclmul vmw_balloon ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper pcspkr cryptd joydev sg parport_pc parport i2c_piix4 vmw_vmci CyProtectDrv(OE) ip_tables ext4 mbcache jbd2
sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi nfit libata scsi_transport_spi libnvdimm crct10dif_pclmul mptscsih crct10dif_common crc32c_intel serio_raw mptbase drm_panel_orientation_quirks vmxnet3 dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 444 Comm: jbd2/dm-0-8 Kdump: loaded Tainted: G           OEL ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8be419df5230 ti: ffff8be418d88000 task.ti: ffff8be418d88000
RIP: 0010:[<ffffffffc03933be>]  [<ffffffffc03933be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff8be418d8ba68  EFLAGS: 00000246
RAX: ffffb36e835c0000 RBX: ffff8be40b87c6a0 RCX: 0000000000000003
RDX: ffff8be41b9ad400 RSI: ffff8be41bb53000 RDI: 000000000000000e
RBP: ffff8be418d8ba78 R08: 0000000000000003 R09: 0000000817035fff
R10: ffff8be41aa2c000 R11: ffff8be408160700 R12: ffff8be408e7f980
R13: ffff8be418d8b9dc R14: ffffffff9cb5b0cb R15: ffff8be418d8ba20
FS:  0000000000000000(0000) GS:ffff8be43fc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3e7ecb6000 CR3: 00000004ef810000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc03e971e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc03ae2e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffff9cce2990>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff9ccec0bc>] scsi_request_fn+0x4ac/0x680
[<ffffffff9cb527a9>] __blk_run_queue+0x39/0x50
[<ffffffff9cb5286a>] queue_unplugged+0x2a/0xa0
[<ffffffff9cb560a8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff9cb56514>] blk_finish_plug+0x14/0x40
[<ffffffffc05b0f01>] jbd2_journal_commit_transaction+0xe31/0x19c0 [jbd2]
[<ffffffffc05b6f39>] kjournald2+0xc9/0x260 [jbd2]
[<ffffffff9c8c7780>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffc05b6e70>] ? commit_timeout+0x10/0x10 [jbd2]
[<ffffffff9c8c6691>] kthread+0xd1/0xe0
[<ffffffff9c8c65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff9cf92d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9c8c65c0>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 13 3a