Info

Permalink
Function
_raw_spin_unlock_irqrestore
First occurrence
2020-09-27
Last occurrence
2020-09-27
State
NEW
Components
kernel
Quality
-66

Statistics

Operating system Count
CentOS 7 294
Architecture Count
x86_64 294
Related packages Count
kernel 294
 0:3.10.0-1160.el7 55
 0:3.10.0-1127.19.1.el7 34
 0:3.10.0-1160.11.1.el7 29
 0:3.10.0-957.el7 25
 0:3.10.0-1160.53.1.el7 23
 0:3.10.0-1160.71.1.el7 18
 0:3.10.0-1160.15.2.el7 11
 0:3.10.0-1160.76.1.el7 8
 0:3.10.0-1160.108.1.el7 7
 0:3.10.0-1160.66.1.el7 7
 0:3.10.0-1160.25.1.el7 6
 0:3.10.0-1160.119.1.el7 5
 0:3.10.0-1160.36.2.el7 5
 0:3.10.0-1160.42.2.el7 5
 0:3.10.0-862.el7 5
 0:3.10.0-1062.9.1.el7 4
 0:3.10.0-1127.el7 4
 0:3.10.0-1160.62.1.el7 4
 0:3.10.0-1160.83.1.el7 4
 0:3.10.0-1062.el7 3
 0:3.10.0-1160.6.1.el7 3
 0:3.10.0-1160.88.1.el7 3
 0:3.10.0-1160.90.1.el7 3
 0:3.10.0-957.10.1.el7 3
 0:3.10.0-957.5.1.el7 3
 0:3.10.0-1160.59.1.el7 2
 0:3.10.0-1160.92.1.el7 2
 0:3.10.0-1127.13.1.el7 2
 0:3.10.0-1160.31.1.el7 2
 0:3.10.0-862.11.6.el7 1
 0:3.10.0-1062.18.1.el7 1
 0:3.10.0-1160.45.1.el7 1
 0:3.10.0-1160.80.1.el7 1
 0:3.10.0-957.21.2.el7 1
 0:3.10.0-1062.1.2.el7 1
 0:3.10.0-1127.18.2.el7 1
 0:3.10.0-1160.21.1.el7 1
 0:3.10.0-1160.49.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #1403071
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff92fba385
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x15
2
ata_scsi_queuecmd
libata 0xffffffffc03bb275
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x155
3
? ata_scsi_invalid_field
libata 0xffffffffc03b7e60
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff92d03030
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff92d0cbdc
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffff92b687d9
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffff92b688aa
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff92b6c2f8
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffff92b6c4d2
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffff92b6a537
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x157
11
submit_bio
vmlinux 0xffffffff92b6a7e0
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x70
12
? init_emergency_isa_pool
vmlinux 0xffffffff92a153e0
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x70
13
__swap_writepage
vmlinux 0xffffffff92a159a9
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x239
14
? rmap_walk
vmlinux 0xffffffff92a0f699
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x2c9
15
? _swap_info_get
vmlinux 0xffffffff92a17042
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x12
16
? page_swapcount
vmlinux 0xffffffff92a1918c
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x6c
17
swap_writepage
vmlinux 0xffffffff92a15a29
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x39
18
shrink_page_list
vmlinux 0xffffffff929dea02
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x892
19
shrink_inactive_list
vmlinux 0xffffffff929df3c6
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x1b6
20
shrink_lruvec
vmlinux 0xffffffff929dfea5
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x375
21
shrink_zone
vmlinux 0xffffffff929e02d6
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x76
22
balance_pgdat
vmlinux 0xffffffff929e1503
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x383
23
kswapd
vmlinux 0xffffffff929e18d3
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x173
24
? wake_up_atomic_t
vmlinux 0xffffffff928cc790
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x40
25
? balance_pgdat
vmlinux 0xffffffff929e1760
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x5e0
26
kthread
vmlinux 0xffffffff928cb621
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xd1
27
? insert_kthread_work
vmlinux 0xffffffff928cb550
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x40
28
ret_from_fork_nospec_begin
vmlinux 0xffffffff92fc51f7
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x21
29
? insert_kthread_work
vmlinux 0xffffffff928cb550
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 43s! [kswapd0:42]
Modules linked in: binfmt_misc xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg joydev virtio_balloon pcspkr i2c_piix4 auth_rpcgss sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_common ata_generic pata_acpi bochs_drm drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops ttm virtio_net drm net_failover failover ahci libahci ata_piix libata crc32c_intel serio_raw virtio_pci virtio_ring virtio drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 42 Comm: kswapd0 Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014
task: ffff88daf38b1080 ti: ffff88daf38c8000 task.ti: ffff88daf38c8000
RIP: 0010:[<ffffffff92fba385>]  [<ffffffff92fba385>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff88daf38cb658  EFLAGS: 00000282
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: ffff88d9f54d0018 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff88daf38cb658 R08: 0000000000000000 R09: 0000000001f3efff
R10: 0000000000000000 R11: 0000000000000001 R12: ffff88daf38cb5d8
R13: ffff88d9f5e5f798 R14: ffff88d9f5e70000 R15: ffffffff92d0a83e
FS:  0000000000000000(0000) GS:ffff88daffc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f676f6aa000 CR3: 0000000137604000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffc03bb275>] ata_scsi_queuecmd+0x155/0x450 [libata]
[<ffffffffc03b7e60>] ? ata_scsi_invalid_field+0x50/0x50 [libata]
[<ffffffff92d03030>] scsi_dispatch_cmd+0xb0/0x250
[<ffffffff92d0cbdc>] scsi_request_fn+0x4ac/0x680
[<ffffffff92b687d9>] __blk_run_queue+0x39/0x50
[<ffffffff92b688aa>] queue_unplugged+0x2a/0xa0
[<ffffffff92b6c2f8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff92b6c4d2>] blk_queue_bio+0x182/0x400
[<ffffffff92b6a537>] generic_make_request+0x157/0x390
[<ffffffff92b6a7e0>] submit_bio+0x70/0x150
[<ffffffff92a153e0>] ? init_emergency_isa_pool+0x70/0x70
[<ffffffff92a159a9>] __swap_writepage+0x239/0x280
[<ffffffff92a0f699>] ? rmap_walk+0x2c9/0x370
[<ffffffff92a17042>] ? _swap_info_get+0x12/0x60
[<ffffffff92a1918c>] ? page_swapcount+0x6c/0xa0
[<ffffffff92a15a29>] swap_writepage+0x39/0x80
[<ffffffff929dea02>] shrink_page_list+0x892/0xc40
[<ffffffff929df3c6>] shrink_inactive_list+0x1b6/0x5c0
[<ffffffff929dfea5>] shrink_lruvec+0x375/0x730
[<ffffffff929e02d6>] shrink_zone+0x76/0x1a0
[<ffffffff929e1503>] balance_pgdat+0x383/0x5e0
[<ffffffff929e18d3>] kswapd+0x173/0x430
[<ffffffff928cc790>] ? wake_up_atomic_t+0x40/0x40
[<ffffffff929e1760>] ? balance_pgdat+0x5e0/0x5e0
[<ffffffff928cb621>] kthread+0xd1/0xe0
[<ffffffff928cb550>] ? insert_kthread_work+0x40/0x40
[<ffffffff92fc51f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff928cb550>] ? insert_kthread_work+0x40/0x40
Code: aa 42 96 ff 66 90 5d c3 cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 e8 8a 42 96 ff 66 90 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 cc cc cc cc 0f 1f 44 00 00 55 48 89 e5 48
Complete report #1144789
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff8f96a175
Build id: 3.10.0-957.5.1.el7.x86_64 		0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc0195622
Build id: 3.10.0-957.5.1.el7.x86_64 		0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffff8f6d9510
Build id: 3.10.0-957.5.1.el7.x86_64 		0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffff8f6d0fe0
Build id: 3.10.0-957.5.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff8f6da57c
Build id: 3.10.0-957.5.1.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffff8f5435d9
Build id: 3.10.0-957.5.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffff8f54369a
Build id: 3.10.0-957.5.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff8f546ec8
Build id: 3.10.0-957.5.1.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffff8f5470a2
Build id: 3.10.0-957.5.1.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffff8f545267
Build id: 3.10.0-957.5.1.el7.x86_64 		0x147
11
submit_bio
vmlinux 0xffffffff8f545510
Build id: 3.10.0-957.5.1.el7.x86_64 		0x70
12
? init_emergency_isa_pool
vmlinux 0xffffffff8f3fe960
Build id: 3.10.0-957.5.1.el7.x86_64 		0x60
13
__swap_writepage
vmlinux 0xffffffff8f3fef09
Build id: 3.10.0-957.5.1.el7.x86_64 		0x239
14
? rmap_walk
vmlinux 0xffffffff8f3f8ef9
Build id: 3.10.0-957.5.1.el7.x86_64 		0x2b9
15
? _swap_info_get
vmlinux 0xffffffff8f3ffd12
Build id: 3.10.0-957.5.1.el7.x86_64 		0x12
16
? page_swapcount
vmlinux 0xffffffff8f401c6f
Build id: 3.10.0-957.5.1.el7.x86_64 		0x8f
17
swap_writepage
vmlinux 0xffffffff8f3fef89
Build id: 3.10.0-957.5.1.el7.x86_64 		0x39
18
shrink_page_list
vmlinux 0xffffffff8f3cafc2
Build id: 3.10.0-957.5.1.el7.x86_64 		0x872
19
shrink_inactive_list
vmlinux 0xffffffff8f3cb9a6
Build id: 3.10.0-957.5.1.el7.x86_64 		0x1c6
20
shrink_lruvec
vmlinux 0xffffffff8f3cc4a5
Build id: 3.10.0-957.5.1.el7.x86_64 		0x385
21
shrink_zone
vmlinux 0xffffffff8f3cc8c6
Build id: 3.10.0-957.5.1.el7.x86_64 		0x76
22
balance_pgdat
vmlinux 0xffffffff8f3cdbbc
Build id: 3.10.0-957.5.1.el7.x86_64 		0x48c
23
kswapd
vmlinux 0xffffffff8f3cde83
Build id: 3.10.0-957.5.1.el7.x86_64 		0x173
24
? wake_up_atomic_t
vmlinux 0xffffffff8f2c2d40
Build id: 3.10.0-957.5.1.el7.x86_64 		0x30
25
? balance_pgdat
vmlinux 0xffffffff8f3cdd10
Build id: 3.10.0-957.5.1.el7.x86_64 		0x5e0
26
kthread
vmlinux 0xffffffff8f2c1c71
Build id: 3.10.0-957.5.1.el7.x86_64 		0xd1
27
? insert_kthread_work
vmlinux 0xffffffff8f2c1ba0
Build id: 3.10.0-957.5.1.el7.x86_64 		0x40
28
ret_from_fork_nospec_begin
vmlinux 0xffffffff8f974c37
Build id: 3.10.0-957.5.1.el7.x86_64 		0x21
29
? insert_kthread_work
vmlinux 0xffffffff8f2c1ba0
Build id: 3.10.0-957.5.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 51s! [kswapd0:65]
Modules linked in: cmac arc4 md4 nls_utf8 cifs ccm dns_resolver xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter event_collector_3_0_1608992(OE) vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg i2c_piix4 parport_pc parport vmw_vmci fuse ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw nfit libnvdimm vmwgfx drm_kms_helper syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm ahci libahci drm ata_piix vmxnet3 libata vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 65 Comm: kswapd0 Kdump: loaded Tainted: G           OE  ------------   3.10.0-957.5.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9c6e33162080 ti: ffff9c6e331e4000 task.ti: ffff9c6e331e4000
RIP: 0010:[<ffffffff8f96a175>]  [<ffffffff8f96a175>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9c6e331e7628  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffff9c6e331e75e8 RCX: ffffffff8fe343c0
RDX: ffffb45cc0f00000 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff9c6e331e7628 R08: 0000000000000001 R09: 0000000000000000
R10: ffff9c6c35d408d8 R11: ffff9c6e32ca4800 R12: 0000000000000020
R13: ffff9c6cb4632c00 R14: ffffffff8f6d8269 R15: ffff9c6e331e75a0
FS:  0000000000000000(0000) GS:ffff9c6e3fd40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f1281da8000 CR3: 0000000049210000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc0195622>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffff8f6d9510>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffff8f6d0fe0>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff8f6da57c>] scsi_request_fn+0x4cc/0x680
[<ffffffff8f5435d9>] __blk_run_queue+0x39/0x50
[<ffffffff8f54369a>] queue_unplugged+0x2a/0xa0
[<ffffffff8f546ec8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff8f5470a2>] blk_queue_bio+0x182/0x400
[<ffffffff8f545267>] generic_make_request+0x147/0x380
[<ffffffff8f545510>] submit_bio+0x70/0x150
[<ffffffff8f3fe960>] ? init_emergency_isa_pool+0x60/0x60
[<ffffffff8f3fef09>] __swap_writepage+0x239/0x280
[<ffffffff8f3f8ef9>] ? rmap_walk+0x2b9/0x360
[<ffffffff8f3ffd12>] ? _swap_info_get+0x12/0x60
[<ffffffff8f401c6f>] ? page_swapcount+0x8f/0xa0
[<ffffffff8f3fef89>] swap_writepage+0x39/0x80
[<ffffffff8f3cafc2>] shrink_page_list+0x872/0xc30
[<ffffffff8f3cb9a6>] shrink_inactive_list+0x1c6/0x5d0
[<ffffffff8f3cc4a5>] shrink_lruvec+0x385/0x730
[<ffffffff8f3cc8c6>] shrink_zone+0x76/0x1a0
[<ffffffff8f3cdbbc>] balance_pgdat+0x48c/0x5e0
[<ffffffff8f3cde83>] kswapd+0x173/0x440
[<ffffffff8f2c2d40>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff8f3cdd10>] ? balance_pgdat+0x5e0/0x5e0
[<ffffffff8f2c1c71>] kthread+0xd1/0xe0
[<ffffffff8f2c1ba0>] ? insert_kthread_work+0x40/0x40
[<ffffffff8f974c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8f2c1ba0>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #932208
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff8ad8b565
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc0356632
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffff8aaec6b0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffff8aae3fa0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff8aaed6cc
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffff8a953939
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffff8a9539fa
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff8a957338
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffff8a957512
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffff8a9555c7
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x147
11
submit_bio
vmlinux 0xffffffff8a955870
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x70
12
? init_emergency_isa_pool
vmlinux 0xffffffff8a808b00
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x60
13
__swap_writepage
vmlinux 0xffffffff8a8090a9
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x239
14
? generic_exec_single
vmlinux 0xffffffff8a71688f
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x14f
15
? SyS_msync
vmlinux 0xffffffff8a8005a0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x250
16
? SyS_msync
vmlinux 0xffffffff8a8005a0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x250
17
? SyS_msync
vmlinux 0xffffffff8a8005a0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x250
18
? smp_call_function_single
vmlinux 0xffffffff8a71695f
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x5f
19
? cpumask_next_and
vmlinux 0xffffffff8a986395
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x35
20
? _swap_info_get
vmlinux 0xffffffff8a80a6d2
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x12
21
? page_swapcount
vmlinux 0xffffffff8a80c7ef
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x8f
22
swap_writepage
vmlinux 0xffffffff8a809129
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x39
23
shrink_page_list
vmlinux 0xffffffff8a7d2cf2
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x882
24
shrink_inactive_list
vmlinux 0xffffffff8a7d36b6
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x1b6
25
shrink_lruvec
vmlinux 0xffffffff8a7d4195
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x375
26
shrink_zone
vmlinux 0xffffffff8a7d45c6
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x76
27
balance_pgdat
vmlinux 0xffffffff8a7d57d3
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x383
28
kswapd
vmlinux 0xffffffff8a7d5ba3
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x173
29
? wake_up_atomic_t
vmlinux 0xffffffff8a6c6e90
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x30
30
? balance_pgdat
vmlinux 0xffffffff8a7d5a30
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x5e0
31
kthread
vmlinux 0xffffffff8a6c5da1
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xd1
32
? insert_kthread_work
vmlinux 0xffffffff8a6c5cd0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x40
33
ret_from_fork_nospec_begin
vmlinux 0xffffffff8ad95df7
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x21
34
? insert_kthread_work
vmlinux 0xffffffff8a6c5cd0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 21s! [kswapd0:105]
Modules linked in: veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter overlay(T) mfe_aac_100717845(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc ext4 iosf_mbi mbcache jbd2 crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd vmw_balloon pcspkr sg joydev parport_pc parport i2c_piix4 vmw_vmci binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt sd_mod fb_sys_fops ttm crc_t10dif crct10dif_generic
ahci drm nfit ata_piix libahci crct10dif_pclmul libnvdimm crct10dif_common crc32c_intel libata serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 6 PID: 105 Comm: kswapd0 Tainted: G           OEL ------------ T 3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9eb495abe300 ti: ffff9eabe37ec000 task.ti: ffff9eabe37ec000
RIP: 0010:[<ffffffff8ad8b565>]  [<ffffffff8ad8b565>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0000:ffff9eabe37ef628  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffff9eabe37ef5e8 RCX: ffffffff8b234f40
RDX: ffffae1b46290000 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff9eabe37ef628 R08: 0000000000000001 R09: 0000000000000000
R10: ffff9eabec7a6c00 R11: ffff9eabe6ba0000 R12: 0000000000000020
R13: ffff9eabf3fe6e80 R14: ffffffff8aaeb369 R15: ffff9eabe37ef5a0
FS:  0000000000000000(0000) GS:ffff9eb495780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000001724d088 CR3: 0000000a046b0000 CR4: 00000000007607e0
PKRU: 00000000
Call Trace:
[<ffffffffc0356632>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffff8aaec6b0>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffff8aae3fa0>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff8aaed6cc>] scsi_request_fn+0x4ac/0x680
[<ffffffff8a953939>] __blk_run_queue+0x39/0x50
[<ffffffff8a9539fa>] queue_unplugged+0x2a/0xa0
[<ffffffff8a957338>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff8a957512>] blk_queue_bio+0x182/0x400
[<ffffffff8a9555c7>] generic_make_request+0x147/0x380
[<ffffffff8a955870>] submit_bio+0x70/0x150
[<ffffffff8a808b00>] ? init_emergency_isa_pool+0x60/0x60
[<ffffffff8a8090a9>] __swap_writepage+0x239/0x280
[<ffffffff8a71688f>] ? generic_exec_single+0x14f/0x1c0
[<ffffffff8a8005a0>] ? SyS_msync+0x250/0x250
[<ffffffff8a8005a0>] ? SyS_msync+0x250/0x250
[<ffffffff8a8005a0>] ? SyS_msync+0x250/0x250
[<ffffffff8a71695f>] ? smp_call_function_single+0x5f/0xa0
[<ffffffff8a986395>] ? cpumask_next_and+0x35/0x50
[<ffffffff8a80a6d2>] ? _swap_info_get+0x12/0x60
[<ffffffff8a80c7ef>] ? page_swapcount+0x8f/0xa0
[<ffffffff8a809129>] swap_writepage+0x39/0x80
[<ffffffff8a7d2cf2>] shrink_page_list+0x882/0xc30
[<ffffffff8a7d36b6>] shrink_inactive_list+0x1b6/0x5c0
[<ffffffff8a7d4195>] shrink_lruvec+0x375/0x730
[<ffffffff8a7d45c6>] shrink_zone+0x76/0x1a0
[<ffffffff8a7d57d3>] balance_pgdat+0x383/0x5e0
[<ffffffff8a7d5ba3>] kswapd+0x173/0x430
[<ffffffff8a6c6e90>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff8a7d5a30>] ? balance_pgdat+0x5e0/0x5e0
[<ffffffff8a6c5da1>] kthread+0xd1/0xe0
[<ffffffff8a6c5cd0>] ? insert_kthread_work+0x40/0x40
[<ffffffff8ad95df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8a6c5cd0>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #738405
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffb378b565
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc031f632
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffffb34ec6b0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffffb34e3fa0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffb34ed6cc
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffffb3353939
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffb33539fa
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffb3357338
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffffb3357512
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffffb33555c7
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x147
11
submit_bio
vmlinux 0xffffffffb3355870
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x70
12
? init_emergency_isa_pool
vmlinux 0xffffffffb3208b00
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x60
13
__swap_writepage
vmlinux 0xffffffffb32090a9
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x239
14
? free_cpumask_var
vmlinux 0xffffffffb3386549
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x9
15
? smp_call_function_many
vmlinux 0xffffffffb3116eea
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x20a
16
? _swap_info_get
vmlinux 0xffffffffb320a6d2
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x12
17
? page_swapcount
vmlinux 0xffffffffb320c7ef
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x8f
18
swap_writepage
vmlinux 0xffffffffb3209129
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x39
19
shrink_page_list
vmlinux 0xffffffffb31d2cf2
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x882
20
shrink_inactive_list
vmlinux 0xffffffffb31d36b6
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x1b6
21
shrink_lruvec
vmlinux 0xffffffffb31d4195
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x375
22
shrink_zone
vmlinux 0xffffffffb31d45c6
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x76
23
balance_pgdat
vmlinux 0xffffffffb31d57d3
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x383
24
kswapd
vmlinux 0xffffffffb31d5ba3
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x173
25
? wake_up_atomic_t
vmlinux 0xffffffffb30c6e90
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x30
26
? balance_pgdat
vmlinux 0xffffffffb31d5a30
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x5e0
27
kthread
vmlinux 0xffffffffb30c5da1
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xd1
28
? insert_kthread_work
vmlinux 0xffffffffb30c5cd0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x40
29
ret_from_fork_nospec_begin
vmlinux 0xffffffffb3795df7
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x21
30
? insert_kthread_work
vmlinux 0xffffffffb30c5cd0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#11 stuck for 23s! [kswapd0:188]
Modules linked in: binfmt_misc xt_nat veth xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel aesni_intel lrw gf128mul vmw_balloon glue_helper ablk_helper pcspkr cryptd sg joydev parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci ata_piix nfit crct10dif_pclmul crct10dif_common libata crc32c_intel libnvdimm serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks
dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 11 PID: 188 Comm: kswapd0 Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9189e134d280 ti: ffff9182ce3bc000 task.ti: ffff9182ce3bc000
RIP: 0010:[<ffffffffb378b565>]  [<ffffffffb378b565>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9182ce3bf628  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffff9182ce3bf5e8 RCX: ffffffffb3c34f40
RDX: ffff9e09c62b0000 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff9182ce3bf628 R08: 0000000000000001 R09: 0000000000000000
R10: ffff9182cf7c1c00 R11: ffff9189b73fe000 R12: 0000000000000020
R13: ffff9181f60bc180 R14: ffffffffb34eb369 R15: ffff9182ce3bf5a0
FS:  0000000000000000(0000) GS:ffff9189492c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fcacd838a08 CR3: 0000000f36410000 CR4: 00000000003607e0
Call Trace:
[<ffffffffc031f632>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffffb34ec6b0>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffffb34e3fa0>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffb34ed6cc>] scsi_request_fn+0x4ac/0x680
[<ffffffffb3353939>] __blk_run_queue+0x39/0x50
[<ffffffffb33539fa>] queue_unplugged+0x2a/0xa0
[<ffffffffb3357338>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffb3357512>] blk_queue_bio+0x182/0x400
[<ffffffffb33555c7>] generic_make_request+0x147/0x380
[<ffffffffb3355870>] submit_bio+0x70/0x150
[<ffffffffb3208b00>] ? init_emergency_isa_pool+0x60/0x60
[<ffffffffb32090a9>] __swap_writepage+0x239/0x280
[<ffffffffb3386549>] ? free_cpumask_var+0x9/0x10
[<ffffffffb3116eea>] ? smp_call_function_many+0x20a/0x270
[<ffffffffb320a6d2>] ? _swap_info_get+0x12/0x60
[<ffffffffb320c7ef>] ? page_swapcount+0x8f/0xa0
[<ffffffffb3209129>] swap_writepage+0x39/0x80
[<ffffffffb31d2cf2>] shrink_page_list+0x882/0xc30
[<ffffffffb31d36b6>] shrink_inactive_list+0x1b6/0x5c0
[<ffffffffb31d4195>] shrink_lruvec+0x375/0x730
[<ffffffffb31d45c6>] shrink_zone+0x76/0x1a0
[<ffffffffb31d57d3>] balance_pgdat+0x383/0x5e0
[<ffffffffb31d5ba3>] kswapd+0x173/0x430
[<ffffffffb30c6e90>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffb31d5a30>] ? balance_pgdat+0x5e0/0x5e0
[<ffffffffb30c5da1>] kthread+0xd1/0xe0
[<ffffffffb30c5cd0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb3795df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb30c5cd0>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #365465
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc00da3be
Build id: 3.10.0-1160.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc012971e
Build id: 3.10.0-1160.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc01922e0
Build id: 3.10.0-1160.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff860e3980
Build id: 3.10.0-1160.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff860ed0ac
Build id: 3.10.0-1160.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffff85f534d9
Build id: 3.10.0-1160.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffff85f5359a
Build id: 3.10.0-1160.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff85f56dd8
Build id: 3.10.0-1160.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffff85f56fb2
Build id: 3.10.0-1160.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffff85f55167
Build id: 3.10.0-1160.el7.x86_64 		0x147
11
submit_bio
vmlinux 0xffffffff85f55410
Build id: 3.10.0-1160.el7.x86_64 		0x70
12
? init_emergency_isa_pool
vmlinux 0xffffffff85e08850
Build id: 3.10.0-1160.el7.x86_64 		0x60
13
__swap_writepage
vmlinux 0xffffffff85e08df9
Build id: 3.10.0-1160.el7.x86_64 		0x239
14
? generic_exec_single
vmlinux 0xffffffff85d165af
Build id: 3.10.0-1160.el7.x86_64 		0x14f
15
? SyS_msync
vmlinux 0xffffffff85e002f0
Build id: 3.10.0-1160.el7.x86_64 		0x250
16
? SyS_msync
vmlinux 0xffffffff85e002f0
Build id: 3.10.0-1160.el7.x86_64 		0x250
17
? SyS_msync
vmlinux 0xffffffff85e002f0
Build id: 3.10.0-1160.el7.x86_64 		0x250
18
? smp_call_function_single
vmlinux 0xffffffff85d1667f
Build id: 3.10.0-1160.el7.x86_64 		0x5f
19
? cpumask_next_and
vmlinux 0xffffffff85f85de5
Build id: 3.10.0-1160.el7.x86_64 		0x35
20
? _swap_info_get
vmlinux 0xffffffff85e0a422
Build id: 3.10.0-1160.el7.x86_64 		0x12
21
? page_swapcount
vmlinux 0xffffffff85e0c53f
Build id: 3.10.0-1160.el7.x86_64 		0x8f
22
swap_writepage
vmlinux 0xffffffff85e08e79
Build id: 3.10.0-1160.el7.x86_64 		0x39
23
shrink_page_list
vmlinux 0xffffffff85dd2ab2
Build id: 3.10.0-1160.el7.x86_64 		0x882
24
shrink_inactive_list
vmlinux 0xffffffff85dd3476
Build id: 3.10.0-1160.el7.x86_64 		0x1b6
25
shrink_lruvec
vmlinux 0xffffffff85dd3f55
Build id: 3.10.0-1160.el7.x86_64 		0x375
26
shrink_zone
vmlinux 0xffffffff85dd4386
Build id: 3.10.0-1160.el7.x86_64 		0x76
27
balance_pgdat
vmlinux 0xffffffff85dd5593
Build id: 3.10.0-1160.el7.x86_64 		0x383
28
kswapd
vmlinux 0xffffffff85dd5963
Build id: 3.10.0-1160.el7.x86_64 		0x173
29
? wake_up_atomic_t
vmlinux 0xffffffff85cc6d10
Build id: 3.10.0-1160.el7.x86_64 		0x30
30
? balance_pgdat
vmlinux 0xffffffff85dd57f0
Build id: 3.10.0-1160.el7.x86_64 		0x5e0
31
kthread
vmlinux 0xffffffff85cc5c21
Build id: 3.10.0-1160.el7.x86_64 		0xd1
32
? insert_kthread_work
vmlinux 0xffffffff85cc5b50
Build id: 3.10.0-1160.el7.x86_64 		0x40
33
ret_from_fork_nospec_begin
vmlinux 0xffffffff86393df7
Build id: 3.10.0-1160.el7.x86_64 		0x21
34
? insert_kthread_work
vmlinux 0xffffffff85cc5b50
Build id: 3.10.0-1160.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 63s! [kswapd0:45]
Modules linked in: tcp_lp nls_utf8 isofs xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg joydev vmw_balloon pcspkr parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif
crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit ata_piix drm mptspi crct10dif_pclmul libnvdimm crct10dif_common scsi_transport_spi crc32c_intel libata mptscsih e1000 mptbase serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 45 Comm: kswapd0 Not tainted 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff8cd7f8bbb180 ti: ffff8cd7ec648000 task.ti: ffff8cd7ec648000
RIP: 0010:[<ffffffffc00da3be>]  [<ffffffffc00da3be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff8cd7ec64b5c0  EFLAGS: 00000246
RAX: ffff9e6e006c0000 RBX: ffff8cd75a47fc60 RCX: 0000000000000002
RDX: ffff8cd7ebc28a00 RSI: ffff8cd7ec6ff000 RDI: 000000000000000e
RBP: ffff8cd7ec64b5d0 R08: 0000000000000003 R09: 00000000098e3fff
R10: ffff8cd6f56fec00 R11: ffff8cd7f05f9340 R12: 0000000100000064
R13: ffff8cd73c32a100 R14: ffff8cd7ec64b534 R15: ffffffff85f5bdfb
FS:  0000000000000000(0000) GS:ffff8cd7f9680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f20498ed9ac CR3: 000000008dc10000 CR4: 00000000003607e0
Call Trace:
[<ffffffffc012971e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc01922e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffff860e3980>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff860ed0ac>] scsi_request_fn+0x4ac/0x680
[<ffffffff85f534d9>] __blk_run_queue+0x39/0x50
[<ffffffff85f5359a>] queue_unplugged+0x2a/0xa0
[<ffffffff85f56dd8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff85f56fb2>] blk_queue_bio+0x182/0x400
[<ffffffff85f55167>] generic_make_request+0x147/0x380
[<ffffffff85f55410>] submit_bio+0x70/0x150
[<ffffffff85e08850>] ? init_emergency_isa_pool+0x60/0x60
[<ffffffff85e08df9>] __swap_writepage+0x239/0x280
[<ffffffff85d165af>] ? generic_exec_single+0x14f/0x1c0
[<ffffffff85e002f0>] ? SyS_msync+0x250/0x250
[<ffffffff85e002f0>] ? SyS_msync+0x250/0x250
[<ffffffff85e002f0>] ? SyS_msync+0x250/0x250
[<ffffffff85d1667f>] ? smp_call_function_single+0x5f/0xa0
[<ffffffff85f85de5>] ? cpumask_next_and+0x35/0x50
[<ffffffff85e0a422>] ? _swap_info_get+0x12/0x60
[<ffffffff85e0c53f>] ? page_swapcount+0x8f/0xa0
[<ffffffff85e08e79>] swap_writepage+0x39/0x80
[<ffffffff85dd2ab2>] shrink_page_list+0x882/0xc30
[<ffffffff85dd3476>] shrink_inactive_list+0x1b6/0x5c0
[<ffffffff85dd3f55>] shrink_lruvec+0x375/0x730
[<ffffffff85dd4386>] shrink_zone+0x76/0x1a0
[<ffffffff85dd5593>] balance_pgdat+0x383/0x5e0
[<ffffffff85dd5963>] kswapd+0x173/0x430
[<ffffffff85cc6d10>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff85dd57f0>] ? balance_pgdat+0x5e0/0x5e0
[<ffffffff85cc5c21>] kthread+0xd1/0xe0
[<ffffffff85cc5b50>] ? insert_kthread_work+0x40/0x40
[<ffffffff86393df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff85cc5b50>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 83 0e
Complete report #293410
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc01da3be
Build id: 3.10.0-957.10.1.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc01fc71e
Build id: 3.10.0-957.10.1.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc02682e0
Build id: 3.10.0-957.10.1.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffb0ed14c0
Build id: 3.10.0-957.10.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffb0edaa5c
Build id: 3.10.0-957.10.1.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffffb0d436b9
Build id: 3.10.0-957.10.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffb0d4377a
Build id: 3.10.0-957.10.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffb0d46fa8
Build id: 3.10.0-957.10.1.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffffb0d47182
Build id: 3.10.0-957.10.1.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffffb0d45347
Build id: 3.10.0-957.10.1.el7.x86_64 		0x147
11
submit_bio
vmlinux 0xffffffffb0d455f0
Build id: 3.10.0-957.10.1.el7.x86_64 		0x70
12
? init_emergency_isa_pool
vmlinux 0xffffffffb0bfea40
Build id: 3.10.0-957.10.1.el7.x86_64 		0x60
13
__swap_writepage
vmlinux 0xffffffffb0bfefe9
Build id: 3.10.0-957.10.1.el7.x86_64 		0x239
14
? rmap_walk
vmlinux 0xffffffffb0bf8fd9
Build id: 3.10.0-957.10.1.el7.x86_64 		0x2b9
15
? _swap_info_get
vmlinux 0xffffffffb0bffdf2
Build id: 3.10.0-957.10.1.el7.x86_64 		0x12
16
? page_swapcount
vmlinux 0xffffffffb0c01d4f
Build id: 3.10.0-957.10.1.el7.x86_64 		0x8f
17
swap_writepage
vmlinux 0xffffffffb0bff069
Build id: 3.10.0-957.10.1.el7.x86_64 		0x39
18
shrink_page_list
vmlinux 0xffffffffb0bcb0a2
Build id: 3.10.0-957.10.1.el7.x86_64 		0x872
19
shrink_inactive_list
vmlinux 0xffffffffb0bcba86
Build id: 3.10.0-957.10.1.el7.x86_64 		0x1c6
20
shrink_lruvec
vmlinux 0xffffffffb0bcc585
Build id: 3.10.0-957.10.1.el7.x86_64 		0x385
21
shrink_zone
vmlinux 0xffffffffb0bcc9a6
Build id: 3.10.0-957.10.1.el7.x86_64 		0x76
22
balance_pgdat
vmlinux 0xffffffffb0bcdc9c
Build id: 3.10.0-957.10.1.el7.x86_64 		0x48c
23
kswapd
vmlinux 0xffffffffb0bcdf63
Build id: 3.10.0-957.10.1.el7.x86_64 		0x173
24
? wake_up_atomic_t
vmlinux 0xffffffffb0ac2d40
Build id: 3.10.0-957.10.1.el7.x86_64 		0x30
25
? balance_pgdat
vmlinux 0xffffffffb0bcddf0
Build id: 3.10.0-957.10.1.el7.x86_64 		0x5e0
26
kthread
vmlinux 0xffffffffb0ac1c71
Build id: 3.10.0-957.10.1.el7.x86_64 		0xd1
27
? insert_kthread_work
vmlinux 0xffffffffb0ac1ba0
Build id: 3.10.0-957.10.1.el7.x86_64 		0x40
28
ret_from_fork_nospec_begin
vmlinux 0xffffffffb1175c1d
Build id: 3.10.0-957.10.1.el7.x86_64 		0x7
29
? insert_kthread_work
vmlinux 0xffffffffb0ac1ba0
Build id: 3.10.0-957.10.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kswapd0:30]
Modules linked in: veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmhgfs(OE) vmw_vsock_vmci_transport vsock bnep sunrpc ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper vmw_balloon cryptd joydev pcspkr snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi btusb btrtl btbcm snd_ac97_codec btintel ac97_bus snd_seq snd_seq_device bluetooth snd_pcm snd_timer rfkill snd soundcore sg parport_pc parport i2c_piix4 vmw_vmci sch_fq_codel ip_tables
xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw e1000 nfit libnvdimm ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm mptspi scsi_transport_spi libata mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 30 Comm: kswapd0 Tainted: G           OE  ------------ T 3.10.0-957.10.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff8c6bb69e1040 ti: ffff8c6bb5c24000 task.ti: ffff8c6bb5c24000
RIP: 0010:[<ffffffffc01da3be>]  [<ffffffffc01da3be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0000:ffff8c6bb5c275c0  EFLAGS: 00010246
RAX: ffff9cd340280000 RBX: ffff8c6b83c627e0 RCX: 0000000000000005
RDX: ffff8c6bb5679a00 RSI: ffff8c6bb553a000 RDI: 000000000000000e
RBP: ffff8c6bb5c275d0 R08: 0000000000000003 R09: 000000002553efff
R10: ffff8c6bb5f750d8 R11: ffff8c6bbaacd340 R12: 0000000100000040
R13: ffff8c6b87a2f000 R14: ffff8c6bb5c27534 R15: ffffffffb0d4befb
FS:  0000000000000000(0000) GS:ffff8c6bbc600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000035a75e537000 CR3: 0000000003446000 CR4: 00000000003607f0
Call Trace:
[<ffffffffc01fc71e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc02682e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffb0ed14c0>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffb0edaa5c>] scsi_request_fn+0x4cc/0x680
[<ffffffffb0d436b9>] __blk_run_queue+0x39/0x50
[<ffffffffb0d4377a>] queue_unplugged+0x2a/0xa0
[<ffffffffb0d46fa8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffb0d47182>] blk_queue_bio+0x182/0x400
[<ffffffffb0d45347>] generic_make_request+0x147/0x380
[<ffffffffb0d455f0>] submit_bio+0x70/0x150
[<ffffffffb0bfea40>] ? init_emergency_isa_pool+0x60/0x60
[<ffffffffb0bfefe9>] __swap_writepage+0x239/0x280
[<ffffffffb0bf8fd9>] ? rmap_walk+0x2b9/0x360
[<ffffffffb0bffdf2>] ? _swap_info_get+0x12/0x60
[<ffffffffb0c01d4f>] ? page_swapcount+0x8f/0xa0
[<ffffffffb0bff069>] swap_writepage+0x39/0x80
[<ffffffffb0bcb0a2>] shrink_page_list+0x872/0xc30
[<ffffffffb0bcba86>] shrink_inactive_list+0x1c6/0x5d0
[<ffffffffb0bcc585>] shrink_lruvec+0x385/0x730
[<ffffffffb0bcc9a6>] shrink_zone+0x76/0x1a0
[<ffffffffb0bcdc9c>] balance_pgdat+0x48c/0x5e0
[<ffffffffb0bcdf63>] kswapd+0x173/0x440
[<ffffffffb0ac2d40>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffb0bcddf0>] ? balance_pgdat+0x5e0/0x5e0
[<ffffffffb0ac1c71>] kthread+0xd1/0xe0
[<ffffffffb0ac1ba0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb1175c1d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffffb0ac1ba0>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 83 1e
Complete report #167271
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc02013be
Build id: 3.10.0-862.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc021c71e
Build id: 3.10.0-862.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc02b22e0
Build id: 3.10.0-862.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff9509b050
Build id: 3.10.0-862.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff950a45bc
Build id: 3.10.0-862.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffff94f18ad9
Build id: 3.10.0-862.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffff94f18b9a
Build id: 3.10.0-862.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff94f1c358
Build id: 3.10.0-862.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffff94f1c532
Build id: 3.10.0-862.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffff94f1a6bb
Build id: 3.10.0-862.el7.x86_64 		0x10b
11
? bio_alloc_bioset
vmlinux 0xffffffff94e57395
Build id: 3.10.0-862.el7.x86_64 		0x115
12
submit_bio
vmlinux 0xffffffff94f1a940
Build id: 3.10.0-862.el7.x86_64 		0x70
13
? init_emergency_isa_pool
vmlinux 0xffffffff94dd9860
Build id: 3.10.0-862.el7.x86_64 		0x60
14
__swap_writepage
vmlinux 0xffffffff94dd9e09
Build id: 3.10.0-862.el7.x86_64 		0x239
15
? page_remove_rmap
vmlinux 0xffffffff94dd229e
Build id: 3.10.0-862.el7.x86_64 		0xce
16
? try_to_unmap_one
vmlinux 0xffffffff94dd25bf
Build id: 3.10.0-862.el7.x86_64 		0x28f
17
? _swap_info_get
vmlinux 0xffffffff94ddab32
Build id: 3.10.0-862.el7.x86_64 		0x12
18
? page_swapcount
vmlinux 0xffffffff94ddc8ef
Build id: 3.10.0-862.el7.x86_64 		0x8f
19
swap_writepage
vmlinux 0xffffffff94dd9e89
Build id: 3.10.0-862.el7.x86_64 		0x39
20
shrink_page_list
vmlinux 0xffffffff94da814f
Build id: 3.10.0-862.el7.x86_64 		0x4df
21
shrink_inactive_list
vmlinux 0xffffffff94da8d8d
Build id: 3.10.0-862.el7.x86_64 		0x1cd
22
shrink_lruvec
vmlinux 0xffffffff94da9885
Build id: 3.10.0-862.el7.x86_64 		0x385
23
shrink_zone
vmlinux 0xffffffff94da9ca6
Build id: 3.10.0-862.el7.x86_64 		0x76
24
balance_pgdat
vmlinux 0xffffffff94daaf9c
Build id: 3.10.0-862.el7.x86_64 		0x48c
25
kswapd
vmlinux 0xffffffff94dab263
Build id: 3.10.0-862.el7.x86_64 		0x173
26
? wake_up_atomic_t
vmlinux 0xffffffff94cbbe20
Build id: 3.10.0-862.el7.x86_64 		0x30
27
? balance_pgdat
vmlinux 0xffffffff94dab0f0
Build id: 3.10.0-862.el7.x86_64 		0x5e0
28
kthread
vmlinux 0xffffffff94cbae31
Build id: 3.10.0-862.el7.x86_64 		0xd1
29
? insert_kthread_work
vmlinux 0xffffffff94cbad60
Build id: 3.10.0-862.el7.x86_64 		0x40
30
ret_from_fork_nospec_begin
vmlinux 0xffffffff9531f637
Build id: 3.10.0-862.el7.x86_64 		0x21
31
? insert_kthread_work
vmlinux 0xffffffff94cbad60
Build id: 3.10.0-862.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 24s! [kswapd0:63]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd joydev pcspkr soundcore ppdev nfit libnvdimm sg vmw_balloon parport_pc parport vmw_vmci i2c_piix4 shpchp ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi
vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel e1000 libata mptspi scsi_transport_spi mptscsih serio_raw mptbase i2c_core
CPU: 6 PID: 63 Comm: kswapd0 Tainted: G             L ------------   3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff904a7083bf40 ti: ffff904a70aa0000 task.ti: ffff904a70aa0000
RIP: 0010:[<ffffffffc02013be>]  [<ffffffffc02013be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff904a70aa35b0  EFLAGS: 00000246
RAX: ffffba6700f80000 RBX: ffff9049069d3840 RCX: 0000000000000011
RDX: ffff904935f72600 RSI: ffff904a706ca000 RDI: 000000000000000e
RBP: ffff904a70aa35c0 R08: 0000000000000003 R09: 00000000a9a14fff
R10: ffff904a7082e0d8 R11: ffff904a6f154e00 R12: 0000000100000003
R13: ffff904a73811380 R14: ffff904a70aa3524 R15: ffffffff94f212cb
FS:  0000000000000000(0000) GS:ffff904a78780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd1d98d1000 CR3: 000000005de0e000 CR4: 00000000003607e0
Call Trace:
[<ffffffffc021c71e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc02b22e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffff9509b050>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff950a45bc>] scsi_request_fn+0x4cc/0x680
[<ffffffff94f18ad9>] __blk_run_queue+0x39/0x50
[<ffffffff94f18b9a>] queue_unplugged+0x2a/0xa0
[<ffffffff94f1c358>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff94f1c532>] blk_queue_bio+0x182/0x400
[<ffffffff94f1a6bb>] generic_make_request+0x10b/0x320
[<ffffffff94e57395>] ? bio_alloc_bioset+0x115/0x310
[<ffffffff94f1a940>] submit_bio+0x70/0x150
[<ffffffff94dd9860>] ? init_emergency_isa_pool+0x60/0x60
[<ffffffff94dd9e09>] __swap_writepage+0x239/0x280
[<ffffffff94dd229e>] ? page_remove_rmap+0xce/0x160
[<ffffffff94dd25bf>] ? try_to_unmap_one+0x28f/0x7c0
[<ffffffff94ddab32>] ? _swap_info_get+0x12/0x60
[<ffffffff94ddc8ef>] ? page_swapcount+0x8f/0xa0
[<ffffffff94dd9e89>] swap_writepage+0x39/0x80
[<ffffffff94da814f>] shrink_page_list+0x4df/0xaf0
[<ffffffff94da8d8d>] shrink_inactive_list+0x1cd/0x5d0
[<ffffffff94da9885>] shrink_lruvec+0x385/0x730
[<ffffffff94da9ca6>] shrink_zone+0x76/0x1a0
[<ffffffff94daaf9c>] balance_pgdat+0x48c/0x5e0
[<ffffffff94dab263>] kswapd+0x173/0x440
[<ffffffff94cbbe20>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff94dab0f0>] ? balance_pgdat+0x5e0/0x5e0
[<ffffffff94cbae31>] kthread+0xd1/0xe0
[<ffffffff94cbad60>] ? insert_kthread_work+0x40/0x40
[<ffffffff9531f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff94cbad60>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 f3 20
Complete report #102684
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffb8d15375
Build id: 3.10.0-862.el7.x86_64 		0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc00b4622
Build id: 3.10.0-862.el7.x86_64 		0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffffb8aa3540
Build id: 3.10.0-862.el7.x86_64 		0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffffb8a9b050
Build id: 3.10.0-862.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffb8aa45bc
Build id: 3.10.0-862.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffffb8918ad9
Build id: 3.10.0-862.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffb8918b9a
Build id: 3.10.0-862.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffb891c358
Build id: 3.10.0-862.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffffb891c532
Build id: 3.10.0-862.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffffb891a6bb
Build id: 3.10.0-862.el7.x86_64 		0x10b
11
? bio_alloc_bioset
vmlinux 0xffffffffb8857395
Build id: 3.10.0-862.el7.x86_64 		0x115
12
submit_bio
vmlinux 0xffffffffb891a940
Build id: 3.10.0-862.el7.x86_64 		0x70
13
? init_emergency_isa_pool
vmlinux 0xffffffffb87d9860
Build id: 3.10.0-862.el7.x86_64 		0x60
14
__swap_writepage
vmlinux 0xffffffffb87d9e09
Build id: 3.10.0-862.el7.x86_64 		0x239
15
? page_remove_rmap
vmlinux 0xffffffffb87d229e
Build id: 3.10.0-862.el7.x86_64 		0xce
16
? try_to_unmap_one
vmlinux 0xffffffffb87d25bf
Build id: 3.10.0-862.el7.x86_64 		0x28f
17
? _swap_info_get
vmlinux 0xffffffffb87dab32
Build id: 3.10.0-862.el7.x86_64 		0x12
18
? page_swapcount
vmlinux 0xffffffffb87dc8ef
Build id: 3.10.0-862.el7.x86_64 		0x8f
19
swap_writepage
vmlinux 0xffffffffb87d9e89
Build id: 3.10.0-862.el7.x86_64 		0x39
20
shrink_page_list
vmlinux 0xffffffffb87a814f
Build id: 3.10.0-862.el7.x86_64 		0x4df
21
shrink_inactive_list
vmlinux 0xffffffffb87a8d8d
Build id: 3.10.0-862.el7.x86_64 		0x1cd
22
shrink_lruvec
vmlinux 0xffffffffb87a9885
Build id: 3.10.0-862.el7.x86_64 		0x385
23
shrink_zone
vmlinux 0xffffffffb87a9ca6
Build id: 3.10.0-862.el7.x86_64 		0x76
24
balance_pgdat
vmlinux 0xffffffffb87aaf9c
Build id: 3.10.0-862.el7.x86_64 		0x48c
25
kswapd
vmlinux 0xffffffffb87ab263
Build id: 3.10.0-862.el7.x86_64 		0x173
26
? wake_up_atomic_t
vmlinux 0xffffffffb86bbe20
Build id: 3.10.0-862.el7.x86_64 		0x30
27
? balance_pgdat
vmlinux 0xffffffffb87ab0f0
Build id: 3.10.0-862.el7.x86_64 		0x5e0
28
kthread
vmlinux 0xffffffffb86bae31
Build id: 3.10.0-862.el7.x86_64 		0xd1
29
? insert_kthread_work
vmlinux 0xffffffffb86bad60
Build id: 3.10.0-862.el7.x86_64 		0x40
30
ret_from_fork_nospec_begin
vmlinux 0xffffffffb8d1f637
Build id: 3.10.0-862.el7.x86_64 		0x21
31
? insert_kthread_work
vmlinux 0xffffffffb86bad60
Build id: 3.10.0-862.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 53s! [kswapd0:32]
Modules linked in: nf_nat_ftp nf_conntrack_ftp ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev sg pcspkr nfit libnvdimm vmw_vmci parport_pc shpchp parport i2c_piix4 binfmt_misc ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic
ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci crct10dif_pclmul crct10dif_common crc32c_intel libahci serio_raw vmxnet3 ata_piix vmw_pvscsi libata i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 32 Comm: kswapd0 Kdump: loaded Not tainted 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff8ebe7f74eeb0 ti: ffff8ebe746e0000 task.ti: ffff8ebe746e0000
RIP: 0010:[<ffffffffb8d15375>]  [<ffffffffb8d15375>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff8ebe746e3618  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff8ebe746e35d8 RCX: ffffffffb9230880
RDX: ffffbab780f00000 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff8ebe746e3618 R08: 0000000000000001 R09: 0000000000000000
R10: ffff8ebe7415f0d8 R11: ffff8ebe7300a000 R12: 0000000000000020
R13: ffff8ebe68a0ef00 R14: ffffffffb8aa2299 R15: ffff8ebe746e3590
FS:  0000000000000000(0000) GS:ffff8ebe7fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005578bcda82f8 CR3: 000000022d2a6000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffc00b4622>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffffb8aa3540>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffffb8a9b050>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffb8aa45bc>] scsi_request_fn+0x4cc/0x680
[<ffffffffb8918ad9>] __blk_run_queue+0x39/0x50
[<ffffffffb8918b9a>] queue_unplugged+0x2a/0xa0
[<ffffffffb891c358>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffb891c532>] blk_queue_bio+0x182/0x400
[<ffffffffb891a6bb>] generic_make_request+0x10b/0x320
[<ffffffffb8857395>] ? bio_alloc_bioset+0x115/0x310
[<ffffffffb891a940>] submit_bio+0x70/0x150
[<ffffffffb87d9860>] ? init_emergency_isa_pool+0x60/0x60
[<ffffffffb87d9e09>] __swap_writepage+0x239/0x280
[<ffffffffb87d229e>] ? page_remove_rmap+0xce/0x160
[<ffffffffb87d25bf>] ? try_to_unmap_one+0x28f/0x7c0
[<ffffffffb87dab32>] ? _swap_info_get+0x12/0x60
[<ffffffffb87dc8ef>] ? page_swapcount+0x8f/0xa0
[<ffffffffb87d9e89>] swap_writepage+0x39/0x80
[<ffffffffb87a814f>] shrink_page_list+0x4df/0xaf0
[<ffffffffb87a8d8d>] shrink_inactive_list+0x1cd/0x5d0
[<ffffffffb87a9885>] shrink_lruvec+0x385/0x730
[<ffffffffb87a9ca6>] shrink_zone+0x76/0x1a0
[<ffffffffb87aaf9c>] balance_pgdat+0x48c/0x5e0
[<ffffffffb87ab263>] kswapd+0x173/0x440
[<ffffffffb86bbe20>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffb87ab0f0>] ? balance_pgdat+0x5e0/0x5e0
[<ffffffffb86bae31>] kthread+0xd1/0xe0
[<ffffffffb86bad60>] ? insert_kthread_work+0x40/0x40
[<ffffffffb8d1f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb86bad60>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #14961
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffff9d3883c5
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc00b5632
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffff9d0eb060
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffff9d0e2950
Build id: 3.10.0-1127.18.2.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff9d0ec07c
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffff9cf52769
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffff9cf5282a
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff9cf56068
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffff9cf56242
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffff9cf543f7
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x147
11
submit_bio
vmlinux 0xffffffff9cf546a0
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x70
12
? init_emergency_isa_pool
vmlinux 0xffffffff9ce089b0
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x60
13
__swap_writepage
vmlinux 0xffffffff9ce08f59
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x239
14
? rmap_walk
vmlinux 0xffffffff9ce02e09
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x2b9
15
? _swap_info_get
vmlinux 0xffffffff9ce0a582
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x12
16
? page_swapcount
vmlinux 0xffffffff9ce0c69f
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x8f
17
swap_writepage
vmlinux 0xffffffff9ce08fd9
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x39
18
shrink_page_list
vmlinux 0xffffffff9cdd2f32
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x882
19
shrink_inactive_list
vmlinux 0xffffffff9cdd38f6
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x1b6
20
shrink_lruvec
vmlinux 0xffffffff9cdd43d5
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x375
21
shrink_zone
vmlinux 0xffffffff9cdd4806
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x76
22
balance_pgdat
vmlinux 0xffffffff9cdd5a13
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x383
23
kswapd
vmlinux 0xffffffff9cdd5de3
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x173
24
? wake_up_atomic_t
vmlinux 0xffffffff9ccc7780
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x30
25
? balance_pgdat
vmlinux 0xffffffff9cdd5c70
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x5e0
26
kthread
vmlinux 0xffffffff9ccc6691
Build id: 3.10.0-1127.18.2.el7.x86_64 		0xd1
27
? insert_kthread_work
vmlinux 0xffffffff9ccc65c0
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x40
28
ret_from_fork_nospec_begin
vmlinux 0xffffffff9d392d37
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x21
29
? insert_kthread_work
vmlinux 0xffffffff9ccc65c0
Build id: 3.10.0-1127.18.2.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [kswapd0:65]
Modules linked in: veth xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter xt_nat iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat tun nf_conntrack vmw_vsock_vmci_transport vsock overlay(T) sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw sg gf128mul pcspkr glue_helper joydev ppdev ablk_helper cryptd i2c_piix4 vmw_vmci vmw_balloon parport_pc parport binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod syscopyarea sysfillrect crc_t10dif sysimgblt fb_sys_fops crct10dif_generic ttm ahci drm crct10dif_pclmul crct10dif_common ata_piix libahci crc32c_intel
nfit serio_raw libata libnvdimm vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 65 Comm: kswapd0 Kdump: loaded Tainted: G             L ------------ T 3.10.0-1127.18.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff9224aa5e0000 ti: ffff9224aa5d4000 task.ti: ffff9224aa5d4000
RIP: 0010:[<ffffffff9d3883c5>]  [<ffffffff9d3883c5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9224aa5d7628  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffff9224aa5d75e8 RCX: ffff9224af101060
RDX: ffffa89b01bb0000 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff9224aa5d7628 R08: 0000000000000000 R09: ffff9224aeb7c600
R10: ffff9224aa587c00 R11: ffff9220b5cb4000 R12: 0000000000000020
R13: ffff9224767df900 R14: ffffffff9d0e9d19 R15: ffff9224aa5d75a0
FS:  0000000000000000(0000) GS:ffff9224bfc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff6d01190f8 CR3: 000000008ec10000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 00000000
Call Trace:
[<ffffffffc00b5632>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffff9d0eb060>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffff9d0e2950>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff9d0ec07c>] scsi_request_fn+0x4ac/0x680
[<ffffffff9cf52769>] __blk_run_queue+0x39/0x50
[<ffffffff9cf5282a>] queue_unplugged+0x2a/0xa0
[<ffffffff9cf56068>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff9cf56242>] blk_queue_bio+0x182/0x400
[<ffffffff9cf543f7>] generic_make_request+0x147/0x380
[<ffffffff9cf546a0>] submit_bio+0x70/0x150
[<ffffffff9ce089b0>] ? init_emergency_isa_pool+0x60/0x60
[<ffffffff9ce08f59>] __swap_writepage+0x239/0x280
[<ffffffff9ce02e09>] ? rmap_walk+0x2b9/0x360
[<ffffffff9ce0a582>] ? _swap_info_get+0x12/0x60
[<ffffffff9ce0c69f>] ? page_swapcount+0x8f/0xa0
[<ffffffff9ce08fd9>] swap_writepage+0x39/0x80
[<ffffffff9cdd2f32>] shrink_page_list+0x882/0xc30
[<ffffffff9cdd38f6>] shrink_inactive_list+0x1b6/0x5c0
[<ffffffff9cdd43d5>] shrink_lruvec+0x375/0x730
[<ffffffff9cdd4806>] shrink_zone+0x76/0x1a0
[<ffffffff9cdd5a13>] balance_pgdat+0x383/0x5e0
[<ffffffff9cdd5de3>] kswapd+0x173/0x430
[<ffffffff9ccc7780>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff9cdd5c70>] ? balance_pgdat+0x5e0/0x5e0
[<ffffffff9ccc6691>] kthread+0xd1/0xe0
[<ffffffff9ccc65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff9d392d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9ccc65c0>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #9390
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc01e43be
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc027f71e
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc03362e0
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffff8aadc890
Build id: 3.10.0-1062.1.2.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffff8aae5efc
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffff8a94cf59
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffff8a94d01a
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffff8a950858
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffff8a950a32
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffff8a94ebf7
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x147
11
submit_bio
vmlinux 0xffffffff8a94eea0
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x70
12
? init_emergency_isa_pool
vmlinux 0xffffffff8a804b50
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x60
13
__swap_writepage
vmlinux 0xffffffff8a8050f9
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x239
14
? rmap_walk
vmlinux 0xffffffff8a7ff099
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x2b9
15
? _swap_info_get
vmlinux 0xffffffff8a806682
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x12
16
? page_swapcount
vmlinux 0xffffffff8a80871f
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x8f
17
swap_writepage
vmlinux 0xffffffff8a805179
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x39
18
shrink_page_list
vmlinux 0xffffffff8a7d0a02
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x882
19
shrink_inactive_list
vmlinux 0xffffffff8a7d13d6
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x1c6
20
shrink_lruvec
vmlinux 0xffffffff8a7d1ed5
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x385
21
shrink_zone
vmlinux 0xffffffff8a7d2306
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x76
22
balance_pgdat
vmlinux 0xffffffff8a7d3513
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x383
23
kswapd
vmlinux 0xffffffff8a7d38e3
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x173
24
? wake_up_atomic_t
vmlinux 0xffffffff8a6c61c0
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x30
25
? balance_pgdat
vmlinux 0xffffffff8a7d3770
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x5e0
26
kthread
vmlinux 0xffffffff8a6c50d1
Build id: 3.10.0-1062.1.2.el7.x86_64 		0xd1
27
? insert_kthread_work
vmlinux 0xffffffff8a6c5000
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x40
28
ret_from_fork_nospec_begin
vmlinux 0xffffffff8ad8cd37
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x21
29
? insert_kthread_work
vmlinux 0xffffffff8a6c5000
Build id: 3.10.0-1062.1.2.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 31s! [kswapd0:46]
Modules linked in: veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink binfmt_misc vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus coretemp snd_seq iosf_mbi crc32_pclmul snd_seq_device snd_pcm ghash_clmulni_intel aesni_intel ppdev snd_timer snd lrw gf128mul vmw_balloon glue_helper soundcore ablk_helper cryptd sg joydev pcspkr parport_pc parport vmw_vmci i2c_piix4 sch_fq_codel ip_tables xfs libcrc32c sr_mod cdrom sd_mod ata_generic
crc_t10dif pata_acpi crct10dif_generic vmwgfx crct10dif_pclmul crct10dif_common crc32c_intel drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops nfit ttm mptspi libnvdimm serio_raw scsi_transport_spi drm mptscsih e1000 ata_piix libata mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ipmi_msghandler]
CPU: 2 PID: 46 Comm: kswapd0 Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-1062.1.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff9dabf5e33150 ti: ffff9dabf1e60000 task.ti: ffff9dabf1e60000
RIP: 0010:[<ffffffffc01e43be>]  [<ffffffffc01e43be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff9dabf1e635c0  EFLAGS: 00000246
RAX: ffffb5b080d00000 RBX: ffff9daad4a76800 RCX: 000000000000000b
RDX: ffff9dab6b3cd000 RSI: ffff9dab3c441000 RDI: 000000000000000e
RBP: ffff9dabf1e635d0 R08: 0000000000000002 R09: 000000009e25ffff
R10: ffff9dabf00b90d8 R11: ffff9dab414fd500 R12: 0000000100000001
R13: ffff9dab0c5deb80 R14: ffff9dabf1e63534 R15: ffffffff8a9557ab
FS:  0000000000000000(0000) GS:ffff9dabf5680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f65aa5c8000 CR3: 0000000172bc4000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc027f71e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc03362e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffff8aadc890>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffff8aae5efc>] scsi_request_fn+0x4cc/0x680
[<ffffffff8a94cf59>] __blk_run_queue+0x39/0x50
[<ffffffff8a94d01a>] queue_unplugged+0x2a/0xa0
[<ffffffff8a950858>] blk_flush_plug_list+0x1d8/0x230
[<ffffffff8a950a32>] blk_queue_bio+0x182/0x400
[<ffffffff8a94ebf7>] generic_make_request+0x147/0x380
[<ffffffff8a94eea0>] submit_bio+0x70/0x150
[<ffffffff8a804b50>] ? init_emergency_isa_pool+0x60/0x60
[<ffffffff8a8050f9>] __swap_writepage+0x239/0x280
[<ffffffff8a7ff099>] ? rmap_walk+0x2b9/0x360
[<ffffffff8a806682>] ? _swap_info_get+0x12/0x60
[<ffffffff8a80871f>] ? page_swapcount+0x8f/0xa0
[<ffffffff8a805179>] swap_writepage+0x39/0x80
[<ffffffff8a7d0a02>] shrink_page_list+0x882/0xc30
[<ffffffff8a7d13d6>] shrink_inactive_list+0x1c6/0x5d0
[<ffffffff8a7d1ed5>] shrink_lruvec+0x385/0x740
[<ffffffff8a7d2306>] shrink_zone+0x76/0x1a0
[<ffffffff8a7d3513>] balance_pgdat+0x383/0x5e0
[<ffffffff8a7d38e3>] kswapd+0x173/0x440
[<ffffffff8a6c61c0>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff8a7d3770>] ? balance_pgdat+0x5e0/0x5e0
[<ffffffff8a6c50d1>] kthread+0xd1/0xe0
[<ffffffff8a6c5000>] ? insert_kthread_work+0x40/0x40
[<ffffffff8ad8cd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8a6c5000>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 23 1f
Complete report #7397
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffbc5883c5
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc00f2632
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffffbc2eb060
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffffbc2e2950
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffbc2ec07c
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffffbc152769
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffbc15282a
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffbc156068
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffffbc156242
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffffbc1543f7
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x147
11
submit_bio
vmlinux 0xffffffffbc1546a0
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x70
12
? init_emergency_isa_pool
vmlinux 0xffffffffbc008980
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x60
13
__swap_writepage
vmlinux 0xffffffffbc008f29
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x239
14
? generic_exec_single
vmlinux 0xffffffffbbf16f6f
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x14f
15
? SyS_msync
vmlinux 0xffffffffbc000420
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x250
16
? SyS_msync
vmlinux 0xffffffffbc000420
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x250
17
? SyS_msync
vmlinux 0xffffffffbc000420
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x250
18
? smp_call_function_single
vmlinux 0xffffffffbbf1703f
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x5f
19
? cpumask_next_and
vmlinux 0xffffffffbc184fc5
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x35
20
? _swap_info_get
vmlinux 0xffffffffbc00a552
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x12
21
? page_swapcount
vmlinux 0xffffffffbc00c66f
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x8f
22
swap_writepage
vmlinux 0xffffffffbc008fa9
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x39
23
shrink_page_list
vmlinux 0xffffffffbbfd2f12
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x882
24
shrink_inactive_list
vmlinux 0xffffffffbbfd38d6
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x1b6
25
shrink_lruvec
vmlinux 0xffffffffbbfd43b5
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x375
26
shrink_zone
vmlinux 0xffffffffbbfd47e6
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x76
27
balance_pgdat
vmlinux 0xffffffffbbfd59f3
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x383
28
kswapd
vmlinux 0xffffffffbbfd5dc3
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x173
29
? wake_up_atomic_t
vmlinux 0xffffffffbbec7780
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x30
30
? balance_pgdat
vmlinux 0xffffffffbbfd5c50
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x5e0
31
kthread
vmlinux 0xffffffffbbec6691
Build id: 3.10.0-1127.13.1.el7.x86_64 		0xd1
32
? insert_kthread_work
vmlinux 0xffffffffbbec65c0
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x40
33
ret_from_fork_nospec_begin
vmlinux 0xffffffffbc592d37
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x21
34
? insert_kthread_work
vmlinux 0xffffffffbbec65c0
Build id: 3.10.0-1127.13.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 47s! [kswapd0:65]
Modules linked in: rpcsec_gss_krb5 auth_rpcgss tcp_lp fuse nfsv3 nfs_acl nfs lockd grace fscache veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd
vmw_balloon pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom vmwgfx sd_mod drm_kms_helper ata_generic crc_t10dif syscopyarea nfit sysfillrect crct10dif_generic sysimgblt fb_sys_fops ttm pata_acpi libnvdimm ahci drm libahci ata_piix crct10dif_pclmul crct10dif_common crc32c_intel libata vmxnet3 drm_panel_orientation_quirks vmw_pvscsi serio_raw dm_mirror dm_region_hash dm_log dm_mod
CPU: 6 PID: 65 Comm: kswapd0 Kdump: loaded Tainted: G             L ------------ T 3.10.0-1127.13.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff91c5e9361070 ti: ffff91c5ee6b0000 task.ti: ffff91c5ee6b0000
RIP: 0010:[<ffffffffbc5883c5>]  [<ffffffffbc5883c5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff91c5ee6b3628  EFLAGS: 00000282
RAX: 0000000000000000 RBX: ffff91c5ee6b35e8 RCX: ffffffffbca34e40
RDX: ffffa4b1818f0000 RSI: 0000000000000282 RDI: 0000000000000282
RBP: ffff91c5ee6b3628 R08: 0000000000000001 R09: 0000000000000000
R10: ffff91c5e8ae6c00 R11: ffff91c5e889d000 R12: 0000000000000020
R13: ffff91c557653d80 R14: ffffffffbc2e9d19 R15: ffff91c5ee6b35a0
FS:  0000000000000000(0000) GS:ffff91c5ed780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000a73dff0 CR3: 00000003f0066000 CR4: 00000000001607e0
Call Trace:
[<ffffffffc00f2632>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffffbc2eb060>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffffbc2e2950>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffbc2ec07c>] scsi_request_fn+0x4ac/0x680
[<ffffffffbc152769>] __blk_run_queue+0x39/0x50
[<ffffffffbc15282a>] queue_unplugged+0x2a/0xa0
[<ffffffffbc156068>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffbc156242>] blk_queue_bio+0x182/0x400
[<ffffffffbc1543f7>] generic_make_request+0x147/0x380
[<ffffffffbc1546a0>] submit_bio+0x70/0x150
[<ffffffffbc008980>] ? init_emergency_isa_pool+0x60/0x60
[<ffffffffbc008f29>] __swap_writepage+0x239/0x280
[<ffffffffbbf16f6f>] ? generic_exec_single+0x14f/0x1c0
[<ffffffffbc000420>] ? SyS_msync+0x250/0x250
[<ffffffffbc000420>] ? SyS_msync+0x250/0x250
[<ffffffffbc000420>] ? SyS_msync+0x250/0x250
[<ffffffffbbf1703f>] ? smp_call_function_single+0x5f/0xa0
[<ffffffffbc184fc5>] ? cpumask_next_and+0x35/0x50
[<ffffffffbc00a552>] ? _swap_info_get+0x12/0x60
[<ffffffffbc00c66f>] ? page_swapcount+0x8f/0xa0
[<ffffffffbc008fa9>] swap_writepage+0x39/0x80
[<ffffffffbbfd2f12>] shrink_page_list+0x882/0xc30
[<ffffffffbbfd38d6>] shrink_inactive_list+0x1b6/0x5c0
[<ffffffffbbfd43b5>] shrink_lruvec+0x375/0x730
[<ffffffffbbfd47e6>] shrink_zone+0x76/0x1a0
[<ffffffffbbfd59f3>] balance_pgdat+0x383/0x5e0
[<ffffffffbbfd5dc3>] kswapd+0x173/0x430
[<ffffffffbbec7780>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffbbfd5c50>] ? balance_pgdat+0x5e0/0x5e0
[<ffffffffbbec6691>] kthread+0xd1/0xe0
[<ffffffffbbec65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffbc592d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffbbec65c0>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48
Complete report #3217
Frame # Function Binary Source or offset Line
1
mpt_put_msg_frame
mptbase 0xffffffffc02f23be
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x5e
2
mptscsih_qcmd
mptscsih 0xffffffffc03c871e
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x24e
3
mptspi_qcmd
mptspi 0xffffffffc04782e0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x50
4
scsi_dispatch_cmd
vmlinux 0xffffffffb20e2990
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffb20ec0bc
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x4ac
6
__blk_run_queue
vmlinux 0xffffffffb1f527a9
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffb1f5286a
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffb1f560a8
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffffb1f56282
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffffb1f54437
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x147
11
submit_bio
vmlinux 0xffffffffb1f546e0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x70
12
? init_emergency_isa_pool
vmlinux 0xffffffffb1e089b0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x60
13
__swap_writepage
vmlinux 0xffffffffb1e08f59
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x239
14
? rmap_walk
vmlinux 0xffffffffb1e02e09
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x2b9
15
? _swap_info_get
vmlinux 0xffffffffb1e0a582
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x12
16
? page_swapcount
vmlinux 0xffffffffb1e0c69f
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x8f
17
swap_writepage
vmlinux 0xffffffffb1e08fd9
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x39
18
shrink_page_list
vmlinux 0xffffffffb1dd2f32
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x882
19
shrink_inactive_list
vmlinux 0xffffffffb1dd38f6
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x1b6
20
shrink_lruvec
vmlinux 0xffffffffb1dd43d5
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x375
21
shrink_zone
vmlinux 0xffffffffb1dd4806
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x76
22
balance_pgdat
vmlinux 0xffffffffb1dd5a13
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x383
23
kswapd
vmlinux 0xffffffffb1dd5de3
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x173
24
? wake_up_atomic_t
vmlinux 0xffffffffb1cc7780
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x30
25
? balance_pgdat
vmlinux 0xffffffffb1dd5c70
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x5e0
26
kthread
vmlinux 0xffffffffb1cc6691
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xd1
27
? insert_kthread_work
vmlinux 0xffffffffb1cc65c0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x40
28
ret_from_fork_nospec_begin
vmlinux 0xffffffffb2392d37
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x21
29
? insert_kthread_work
vmlinux 0xffffffffb1cc65c0
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kswapd0:30]
Modules linked in: tcp_lp rfcomm fuse devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bnep vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon snd_ens1371 snd_rawmidi btusb snd_ac97_codec btrtl btbcm btintel ac97_bus snd_seq
bluetooth snd_seq_device joydev pcspkr snd_pcm snd_timer snd rfkill soundcore sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c vmwgfx sd_mod sr_mod crc_t10dif crct10dif_generic cdrom ata_generic drm_kms_helper crct10dif_pclmul crct10dif_common crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops pata_acpi ttm mptspi scsi_transport_spi drm mptscsih nfit ata_piix libnvdimm libata serio_raw e1000 mptbase drm_panel_orientation_quirks
CPU: 0 PID: 30 Comm: kswapd0 Not tainted 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff9611b6d38000 ti: ffff9611b6f6c000 task.ti: ffff9611b6f6c000
RIP: 0010:[<ffffffffc02f23be>]  [<ffffffffc02f23be>] mpt_put_msg_frame+0x5e/0x80 [mptbase]
RSP: 0018:ffff9611b6f6f5c0  EFLAGS: 00000246
RAX: ffffb28440200000 RBX: ffff9611ba4e86e0 RCX: 000000000000001a
RDX: ffff9611b63ff400 RSI: ffff9611b63cb000 RDI: 000000000000000e
RBP: ffff9611b6f6f5d0 R08: 0000000000000003 R09: 0000000030a27fff
R10: ffff9611b62eb800 R11: ffff9611b5f91c00 R12: 0000000100000038
R13: ffff9611840d2400 R14: ffff9611b6f6f534 R15: ffffffffb1f5b0cb
FS:  0000000000000000(0000) GS:ffff9611bc600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe6a79dcbb8 CR3: 0000000004d56000 CR4: 00000000003607f0
Call Trace:
[<ffffffffc03c871e>] mptscsih_qcmd+0x24e/0x830 [mptscsih]
[<ffffffffc04782e0>] mptspi_qcmd+0x50/0xf0 [mptspi]
[<ffffffffb20e2990>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffb20ec0bc>] scsi_request_fn+0x4ac/0x680
[<ffffffffb1f527a9>] __blk_run_queue+0x39/0x50
[<ffffffffb1f5286a>] queue_unplugged+0x2a/0xa0
[<ffffffffb1f560a8>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffb1f56282>] blk_queue_bio+0x182/0x400
[<ffffffffb1f54437>] generic_make_request+0x147/0x380
[<ffffffffb1f546e0>] submit_bio+0x70/0x150
[<ffffffffb1e089b0>] ? init_emergency_isa_pool+0x60/0x60
[<ffffffffb1e08f59>] __swap_writepage+0x239/0x280
[<ffffffffb1e02e09>] ? rmap_walk+0x2b9/0x360
[<ffffffffb1e0a582>] ? _swap_info_get+0x12/0x60
[<ffffffffb1e0c69f>] ? page_swapcount+0x8f/0xa0
[<ffffffffb1e08fd9>] swap_writepage+0x39/0x80
[<ffffffffb1dd2f32>] shrink_page_list+0x882/0xc30
[<ffffffffb1dd38f6>] shrink_inactive_list+0x1b6/0x5c0
[<ffffffffb1dd43d5>] shrink_lruvec+0x375/0x730
[<ffffffffb1dd4806>] shrink_zone+0x76/0x1a0
[<ffffffffb1dd5a13>] balance_pgdat+0x383/0x5e0
[<ffffffffb1dd5de3>] kswapd+0x173/0x430
[<ffffffffb1cc7780>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffb1dd5c70>] ? balance_pgdat+0x5e0/0x5e0
[<ffffffffb1cc6691>] kthread+0xd1/0xe0
[<ffffffffb1cc65c0>] ? insert_kthread_work+0x40/0x40
[<ffffffffb2392d37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb1cc65c0>] ? insert_kthread_work+0x40/0x40
Code: 8b 96 68 01 00 00 0f b7 c8 44 03 a6 b0 01 00 00 44 8b 04 8a 45 09 c4 f6 86 e0 00 00 00 04 75 10 48 8b 83 e8 00 00 00 44 89 60 40 <5b> 41 5c 5d c3 48 8d 76 08 0f b7 c8 44 89 e2 48 c7 c7 78 03 30
Complete report #2729
Frame # Function Binary Source or offset Line
1
_raw_spin_unlock_irqrestore
vmlinux 0xffffffffb2d1b2c5
Build id: 3.10.0-862.11.6.el7.x86_64 		0x15
2
pvscsi_queue
vmw_pvscsi 0xffffffffc029f622
Build id: 3.10.0-862.11.6.el7.x86_64 		0x4a2
3
? scsi_test_unit_ready
vmlinux 0xffffffffb2aa8500
Build id: 3.10.0-862.11.6.el7.x86_64 		0x170
4
scsi_dispatch_cmd
vmlinux 0xffffffffb2aa0010
Build id: 3.10.0-862.11.6.el7.x86_64 		0xb0
5
scsi_request_fn
vmlinux 0xffffffffb2aa957c
Build id: 3.10.0-862.11.6.el7.x86_64 		0x4cc
6
__blk_run_queue
vmlinux 0xffffffffb291d4e9
Build id: 3.10.0-862.11.6.el7.x86_64 		0x39
7
queue_unplugged
vmlinux 0xffffffffb291d5aa
Build id: 3.10.0-862.11.6.el7.x86_64 		0x2a
8
blk_flush_plug_list
vmlinux 0xffffffffb2920d68
Build id: 3.10.0-862.11.6.el7.x86_64 		0x1d8
9
blk_queue_bio
vmlinux 0xffffffffb2920f42
Build id: 3.10.0-862.11.6.el7.x86_64 		0x182
10
generic_make_request
vmlinux 0xffffffffb291f0cb
Build id: 3.10.0-862.11.6.el7.x86_64 		0x10b
11
? bio_alloc_bioset
vmlinux 0xffffffffb285b7a5
Build id: 3.10.0-862.11.6.el7.x86_64 		0x115
12
submit_bio
vmlinux 0xffffffffb291f350
Build id: 3.10.0-862.11.6.el7.x86_64 		0x70
13
? init_emergency_isa_pool
vmlinux 0xffffffffb27dd060
Build id: 3.10.0-862.11.6.el7.x86_64 		0x60
14
__swap_writepage
vmlinux 0xffffffffb27dd609
Build id: 3.10.0-862.11.6.el7.x86_64 		0x239
15
? page_remove_rmap
vmlinux 0xffffffffb27d59fe
Build id: 3.10.0-862.11.6.el7.x86_64 		0xce
16
? try_to_unmap_one
vmlinux 0xffffffffb27d5d2a
Build id: 3.10.0-862.11.6.el7.x86_64 		0x29a
17
? _swap_info_get
vmlinux 0xffffffffb27de332
Build id: 3.10.0-862.11.6.el7.x86_64 		0x12
18
? page_swapcount
vmlinux 0xffffffffb27e014f
Build id: 3.10.0-862.11.6.el7.x86_64 		0x8f
19
swap_writepage
vmlinux 0xffffffffb27dd689
Build id: 3.10.0-862.11.6.el7.x86_64 		0x39
20
shrink_page_list
vmlinux 0xffffffffb27aadef
Build id: 3.10.0-862.11.6.el7.x86_64 		0x4df
21
shrink_inactive_list
vmlinux 0xffffffffb27aba2d
Build id: 3.10.0-862.11.6.el7.x86_64 		0x1cd
22
shrink_lruvec
vmlinux 0xffffffffb27ac525
Build id: 3.10.0-862.11.6.el7.x86_64 		0x385
23
shrink_zone
vmlinux 0xffffffffb27ac946
Build id: 3.10.0-862.11.6.el7.x86_64 		0x76
24
balance_pgdat
vmlinux 0xffffffffb27adc3c
Build id: 3.10.0-862.11.6.el7.x86_64 		0x48c
25
kswapd
vmlinux 0xffffffffb27adf03
Build id: 3.10.0-862.11.6.el7.x86_64 		0x173
26
? wake_up_atomic_t
vmlinux 0xffffffffb26bef10
Build id: 3.10.0-862.11.6.el7.x86_64 		0x30
27
? balance_pgdat
vmlinux 0xffffffffb27add90
Build id: 3.10.0-862.11.6.el7.x86_64 		0x5e0
28
kthread
vmlinux 0xffffffffb26bdf21
Build id: 3.10.0-862.11.6.el7.x86_64 		0xd1
29
? insert_kthread_work
vmlinux 0xffffffffb26bde50
Build id: 3.10.0-862.11.6.el7.x86_64 		0x40
30
ret_from_fork_nospec_begin
vmlinux 0xffffffffb2d255f7
Build id: 3.10.0-862.11.6.el7.x86_64 		0x21
31
? insert_kthread_work
vmlinux 0xffffffffb26bde50
Build id: 3.10.0-862.11.6.el7.x86_64 		0x40 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 33s! [kswapd0:39]
Modules linked in: arc4 ppp_mppe ppp_async crc_ccitt ppp_generic slhc ebtable_filter ebtables ip6table_filter ip6_tables devlink vmw_vsock_vmci_transport vsock ipt_REJECT nf_reject_ipv4 xt_conntrack iptable_filter iptable_raw iptable_security iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr ppdev joydev sg vmw_balloon nfit libnvdimm shpchp i2c_piix4 parport_pc parport vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt sd_mod fb_sys_fops crc_t10dif ttm crct10dif_generic crct10dif_pclmul drm crct10dif_common ahci crc32c_intel
ata_piix libahci serio_raw libata vmxnet3 vmw_pvscsi i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 39 Comm: kswapd0 Kdump: loaded Tainted: G        W    L ------------   3.10.0-862.11.6.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/28/2017
task: ffff95ecf8048000 ti: ffff95ecf8044000 task.ti: ffff95ecf8044000
RIP: 0010:[<ffffffffb2d1b2c5>]  [<ffffffffb2d1b2c5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff95ecf8047618  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff95ecf80475d8 RCX: 0000000000001000
RDX: ffffb5db00780000 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff95ecf8047618 R08: ffffffffffffffff R09: ffff95ecea6be400
R10: ffff95ecf820e0d8 R11: ffff95ecffcb8800 R12: 0000000000000020
R13: ffff95ec66094f00 R14: ffffffffb2aa7259 R15: ffff95ecf8047590
FS:  0000000000000000(0000) GS:ffff95ecffd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055fa162aa620 CR3: 00000000b1006000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffc029f622>] pvscsi_queue+0x4a2/0x920 [vmw_pvscsi]
[<ffffffffb2aa8500>] ? scsi_test_unit_ready+0x170/0x170
[<ffffffffb2aa0010>] scsi_dispatch_cmd+0xb0/0x240
[<ffffffffb2aa957c>] scsi_request_fn+0x4cc/0x680
[<ffffffffb291d4e9>] __blk_run_queue+0x39/0x50
[<ffffffffb291d5aa>] queue_unplugged+0x2a/0xa0
[<ffffffffb2920d68>] blk_flush_plug_list+0x1d8/0x230
[<ffffffffb2920f42>] blk_queue_bio+0x182/0x400
[<ffffffffb291f0cb>] generic_make_request+0x10b/0x320
[<ffffffffb285b7a5>] ? bio_alloc_bioset+0x115/0x310
[<ffffffffb291f350>] submit_bio+0x70/0x150
[<ffffffffb27dd060>] ? init_emergency_isa_pool+0x60/0x60
[<ffffffffb27dd609>] __swap_writepage+0x239/0x280
[<ffffffffb27d59fe>] ? page_remove_rmap+0xce/0x160
[<ffffffffb27d5d2a>] ? try_to_unmap_one+0x29a/0x810
[<ffffffffb27de332>] ? _swap_info_get+0x12/0x60
[<ffffffffb27e014f>] ? page_swapcount+0x8f/0xa0
[<ffffffffb27dd689>] swap_writepage+0x39/0x80
[<ffffffffb27aadef>] shrink_page_list+0x4df/0xaf0
[<ffffffffb27aba2d>] shrink_inactive_list+0x1cd/0x5d0
[<ffffffffb27ac525>] shrink_lruvec+0x385/0x730
[<ffffffffb27ac946>] shrink_zone+0x76/0x1a0
[<ffffffffb27adc3c>] balance_pgdat+0x48c/0x5e0
[<ffffffffb27adf03>] kswapd+0x173/0x440
[<ffffffffb26bef10>] ? wake_up_atomic_t+0x30/0x30
[<ffffffffb27add90>] ? balance_pgdat+0x5e0/0x5e0
[<ffffffffb26bdf21>] kthread+0xd1/0xe0
[<ffffffffb26bde50>] ? insert_kthread_work+0x40/0x40
[<ffffffffb2d255f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb26bde50>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48