Info

Permalink
Function
__list_del_entry
First occurrence
2021-05-27
Last occurrence
2021-05-27
State
NEW
Components
kernel
Quality
-37

Statistics

Operating system Count
CentOS 7 11
Architecture Count
x86_64 11
Related packages Count
kernel 11
 0:3.10.0-1160.el7 2
 0:3.10.0-1160.53.1.el7 2
 0:3.10.0-1160.25.1.el7 1
 0:3.10.0-1160.62.1.el7 1
 0:3.10.0-1160.71.1.el7 1
 0:3.10.0-514.26.2.el7 1
 0:3.10.0-1062.4.1.el7 1
 0:3.10.0-1160.92.1.el7 1
 0:3.10.0-1160.59.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

Report backtrace


Complete report #1423852
Frame # Function Binary Source or offset Line
1
__list_del_entry
vmlinux 0xffffffff8dba6779
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x29
2
list_del
vmlinux 0xffffffff8dba682d
Build id: 3.10.0-1160.59.1.el7.x86_64 		0xd
3
mpage_readpages
vmlinux 0xffffffff8da95011
Build id: 3.10.0-1160.59.1.el7.x86_64 		0xc1
4
? __xfs_get_blocks
xfs 0xffffffffc065ece0
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x6d0
5
? __xfs_get_blocks
xfs 0xffffffffc065ece0
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x6d0
6
? alloc_pages_current
vmlinux 0xffffffff8da193b8
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x98
7
xfs_vm_readpages
xfs 0xffffffffc065e058
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x38
8
__do_page_cache_readahead
vmlinux 0xffffffff8d9cbe1f
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x1cf
9
ra_submit
vmlinux 0xffffffff8d9cc451
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x21
10
filemap_fault
vmlinux 0xffffffff8d9c0e35
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x105
11
__xfs_filemap_fault
xfs 0xffffffffc066991e
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x7e
12
xfs_filemap_fault
xfs 0xffffffffc0669b1c
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x2c
13
__do_fault.isra.61
vmlinux 0xffffffff8d9ee7aa
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x8a
14
do_read_fault.isra.63
vmlinux 0xffffffff8d9eed5c
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x4c
15
handle_mm_fault
vmlinux 0xffffffff8d9f65a0
Build id: 3.10.0-1160.59.1.el7.x86_64 		0xa20
16
? do_mmap
vmlinux 0xffffffff8d9fd36c
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x39c
17
__do_page_fault
vmlinux 0xffffffff8df94653
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x213
18
do_page_fault
vmlinux 0xffffffff8df94975
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x35
19
page_fault
vmlinux 0xffffffff8df90778
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 24s! [bash:31056]
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [CRTC:37:crtc-0] flip_done timed out
Modules linked in: tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag veth xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper pcspkr cryptd joydev ppdev vmw_vmci vmw_balloon
sg parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sd_mod sysimgblt fb_sys_fops ttm crc_t10dif crct10dif_generic drm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel libata serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 4 PID: 31056 Comm: bash Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.59.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff99d8fc642100 ti: ffff99da923d8000 task.ti: ffff99da923d8000
RIP: 0010:[<ffffffff8dba6779>]  [<ffffffff8dba6779>] __list_del_entry+0x29/0xd0
RSP: 0018:ffff99da923dba20  EFLAGS: 00010202
RAX: ffffea77023923e0 RBX: ffffea770024fa00 RCX: dead000000000200
RDX: ffff99da923dbb98 RSI: ffff99dcbfd1fcd0 RDI: ffffea7702957d60
RBP: ffff99da923dba20 R08: ffffea770171e2a0 R09: 0000000000000000
R10: ffff99dcbfbce020 R11: fff00000f0000000 R12: ffff99da00000000
R13: ffffffff8da3dd5f R14: ffff99da923db9c0 R15: ffff99dcab94dc00
FS:  00007fc3f1bd8740(0000) GS:ffff99dcbfd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc3eddd2e70 CR3: 00000000976d6000 CR4: 00000000001607e0
Call Trace:
[<ffffffff8dba682d>] list_del+0xd/0x30
[<ffffffff8da95011>] mpage_readpages+0xc1/0x170
[<ffffffffc065ece0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc065ece0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffff8da193b8>] ? alloc_pages_current+0x98/0x110
[<ffffffffc065e058>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffff8d9cbe1f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffff8d9cc451>] ra_submit+0x21/0x30
[<ffffffff8d9c0e35>] filemap_fault+0x105/0x420
[<ffffffffc066991e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc0669b1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffff8d9ee7aa>] __do_fault.isra.61+0x8a/0x100
[<ffffffff8d9eed5c>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffff8d9f65a0>] handle_mm_fault+0xa20/0xfb0
[<ffffffff8d9fd36c>] ? do_mmap+0x39c/0x590
[<ffffffff8df94653>] __do_page_fault+0x213/0x500
[<ffffffff8df94975>] do_page_fault+0x35/0x90
[<ffffffff8df90778>] page_fault+0x28/0x30
Code: 00 00 55 48 8b 17 48 b9 00 01 00 00 00 00 ad de 48 8b 47 08 48 89 e5 48 39 ca 74 29 48 b9 00 02 00 00 00 00 ad de 48 39 c8 74 7a <4c> 8b 00 4c 39 c7 75 53 4c 8b 42 08 4c 39 c7 75 2b 48 89 42 08
Complete report #750842
Frame # Function Binary Source or offset Line
1
__add_to_page_cache_locked
vmlinux 0xffffffff81181419
Build id: 3.10.0-514.26.2.el7.x86_64 		0x189
2
add_to_page_cache_lru
vmlinux 0xffffffff81181597
Build id: 3.10.0-514.26.2.el7.x86_64 		0x37
3
mpage_readpages
vmlinux 0xffffffff81240555
Build id: 3.10.0-514.26.2.el7.x86_64 		0xb5
4
? __xfs_get_blocks
xfs 0xffffffffa0276d70
Build id: 3.10.0-514.26.2.el7.x86_64 		0x7d0
5
? __xfs_get_blocks
xfs 0xffffffffa0276d70
Build id: 3.10.0-514.26.2.el7.x86_64 		0x7d0
6
? alloc_pages_current
vmlinux 0xffffffff811cf9ca
Build id: 3.10.0-514.26.2.el7.x86_64 		0xaa
7
xfs_vm_readpages
xfs 0xffffffffa0275298
Build id: 3.10.0-514.26.2.el7.x86_64 		0x38
8
__do_page_cache_readahead
vmlinux 0xffffffff8118dd2c
Build id: 3.10.0-514.26.2.el7.x86_64 		0x1cc
9
ra_submit
vmlinux 0xffffffff8118e3c1
Build id: 3.10.0-514.26.2.el7.x86_64 		0x21
10
filemap_fault
vmlinux 0xffffffff811836f5
Build id: 3.10.0-514.26.2.el7.x86_64 		0x105
11
xfs_filemap_fault
xfs 0xffffffffa02810af
Build id: 3.10.0-514.26.2.el7.x86_64 		0x5f
12
__do_fault
vmlinux 0xffffffff811ac83c
Build id: 3.10.0-514.26.2.el7.x86_64 		0x4c
13
do_read_fault.isra.42
vmlinux 0xffffffff811accd3
Build id: 3.10.0-514.26.2.el7.x86_64 		0x43
14
handle_mm_fault
vmlinux 0xffffffff811b1461
Build id: 3.10.0-514.26.2.el7.x86_64 		0x6b1
15
__do_page_fault
vmlinux 0xffffffff81692cc4
Build id: 3.10.0-514.26.2.el7.x86_64 		0x154
16
do_page_fault
vmlinux 0xffffffff81692ff5
Build id: 3.10.0-514.26.2.el7.x86_64 		0x35
17
page_fault
vmlinux 0xffffffff8168f208
Build id: 3.10.0-514.26.2.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [java:62533]
Modules linked in: tcp_lp rfcomm fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock bnep dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event intel_powerclamp coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd vmw_balloon snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device btusb btrtl btbcm snd_pcm btintel pcspkr bluetooth snd_timer snd soundcore rfkill sg nfit libnvdimm parport_pc parport vmw_vmci shpchp i2c_piix4 nfsd auth_rpcgss nfs_acl lockd
grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix e1000 mptspi scsi_transport_spi mptscsih mptbase vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm i2c_core libata fjes
CPU: 0 PID: 62533 Comm: java Not tainted 3.10.0-514.26.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff8800132b4e70 ti: ffff88001ab74000 task.ti: ffff88001ab74000
RIP: 0010:[<ffffffff81181419>]  [<ffffffff81181419>] __add_to_page_cache_locked+0x189/0x2b0
RSP: 0000:ffff88001ab77a98  EFLAGS: 00000206
RAX: 00000000000000ff RBX: 0000000000000080 RCX: 000000000001a008
RDX: 000000000001a07a RSI: 000000000000000a RDI: ffff88003ffd9800
RBP: ffff88001ab77ae0 R08: ffff880016653db0 R09: 0000000000000400
R10: ffff880026697700 R11: 0000000000000008 R12: 0000000000000001
R13: ffffea0000c3cd40 R14: 0000000100000000 R15: 00000000000000d0
FS:  00007f9a313d5700(0000) GS:ffff88003c600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9a5cc9e940 CR3: 0000000038d09000 CR4: 00000000003407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff88001ab77af0 ffff880016653d98 ffff880016653dc0 000000002e93ce1a
ffffea0000c3cd40 00000000000001dc ffff88001ab77c60 ffff8800246fd808
ffffea0000c3cd60 ffff88001ab77b10 ffffffff81181597 00000005765a8006
Call Trace:
[<ffffffff81181597>] add_to_page_cache_lru+0x37/0xb0
[<ffffffff81240555>] mpage_readpages+0xb5/0x160
[<ffffffffa0276d70>] ? __xfs_get_blocks+0x7d0/0x7d0 [xfs]
[<ffffffffa0276d70>] ? __xfs_get_blocks+0x7d0/0x7d0 [xfs]
[<ffffffff811cf9ca>] ? alloc_pages_current+0xaa/0x170
[<ffffffffa0275298>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffff8118dd2c>] __do_page_cache_readahead+0x1cc/0x250
[<ffffffff8118e3c1>] ra_submit+0x21/0x30
[<ffffffff811836f5>] filemap_fault+0x105/0x410
[<ffffffffa02810af>] xfs_filemap_fault+0x5f/0xf0 [xfs]
[<ffffffff811ac83c>] __do_fault+0x4c/0xc0
[<ffffffff811accd3>] do_read_fault.isra.42+0x43/0x130
[<ffffffff811b1461>] handle_mm_fault+0x6b1/0x1000
[<ffffffff81692cc4>] __do_page_fault+0x154/0x450
[<ffffffff81692ff5>] do_page_fault+0x35/0x90
[<ffffffff8168f208>] page_fault+0x28/0x30
Code: 48 39 47 18 74 05 e8 37 89 02 00 be 0a 00 00 00 48 89 df e8 da 0e 02 00 0f 1f 44 00 00 66 41 83 44 24 18 02 fb 66 0f 1f 44 00 00 <0f> 1f 44 00 00 e9 c6 fe ff ff 0f 1f 44 00 00 48 89 df e8 d0 35
Complete report #437585
Frame # Function Binary Source or offset Line
1
add_to_page_cache_lru
vmlinux 0xffffffffb71be940
Build id: 3.10.0-1160.el7.x86_64 		-
2
? mpage_readpages
vmlinux 0xffffffffb7294677
Build id: 3.10.0-1160.el7.x86_64 		0xd7
3
? __xfs_get_blocks
xfs 0xffffffffc0662ce0
Build id: 3.10.0-1160.el7.x86_64 		0x6d0
4
? __xfs_get_blocks
xfs 0xffffffffc0662ce0
Build id: 3.10.0-1160.el7.x86_64 		0x6d0
5
? alloc_pages_current
vmlinux 0xffffffffb72189d8
Build id: 3.10.0-1160.el7.x86_64 		0x98
6
xfs_vm_readpages
xfs 0xffffffffc0662058
Build id: 3.10.0-1160.el7.x86_64 		0x38
7
__do_page_cache_readahead
vmlinux 0xffffffffb71cb24f
Build id: 3.10.0-1160.el7.x86_64 		0x1cf
8
ra_submit
vmlinux 0xffffffffb71cb881
Build id: 3.10.0-1160.el7.x86_64 		0x21
9
filemap_fault
vmlinux 0xffffffffb71c0975
Build id: 3.10.0-1160.el7.x86_64 		0x105
10
? _cond_resched
vmlinux 0xffffffffb778740a
Build id: 3.10.0-1160.el7.x86_64 		0x3a
11
__xfs_filemap_fault
xfs 0xffffffffc066d91e
Build id: 3.10.0-1160.el7.x86_64 		0x7e
12
xfs_filemap_fault
xfs 0xffffffffc066db1c
Build id: 3.10.0-1160.el7.x86_64 		0x2c
13
__do_fault.isra.61
vmlinux 0xffffffffb71ede3a
Build id: 3.10.0-1160.el7.x86_64 		0x8a
14
do_read_fault.isra.63
vmlinux 0xffffffffb71ee3ec
Build id: 3.10.0-1160.el7.x86_64 		0x4c
15
handle_mm_fault
vmlinux 0xffffffffb71f5c30
Build id: 3.10.0-1160.el7.x86_64 		0xa20
16
? put_prev_entity
vmlinux 0xffffffffb70e5f1b
Build id: 3.10.0-1160.el7.x86_64 		0x8b
17
? pick_next_entity
vmlinux 0xffffffffb70e23a9
Build id: 3.10.0-1160.el7.x86_64 		0xa9
18
? set_next_entity
vmlinux 0xffffffffb70e055c
Build id: 3.10.0-1160.el7.x86_64 		0x3c
19
__do_page_fault
vmlinux 0xffffffffb778e653
Build id: 3.10.0-1160.el7.x86_64 		0x213
20
do_page_fault
vmlinux 0xffffffffb778e975
Build id: 3.10.0-1160.el7.x86_64 		0x35
21
page_fault
vmlinux 0xffffffffb778a778
Build id: 3.10.0-1160.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 24s! [containerd-shim:2058]
Modules linked in: tcp_lp veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq iosf_mbi crc32_pclmul ghash_clmulni_intel
snd_seq_device snd_pcm aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev snd_timer snd soundcore vmw_balloon pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif ata_generic crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect nfit ata_piix libnvdimm sysimgblt fb_sys_fops libata ttm mptspi scsi_transport_spi e1000 crct10dif_pclmul crct10dif_common mptscsih drm crc32c_intel serio_raw mptbase drm_panel_orientation_quirks fuse
CPU: 2 PID: 2058 Comm: containerd-shim Kdump: loaded Tainted: G               ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9916c9f70000 ti: ffff9916c9f78000 task.ti: ffff9916c9f78000
RIP: 0010:[<ffffffffb71be940>]  [<ffffffffb71be940>] add_to_page_cache_lru+0x0/0xb0
RSP: 0018:ffff9916c9f7ba40  EFLAGS: 00010246
RAX: dead000000000200 RBX: 0000000c00000003 RCX: 0000000000000050
RDX: 00000000000005c8 RSI: ffff9916e9369198 RDI: fffffc4481b8ebc0
RBP: ffff9916c9f7bb18 R08: fffffc4481b8ebe0 R09: 0000000000000400
R10: 0000000000001000 R11: 0000000000000008 R12: ffff9916b57c0000
R13: 0000000001e2ad40 R14: ffff991600000001 R15: ffffffffc0662ce0
FS:  000000c000200090(0000) GS:ffff9916fb680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe075009000 CR3: 0000000049f42000 CR4: 00000000001607e0
Call Trace:
[<ffffffffb7294677>] ? mpage_readpages+0xd7/0x170
[<ffffffffc0662ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc0662ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffb72189d8>] ? alloc_pages_current+0x98/0x110
[<ffffffffc0662058>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffffb71cb24f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffffb71cb881>] ra_submit+0x21/0x30
[<ffffffffb71c0975>] filemap_fault+0x105/0x420
[<ffffffffb778740a>] ? _cond_resched+0x3a/0x50
[<ffffffffc066d91e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc066db1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffffb71ede3a>] __do_fault.isra.61+0x8a/0x100
[<ffffffffb71ee3ec>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffffb71f5c30>] handle_mm_fault+0xa20/0xfb0
[<ffffffffb70e5f1b>] ? put_prev_entity+0x8b/0x400
[<ffffffffb70e23a9>] ? pick_next_entity+0xa9/0x190
[<ffffffffb70e055c>] ? set_next_entity+0x3c/0xe0
[<ffffffffb778e653>] __do_page_fault+0x213/0x500
[<ffffffffb778e975>] do_page_fault+0x35/0x90
[<ffffffffb778a778>] page_fault+0x28/0x30
Code: 90 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 45 31 c0 48 89 e5 e8 4f fe ff ff 5d c3 0f 1f 00 66 2e 0f 1f 84 00 00 00 00 00 <0f> 1f 44 00 00 55 48 89 e5 41 54 53 48 89 fb 48 83 ec 10 48 c7
Complete report #315007
Frame # Function Binary Source or offset Line
1
__add_to_page_cache_locked
vmlinux 0xffffffffa11be858
Build id: 3.10.0-1160.el7.x86_64 		0xd8
2
add_to_page_cache_lru
vmlinux 0xffffffffa11be977
Build id: 3.10.0-1160.el7.x86_64 		0x37
3
mpage_readpages
vmlinux 0xffffffffa1294677
Build id: 3.10.0-1160.el7.x86_64 		0xd7
4
? __xfs_get_blocks
xfs 0xffffffffc0318ce0
Build id: 3.10.0-1160.el7.x86_64 		0x6d0
5
? __xfs_get_blocks
xfs 0xffffffffc0318ce0
Build id: 3.10.0-1160.el7.x86_64 		0x6d0
6
? alloc_pages_current
vmlinux 0xffffffffa12189d8
Build id: 3.10.0-1160.el7.x86_64 		0x98
7
xfs_vm_readpages
xfs 0xffffffffc0318058
Build id: 3.10.0-1160.el7.x86_64 		0x38
8
__do_page_cache_readahead
vmlinux 0xffffffffa11cb24f
Build id: 3.10.0-1160.el7.x86_64 		0x1cf
9
ra_submit
vmlinux 0xffffffffa11cb881
Build id: 3.10.0-1160.el7.x86_64 		0x21
10
filemap_fault
vmlinux 0xffffffffa11c0975
Build id: 3.10.0-1160.el7.x86_64 		0x105
11
__xfs_filemap_fault
xfs 0xffffffffc032391e
Build id: 3.10.0-1160.el7.x86_64 		0x7e
12
xfs_filemap_fault
xfs 0xffffffffc0323b1c
Build id: 3.10.0-1160.el7.x86_64 		0x2c
13
__do_fault.isra.61
vmlinux 0xffffffffa11ede3a
Build id: 3.10.0-1160.el7.x86_64 		0x8a
14
do_read_fault.isra.63
vmlinux 0xffffffffa11ee3ec
Build id: 3.10.0-1160.el7.x86_64 		0x4c
15
handle_mm_fault
vmlinux 0xffffffffa11f5c30
Build id: 3.10.0-1160.el7.x86_64 		0xa20
16
__do_page_fault
vmlinux 0xffffffffa178e653
Build id: 3.10.0-1160.el7.x86_64 		0x213
17
do_page_fault
vmlinux 0xffffffffa178e975
Build id: 3.10.0-1160.el7.x86_64 		0x35
18
page_fault
vmlinux 0xffffffffa178a778
Build id: 3.10.0-1160.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 29s! [mysqld:1732]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink bnep vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi btusb btrtl btbcm btintel snd_ac97_codec bluetooth ac97_bus snd_seq snd_seq_device rfkill snd_pcm snd_timer iosf_mbi snd crc32_pclmul soundcore ghash_clmulni_intel aesni_intel lrw joydev gf128mul glue_helper ablk_helper cryptd pcspkr ppdev sg vmw_balloon parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic
ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt mptspi fb_sys_fops ttm scsi_transport_spi ata_piix nfit crct10dif_pclmul crct10dif_common mptscsih e1000 crc32c_intel libata libnvdimm drm serio_raw mptbase drm_panel_orientation_quirks fuse
CPU: 0 PID: 1732 Comm: mysqld Kdump: loaded Tainted: G             L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff8d736844d280 ti: ffff8d735be3c000 task.ti: ffff8d735be3c000
RIP: 0010:[<ffffffffa11be858>]  [<ffffffffa11be858>] __add_to_page_cache_locked+0xd8/0x1a0
RSP: 0000:ffff8d735be3f9e0  EFLAGS: 00000297
RAX: 0000000000000003 RBX: 00000000081dd914 RCX: 000000000001fc28
RDX: 000000000001fcea RSI: 000000000000000a RDI: ffff8d735c4c6430
RBP: ffff8d735be3fa08 R08: ffff8d735c445910 R09: 0000000000000400
R10: 0000000000001000 R11: 0000000000000008 R12: 0000000000002100
R13: 0000000000000001 R14: ffff8d735be3f9a0 R15: ffff8d735be3f9a8
FS:  00007f679a4ec700(0000) GS:ffff8d737b600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000023dfeb8 CR3: 000000006df84000 CR4: 00000000003607f0
Call Trace:
[<ffffffffa11be977>] add_to_page_cache_lru+0x37/0xb0
[<ffffffffa1294677>] mpage_readpages+0xd7/0x170
[<ffffffffc0318ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc0318ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffa12189d8>] ? alloc_pages_current+0x98/0x110
[<ffffffffc0318058>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffffa11cb24f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffffa11cb881>] ra_submit+0x21/0x30
[<ffffffffa11c0975>] filemap_fault+0x105/0x420
[<ffffffffc032391e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc0323b1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffffa11ede3a>] __do_fault.isra.61+0x8a/0x100
[<ffffffffa11ee3ec>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffffa11f5c30>] handle_mm_fault+0xa20/0xfb0
[<ffffffffa178e653>] __do_page_fault+0x213/0x500
[<ffffffffa178e975>] do_page_fault+0x35/0x90
[<ffffffffa178a778>] page_fault+0x28/0x30
Code: ff ff 41 89 c5 85 c0 0f 85 93 00 00 00 4c 89 e7 be 0a 00 00 00 e8 d9 18 02 00 48 89 df c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <0f> 1f 44 00 00 5b 41 5c 41 5d 41 5e 41 5f 31 c0 5d c3 66 0f 1f
Complete report #167712
Frame # Function Binary Source or offset Line
1
__add_to_page_cache_locked
vmlinux 0xffffffff863beaf8
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xd8
2
add_to_page_cache_lru
vmlinux 0xffffffff863bec17
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x37
3
mpage_readpages
vmlinux 0xffffffff86494ab7
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xd7
4
? __xfs_get_blocks
xfs 0xffffffffc0595ce0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x6d0
5
? __xfs_get_blocks
xfs 0xffffffffc0595ce0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x6d0
6
? alloc_pages_current
vmlinux 0xffffffff86418c88
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x98
7
xfs_vm_readpages
xfs 0xffffffffc0595058
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x38
8
__do_page_cache_readahead
vmlinux 0xffffffff863cb46f
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x1cf
9
ra_submit
vmlinux 0xffffffff863cbaa1
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x21
10
filemap_fault
vmlinux 0xffffffff863c0c15
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x105
11
? __schedule
vmlinux 0xffffffff86988a77
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x3c7
12
__xfs_filemap_fault
xfs 0xffffffffc05a091e
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x7e
13
xfs_filemap_fault
xfs 0xffffffffc05a0b1c
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x2c
14
__do_fault.isra.61
vmlinux 0xffffffff863ee08a
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x8a
15
do_read_fault.isra.63
vmlinux 0xffffffff863ee63c
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x4c
16
handle_mm_fault
vmlinux 0xffffffff863f5e80
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xa20
17
? do_sync_write
vmlinux 0xffffffff8644d313
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x93
18
__do_page_fault
vmlinux 0xffffffff86990653
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x213
19
do_page_fault
vmlinux 0xffffffff86990975
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x35
20
page_fault
vmlinux 0xffffffff8698c778
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 24s! [consul:39740]
Modules linked in: veth tcp_lp nls_utf8 isofs xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper snd_ens1371 cryptd snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd soundcore vmw_balloon pcspkr joydev sg i2c_piix4 vmw_vmci parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi
sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix drm nfit libnvdimm mptspi libata serio_raw scsi_transport_spi e1000 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 39740 Comm: consul Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff9cc6c7f94200 ti: ffff9cc6c61a0000 task.ti: ffff9cc6c61a0000
RIP: 0010:[<ffffffff863beaf8>]  [<ffffffff863beaf8>] __add_to_page_cache_locked+0xd8/0x1a0
RSP: 0018:ffff9cc6c61a39e0  EFLAGS: 00000297
RAX: 0000000000000004 RBX: 00000000886bfdbb RCX: 000045acc281740a
RDX: 000045acc2817532 RSI: 000000000000000a RDI: ffff9cc6d5a7b370
RBP: ffff9cc6c61a3a08 R08: ffff9cc6f9930b80 R09: ffff9cc6f5b61408
R10: 0000000000000000 R11: ffff9cc6f5b61408 R12: 00000000000003c0
R13: 0000000000000001 R14: ffff9cc6c61a39a0 R15: ffff9cc6c61a39a8
FS:  000000c000070490(0000) GS:ffff9cc73b600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000519380 CR3: 0000000011410000 CR4: 00000000003607f0
Call Trace:
[<ffffffff863bec17>] add_to_page_cache_lru+0x37/0xb0
[<ffffffff86494ab7>] mpage_readpages+0xd7/0x170
[<ffffffffc0595ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc0595ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffff86418c88>] ? alloc_pages_current+0x98/0x110
[<ffffffffc0595058>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffff863cb46f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffff863cbaa1>] ra_submit+0x21/0x30
[<ffffffff863c0c15>] filemap_fault+0x105/0x420
[<ffffffff86988a77>] ? __schedule+0x3c7/0x870
[<ffffffffc05a091e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc05a0b1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffff863ee08a>] __do_fault.isra.61+0x8a/0x100
[<ffffffff863ee63c>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffff863f5e80>] handle_mm_fault+0xa20/0xfb0
[<ffffffff8644d313>] ? do_sync_write+0x93/0xe0
[<ffffffff86990653>] __do_page_fault+0x213/0x500
[<ffffffff86990975>] do_page_fault+0x35/0x90
[<ffffffff8698c778>] page_fault+0x28/0x30
Code: ff ff 41 89 c5 85 c0 0f 85 93 00 00 00 4c 89 e7 be 0a 00 00 00 e8 79 18 02 00 48 89 df c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <0f> 1f 44 00 00 5b 41 5c 41 5d 41 5e 41 5f 31 c0 5d c3 66 0f 1f
Complete report #1276884
Frame # Function Binary Source or offset Line
1
? lru_cache_add
vmlinux 0xffffffff91dd91ce
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xe
2
mpage_readpages
vmlinux 0xffffffff91ea43e2
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x112
3
? __xfs_get_blocks
xfs 0xffffffffc06fc0f0
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x6e0
4
? __xfs_get_blocks
xfs 0xffffffffc06fc0f0
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x6e0
5
? alloc_pages_current
vmlinux 0xffffffff91e259d8
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x98
6
xfs_vm_readpages
xfs 0xffffffffc06fb448
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x38
7
__do_page_cache_readahead
vmlinux 0xffffffff91dd6ebf
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x1cf
8
ra_submit
vmlinux 0xffffffff91dd7501
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x21
9
filemap_fault
vmlinux 0xffffffff91dcbb75
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x105
10
__xfs_filemap_fault
xfs 0xffffffffc0706ffe
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x7e
11
xfs_filemap_fault
xfs 0xffffffffc070720c
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x2c
12
__do_fault.isra.61
vmlinux 0xffffffff91dfa15a
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x8a
13
do_read_fault.isra.63
vmlinux 0xffffffff91dfa70c
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x4c
14
handle_mm_fault
vmlinux 0xffffffff91e02113
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xa33
15
__do_page_fault
vmlinux 0xffffffff923bf7d3
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x213
16
do_page_fault
vmlinux 0xffffffff923bfb05
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x35
17
page_fault
vmlinux 0xffffffff923bb7b8
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 24s! [python:107705]
[<ffffffff91dd91ce>] ? lru_cache_add+0xe/0x20
[<ffffffff91ea43e2>] mpage_readpages+0x112/0x180
[<ffffffffc06fc0f0>] ? __xfs_get_blocks+0x6e0/0x6e0 [xfs]
[<ffffffffc06fc0f0>] ? __xfs_get_blocks+0x6e0/0x6e0 [xfs]
[<ffffffff91e259d8>] ? alloc_pages_current+0x98/0x110
[<ffffffffc06fb448>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffff91dd6ebf>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffff91dd7501>] ra_submit+0x21/0x30
[<ffffffff91dcbb75>] filemap_fault+0x105/0x420
[<ffffffffc0706ffe>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc070720c>] xfs_filemap_fault+0x2c/0x40 [xfs]
[<ffffffff91dfa15a>] __do_fault.isra.61+0x8a/0x100
[<ffffffff91dfa70c>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffff91e02113>] handle_mm_fault+0xa33/0x1190
[<ffffffff923bf7d3>] __do_page_fault+0x213/0x510
[<ffffffff923bfb05>] do_page_fault+0x35/0x90
[<ffffffff923bb7b8>] page_fault+0x28/0x30
Complete report #1156587
Frame # Function Binary Source or offset Line
1
__list_del_entry
vmlinux 0xffffffffb3b9f8ec
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x2c
2
list_del
vmlinux 0xffffffffb3b9f99d
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xd
3
mpage_readpages
vmlinux 0xffffffffb3a8ee61
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xc1
4
? __xfs_get_blocks
xfs 0xffffffffc01f9a80
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x6d0
5
? __xfs_get_blocks
xfs 0xffffffffc01f9a80
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x6d0
6
? alloc_pages_current
vmlinux 0xffffffffb3a15258
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x98
7
xfs_vm_readpages
xfs 0xffffffffc01f8df8
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x38
8
__do_page_cache_readahead
vmlinux 0xffffffffb39c975f
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x1cf
9
ra_submit
vmlinux 0xffffffffb39c9dc1
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x21
10
filemap_fault
vmlinux 0xffffffffb39be775
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x105
11
? down_read
vmlinux 0xffffffffb3f7dc82
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x12
12
__xfs_filemap_fault
xfs 0xffffffffc020455e
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x7e
13
xfs_filemap_fault
xfs 0xffffffffc020475c
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x2c
14
__do_fault.isra.61
vmlinux 0xffffffffb39ea88a
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x8a
15
do_read_fault.isra.63
vmlinux 0xffffffffb39eae3c
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x4c
16
handle_pte_fault
vmlinux 0xffffffffb39ef8ea
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x22a
17
? __switch_to
vmlinux 0xffffffffb382b621
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x151
18
handle_mm_fault
vmlinux 0xffffffffb39f25fd
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x39d
19
__do_page_fault
vmlinux 0xffffffffb3f86653
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x213
20
do_page_fault
vmlinux 0xffffffffb3f86975
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x35
21
? error_swapgs
vmlinux 0xffffffffb3f82ac9
Build id: 3.10.0-1062.4.1.el7.x86_64 		0xaa
22
page_fault
vmlinux 0xffffffffb3f82778
Build id: 3.10.0-1062.4.1.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [gnome-shell:19965]
Modules linked in: tcp_lp binfmt_misc fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc crc32_pclmul ghash_clmulni_intel ppdev vboxvideo(OE) ttm drm_kms_helper vboxguest(OE) aesni_intel lrw gf128mul glue_helper joydev ablk_helper syscopyarea cryptd sysfillrect sysimgblt fb_sys_fops pcspkr parport_pc sg drm parport i2c_piix4 video drm_panel_orientation_quirks
ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ahci libahci libata crct10dif_pclmul crct10dif_common e1000 crc32c_intel serio_raw dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 19965 Comm: gnome-shell Kdump: loaded Tainted: G           OEL ------------   3.10.0-1062.4.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff99f082de9070 ti: ffff99f0f92e8000 task.ti: ffff99f0f92e8000
RIP: 0010:[<ffffffffb3b9f8ec>]  [<ffffffffb3b9f8ec>] __list_del_entry+0x2c/0xd0
RSP: 0000:ffff99f0f92eb998  EFLAGS: 00010206
RAX: ffffdc0841406060 RBX: ffffffffc01f9a80 RCX: dead000000000200
RDX: ffff99f0f92ebb10 RSI: 000000000986d000 RDI: ffffdc08416e83a0
RBP: ffff99f0f92eb998 R08: ffffdc08416e83a0 R09: ffff99f0b5bfd208
R10: 0000000000000000 R11: ffff99f0b5bfd208 R12: 0000001df92eb940
R13: 0000000000000001 R14: ffff99f0f92eb9e8 R15: ffff99f0f92eb990
FS:  00007fc332240a80(0000) GS:ffff99f0ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f931afcbbc0 CR3: 00000000782a8000 CR4: 00000000000206f0
Call Trace:
[<ffffffffb3b9f99d>] list_del+0xd/0x30
[<ffffffffb3a8ee61>] mpage_readpages+0xc1/0x170
[<ffffffffc01f9a80>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc01f9a80>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffb3a15258>] ? alloc_pages_current+0x98/0x110
[<ffffffffc01f8df8>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffffb39c975f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffffb39c9dc1>] ra_submit+0x21/0x30
[<ffffffffb39be775>] filemap_fault+0x105/0x490
[<ffffffffb3f7dc82>] ? down_read+0x12/0x40
[<ffffffffc020455e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc020475c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffffb39ea88a>] __do_fault.isra.61+0x8a/0x100
[<ffffffffb39eae3c>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffffb39ef8ea>] handle_pte_fault+0x22a/0xe20
[<ffffffffb382b621>] ? __switch_to+0x151/0x580
[<ffffffffb39f25fd>] handle_mm_fault+0x39d/0x9b0
[<ffffffffb3f86653>] __do_page_fault+0x213/0x500
[<ffffffffb3f86975>] do_page_fault+0x35/0x90
[<ffffffffb3f82ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffb3f82778>] page_fault+0x28/0x30
Code: 48 8b 17 48 b9 00 01 00 00 00 00 ad de 48 8b 47 08 48 89 e5 48 39 ca 74 29 48 b9 00 02 00 00 00 00 ad de 48 39 c8 74 7a 4c 8b 00 <4c> 39 c7 75 53 4c 8b 42 08 4c 39 c7 75 2b 48 89 42 08 48 89 10
Complete report #533529
Frame # Function Binary Source or offset Line
1
mpage_readpages
vmlinux 0xffffffff88094f32
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x112
2
? __xfs_get_blocks
xfs 0xffffffffc0468ce0
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x6d0
3
? __xfs_get_blocks
xfs 0xffffffffc0468ce0
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x6d0
4
? alloc_pages_current
vmlinux 0xffffffff880193d8
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x98
5
xfs_vm_readpages
xfs 0xffffffffc0468058
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x38
6
__do_page_cache_readahead
vmlinux 0xffffffff87fcbe7f
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x1cf
7
ra_submit
vmlinux 0xffffffff87fcc4b1
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x21
8
filemap_fault
vmlinux 0xffffffff87fc0eb5
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x105
9
__xfs_filemap_fault
xfs 0xffffffffc047391e
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x7e
10
xfs_filemap_fault
xfs 0xffffffffc0473b1c
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x2c
11
__do_fault.isra.61
vmlinux 0xffffffff87fee7fa
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x8a
12
? hrtimer_get_res
vmlinux 0xffffffff87ec9bd0
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x50
13
do_read_fault.isra.63
vmlinux 0xffffffff87feedac
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x4c
14
handle_mm_fault
vmlinux 0xffffffff87ff65f0
Build id: 3.10.0-1160.71.1.el7.x86_64 		0xa20
15
__do_page_fault
vmlinux 0xffffffff88594653
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x213
16
do_page_fault
vmlinux 0xffffffff88594975
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x35
17
page_fault
vmlinux 0xffffffff88590778
Build id: 3.10.0-1160.71.1.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 36s! [systemd-logind:825]
[<ffffffff88094f32>] mpage_readpages+0x112/0x170
[<ffffffffc0468ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc0468ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffff880193d8>] ? alloc_pages_current+0x98/0x110
[<ffffffffc0468058>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffff87fcbe7f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffff87fcc4b1>] ra_submit+0x21/0x30
[<ffffffff87fc0eb5>] filemap_fault+0x105/0x420
[<ffffffffc047391e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc0473b1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffff87fee7fa>] __do_fault.isra.61+0x8a/0x100
[<ffffffff87ec9bd0>] ? hrtimer_get_res+0x50/0x50
[<ffffffff87feedac>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffff87ff65f0>] handle_mm_fault+0xa20/0xfb0
[<ffffffff88594653>] __do_page_fault+0x213/0x500
[<ffffffff88594975>] do_page_fault+0x35/0x90
[<ffffffff88590778>] page_fault+0x28/0x30
Complete report #403618
Frame # Function Binary Source or offset Line
1
__list_del_entry
vmlinux 0xffffffff88da654c
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x2c
2
list_del
vmlinux 0xffffffff88da65fd
Build id: 3.10.0-1160.62.1.el7.x86_64 		0xd
3
mpage_readpages
vmlinux 0xffffffff88c94ea1
Build id: 3.10.0-1160.62.1.el7.x86_64 		0xc1
4
? __xfs_get_blocks
xfs 0xffffffffc0380ce0
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x6d0
5
? __xfs_get_blocks
xfs 0xffffffffc0380ce0
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x6d0
6
? alloc_pages_current
vmlinux 0xffffffff88c193a8
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x98
7
xfs_vm_readpages
xfs 0xffffffffc0380058
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x38
8
__do_page_cache_readahead
vmlinux 0xffffffff88bcbe2f
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x1cf
9
ra_submit
vmlinux 0xffffffff88bcc461
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x21
10
filemap_fault
vmlinux 0xffffffff88bc0e65
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x105
11
__xfs_filemap_fault
xfs 0xffffffffc038b91e
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x7e
12
xfs_filemap_fault
xfs 0xffffffffc038bb1c
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x2c
13
__do_fault.isra.61
vmlinux 0xffffffff88bee79a
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x8a
14
do_read_fault.isra.63
vmlinux 0xffffffff88beed4c
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x4c
15
handle_mm_fault
vmlinux 0xffffffff88bf6590
Build id: 3.10.0-1160.62.1.el7.x86_64 		0xa20
16
__do_page_fault
vmlinux 0xffffffff89194653
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x213
17
do_page_fault
vmlinux 0xffffffff89194975
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x35
18
? error_swapgs
vmlinux 0xffffffff89190ac9
Build id: 3.10.0-1160.62.1.el7.x86_64 		0xaa
19
page_fault
vmlinux 0xffffffff89190778
Build id: 3.10.0-1160.62.1.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 1694s! [gsd-media-keys:15629]
Modules linked in: tcp_lp binfmt_misc nls_utf8 isofs vboxsf(OE) tun devlink bridge stp llc ip_set sunrpc intel_powerclamp iosf_mbi crc32_pclmul snd_intel8x0 ghash_clmulni_intel snd_ac97_codec ac97_bus joydev ppdev snd_seq snd_seq_device snd_pcm aesni_intel lrw gf128mul glue_helper snd_timer ablk_helper cryptd snd sg pcspkr vboxguest(OE) soundcore i2c_piix4 parport_pc parport video xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci ata_piix libahci libata e1000 crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: ip_tables]
CPU: 0 PID: 15629 Comm: gsd-media-keys Kdump: loaded Tainted: G           OE  ------------   3.10.0-1160.62.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff98dc4a5ed280 ti: ffff98dc474a4000 task.ti: ffff98dc474a4000
RIP: 0010:[<ffffffff88da654c>]  [<ffffffff88da654c>] __list_del_entry+0x2c/0xd0
RSP: 0000:ffff98dc474a7a20  EFLAGS: 00000202
RAX: fffff76900f6d320 RBX: ffff98dc00000001 RCX: dead000000000200
RDX: ffff98dc474a7b98 RSI: 0000000065d82000 RDI: fffff7690136b020
RBP: ffff98dc474a7a20 R08: fffff7690136b020 R09: ffff98dc7603bc08
R10: 0000000000000000 R11: ffff98dc7603bc08 R12: ffff98dc474a7a78
R13: 00000081474a7a18 R14: 0000000000000001 R15: ffff98dc474a7a70
FS:  00007f7bae078a40(0000) GS:ffff98dcbfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7bac5bd359 CR3: 0000000021152000 CR4: 00000000000606f0
Call Trace:
[<ffffffff88da65fd>] list_del+0xd/0x30
[<ffffffff88c94ea1>] mpage_readpages+0xc1/0x170
[<ffffffffc0380ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc0380ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffff88c193a8>] ? alloc_pages_current+0x98/0x110
[<ffffffffc0380058>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffff88bcbe2f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffff88bcc461>] ra_submit+0x21/0x30
[<ffffffff88bc0e65>] filemap_fault+0x105/0x420
[<ffffffffc038b91e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc038bb1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffff88bee79a>] __do_fault.isra.61+0x8a/0x100
[<ffffffff88beed4c>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffff88bf6590>] handle_mm_fault+0xa20/0xfb0
[<ffffffff89194653>] __do_page_fault+0x213/0x500
[<ffffffff89194975>] do_page_fault+0x35/0x90
[<ffffffff89190ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffff89190778>] page_fault+0x28/0x30
Code: 48 8b 17 48 b9 00 01 00 00 00 00 ad de 48 8b 47 08 48 89 e5 48 39 ca 74 29 48 b9 00 02 00 00 00 00 ad de 48 39 c8 74 7a 4c 8b 00 <4c> 39 c7 75 53 4c 8b 42 08 4c 39 c7 75 2b 48 89 42 08 48 89 10
Complete report #354270
Frame # Function Binary Source or offset Line
1
? lru_cache_add
vmlinux 0xffffffff877ce0be
Build id: 3.10.0-1160.53.1.el7.x86_64 		0xe
2
mpage_readpages
vmlinux 0xffffffff87895062
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x112
3
? __xfs_get_blocks
xfs 0xffffffffc04c7ce0
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x6d0
4
? __xfs_get_blocks
xfs 0xffffffffc04c7ce0
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x6d0
5
? alloc_pages_current
vmlinux 0xffffffff878193b8
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x98
6
xfs_vm_readpages
xfs 0xffffffffc04c7058
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x38
7
__do_page_cache_readahead
vmlinux 0xffffffff877cbe1f
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x1cf
8
ra_submit
vmlinux 0xffffffff877cc451
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x21
9
filemap_fault
vmlinux 0xffffffff877c0e35
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x105
10
__xfs_filemap_fault
xfs 0xffffffffc04d291e
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x7e
11
? set_next_entity
vmlinux 0xffffffff876e26ec
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x3c
12
xfs_filemap_fault
xfs 0xffffffffc04d2b1c
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x2c
13
__do_fault.isra.61
vmlinux 0xffffffff877ee7aa
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x8a
14
do_read_fault.isra.63
vmlinux 0xffffffff877eed5c
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x4c
15
handle_mm_fault
vmlinux 0xffffffff877f65a0
Build id: 3.10.0-1160.53.1.el7.x86_64 		0xa20
16
__do_page_fault
vmlinux 0xffffffff87d90653
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x213
17
do_page_fault
vmlinux 0xffffffff87d90975
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x35
18
page_fault
vmlinux 0xffffffff87d8c778
Build id: 3.10.0-1160.53.1.el7.x86_64 		0x28 
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 25s! [xfsaild/dm-0:469]
[<ffffffff877ce0be>] ? lru_cache_add+0xe/0x10
[<ffffffff87895062>] mpage_readpages+0x112/0x170
[<ffffffffc04c7ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffffc04c7ce0>] ? __xfs_get_blocks+0x6d0/0x6d0 [xfs]
[<ffffffff878193b8>] ? alloc_pages_current+0x98/0x110
[<ffffffffc04c7058>] xfs_vm_readpages+0x38/0x80 [xfs]
[<ffffffff877cbe1f>] __do_page_cache_readahead+0x1cf/0x260
[<ffffffff877cc451>] ra_submit+0x21/0x30
[<ffffffff877c0e35>] filemap_fault+0x105/0x420
[<ffffffffc04d291e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffff876e26ec>] ? set_next_entity+0x3c/0xe0
[<ffffffffc04d2b1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffff877ee7aa>] __do_fault.isra.61+0x8a/0x100
[<ffffffff877eed5c>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffff877f65a0>] handle_mm_fault+0xa20/0xfb0
[<ffffffff87d90653>] __do_page_fault+0x213/0x500
[<ffffffff87d90975>] do_page_fault+0x35/0x90
[<ffffffff87d8c778>] page_fault+0x28/0x30