Info

Permalink
Function
ktime_get_ts64
First occurrence
2020-10-19
Last occurrence
2020-10-19
State
NEW
Components
kernel
Quality
-35

Statistics

Operating system Count
CentOS 7 21
Architecture Count
x86_64 21
Related packages Count
kernel 21
 0:3.10.0-1160.el7 5
 0:3.10.0-862.11.6.el7 4
 0:3.10.0-862.el7 4
 0:3.10.0-1127.19.1.el7 1
 0:3.10.0-1062.9.1.el7 1
 0:3.10.0-693.11.6.el7 1
 0:3.10.0-957.10.1.el7 1
 0:3.10.0-1062.el7 1
 0:3.10.0-957.5.1.el7 1
 0:3.10.0-693.5.2.el7 1
 0:3.10.0-957.12.2.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

Report backtrace


Complete report #1418877
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffffb19063b0
Build id: 3.10.0-1160.el7.x86_64
0xa0
2
delayacct_end
vmlinux 0xffffffffb195db27
Build id: 3.10.0-1160.el7.x86_64
0x37
3
? kvm_clock_get_cycles
vmlinux 0xffffffffb186d39e
Build id: 3.10.0-1160.el7.x86_64
0x1e
4
__delayacct_blkio_end
vmlinux 0xffffffffb195dca4
Build id: 3.10.0-1160.el7.x86_64
0x34
5
io_schedule_timeout
vmlinux 0xffffffffb1f86877
Build id: 3.10.0-1160.el7.x86_64
0xe7
6
io_schedule
vmlinux 0xffffffffb1f868d8
Build id: 3.10.0-1160.el7.x86_64
0x18
7
bit_wait_io
vmlinux 0xffffffffb1f852a1
Build id: 3.10.0-1160.el7.x86_64
0x11
8
__wait_on_bit
vmlinux 0xffffffffb1f84dc7
Build id: 3.10.0-1160.el7.x86_64
0x67
9
wait_on_page_bit_killable
vmlinux 0xffffffffb19c0793
Build id: 3.10.0-1160.el7.x86_64
0x83
10
? wake_bit_function
vmlinux 0xffffffffb18c6dd0
Build id: 3.10.0-1160.el7.x86_64
0x40
11
__lock_page_or_retry
vmlinux 0xffffffffb19c0862
Build id: 3.10.0-1160.el7.x86_64
0xb2
12
filemap_fault
vmlinux 0xffffffffb19c0c57
Build id: 3.10.0-1160.el7.x86_64
0x3e7
13
__xfs_filemap_fault
xfs 0xffffffffc04a391e
Build id: 3.10.0-1160.el7.x86_64
0x7e
14
xfs_filemap_fault
xfs 0xffffffffc04a3b1c
Build id: 3.10.0-1160.el7.x86_64
0x2c
15
__do_fault.isra.61
vmlinux 0xffffffffb19ede3a
Build id: 3.10.0-1160.el7.x86_64
0x8a
16
do_read_fault.isra.63
vmlinux 0xffffffffb19ee3ec
Build id: 3.10.0-1160.el7.x86_64
0x4c
17
handle_mm_fault
vmlinux 0xffffffffb19f5c30
Build id: 3.10.0-1160.el7.x86_64
0xa20
18
? do_sync_read
vmlinux 0xffffffffb1a4cf83
Build id: 3.10.0-1160.el7.x86_64
0x93
19
__do_page_fault
vmlinux 0xffffffffb1f8e653
Build id: 3.10.0-1160.el7.x86_64
0x213
20
do_page_fault
vmlinux 0xffffffffb1f8e975
Build id: 3.10.0-1160.el7.x86_64
0x35
21
? error_swapgs
vmlinux 0xffffffffb1f8aac9
Build id: 3.10.0-1160.el7.x86_64
0xaa
22
page_fault
vmlinux 0xffffffffb1f8a778
Build id: 3.10.0-1160.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 32784s! [firefox:3504]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables tcp_diag udp_diag inet_diag tcp_lp tun devlink bridge stp llc ip_set nfnetlink sunrpc dm_mirror dm_region_hash dm_log dm_mod vmwgfx ttm crc32_pclmul drm_kms_helper ghash_clmulni_intel syscopyarea sysfillrect sysimgblt snd_intel8x0 fb_sys_fops snd_ac97_codec ac97_bus snd_seq snd_seq_device aesni_intel snd_pcm ppdev lrw
drm gf128mul glue_helper ablk_helper cryptd pcspkr i2c_piix4 sg snd_timer snd soundcore drm_panel_orientation_quirks parport_pc video parport xfs libcrc32c sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi ahci libahci ata_piix libata e1000 crct10dif_pclmul crct10dif_common crc32c_intel serio_raw fuse [last unloaded: ip_tables]
CPU: 0 PID: 3504 Comm: firefox Kdump: loaded Tainted: G             L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff8f73bdc6a100 ti: ffff8f73ccd04000 task.ti: ffff8f73ccd04000
RIP: 0010:[<ffffffffb19063b0>]  [<ffffffffb19063b0>] ktime_get_ts64+0xa0/0xf0
RSP: 0000:ffff8f73ccd07a98  EFLAGS: 00010292
RAX: ba8f26c515479afa RBX: ffff8f73b64c1800 RCX: 000000000000249a
RDX: 000000002a3efb4c RSI: 0000000022cdca65 RDI: ffff8f73fff78000
RBP: ffff8f73ccd07ab8 R08: 00000000be79e73c R09: 0000000000000001
R10: 0000000000000005 R11: ffff8f73ec9b1a80 R12: 0000000000000000
R13: ffff8f73cb53b180 R14: 000000000001acc0 R15: ffff8f73ccd07fd8
FS:  00007f1da635b780(0000) GS:ffff8f73ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000017193ce52000 CR3: 000000004b69c000 CR4: 00000000000206f0
Call Trace:
[<ffffffffb195db27>] delayacct_end+0x37/0xb0
[<ffffffffb186d39e>] ? kvm_clock_get_cycles+0x1e/0x20
[<ffffffffb195dca4>] __delayacct_blkio_end+0x34/0x60
[<ffffffffb1f86877>] io_schedule_timeout+0xe7/0x130
[<ffffffffb1f868d8>] io_schedule+0x18/0x20
[<ffffffffb1f852a1>] bit_wait_io+0x11/0x50
[<ffffffffb1f84dc7>] __wait_on_bit+0x67/0x90
[<ffffffffb19c0793>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffffb18c6dd0>] ? wake_bit_function+0x40/0x40
[<ffffffffb19c0862>] __lock_page_or_retry+0xb2/0xc0
[<ffffffffb19c0c57>] filemap_fault+0x3e7/0x420
[<ffffffffc04a391e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc04a3b1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffffb19ede3a>] __do_fault.isra.61+0x8a/0x100
[<ffffffffb19ee3ec>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffffb19f5c30>] handle_mm_fault+0xa20/0xfb0
[<ffffffffb1a4cf83>] ? do_sync_read+0x93/0xe0
[<ffffffffb1f8e653>] __do_page_fault+0x213/0x500
[<ffffffffb1f8e975>] do_page_fault+0x35/0x90
[<ffffffffb1f8aac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffb1f8a778>] page_fault+0x28/0x30
Code: 48 03 05 6c 40 01 01 48 d3 f8 48 8b 0d a2 40 01 01 44 3b 35 3b 40 01 01 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 <48> 2d 00 ca 9a 3b 83 c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 
Complete report #1389900
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffff89f01266
Build id: 3.10.0-957.12.2.el7.x86_64
0xa6
2
__delayacct_blkio_start
vmlinux 0xffffffff89f58542
Build id: 3.10.0-957.12.2.el7.x86_64
0x22
3
io_schedule_timeout
vmlinux 0xffffffff8a5684cb
Build id: 3.10.0-957.12.2.el7.x86_64
0x8b
4
io_schedule
vmlinux 0xffffffff8a568588
Build id: 3.10.0-957.12.2.el7.x86_64
0x18
5
bit_wait_io
vmlinux 0xffffffff8a566f71
Build id: 3.10.0-957.12.2.el7.x86_64
0x11
6
__wait_on_bit
vmlinux 0xffffffff8a566a97
Build id: 3.10.0-957.12.2.el7.x86_64
0x67
7
wait_on_page_bit_killable
vmlinux 0xffffffff89fb8f03
Build id: 3.10.0-957.12.2.el7.x86_64
0x83
8
? wake_bit_function
vmlinux 0xffffffff89ec2eb0
Build id: 3.10.0-957.12.2.el7.x86_64
0x40
9
__lock_page_or_retry
vmlinux 0xffffffff89fb8fd2
Build id: 3.10.0-957.12.2.el7.x86_64
0xb2
10
filemap_fault
vmlinux 0xffffffff89fb9420
Build id: 3.10.0-957.12.2.el7.x86_64
0x440
11
__xfs_filemap_fault
xfs 0xffffffffc0560d0e
Build id: 3.10.0-957.12.2.el7.x86_64
0x7e
12
xfs_filemap_fault
xfs 0xffffffffc0560f0c
Build id: 3.10.0-957.12.2.el7.x86_64
0x2c
13
__do_fault.isra.59
vmlinux 0xffffffff89fe476a
Build id: 3.10.0-957.12.2.el7.x86_64
0x8a
14
do_cow_fault
vmlinux 0xffffffff89fe5624
Build id: 3.10.0-957.12.2.el7.x86_64
0xb4
15
handle_pte_fault
vmlinux 0xffffffff89fe9724
Build id: 3.10.0-957.12.2.el7.x86_64
0x354
16
handle_mm_fault
vmlinux 0xffffffff89fec1fd
Build id: 3.10.0-957.12.2.el7.x86_64
0x39d
17
__do_page_fault
vmlinux 0xffffffff8a570603
Build id: 3.10.0-957.12.2.el7.x86_64
0x203
18
do_page_fault
vmlinux 0xffffffff8a570925
Build id: 3.10.0-957.12.2.el7.x86_64
0x35
19
? error_swapgs
vmlinux 0xffffffff8a56cab6
Build id: 3.10.0-957.12.2.el7.x86_64
0xa7
20
page_fault
vmlinux 0xffffffff8a56c768
Build id: 3.10.0-957.12.2.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [abrt-hook-ccpp:20017]
Modules linked in: tcp_lp fuse vboxsf(OE) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc joydev ppdev crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_intel8x0 snd_ac97_codec ac97_bus sg pcspkr snd_seq snd_seq_device snd_pcm parport_pc vboxguest(OE) parport video snd_timer snd soundcore i2c_piix4
binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod ata_generic crc_t10dif crct10dif_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel drm_kms_helper e1000 syscopyarea sysfillrect sysimgblt fb_sys_fops serio_raw ttm ahci libahci drm ata_piix libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 20017 Comm: abrt-hook-ccpp Tainted: G           OEL ------------   3.10.0-957.12.2.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff9619755f2080 ti: ffff9618ca2d8000 task.ti: ffff9618ca2d8000
RIP: 0010:[<ffffffff89f01266>]  [<ffffffff89f01266>] ktime_get_ts64+0xa6/0xf0
RSP: 0000:ffff9618ca2dba60  EFLAGS: 00000282
RAX: f46a7f3ef7538e19 RBX: ffff9618f5368000 RCX: 00000000000042e0
RDX: 0000000031c0bcb3 RSI: 0000000022878a18 RDI: ffff9619dff840c0
RBP: ffff9618ca2dba80 R08: 00000000a04ced40 R09: ac9a11f972000000
R10: 5365d92d127e5c80 R11: ffff96196e79b180 R12: 0000000000000000
R13: ffff9619d48de048 R14: ffff9619d48df990 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff9619dfd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f099e3058a0 CR3: 00000000d9358000 CR4: 00000000000406e0
Call Trace:
[<ffffffff89f58542>] __delayacct_blkio_start+0x22/0x30
[<ffffffff8a5684cb>] io_schedule_timeout+0x8b/0x130
[<ffffffff8a568588>] io_schedule+0x18/0x20
[<ffffffff8a566f71>] bit_wait_io+0x11/0x50
[<ffffffff8a566a97>] __wait_on_bit+0x67/0x90
[<ffffffff89fb8f03>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffff89ec2eb0>] ? wake_bit_function+0x40/0x40
[<ffffffff89fb8fd2>] __lock_page_or_retry+0xb2/0xc0
[<ffffffff89fb9420>] filemap_fault+0x440/0x490
[<ffffffffc0560d0e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc0560f0c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffff89fe476a>] __do_fault.isra.59+0x8a/0x100
[<ffffffff89fe5624>] do_cow_fault+0xb4/0x2d0
[<ffffffff89fe9724>] handle_pte_fault+0x354/0xd10
[<ffffffff89fec1fd>] handle_mm_fault+0x39d/0x9b0
[<ffffffff8a570603>] __do_page_fault+0x203/0x4f0
[<ffffffff8a570925>] do_page_fault+0x35/0x90
[<ffffffff8a56cab6>] ? error_swapgs+0xa7/0xbd
[<ffffffff8a56c768>] page_fault+0x28/0x30
Code: 00 48 d3 f8 48 8b 0d b2 7f ff 00 44 3b 35 4b 7f ff 00 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 48 2d 00 ca 9a 3b <83> c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 08 48 01 ca 5b 49 
Complete report #1305052
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffff810e940f
Build id: 3.10.0-693.5.2.el7.x86_64
0xaf
2
__delayacct_blkio_start
vmlinux 0xffffffff8113d462
Build id: 3.10.0-693.5.2.el7.x86_64
0x22
3
io_schedule_timeout
vmlinux 0xffffffff816a8beb
Build id: 3.10.0-693.5.2.el7.x86_64
0x8b
4
io_schedule
vmlinux 0xffffffff816a8ca8
Build id: 3.10.0-693.5.2.el7.x86_64
0x18
5
bit_wait_io
vmlinux 0xffffffff816a76c1
Build id: 3.10.0-693.5.2.el7.x86_64
0x11
6
__wait_on_bit
vmlinux 0xffffffff816a71e5
Build id: 3.10.0-693.5.2.el7.x86_64
0x65
7
wait_on_page_bit_killable
vmlinux 0xffffffff81184c73
Build id: 3.10.0-693.5.2.el7.x86_64
0x83
8
? wake_bit_function
vmlinux 0xffffffff810b19e0
Build id: 3.10.0-693.5.2.el7.x86_64
0x40
9
__lock_page_or_retry
vmlinux 0xffffffff81184d42
Build id: 3.10.0-693.5.2.el7.x86_64
0xb2
10
filemap_fault
vmlinux 0xffffffff81185107
Build id: 3.10.0-693.5.2.el7.x86_64
0x3b7
11
xfs_filemap_fault
xfs 0xffffffffc029092f
Build id: 3.10.0-693.5.2.el7.x86_64
0x5f
12
__do_fault
vmlinux 0xffffffff811ad0d2
Build id: 3.10.0-693.5.2.el7.x86_64
0x52
13
do_read_fault.isra.44
vmlinux 0xffffffff811ad57b
Build id: 3.10.0-693.5.2.el7.x86_64
0x4b
14
? poll_select_copy_remaining
vmlinux 0xffffffff81215dc0
Build id: 3.10.0-693.5.2.el7.x86_64
0x150
15
handle_mm_fault
vmlinux 0xffffffff811b1e81
Build id: 3.10.0-693.5.2.el7.x86_64
0x691
16
__do_page_fault
vmlinux 0xffffffff816b0074
Build id: 3.10.0-693.5.2.el7.x86_64
0x154
17
do_page_fault
vmlinux 0xffffffff816b03a5
Build id: 3.10.0-693.5.2.el7.x86_64
0x35
18
page_fault
vmlinux 0xffffffff816ac5c8
Build id: 3.10.0-693.5.2.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [NetworkManager:716]
Modules linked in: fuse vboxsf(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_timer joydev ppdev pcspkr snd soundcore sg vboxguest(OE) parport_pc parport video i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci ata_piix libahci
drm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw e1000 i2c_core libata dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 716 Comm: NetworkManager Tainted: G           OEL ------------   3.10.0-693.5.2.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff88007b128000 ti: ffff88007bcb4000 task.ti: ffff88007bcb4000
RIP: 0010:[<ffffffff810e940f>]  [<ffffffff810e940f>] ktime_get_ts64+0xaf/0xf0
RSP: 0000:ffff88007bcb7b90  EFLAGS: 00010292
RAX: 8f1ea9b115c1b125 RBX: ffff8800346008d0 RCX: 00000000000092f5
RDX: 00000000e4d11bb2 RSI: 00000000106bc428 RDI: ffff88007ff79000
RBP: ffff88007bcb7bb0 R08: 00000000cd20d434 R09: a800012061000000
R10: 57ffe8df9f481840 R11: ffff8800773ab000 R12: 0000000000000000
R13: ffff880035fc2848 R14: ffff88003628a990 R15: 0000000000000000
FS:  00007fea63e33940(0000) GS:ffff88007fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055f8e475ae00 CR3: 000000007bb92000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000082 0000000000000000 7fffffffffffffff ffff88007ff4b0e8
ffff88007bcb7bc0 ffffffff8113d462 ffff88007bcb7bf0 ffffffff816a8beb
ffff88007bcb7be0 0000000000000082 0000000000000082 ffff88007bcb7c80
Call Trace:
[<ffffffff8113d462>] __delayacct_blkio_start+0x22/0x30
[<ffffffff816a8beb>] io_schedule_timeout+0x8b/0x130
[<ffffffff816a8ca8>] io_schedule+0x18/0x20
[<ffffffff816a76c1>] bit_wait_io+0x11/0x50
[<ffffffff816a71e5>] __wait_on_bit+0x65/0x90
[<ffffffff81184c73>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffff810b19e0>] ? wake_bit_function+0x40/0x40
[<ffffffff81184d42>] __lock_page_or_retry+0xb2/0xc0
[<ffffffff81185107>] filemap_fault+0x3b7/0x410
[<ffffffffc029092f>] xfs_filemap_fault+0x5f/0xf0 [xfs]
[<ffffffff811ad0d2>] __do_fault+0x52/0xe0
[<ffffffff811ad57b>] do_read_fault.isra.44+0x4b/0x130
[<ffffffff81215dc0>] ? poll_select_copy_remaining+0x150/0x150
[<ffffffff811b1e81>] handle_mm_fault+0x691/0xfa0
[<ffffffff816b0074>] __do_page_fault+0x154/0x450
[<ffffffff816b03a5>] do_page_fault+0x35/0x90
[<ffffffff816ac5c8>] page_fault+0x28/0x30
Code: c3 da 00 75 9b 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 2e 31 d2 66 0f 1f 44 00 00 48 2d 00 ca 9a 3b 83 c2 01 48 3d ff c9 9a 3b <77> ef 49 89 44 24 08 48 01 ca 5b 49 89 14 24 41 5c 41 5d 41 5e 
Complete report #1006747
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffff99704836
Build id: 3.10.0-1062.el7.x86_64
0xa6
2
__delayacct_blkio_start
vmlinux 0xffffffff9975c042
Build id: 3.10.0-1062.el7.x86_64
0x22
3
io_schedule_timeout
vmlinux 0xffffffff99d7e71b
Build id: 3.10.0-1062.el7.x86_64
0x8b
4
io_schedule
vmlinux 0xffffffff99d7e7d8
Build id: 3.10.0-1062.el7.x86_64
0x18
5
bit_wait_io
vmlinux 0xffffffff99d7d1a1
Build id: 3.10.0-1062.el7.x86_64
0x11
6
__wait_on_bit
vmlinux 0xffffffff99d7ccc7
Build id: 3.10.0-1062.el7.x86_64
0x67
7
wait_on_page_bit_killable
vmlinux 0xffffffff997be4c3
Build id: 3.10.0-1062.el7.x86_64
0x83
8
? wake_bit_function
vmlinux 0xffffffff996c6280
Build id: 3.10.0-1062.el7.x86_64
0x40
9
__lock_page_or_retry
vmlinux 0xffffffff997be592
Build id: 3.10.0-1062.el7.x86_64
0xb2
10
filemap_fault
vmlinux 0xffffffff997be9e0
Build id: 3.10.0-1062.el7.x86_64
0x440
11
__xfs_filemap_fault
xfs 0xffffffffc064f55e
Build id: 3.10.0-1062.el7.x86_64
0x7e
12
xfs_filemap_fault
xfs 0xffffffffc064f75c
Build id: 3.10.0-1062.el7.x86_64
0x2c
13
__do_fault.isra.61
vmlinux 0xffffffff997ea29a
Build id: 3.10.0-1062.el7.x86_64
0x8a
14
do_read_fault.isra.63
vmlinux 0xffffffff997ea84c
Build id: 3.10.0-1062.el7.x86_64
0x4c
15
handle_pte_fault
vmlinux 0xffffffff997ef2fa
Build id: 3.10.0-1062.el7.x86_64
0x22a
16
? putname
vmlinux 0xffffffff9985a28d
Build id: 3.10.0-1062.el7.x86_64
0x3d
17
? user_path_at_empty
vmlinux 0xffffffff9985b4a2
Build id: 3.10.0-1062.el7.x86_64
0x72
18
? update_curr
vmlinux 0xffffffff996e375c
Build id: 3.10.0-1062.el7.x86_64
0x14c
19
handle_mm_fault
vmlinux 0xffffffff997f200d
Build id: 3.10.0-1062.el7.x86_64
0x39d
20
__do_page_fault
vmlinux 0xffffffff99d86633
Build id: 3.10.0-1062.el7.x86_64
0x213
21
do_page_fault
vmlinux 0xffffffff99d86955
Build id: 3.10.0-1062.el7.x86_64
0x35
22
page_fault
vmlinux 0xffffffff99d82768
Build id: 3.10.0-1062.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [vmtoolsd:850]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bnep vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel ppdev btusb btrtl btbcm btintel snd_ens1371 snd_rawmidi bluetooth snd_ac97_codec ac97_bus snd_seq aesni_intel vmw_balloon lrw snd_seq_device gf128mul glue_helper ablk_helper cryptd snd_pcm joydev pcspkr snd_timer snd rfkill soundcore sg vmw_vmci i2c_piix4 parport_pc parport fuse ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic vmwgfx pata_acpi drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi ata_piix crct10dif_pclmul crct10dif_common drm mptscsih nfit crc32c_intel libata e1000 libnvdimm serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 850 Comm: vmtoolsd Kdump: loaded Not tainted 3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff88b7f0fe20e0 ti: ffff88b7f4e2c000 task.ti: ffff88b7f4e2c000
RIP: 0010:[<ffffffff99704836>]  [<ffffffff99704836>] ktime_get_ts64+0xa6/0xf0
RSP: 0000:ffff88b7f4e2fa58  EFLAGS: 00000286
RAX: cd004a9971d07bb1 RBX: ffff88b781223030 RCX: 0000000000007449
RDX: 00000000db09d5ff RSI: 0000000021ea9d8e RDI: ffffffff9a22ebc0
RBP: ffff88b7f4e2fa78 R08: ffff88b7fff982f8 R09: 9f5e217d12000000
R10: 60a1c65a765f4480 R11: ffff88b5c165df80 R12: ffff88b781223048
R13: ffff88b781252190 R14: ffff88b5c1619200 R15: ffff88b5c1618f00
FS:  00007f92743bd780(0000) GS:ffff88b7f5640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9268bf77c0 CR3: 00000002341da000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffff9975c042>] __delayacct_blkio_start+0x22/0x30
[<ffffffff99d7e71b>] io_schedule_timeout+0x8b/0x130
[<ffffffff99d7e7d8>] io_schedule+0x18/0x20
[<ffffffff99d7d1a1>] bit_wait_io+0x11/0x50
[<ffffffff99d7ccc7>] __wait_on_bit+0x67/0x90
[<ffffffff997be4c3>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffff996c6280>] ? wake_bit_function+0x40/0x40
[<ffffffff997be592>] __lock_page_or_retry+0xb2/0xc0
[<ffffffff997be9e0>] filemap_fault+0x440/0x490
[<ffffffffc064f55e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc064f75c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffff997ea29a>] __do_fault.isra.61+0x8a/0x100
[<ffffffff997ea84c>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffff997ef2fa>] handle_pte_fault+0x22a/0xe20
[<ffffffff9985a28d>] ? putname+0x3d/0x60
[<ffffffff9985b4a2>] ? user_path_at_empty+0x72/0xc0
[<ffffffff996e375c>] ? update_curr+0x14c/0x1e0
[<ffffffff997f200d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff99d86633>] __do_page_fault+0x213/0x500
[<ffffffff99d86955>] do_page_fault+0x35/0x90
[<ffffffff99d82768>] page_fault+0x28/0x30
Code: 01 48 d3 f8 48 8b 0d e2 29 01 01 44 3b 35 7b 29 01 01 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 48 2d 00 ca 9a 3b <83> c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 08 48 01 ca 5b 49 
Complete report #1006241
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffff974f7736
Build id: 3.10.0-862.el7.x86_64
0xa6
2
__delayacct_blkio_start
vmlinux 0xffffffff9754e1a2
Build id: 3.10.0-862.el7.x86_64
0x22
3
io_schedule_timeout
vmlinux 0xffffffff97b1243b
Build id: 3.10.0-862.el7.x86_64
0x8b
4
io_schedule
vmlinux 0xffffffff97b124f8
Build id: 3.10.0-862.el7.x86_64
0x18
5
bit_wait_io
vmlinux 0xffffffff97b10ee1
Build id: 3.10.0-862.el7.x86_64
0x11
6
__wait_on_bit
vmlinux 0xffffffff97b10a07
Build id: 3.10.0-862.el7.x86_64
0x67
7
wait_on_page_bit_killable
vmlinux 0xffffffff97596083
Build id: 3.10.0-862.el7.x86_64
0x83
8
? wake_bit_function
vmlinux 0xffffffff974bbee0
Build id: 3.10.0-862.el7.x86_64
0x40
9
__lock_page_or_retry
vmlinux 0xffffffff97596152
Build id: 3.10.0-862.el7.x86_64
0xb2
10
filemap_fault
vmlinux 0xffffffff975965a0
Build id: 3.10.0-862.el7.x86_64
0x440
11
xfs_filemap_fault
xfs 0xffffffffc053885f
Build id: 3.10.0-862.el7.x86_64
0x5f
12
__do_fault.isra.58
vmlinux 0xffffffff975c05fa
Build id: 3.10.0-862.el7.x86_64
0x8a
13
do_cow_fault
vmlinux 0xffffffff975c1414
Build id: 3.10.0-862.el7.x86_64
0xb4
14
handle_pte_fault
vmlinux 0xffffffff975c5344
Build id: 3.10.0-862.el7.x86_64
0x344
15
handle_mm_fault
vmlinux 0xffffffff975c747d
Build id: 3.10.0-862.el7.x86_64
0x39d
16
__do_page_fault
vmlinux 0xffffffff97b1a597
Build id: 3.10.0-862.el7.x86_64
0x197
17
do_page_fault
vmlinux 0xffffffff97b1a925
Build id: 3.10.0-862.el7.x86_64
0x35
18
page_fault
vmlinux 0xffffffff97b16768
Build id: 3.10.0-862.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [sshd:38231]
Modules linked in: tcp_lp nls_utf8 isofs rfcomm fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock bnep sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel btusb btrtl btbcm btintel ppdev snd_ens1371 bluetooth snd_rawmidi snd_ac97_codec ac97_bus snd_seq aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_seq_device vmw_balloon snd_pcm joydev pcspkr rfkill snd_timer sg snd vmw_vmci soundcore i2c_piix4 nfit libnvdimm shpchp parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif
crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata e1000 crct10dif_pclmul crct10dif_common crc32c_intel serio_raw mptspi scsi_transport_spi mptscsih mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 38231 Comm: sshd Kdump: loaded Not tainted 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff938f155e2f70 ti: ffff938f2263c000 task.ti: ffff938f2263c000
RIP: 0010:[<ffffffff974f7736>]  [<ffffffff974f7736>] ktime_get_ts64+0xa6/0xf0
RSP: 0000:ffff938f2263faa0  EFLAGS: 00000202
RAX: 0bc2a2f6924edabf RBX: ffff938ef4970000 RCX: 000000000000130d
RDX: 0000000019006410 RSI: 0000000030fa042b RDI: ffffffff9802b440
RBP: ffff938f2263fac0 R08: ffff938f3ffaef38 R09: 83dc0628d1000000
R10: 7c23dace308a3440 R11: ffff938f0d2d79c0 R12: 0000000000000000
R13: ffff938ef4d95048 R14: ffff938ef5f23190 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff938f3b600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f89be1fe200 CR3: 000000005d0b4000 CR4: 00000000003607f0
Call Trace:
[<ffffffff9754e1a2>] __delayacct_blkio_start+0x22/0x30
[<ffffffff97b1243b>] io_schedule_timeout+0x8b/0x130
[<ffffffff97b124f8>] io_schedule+0x18/0x20
[<ffffffff97b10ee1>] bit_wait_io+0x11/0x50
[<ffffffff97b10a07>] __wait_on_bit+0x67/0x90
[<ffffffff97596083>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffff974bbee0>] ? wake_bit_function+0x40/0x40
[<ffffffff97596152>] __lock_page_or_retry+0xb2/0xc0
[<ffffffff975965a0>] filemap_fault+0x440/0x490
[<ffffffffc053885f>] xfs_filemap_fault+0x5f/0xe0 [xfs]
[<ffffffff975c05fa>] __do_fault.isra.58+0x8a/0x100
[<ffffffff975c1414>] do_cow_fault+0xb4/0x2c0
[<ffffffff975c5344>] handle_pte_fault+0x344/0xc30
[<ffffffff975c747d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff97b1a597>] __do_page_fault+0x197/0x4f0
[<ffffffff97b1a925>] do_page_fault+0x35/0x90
[<ffffffff97b16768>] page_fault+0x28/0x30
Code: 00 48 d3 f8 48 8b 0d 22 ef fd 00 44 3b 35 bb ee fd 00 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 48 2d 00 ca 9a 3b <83> c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 08 48 01 ca 5b 49 
Complete report #1003006
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffffbab010e0
Build id: 3.10.0-957.10.1.el7.x86_64
0xa0
2
delayacct_end
vmlinux 0xffffffffbab58257
Build id: 3.10.0-957.10.1.el7.x86_64
0x37
3
__delayacct_blkio_end
vmlinux 0xffffffffbab583d4
Build id: 3.10.0-957.10.1.el7.x86_64
0x34
4
io_schedule_timeout
vmlinux 0xffffffffbb168327
Build id: 3.10.0-957.10.1.el7.x86_64
0xe7
5
io_schedule
vmlinux 0xffffffffbb168388
Build id: 3.10.0-957.10.1.el7.x86_64
0x18
6
bit_wait_io
vmlinux 0xffffffffbb166d71
Build id: 3.10.0-957.10.1.el7.x86_64
0x11
7
__wait_on_bit
vmlinux 0xffffffffbb166897
Build id: 3.10.0-957.10.1.el7.x86_64
0x67
8
wait_on_page_bit_killable
vmlinux 0xffffffffbabb8d53
Build id: 3.10.0-957.10.1.el7.x86_64
0x83
9
? wake_bit_function
vmlinux 0xffffffffbaac2e00
Build id: 3.10.0-957.10.1.el7.x86_64
0x40
10
__lock_page_or_retry
vmlinux 0xffffffffbabb8e22
Build id: 3.10.0-957.10.1.el7.x86_64
0xb2
11
filemap_fault
vmlinux 0xffffffffbabb9270
Build id: 3.10.0-957.10.1.el7.x86_64
0x440
12
ext4_filemap_fault
ext4 0xffffffffc016e186
Build id: 3.10.0-957.10.1.el7.x86_64
0x36
13
__do_fault.isra.59
vmlinux 0xffffffffbabe466a
Build id: 3.10.0-957.10.1.el7.x86_64
0x8a
14
do_read_fault.isra.61
vmlinux 0xffffffffbabe4c1c
Build id: 3.10.0-957.10.1.el7.x86_64
0x4c
15
handle_pte_fault
vmlinux 0xffffffffbabe95c4
Build id: 3.10.0-957.10.1.el7.x86_64
0x2f4
16
? get_futex_key
vmlinux 0xffffffffbab0cc38
Build id: 3.10.0-957.10.1.el7.x86_64
0x1c8
17
handle_mm_fault
vmlinux 0xffffffffbabec0fd
Build id: 3.10.0-957.10.1.el7.x86_64
0x39d
18
__do_page_fault
vmlinux 0xffffffffbb1705e3
Build id: 3.10.0-957.10.1.el7.x86_64
0x203
19
do_page_fault
vmlinux 0xffffffffbb170915
Build id: 3.10.0-957.10.1.el7.x86_64
0x35
20
? error_swapgs
vmlinux 0xffffffffbb16ca96
Build id: 3.10.0-957.10.1.el7.x86_64
0xa7
21
page_fault
vmlinux 0xffffffffbb16c758
Build id: 3.10.0-957.10.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 2048s! [Timer-12:20112]
Modules linked in: xt_nat veth tcp_lp fuse vboxsf(OE) nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod ppdev crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmwgfx ttm drm_kms_helper joydev pcspkr
syscopyarea sysfillrect sysimgblt fb_sys_fops sg drm video vboxguest(OE) parport_pc parport drm_panel_orientation_quirks i2c_piix4 ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi hid_multitouch ata_piix crct10dif_pclmul crct10dif_common crc32c_intel ahci serio_raw libahci libata e1000
CPU: 3 PID: 20112 Comm: Timer-12 Kdump: loaded Tainted: G           OEL ------------ T 3.10.0-957.10.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff8e2aad3ce180 ti: ffff8e2b012e4000 task.ti: ffff8e2b012e4000
RIP: 0010:[<ffffffffbab010e0>]  [<ffffffffbab010e0>] ktime_get_ts64+0xa0/0xf0
RSP: 0018:ffff8e2b012e7a68  EFLAGS: 00000212
RAX: 1edc2ad8372518d2 RBX: ffff8e2a35fa8000 RCX: 0000000000000b1a
RDX: 00000000c6f80426 RSI: 0000000026750b45 RDI: ffff8e2b52f840c0
RBP: ffff8e2b012e7a88 R08: 00000000cd20caa1 R09: 0000000000000001
R10: 0000000000000001 R11: 0000000000000001 R12: ffffffffbad46a8d
R13: ffff8e2a5dc9b0c0 R14: 000000000001ab80 R15: ffff8e2b012e7fd8
FS:  00007fe672b7b700(0000) GS:ffff8e2b52d80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe67583f774 CR3: 000000014a748000 CR4: 00000000000606e0
Call Trace:
[<ffffffffbab58257>] delayacct_end+0x37/0xb0
[<ffffffffbab583d4>] __delayacct_blkio_end+0x34/0x60
[<ffffffffbb168327>] io_schedule_timeout+0xe7/0x130
[<ffffffffbb168388>] io_schedule+0x18/0x20
[<ffffffffbb166d71>] bit_wait_io+0x11/0x50
[<ffffffffbb166897>] __wait_on_bit+0x67/0x90
[<ffffffffbabb8d53>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffffbaac2e00>] ? wake_bit_function+0x40/0x40
[<ffffffffbabb8e22>] __lock_page_or_retry+0xb2/0xc0
[<ffffffffbabb9270>] filemap_fault+0x440/0x490
[<ffffffffc016e186>] ext4_filemap_fault+0x36/0x50 [ext4]
[<ffffffffbabe466a>] __do_fault.isra.59+0x8a/0x100
[<ffffffffbabe4c1c>] do_read_fault.isra.61+0x4c/0x1b0
[<ffffffffbabe95c4>] handle_pte_fault+0x2f4/0xd10
[<ffffffffbab0cc38>] ? get_futex_key+0x1c8/0x2c0
[<ffffffffbabec0fd>] handle_mm_fault+0x39d/0x9b0
[<ffffffffbb1705e3>] __do_page_fault+0x203/0x500
[<ffffffffbb170915>] do_page_fault+0x35/0x90
[<ffffffffbb16ca96>] ? error_swapgs+0xa7/0xbd
[<ffffffffbb16c758>] page_fault+0x28/0x30
Code: 48 03 05 fc 80 ff 00 48 d3 f8 48 8b 0d 32 81 ff 00 44 3b 35 cb 80 ff 00 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 <48> 2d 00 ca 9a 3b 83 c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 
Complete report #679928
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffff810eb100
Build id: 3.10.0-693.11.6.el7.x86_64
0xa0
2
__delayacct_blkio_start
vmlinux 0xffffffff8113f152
Build id: 3.10.0-693.11.6.el7.x86_64
0x22
3
io_schedule_timeout
vmlinux 0xffffffff816aac3b
Build id: 3.10.0-693.11.6.el7.x86_64
0x8b
4
io_schedule
vmlinux 0xffffffff816aacf8
Build id: 3.10.0-693.11.6.el7.x86_64
0x18
5
bit_wait_io
vmlinux 0xffffffff816a9711
Build id: 3.10.0-693.11.6.el7.x86_64
0x11
6
__wait_on_bit
vmlinux 0xffffffff816a9235
Build id: 3.10.0-693.11.6.el7.x86_64
0x65
7
wait_on_page_bit_killable
vmlinux 0xffffffff81186963
Build id: 3.10.0-693.11.6.el7.x86_64
0x83
8
? wake_bit_function
vmlinux 0xffffffff810b3570
Build id: 3.10.0-693.11.6.el7.x86_64
0x40
9
__lock_page_or_retry
vmlinux 0xffffffff81186a32
Build id: 3.10.0-693.11.6.el7.x86_64
0xb2
10
filemap_fault
vmlinux 0xffffffff81186df7
Build id: 3.10.0-693.11.6.el7.x86_64
0x3b7
11
xfs_filemap_fault
xfs 0xffffffffc028e9af
Build id: 3.10.0-693.11.6.el7.x86_64
0x5f
12
__do_fault
vmlinux 0xffffffff811af022
Build id: 3.10.0-693.11.6.el7.x86_64
0x52
13
do_read_fault.isra.44
vmlinux 0xffffffff811af4cb
Build id: 3.10.0-693.11.6.el7.x86_64
0x4b
14
handle_mm_fault
vmlinux 0xffffffff811b3dd1
Build id: 3.10.0-693.11.6.el7.x86_64
0x691
15
__do_page_fault
vmlinux 0xffffffff816b37e4
Build id: 3.10.0-693.11.6.el7.x86_64
0x154
16
do_page_fault
vmlinux 0xffffffff816b3b15
Build id: 3.10.0-693.11.6.el7.x86_64
0x35
17
page_fault
vmlinux 0xffffffff816af8f8
Build id: 3.10.0-693.11.6.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [java:87244]
Modules linked in: binfmt_misc tcp_lp arc4 md4 nls_utf8 cifs dns_resolver fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables xt_multiport xt_conntrack iptable_filter iptable_mangle iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack vmw_vsock_vmci_transport vsock sb_edac edac_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel nfit ppdev lrw gf128mul glue_helper libnvdimm ablk_helper vmw_balloon sg cryptd pcspkr joydev parport_pc parport i2c_piix4 shpchp vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops ttm crct10dif_pclmul drm crct10dif_common mptspi crc32c_intel ata_piix libata scsi_transport_spi serio_raw mptscsih mptbase i2c_core vmxnet3 floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 87244 Comm: java Tainted: G             L ------------   3.10.0-693.11.6.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff880011e4eeb0 ti: ffff880102ce4000 task.ti: ffff880102ce4000
RIP: 0010:[<ffffffff810eb100>]  [<ffffffff810eb100>] ktime_get_ts64+0xa0/0xf0
RSP: 0000:ffff880102ce7b90  EFLAGS: 00000212
RAX: 36aa5319df357daa RBX: 0000000000000400 RCX: 0000000000e8ef8c
RDX: 0000000060b9cf67 RSI: 00000000335a6554 RDI: ffffffff81a173c0
RBP: ffff880102ce7bb0 R08: ffff88000255fc98 R09: a8000454c0000000
R10: 57ffe5ab41153000 R11: 0000000000000000 R12: 0000000000000400
R13: 0000000000000401 R14: 00000000000000aa R15: 00000000000017fb
FS:  00007f1f008a8700(0000) GS:ffff880529680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f20a10802e0 CR3: 00000001036c0000 CR4: 00000000001607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8113f152>] __delayacct_blkio_start+0x22/0x30
[<ffffffff816aac3b>] io_schedule_timeout+0x8b/0x130
[<ffffffff816aacf8>] io_schedule+0x18/0x20
[<ffffffff816a9711>] bit_wait_io+0x11/0x50
[<ffffffff816a9235>] __wait_on_bit+0x65/0x90
[<ffffffff81186963>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffff810b3570>] ? wake_bit_function+0x40/0x40
[<ffffffff81186a32>] __lock_page_or_retry+0xb2/0xc0
[<ffffffff81186df7>] filemap_fault+0x3b7/0x410
[<ffffffffc028e9af>] xfs_filemap_fault+0x5f/0xf0 [xfs]
[<ffffffff811af022>] __do_fault+0x52/0xe0
[<ffffffff811af4cb>] do_read_fault.isra.44+0x4b/0x130
[<ffffffff811b3dd1>] handle_mm_fault+0x691/0xfa0
[<ffffffff816b37e4>] __do_page_fault+0x154/0x450
[<ffffffff816b3b15>] do_page_fault+0x35/0x90
[<ffffffff816af8f8>] page_fault+0x28/0x30
Code: 00 48 d3 f8 48 8b 0d 18 c7 db 00 44 3b 35 b1 c6 db 00 75 9b 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 2e 31 d2 66 0f 1f 44 00 00 <48> 2d 00 ca 9a 3b 83 c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 
Complete report #462648
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffffa7106190
Build id: 3.10.0-1062.9.1.el7.x86_64
0xa0
2
__delayacct_blkio_start
vmlinux 0xffffffffa715d9e2
Build id: 3.10.0-1062.9.1.el7.x86_64
0x22
3
io_schedule_timeout
vmlinux 0xffffffffa77800db
Build id: 3.10.0-1062.9.1.el7.x86_64
0x8b
4
io_schedule
vmlinux 0xffffffffa7780198
Build id: 3.10.0-1062.9.1.el7.x86_64
0x18
5
bit_wait_io
vmlinux 0xffffffffa777eb61
Build id: 3.10.0-1062.9.1.el7.x86_64
0x11
6
__wait_on_bit
vmlinux 0xffffffffa777e687
Build id: 3.10.0-1062.9.1.el7.x86_64
0x67
7
wait_on_page_bit_killable
vmlinux 0xffffffffa71bfe63
Build id: 3.10.0-1062.9.1.el7.x86_64
0x83
8
? wake_bit_function
vmlinux 0xffffffffa70c73a0
Build id: 3.10.0-1062.9.1.el7.x86_64
0x40
9
__lock_page_or_retry
vmlinux 0xffffffffa71bff32
Build id: 3.10.0-1062.9.1.el7.x86_64
0xb2
10
filemap_fault
vmlinux 0xffffffffa71c0380
Build id: 3.10.0-1062.9.1.el7.x86_64
0x440
11
__xfs_filemap_fault
xfs 0xffffffffc062655e
Build id: 3.10.0-1062.9.1.el7.x86_64
0x7e
12
xfs_filemap_fault
xfs 0xffffffffc062675c
Build id: 3.10.0-1062.9.1.el7.x86_64
0x2c
13
__do_fault.isra.61
vmlinux 0xffffffffa71ec15a
Build id: 3.10.0-1062.9.1.el7.x86_64
0x8a
14
do_cow_fault
vmlinux 0xffffffffa71ed014
Build id: 3.10.0-1062.9.1.el7.x86_64
0xb4
15
handle_pte_fault
vmlinux 0xffffffffa71f128c
Build id: 3.10.0-1062.9.1.el7.x86_64
0x2fc
16
handle_mm_fault
vmlinux 0xffffffffa71f3ecd
Build id: 3.10.0-1062.9.1.el7.x86_64
0x39d
17
__do_page_fault
vmlinux 0xffffffffa7788653
Build id: 3.10.0-1062.9.1.el7.x86_64
0x213
18
do_page_fault
vmlinux 0xffffffffa7788975
Build id: 3.10.0-1062.9.1.el7.x86_64
0x35
19
page_fault
vmlinux 0xffffffffa7784778
Build id: 3.10.0-1062.9.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [abrt-hook-ccpp:103328]
Modules linked in: vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac ppdev vmw_balloon snd_ens1371 snd_rawmidi snd_ac97_codec iosf_mbi crc32_pclmul ac97_bus ghash_clmulni_intel snd_seq snd_seq_device aesni_intel snd_pcm lrw gf128mul glue_helper ablk_helper snd_timer cryptd snd sg soundcore joydev pcspkr vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic vmwgfx ata_generic pata_acpi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix nfit libata e1000 libnvdimm crct10dif_pclmul crct10dif_common mptspi scsi_transport_spi crc32c_intel mptscsih mptbase serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 103328 Comm: abrt-hook-ccpp Kdump: loaded Tainted: G             L ------------   3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff9ea99cff0000 ti: ffff9eaa10ab4000 task.ti: ffff9eaa10ab4000
RIP: 0010:[<ffffffffa7106190>]  [<ffffffffa7106190>] ktime_get_ts64+0xa0/0xf0
RSP: 0000:ffff9eaa10ab7a50  EFLAGS: 00000296
RAX: b061e817c6eb5810 RBX: ffff9eaa16f30000 RCX: 0000000000e92213
RDX: 0000000055f46bbd RSI: 0000000021c63df6 RDI: ffffffffa7c2ebc0
RBP: ffff9eaa10ab7a70 R08: ffff9eaa3ff8da48 R09: 8e754d4ff8000000
R10: 718a964d5b53fe00 R11: ffff9eaa16e90700 R12: 0000000000000000
R13: ffff9eaa1abef848 R14: ffff9eaa1f56b190 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff9eaa1d680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f1d0ad704e0 CR3: 000000081325e000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa715d9e2>] __delayacct_blkio_start+0x22/0x30
[<ffffffffa77800db>] io_schedule_timeout+0x8b/0x130
[<ffffffffa7780198>] io_schedule+0x18/0x20
[<ffffffffa777eb61>] bit_wait_io+0x11/0x50
[<ffffffffa777e687>] __wait_on_bit+0x67/0x90
[<ffffffffa71bfe63>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffffa70c73a0>] ? wake_bit_function+0x40/0x40
[<ffffffffa71bff32>] __lock_page_or_retry+0xb2/0xc0
[<ffffffffa71c0380>] filemap_fault+0x440/0x490
[<ffffffffc062655e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc062675c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffffa71ec15a>] __do_fault.isra.61+0x8a/0x100
[<ffffffffa71ed014>] do_cow_fault+0xb4/0x320
[<ffffffffa71f128c>] handle_pte_fault+0x2fc/0xe20
[<ffffffffa71f3ecd>] handle_mm_fault+0x39d/0x9b0
[<ffffffffa7788653>] __do_page_fault+0x213/0x500
[<ffffffffa7788975>] do_page_fault+0x35/0x90
[<ffffffffa7784778>] page_fault+0x28/0x30
Code: 48 03 05 4c 10 01 01 48 d3 f8 48 8b 0d 82 10 01 01 44 3b 35 1b 10 01 01 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 <48> 2d 00 ca 9a 3b 83 c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 
Complete report #417393
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffff91f063b9
Build id: 3.10.0-1160.el7.x86_64
0xa9
2
delayacct_end
vmlinux 0xffffffff91f5db27
Build id: 3.10.0-1160.el7.x86_64
0x37
3
__delayacct_blkio_end
vmlinux 0xffffffff91f5dca4
Build id: 3.10.0-1160.el7.x86_64
0x34
4
io_schedule_timeout
vmlinux 0xffffffff92586877
Build id: 3.10.0-1160.el7.x86_64
0xe7
5
io_schedule
vmlinux 0xffffffff925868d8
Build id: 3.10.0-1160.el7.x86_64
0x18
6
bit_wait_io
vmlinux 0xffffffff925852a1
Build id: 3.10.0-1160.el7.x86_64
0x11
7
__wait_on_bit
vmlinux 0xffffffff92584dc7
Build id: 3.10.0-1160.el7.x86_64
0x67
8
wait_on_page_bit_killable
vmlinux 0xffffffff91fc0793
Build id: 3.10.0-1160.el7.x86_64
0x83
9
? wake_bit_function
vmlinux 0xffffffff91ec6dd0
Build id: 3.10.0-1160.el7.x86_64
0x40
10
__lock_page_or_retry
vmlinux 0xffffffff91fc0862
Build id: 3.10.0-1160.el7.x86_64
0xb2
11
filemap_fault
vmlinux 0xffffffff91fc0c57
Build id: 3.10.0-1160.el7.x86_64
0x3e7
12
__xfs_filemap_fault
xfs 0xffffffffc045891e
Build id: 3.10.0-1160.el7.x86_64
0x7e
13
xfs_filemap_fault
xfs 0xffffffffc0458b1c
Build id: 3.10.0-1160.el7.x86_64
0x2c
14
__do_fault.isra.61
vmlinux 0xffffffff91fede3a
Build id: 3.10.0-1160.el7.x86_64
0x8a
15
do_read_fault.isra.63
vmlinux 0xffffffff91fee3ec
Build id: 3.10.0-1160.el7.x86_64
0x4c
16
handle_mm_fault
vmlinux 0xffffffff91ff5c30
Build id: 3.10.0-1160.el7.x86_64
0xa20
17
__do_page_fault
vmlinux 0xffffffff9258e653
Build id: 3.10.0-1160.el7.x86_64
0x213
18
do_page_fault
vmlinux 0xffffffff9258e975
Build id: 3.10.0-1160.el7.x86_64
0x35
19
page_fault
vmlinux 0xffffffff9258a778
Build id: 3.10.0-1160.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 1037s! [rs:main Q:Reg:1211]
Modules linked in: binfmt_misc tcp_lp nls_utf8 isofs rfcomm tun devlink bridge stp llc ip_set nfnetlink bnep vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event coretemp ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel btusb snd_ens1371 btrtl lrw btbcm btintel gf128mul snd_rawmidi glue_helper ablk_helper cryptd vmw_balloon snd_ac97_codec bluetooth ac97_bus snd_seq snd_seq_device joydev snd_pcm pcspkr rfkill snd_timer snd soundcore parport_pc parport sg vmw_vmci i2c_piix4 xfs libcrc32c vmwgfx sr_mod cdrom ata_generic pata_acpi drm_kms_helper sd_mod syscopyarea crc_t10dif sysfillrect crct10dif_generic sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm nfit ata_piix libnvdimm libata mptspi serio_raw scsi_transport_spi e1000 mptscsih
mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: ip_tables]
CPU: 0 PID: 1211 Comm: rs:main Q:Reg Tainted: G             L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff94efb3599080 ti: ffff94efa5064000 task.ti: ffff94efa5064000
RIP: 0010:[<ffffffff91f063b9>]  [<ffffffff91f063b9>] ktime_get_ts64+0xa9/0xf0
RSP: 0000:ffff94efa5067a98  EFLAGS: 00000206
RAX: f9713b77aec16ad0 RBX: ffff94efb6322000 RCX: 00000000000061c3
RDX: 000000001c2a3eb7 RSI: 0000000009596ee7 RDI: ffffffff92a2f200
RBP: ffff94efa5067ab8 R08: ffff94efa5064000 R09: 0000000000000001
R10: 000000000000001c R11: 0000000000000002 R12: ffffffff921568bd
R13: ffff94efbaf89080 R14: 000000000001acc0 R15: ffff94efa5067fd8
FS:  00007f9136b5c700(0000) GS:ffff94efbc600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f06d78869e5 CR3: 0000000026136000 CR4: 00000000003607f0
Call Trace:
[<ffffffff91f5db27>] delayacct_end+0x37/0xb0
[<ffffffff91f5dca4>] __delayacct_blkio_end+0x34/0x60
[<ffffffff92586877>] io_schedule_timeout+0xe7/0x130
[<ffffffff925868d8>] io_schedule+0x18/0x20
[<ffffffff925852a1>] bit_wait_io+0x11/0x50
[<ffffffff92584dc7>] __wait_on_bit+0x67/0x90
[<ffffffff91fc0793>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffff91ec6dd0>] ? wake_bit_function+0x40/0x40
[<ffffffff91fc0862>] __lock_page_or_retry+0xb2/0xc0
[<ffffffff91fc0c57>] filemap_fault+0x3e7/0x420
[<ffffffffc045891e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc0458b1c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffff91fede3a>] __do_fault.isra.61+0x8a/0x100
[<ffffffff91fee3ec>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffff91ff5c30>] handle_mm_fault+0xa20/0xfb0
[<ffffffff9258e653>] __do_page_fault+0x213/0x500
[<ffffffff9258e975>] do_page_fault+0x35/0x90
[<ffffffff9258a778>] page_fault+0x28/0x30
Code: f8 48 8b 0d a2 40 01 01 44 3b 35 3b 40 01 01 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 48 2d 00 ca 9a 3b 83 c2 01 <48> 3d ff c9 9a 3b 77 ef 49 89 44 24 08 48 01 ca 5b 49 89 14 24 
Complete report #319756
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffff880f7730
Build id: 3.10.0-862.el7.x86_64
0xa0
2
__delayacct_blkio_start
vmlinux 0xffffffff8814e1a2
Build id: 3.10.0-862.el7.x86_64
0x22
3
io_schedule_timeout
vmlinux 0xffffffff8871243b
Build id: 3.10.0-862.el7.x86_64
0x8b
4
io_schedule
vmlinux 0xffffffff887124f8
Build id: 3.10.0-862.el7.x86_64
0x18
5
bit_wait_io
vmlinux 0xffffffff88710ee1
Build id: 3.10.0-862.el7.x86_64
0x11
6
__wait_on_bit
vmlinux 0xffffffff88710a07
Build id: 3.10.0-862.el7.x86_64
0x67
7
wait_on_page_bit_killable
vmlinux 0xffffffff88196083
Build id: 3.10.0-862.el7.x86_64
0x83
8
? wake_bit_function
vmlinux 0xffffffff880bbee0
Build id: 3.10.0-862.el7.x86_64
0x40
9
__lock_page_or_retry
vmlinux 0xffffffff88196152
Build id: 3.10.0-862.el7.x86_64
0xb2
10
filemap_fault
vmlinux 0xffffffff881965a0
Build id: 3.10.0-862.el7.x86_64
0x440
11
xfs_filemap_fault
xfs 0xffffffffc060985f
Build id: 3.10.0-862.el7.x86_64
0x5f
12
__do_fault.isra.58
vmlinux 0xffffffff881c05fa
Build id: 3.10.0-862.el7.x86_64
0x8a
13
do_read_fault.isra.60
vmlinux 0xffffffff881c0b5c
Build id: 3.10.0-862.el7.x86_64
0x4c
14
handle_pte_fault
vmlinux 0xffffffff881c52dc
Build id: 3.10.0-862.el7.x86_64
0x2dc
15
? poll_select_copy_remaining
vmlinux 0xffffffff88230830
Build id: 3.10.0-862.el7.x86_64
0x150
16
handle_mm_fault
vmlinux 0xffffffff881c747d
Build id: 3.10.0-862.el7.x86_64
0x39d
17
__do_page_fault
vmlinux 0xffffffff8871a597
Build id: 3.10.0-862.el7.x86_64
0x197
18
do_page_fault
vmlinux 0xffffffff8871a925
Build id: 3.10.0-862.el7.x86_64
0x35
19
page_fault
vmlinux 0xffffffff88716768
Build id: 3.10.0-862.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 3382s! [gnome-shell:1504]
drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm ata_piix crc32c_intel mptspi libata scsi_transport_spi mptscsih serio_raw mptbase e1000 i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 1504 Comm: gnome-shell Not tainted 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff9b22889a9fa0 ti: ffff9b226b248000 task.ti: ffff9b226b248000
RIP: 0010:[<ffffffff880f7730>]  [<ffffffff880f7730>] ktime_get_ts64+0xa0/0xf0
RSP: 0000:ffff9b226b24baa8  EFLAGS: 00000212
RAX: 6aa780d80cdb65f3 RBX: ffff9b22351b3030 RCX: 0000000000001ae7
RDX: 00000000816f526b RSI: 0000000000156ec4 RDI: ffffffff88c2b440
RBP: ffff9b226b24bac8 R08: ffff9b2288fabd10 R09: 8b4c06c046000000
R10: 74b3dc12bbb01180 R11: ffff9b2280ad5a40 R12: ffff9b22351b3048
R13: ffff9b2235329190 R14: 0000000000000000 R15: 0000000000000000
FS:  00007fec3bcf5ac0(0000) GS:ffff9b2284240000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fec39aea220 CR3: 000000006b324000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffff8814e1a2>] __delayacct_blkio_start+0x22/0x30
[<ffffffff8871243b>] io_schedule_timeout+0x8b/0x130
[<ffffffff887124f8>] io_schedule+0x18/0x20
[<ffffffff88710ee1>] bit_wait_io+0x11/0x50
[<ffffffff88710a07>] __wait_on_bit+0x67/0x90
[<ffffffff88196083>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffff880bbee0>] ? wake_bit_function+0x40/0x40
[<ffffffff88196152>] __lock_page_or_retry+0xb2/0xc0
[<ffffffff881965a0>] filemap_fault+0x440/0x490
[<ffffffffc060985f>] xfs_filemap_fault+0x5f/0xe0 [xfs]
[<ffffffff881c05fa>] __do_fault.isra.58+0x8a/0x100
[<ffffffff881c0b5c>] do_read_fault.isra.60+0x4c/0x1a0
[<ffffffff881c52dc>] handle_pte_fault+0x2dc/0xc30
[<ffffffff88230830>] ? poll_select_copy_remaining+0x150/0x150
[<ffffffff881c747d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff8871a597>] __do_page_fault+0x197/0x4f0
[<ffffffff8871a925>] do_page_fault+0x35/0x90
[<ffffffff88716768>] page_fault+0x28/0x30
Code: 48 03 05 ec ee fd 00 48 d3 f8 48 8b 0d 22 ef fd 00 44 3b 35 bb ee fd 00 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 <48> 2d 00 ca 9a 3b 83 c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 
Complete report #284530
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffff95afa9a0
Build id: 3.10.0-862.11.6.el7.x86_64
0xa0
2
__delayacct_blkio_start
vmlinux 0xffffffff95b514d2
Build id: 3.10.0-862.11.6.el7.x86_64
0x22
3
io_schedule_timeout
vmlinux 0xffffffff961182ab
Build id: 3.10.0-862.11.6.el7.x86_64
0x8b
4
io_schedule
vmlinux 0xffffffff96118368
Build id: 3.10.0-862.11.6.el7.x86_64
0x18
5
bit_wait_io
vmlinux 0xffffffff96116d51
Build id: 3.10.0-862.11.6.el7.x86_64
0x11
6
__wait_on_bit
vmlinux 0xffffffff96116877
Build id: 3.10.0-862.11.6.el7.x86_64
0x67
7
wait_on_page_bit_killable
vmlinux 0xffffffff95b993e3
Build id: 3.10.0-862.11.6.el7.x86_64
0x83
8
? wake_bit_function
vmlinux 0xffffffff95abefd0
Build id: 3.10.0-862.11.6.el7.x86_64
0x40
9
__lock_page_or_retry
vmlinux 0xffffffff95b994b2
Build id: 3.10.0-862.11.6.el7.x86_64
0xb2
10
filemap_fault
vmlinux 0xffffffff95b99900
Build id: 3.10.0-862.11.6.el7.x86_64
0x440
11
xfs_filemap_fault
xfs 0xffffffffc03ae85f
Build id: 3.10.0-862.11.6.el7.x86_64
0x5f
12
__do_fault.isra.58
vmlinux 0xffffffff95bc352a
Build id: 3.10.0-862.11.6.el7.x86_64
0x8a
13
do_read_fault.isra.60
vmlinux 0xffffffff95bc3adc
Build id: 3.10.0-862.11.6.el7.x86_64
0x4c
14
handle_pte_fault
vmlinux 0xffffffff95bc8484
Build id: 3.10.0-862.11.6.el7.x86_64
0x2f4
15
? avc_compute_av
vmlinux 0xffffffff961128dc
Build id: 3.10.0-862.11.6.el7.x86_64
0x1a3
16
handle_mm_fault
vmlinux 0xffffffff95bcae3d
Build id: 3.10.0-862.11.6.el7.x86_64
0x39d
17
__do_page_fault
vmlinux 0xffffffff96120557
Build id: 3.10.0-862.11.6.el7.x86_64
0x197
18
do_page_fault
vmlinux 0xffffffff961208e5
Build id: 3.10.0-862.11.6.el7.x86_64
0x35
19
? error_swapgs
vmlinux 0xffffffff9611caa6
Build id: 3.10.0-862.11.6.el7.x86_64
0xa7
20
page_fault
vmlinux 0xffffffff9611c758
Build id: 3.10.0-862.11.6.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 40s! [InputThread:1258]
Modules linked in: tcp_lp nls_utf8 isofs fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc vboxvideo(OE) ttm snd_intel8x0 snd_ac97_codec ac97_bus drm_kms_helper snd_seq syscopyarea joydev sysfillrect sysimgblt ppdev fb_sys_fops snd_seq_device snd_pcm drm sg pcspkr snd_timer snd vboxguest(OE) parport_pc i2c_piix4 i2c_core parport video soundcore
ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic crct10dif_common sr_mod cdrom ata_generic pata_acpi ahci ata_piix libahci libata e1000 crc32c_intel serio_raw dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 1258 Comm: InputThread Kdump: loaded Tainted: G           OE  ------------   3.10.0-862.11.6.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff8b45eab69fa0 ti: ffff8b45eab44000 task.ti: ffff8b45eab44000
RIP: 0010:[<ffffffff95afa9a0>]  [<ffffffff95afa9a0>] ktime_get_ts64+0xa0/0xf0
RSP: 0000:ffff8b45eab47aa8  EFLAGS: 00013296
RAX: 86023f95d6050602 RBX: ffff8b45fc275030 RCX: 0000000000025efb
RDX: 000000000bf2c2fb RSI: 00000000284dfe45 RDI: ffff8b45fff79000
RBP: ffff8b45eab47ac8 R08: 00000000d3a3d004 R09: d72f06c392000000
R10: 28d0ef082fb0e480 R11: ffff8b45f8c8e380 R12: ffff8b45fc275048
R13: ffff8b45b5c27990 R14: ffff8b45f8ee7600 R15: ffff8b45f8ee7780
FS:  00007ff2035aa700(0000) GS:ffff8b45ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055fa357c70d0 CR3: 0000000078bd8000 CR4: 00000000000206f0
Call Trace:
[<ffffffff95b514d2>] __delayacct_blkio_start+0x22/0x30
[<ffffffff961182ab>] io_schedule_timeout+0x8b/0x130
[<ffffffff96118368>] io_schedule+0x18/0x20
[<ffffffff96116d51>] bit_wait_io+0x11/0x50
[<ffffffff96116877>] __wait_on_bit+0x67/0x90
[<ffffffff95b993e3>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffff95abefd0>] ? wake_bit_function+0x40/0x40
[<ffffffff95b994b2>] __lock_page_or_retry+0xb2/0xc0
[<ffffffff95b99900>] filemap_fault+0x440/0x490
[<ffffffffc03ae85f>] xfs_filemap_fault+0x5f/0xe0 [xfs]
[<ffffffff95bc352a>] __do_fault.isra.58+0x8a/0x100
[<ffffffff95bc3adc>] do_read_fault.isra.60+0x4c/0x1b0
[<ffffffff95bc8484>] handle_pte_fault+0x2f4/0xd10
[<ffffffff961128dc>] ? avc_compute_av+0x1a3/0x1b5
[<ffffffff95bcae3d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff96120557>] __do_page_fault+0x197/0x4f0
[<ffffffff961208e5>] do_page_fault+0x35/0x90
[<ffffffff9611caa6>] ? error_swapgs+0xa7/0xbd
[<ffffffff9611c758>] page_fault+0x28/0x30
Code: 48 03 05 7c cc fd 00 48 d3 f8 48 8b 0d b2 cc fd 00 44 3b 35 4b cc fd 00 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 <48> 2d 00 ca 9a 3b 83 c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 
Complete report #282298
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffff93ef7730
Build id: 3.10.0-862.el7.x86_64
0xa0
2
__delayacct_blkio_start
vmlinux 0xffffffff93f4e1a2
Build id: 3.10.0-862.el7.x86_64
0x22
3
io_schedule_timeout
vmlinux 0xffffffff9451243b
Build id: 3.10.0-862.el7.x86_64
0x8b
4
io_schedule
vmlinux 0xffffffff945124f8
Build id: 3.10.0-862.el7.x86_64
0x18
5
bit_wait_io
vmlinux 0xffffffff94510ee1
Build id: 3.10.0-862.el7.x86_64
0x11
6
__wait_on_bit
vmlinux 0xffffffff94510a07
Build id: 3.10.0-862.el7.x86_64
0x67
7
wait_on_page_bit_killable
vmlinux 0xffffffff93f96083
Build id: 3.10.0-862.el7.x86_64
0x83
8
? wake_bit_function
vmlinux 0xffffffff93ebbee0
Build id: 3.10.0-862.el7.x86_64
0x40
9
__lock_page_or_retry
vmlinux 0xffffffff93f96152
Build id: 3.10.0-862.el7.x86_64
0xb2
10
filemap_fault
vmlinux 0xffffffff93f965a0
Build id: 3.10.0-862.el7.x86_64
0x440
11
xfs_filemap_fault
xfs 0xffffffffc02c785f
Build id: 3.10.0-862.el7.x86_64
0x5f
12
__do_fault.isra.58
vmlinux 0xffffffff93fc05fa
Build id: 3.10.0-862.el7.x86_64
0x8a
13
do_read_fault.isra.60
vmlinux 0xffffffff93fc0b5c
Build id: 3.10.0-862.el7.x86_64
0x4c
14
handle_pte_fault
vmlinux 0xffffffff93fc52dc
Build id: 3.10.0-862.el7.x86_64
0x2dc
15
? futex_wake
vmlinux 0xffffffff93f033a0
Build id: 3.10.0-862.el7.x86_64
0x90
16
handle_mm_fault
vmlinux 0xffffffff93fc747d
Build id: 3.10.0-862.el7.x86_64
0x39d
17
__do_page_fault
vmlinux 0xffffffff9451a597
Build id: 3.10.0-862.el7.x86_64
0x197
18
do_page_fault
vmlinux 0xffffffff9451a925
Build id: 3.10.0-862.el7.x86_64
0x35
19
page_fault
vmlinux 0xffffffff94516768
Build id: 3.10.0-862.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 2049s! [polkitd:798]
Modules linked in: fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq ppdev snd_seq_device snd_pcm snd_timer snd soundcore vmw_balloon
sg nfit joydev pcspkr libnvdimm parport_pc parport vmw_vmci i2c_piix4 shpchp ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common mptspi crc32c_intel ata_piix scsi_transport_spi drm libata mptscsih mptbase e1000 serio_raw i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 798 Comm: polkitd Kdump: loaded Tainted: G             L ------------   3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff8ddcf14b3f40 ti: ffff8ddcef608000 task.ti: ffff8ddcef608000
RIP: 0010:[<ffffffff93ef7730>]  [<ffffffff93ef7730>] ktime_get_ts64+0xa0/0xf0
RSP: 0000:ffff8ddcef60baa8  EFLAGS: 00000216
RAX: 1040597a8f239be0 RBX: ffff8ddaf5e74030 RCX: 000000000000992d
RDX: 0000000005b66947 RSI: 0000000021fc2476 RDI: ffffffff94a2b440
RBP: ffff8ddcef60bac8 R08: ffff8ddcfff8fa78 R09: c8591a0ff3000000
R10: 37a6d8065383fcc0 R11: ffff8ddb79a2ed80 R12: ffff8ddaf5e74048
R13: ffff8ddcf14fc190 R14: ffff8ddc26a8d380 R15: ffff8ddc26a8c480
FS:  00007f81a2c81900(0000) GS:ffff8ddcf5640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f81a1658220 CR3: 000000022ca8c000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff93f4e1a2>] __delayacct_blkio_start+0x22/0x30
[<ffffffff9451243b>] io_schedule_timeout+0x8b/0x130
[<ffffffff945124f8>] io_schedule+0x18/0x20
[<ffffffff94510ee1>] bit_wait_io+0x11/0x50
[<ffffffff94510a07>] __wait_on_bit+0x67/0x90
[<ffffffff93f96083>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffff93ebbee0>] ? wake_bit_function+0x40/0x40
[<ffffffff93f96152>] __lock_page_or_retry+0xb2/0xc0
[<ffffffff93f965a0>] filemap_fault+0x440/0x490
[<ffffffffc02c785f>] xfs_filemap_fault+0x5f/0xe0 [xfs]
[<ffffffff93fc05fa>] __do_fault.isra.58+0x8a/0x100
[<ffffffff93fc0b5c>] do_read_fault.isra.60+0x4c/0x1a0
[<ffffffff93fc52dc>] handle_pte_fault+0x2dc/0xc30
[<ffffffff93f033a0>] ? futex_wake+0x90/0x180
[<ffffffff93fc747d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff9451a597>] __do_page_fault+0x197/0x4f0
[<ffffffff9451a925>] do_page_fault+0x35/0x90
[<ffffffff94516768>] page_fault+0x28/0x30
Code: 48 03 05 ec ee fd 00 48 d3 f8 48 8b 0d 22 ef fd 00 44 3b 35 bb ee fd 00 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 <48> 2d 00 ca 9a 3b 83 c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 
Complete report #277110
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffffbacfa9a6
Build id: 3.10.0-862.11.6.el7.x86_64
0xa6
2
__delayacct_blkio_start
vmlinux 0xffffffffbad514d2
Build id: 3.10.0-862.11.6.el7.x86_64
0x22
3
io_schedule_timeout
vmlinux 0xffffffffbb3182ab
Build id: 3.10.0-862.11.6.el7.x86_64
0x8b
4
io_schedule
vmlinux 0xffffffffbb318368
Build id: 3.10.0-862.11.6.el7.x86_64
0x18
5
bit_wait_io
vmlinux 0xffffffffbb316d51
Build id: 3.10.0-862.11.6.el7.x86_64
0x11
6
__wait_on_bit
vmlinux 0xffffffffbb316877
Build id: 3.10.0-862.11.6.el7.x86_64
0x67
7
wait_on_page_bit_killable
vmlinux 0xffffffffbad993e3
Build id: 3.10.0-862.11.6.el7.x86_64
0x83
8
? wake_bit_function
vmlinux 0xffffffffbacbefd0
Build id: 3.10.0-862.11.6.el7.x86_64
0x40
9
__lock_page_or_retry
vmlinux 0xffffffffbad994b2
Build id: 3.10.0-862.11.6.el7.x86_64
0xb2
10
filemap_fault
vmlinux 0xffffffffbad99900
Build id: 3.10.0-862.11.6.el7.x86_64
0x440
11
xfs_filemap_fault
xfs 0xffffffffc02a385f
Build id: 3.10.0-862.11.6.el7.x86_64
0x5f
12
__do_fault.isra.58
vmlinux 0xffffffffbadc352a
Build id: 3.10.0-862.11.6.el7.x86_64
0x8a
13
do_read_fault.isra.60
vmlinux 0xffffffffbadc3adc
Build id: 3.10.0-862.11.6.el7.x86_64
0x4c
14
handle_pte_fault
vmlinux 0xffffffffbadc8484
Build id: 3.10.0-862.11.6.el7.x86_64
0x2f4
15
? default_wake_function
vmlinux 0xffffffffbacd1ff2
Build id: 3.10.0-862.11.6.el7.x86_64
0x12
16
? pollwake
vmlinux 0xffffffffbae34d23
Build id: 3.10.0-862.11.6.el7.x86_64
0x73
17
handle_mm_fault
vmlinux 0xffffffffbadcae3d
Build id: 3.10.0-862.11.6.el7.x86_64
0x39d
18
__do_page_fault
vmlinux 0xffffffffbb320557
Build id: 3.10.0-862.11.6.el7.x86_64
0x197
19
do_page_fault
vmlinux 0xffffffffbb3208e5
Build id: 3.10.0-862.11.6.el7.x86_64
0x35
20
? error_swapgs
vmlinux 0xffffffffbb31caa6
Build id: 3.10.0-862.11.6.el7.x86_64
0xa7
21
page_fault
vmlinux 0xffffffffbb31c758
Build id: 3.10.0-862.11.6.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 2048s! [ModemManager:665]
Modules linked in: tcp_lp fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc intel_powerclamp crc32_pclmul vboxvideo(OE) ttm ghash_clmulni_intel drm_kms_helper snd_intel8x0 syscopyarea snd_ac97_codec sysfillrect sysimgblt fb_sys_fops ac97_bus snd_seq drm joydev snd_seq_device aesni_intel ppdev vboxguest(OE) snd_pcm lrw gf128mul glue_helper
ablk_helper cryptd snd_timer pcspkr sg i2c_piix4 snd i2c_core soundcore parport_pc parport video ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi ahci libahci e1000 ata_piix libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 665 Comm: ModemManager Kdump: loaded Tainted: G           OE  ------------   3.10.0-862.11.6.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff93fdb7803f40 ti: ffff93fdb86f8000 task.ti: ffff93fdb86f8000
RIP: 0010:[<ffffffffbacfa9a6>]  [<ffffffffbacfa9a6>] ktime_get_ts64+0xa6/0xf0
RSP: 0000:ffff93fdb86fbaa8  EFLAGS: 00000282
RAX: 84f74678d6f2a3fd RBX: ffff93fdbc275030 RCX: 0000000000001aff
RDX: 00000000106d670e RSI: 000000000b9b041c RDI: ffff93fdbff79000
RBP: ffff93fdb86fbac8 R08: 00000000b6a5eccd R09: 68c90752b0000000
R10: 9736d2df91d4ac00 R11: ffff93fd97c9c1c0 R12: ffff93fdbc275048
R13: ffff93fd75c87190 R14: 0000000000000000 R15: 0000000000000000
FS:  00007f7738c29880(0000) GS:ffff93fdbfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000561b76040180 CR3: 00000000786d0000 CR4: 00000000000606f0
Call Trace:
[<ffffffffbad514d2>] __delayacct_blkio_start+0x22/0x30
[<ffffffffbb3182ab>] io_schedule_timeout+0x8b/0x130
[<ffffffffbb318368>] io_schedule+0x18/0x20
[<ffffffffbb316d51>] bit_wait_io+0x11/0x50
[<ffffffffbb316877>] __wait_on_bit+0x67/0x90
[<ffffffffbad993e3>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffffbacbefd0>] ? wake_bit_function+0x40/0x40
[<ffffffffbad994b2>] __lock_page_or_retry+0xb2/0xc0
[<ffffffffbad99900>] filemap_fault+0x440/0x490
[<ffffffffc02a385f>] xfs_filemap_fault+0x5f/0xe0 [xfs]
[<ffffffffbadc352a>] __do_fault.isra.58+0x8a/0x100
[<ffffffffbadc3adc>] do_read_fault.isra.60+0x4c/0x1b0
[<ffffffffbadc8484>] handle_pte_fault+0x2f4/0xd10
[<ffffffffbacd1ff2>] ? default_wake_function+0x12/0x20
[<ffffffffbae34d23>] ? pollwake+0x73/0x90
[<ffffffffbadcae3d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffbb320557>] __do_page_fault+0x197/0x4f0
[<ffffffffbb3208e5>] do_page_fault+0x35/0x90
[<ffffffffbb31caa6>] ? error_swapgs+0xa7/0xbd
[<ffffffffbb31c758>] page_fault+0x28/0x30
Code: 00 48 d3 f8 48 8b 0d b2 cc fd 00 44 3b 35 4b cc fd 00 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 48 2d 00 ca 9a 3b <83> c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 08 48 01 ca 5b 49 
Complete report #23625
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffffae2fa9a0
Build id: 3.10.0-862.11.6.el7.x86_64
0xa0
2
delayacct_end
vmlinux 0xffffffffae351397
Build id: 3.10.0-862.11.6.el7.x86_64
0x37
3
__delayacct_blkio_end
vmlinux 0xffffffffae351514
Build id: 3.10.0-862.11.6.el7.x86_64
0x34
4
io_schedule_timeout
vmlinux 0xffffffffae918307
Build id: 3.10.0-862.11.6.el7.x86_64
0xe7
5
io_schedule
vmlinux 0xffffffffae918368
Build id: 3.10.0-862.11.6.el7.x86_64
0x18
6
bit_wait_io
vmlinux 0xffffffffae916d51
Build id: 3.10.0-862.11.6.el7.x86_64
0x11
7
__wait_on_bit
vmlinux 0xffffffffae916877
Build id: 3.10.0-862.11.6.el7.x86_64
0x67
8
wait_on_page_bit_killable
vmlinux 0xffffffffae3993e3
Build id: 3.10.0-862.11.6.el7.x86_64
0x83
9
? wake_bit_function
vmlinux 0xffffffffae2befd0
Build id: 3.10.0-862.11.6.el7.x86_64
0x40
10
__lock_page_or_retry
vmlinux 0xffffffffae3994b2
Build id: 3.10.0-862.11.6.el7.x86_64
0xb2
11
filemap_fault
vmlinux 0xffffffffae399900
Build id: 3.10.0-862.11.6.el7.x86_64
0x440
12
xfs_filemap_fault
xfs 0xffffffffc033f85f
Build id: 3.10.0-862.11.6.el7.x86_64
0x5f
13
__do_fault.isra.58
vmlinux 0xffffffffae3c352a
Build id: 3.10.0-862.11.6.el7.x86_64
0x8a
14
do_read_fault.isra.60
vmlinux 0xffffffffae3c3adc
Build id: 3.10.0-862.11.6.el7.x86_64
0x4c
15
handle_pte_fault
vmlinux 0xffffffffae3c8484
Build id: 3.10.0-862.11.6.el7.x86_64
0x2f4
16
? avc_compute_av
vmlinux 0xffffffffae9128dc
Build id: 3.10.0-862.11.6.el7.x86_64
0x1a3
17
handle_mm_fault
vmlinux 0xffffffffae3cae3d
Build id: 3.10.0-862.11.6.el7.x86_64
0x39d
18
__do_page_fault
vmlinux 0xffffffffae920557
Build id: 3.10.0-862.11.6.el7.x86_64
0x197
19
do_page_fault
vmlinux 0xffffffffae9208e5
Build id: 3.10.0-862.11.6.el7.x86_64
0x35
20
? error_swapgs
vmlinux 0xffffffffae91caa6
Build id: 3.10.0-862.11.6.el7.x86_64
0xa7
21
page_fault
vmlinux 0xffffffffae91c758
Build id: 3.10.0-862.11.6.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 18434s! [InputThread:1369]
Modules linked in: tcp_lp nls_utf8 isofs fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vboxsf(OE) sunrpc vboxvideo(OE) ttm drm_kms_helper crc32_pclmul snd_intel8x0 syscopyarea sysfillrect sysimgblt snd_ac97_codec fb_sys_fops ghash_clmulni_intel drm ac97_bus snd_seq joydev snd_seq_device ppdev snd_pcm aesni_intel lrw gf128mul glue_helper ablk_helper
cryptd sg pcspkr i2c_piix4 vboxguest(OE) snd_timer parport_pc snd parport video i2c_core soundcore ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod crct10dif_generic cdrom ata_generic pata_acpi ahci ata_piix libahci libata e1000 crct10dif_pclmul crct10dif_common crc32c_intel serio_raw dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 1369 Comm: InputThread Kdump: loaded Tainted: G           OEL ------------   3.10.0-862.11.6.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff9abf699c1fa0 ti: ffff9abf65ec0000 task.ti: ffff9abf65ec0000
RIP: 0010:[<ffffffffae2fa9a0>]  [<ffffffffae2fa9a0>] ktime_get_ts64+0xa0/0xf0
RSP: 0000:ffff9abf65ec3a60  EFLAGS: 00003296
RAX: 8845d58db4953bb0 RBX: ffff9abf35cd8978 RCX: 000000000003477d
RDX: 00000000023975ae RSI: 000000000b50c510 RDI: ffff9abf7ff79000
RBP: ffff9abf65ec3a80 R08: 00000000df06f02f R09: 00000000000003ff
R10: 000000000000bc82 R11: 0000000000000001 R12: ffff9abf35cc5000
R13: ffff9abf699c1fa0 R14: ffff9abf65ec3fd8 R15: ffff9abf65ec3fd8
FS:  00007f6b44927700(0000) GS:ffff9abf7fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055ddbd365c70 CR3: 000000006a362000 CR4: 00000000000406f0
Call Trace:
[<ffffffffae351397>] delayacct_end+0x37/0xb0
[<ffffffffae351514>] __delayacct_blkio_end+0x34/0x60
[<ffffffffae918307>] io_schedule_timeout+0xe7/0x130
[<ffffffffae918368>] io_schedule+0x18/0x20
[<ffffffffae916d51>] bit_wait_io+0x11/0x50
[<ffffffffae916877>] __wait_on_bit+0x67/0x90
[<ffffffffae3993e3>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffffae2befd0>] ? wake_bit_function+0x40/0x40
[<ffffffffae3994b2>] __lock_page_or_retry+0xb2/0xc0
[<ffffffffae399900>] filemap_fault+0x440/0x490
[<ffffffffc033f85f>] xfs_filemap_fault+0x5f/0xe0 [xfs]
[<ffffffffae3c352a>] __do_fault.isra.58+0x8a/0x100
[<ffffffffae3c3adc>] do_read_fault.isra.60+0x4c/0x1b0
[<ffffffffae3c8484>] handle_pte_fault+0x2f4/0xd10
[<ffffffffae9128dc>] ? avc_compute_av+0x1a3/0x1b5
[<ffffffffae3cae3d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffae920557>] __do_page_fault+0x197/0x4f0
[<ffffffffae9208e5>] do_page_fault+0x35/0x90
[<ffffffffae91caa6>] ? error_swapgs+0xa7/0xbd
[<ffffffffae91c758>] page_fault+0x28/0x30
Code: 48 03 05 7c cc fd 00 48 d3 f8 48 8b 0d b2 cc fd 00 44 3b 35 4b cc fd 00 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 <48> 2d 00 ca 9a 3b 83 c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 
Complete report #18681
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffffbd8fa9a0
Build id: 3.10.0-862.11.6.el7.x86_64
0xa0
2
delayacct_end
vmlinux 0xffffffffbd951397
Build id: 3.10.0-862.11.6.el7.x86_64
0x37
3
__delayacct_blkio_end
vmlinux 0xffffffffbd951514
Build id: 3.10.0-862.11.6.el7.x86_64
0x34
4
io_schedule_timeout
vmlinux 0xffffffffbdf18307
Build id: 3.10.0-862.11.6.el7.x86_64
0xe7
5
io_schedule
vmlinux 0xffffffffbdf18368
Build id: 3.10.0-862.11.6.el7.x86_64
0x18
6
bit_wait_io
vmlinux 0xffffffffbdf16d51
Build id: 3.10.0-862.11.6.el7.x86_64
0x11
7
__wait_on_bit
vmlinux 0xffffffffbdf16877
Build id: 3.10.0-862.11.6.el7.x86_64
0x67
8
wait_on_page_bit_killable
vmlinux 0xffffffffbd9993e3
Build id: 3.10.0-862.11.6.el7.x86_64
0x83
9
? wake_bit_function
vmlinux 0xffffffffbd8befd0
Build id: 3.10.0-862.11.6.el7.x86_64
0x40
10
__lock_page_or_retry
vmlinux 0xffffffffbd9994b2
Build id: 3.10.0-862.11.6.el7.x86_64
0xb2
11
filemap_fault
vmlinux 0xffffffffbd999900
Build id: 3.10.0-862.11.6.el7.x86_64
0x440
12
xfs_filemap_fault
xfs 0xffffffffc03e385f
Build id: 3.10.0-862.11.6.el7.x86_64
0x5f
13
__do_fault.isra.58
vmlinux 0xffffffffbd9c352a
Build id: 3.10.0-862.11.6.el7.x86_64
0x8a
14
do_read_fault.isra.60
vmlinux 0xffffffffbd9c3adc
Build id: 3.10.0-862.11.6.el7.x86_64
0x4c
15
handle_pte_fault
vmlinux 0xffffffffbd9c8484
Build id: 3.10.0-862.11.6.el7.x86_64
0x2f4
16
? do_huge_pmd_wp_page
vmlinux 0xffffffffbda0c5a2
Build id: 3.10.0-862.11.6.el7.x86_64
0x4e2
17
? __slab_free
vmlinux 0xffffffffbd9f9d71
Build id: 3.10.0-862.11.6.el7.x86_64
0x81
18
handle_mm_fault
vmlinux 0xffffffffbd9cae3d
Build id: 3.10.0-862.11.6.el7.x86_64
0x39d
19
__do_page_fault
vmlinux 0xffffffffbdf20557
Build id: 3.10.0-862.11.6.el7.x86_64
0x197
20
do_page_fault
vmlinux 0xffffffffbdf208e5
Build id: 3.10.0-862.11.6.el7.x86_64
0x35
21
? error_swapgs
vmlinux 0xffffffffbdf1caa6
Build id: 3.10.0-862.11.6.el7.x86_64
0xa7
22
page_fault
vmlinux 0xffffffffbdf1c758
Build id: 3.10.0-862.11.6.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [polkitd:646]
Modules linked in: tcp_lp nls_utf8 isofs fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc intel_powerclamp iosf_mbi crc32_pclmul ghash_clmulni_intel snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device ppdev snd_pcm aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg pcspkr snd_timer i2c_piix4 snd i2c_core parport_pc parport
video soundcore ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod crct10dif_generic cdrom ata_generic pata_acpi ahci ata_piix libahci libata e1000 crct10dif_pclmul crct10dif_common crc32c_intel serio_raw dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 646 Comm: polkitd Kdump: loaded Tainted: G             L ------------   3.10.0-862.11.6.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff9de7f7b40fd0 ti: ffff9de7f9db0000 task.ti: ffff9de7f9db0000
RIP: 0010:[<ffffffffbd8fa9a0>]  [<ffffffffbd8fa9a0>] ktime_get_ts64+0xa0/0xf0
RSP: 0000:ffff9de7f9db3a60  EFLAGS: 00000216
RAX: 3956d47a6c0854f2 RBX: ffff9de7b5c98978 RCX: 000000000001c07c
RDX: 00000000553de1c4 RSI: 000000000c152dbf RDI: ffff9de7fff79000
RBP: ffff9de7f9db3a80 R08: 000000008e38e457 R09: 00000000000003ff
R10: 000000000000bcd7 R11: 0000000000000001 R12: ffff9de7fc275000
R13: ffff9de7f7b40fd0 R14: ffff9de7f9db3fd8 R15: ffff9de7f9db3fd8
FS:  00007f22c0bab900(0000) GS:ffff9de7ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f22bf4a4a10 CR3: 000000007918e000 CR4: 00000000000606f0
Call Trace:
[<ffffffffbd951397>] delayacct_end+0x37/0xb0
[<ffffffffbd951514>] __delayacct_blkio_end+0x34/0x60
[<ffffffffbdf18307>] io_schedule_timeout+0xe7/0x130
[<ffffffffbdf18368>] io_schedule+0x18/0x20
[<ffffffffbdf16d51>] bit_wait_io+0x11/0x50
[<ffffffffbdf16877>] __wait_on_bit+0x67/0x90
[<ffffffffbd9993e3>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffffbd8befd0>] ? wake_bit_function+0x40/0x40
[<ffffffffbd9994b2>] __lock_page_or_retry+0xb2/0xc0
[<ffffffffbd999900>] filemap_fault+0x440/0x490
[<ffffffffc03e385f>] xfs_filemap_fault+0x5f/0xe0 [xfs]
[<ffffffffbd9c352a>] __do_fault.isra.58+0x8a/0x100
[<ffffffffbd9c3adc>] do_read_fault.isra.60+0x4c/0x1b0
[<ffffffffbd9c8484>] handle_pte_fault+0x2f4/0xd10
[<ffffffffbda0c5a2>] ? do_huge_pmd_wp_page+0x4e2/0xcc0
[<ffffffffbd9f9d71>] ? __slab_free+0x81/0x2f0
[<ffffffffbd9cae3d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffbdf20557>] __do_page_fault+0x197/0x4f0
[<ffffffffbdf208e5>] do_page_fault+0x35/0x90
[<ffffffffbdf1caa6>] ? error_swapgs+0xa7/0xbd
[<ffffffffbdf1c758>] page_fault+0x28/0x30
Code: 48 03 05 7c cc fd 00 48 d3 f8 48 8b 0d b2 cc fd 00 44 3b 35 4b cc fd 00 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 <48> 2d 00 ca 9a 3b 83 c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 
Complete report #9657
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffffb6d06d80
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa0
2
__delayacct_blkio_start
vmlinux 0xffffffffb6d5e572
Build id: 3.10.0-1127.19.1.el7.x86_64
0x22
3
io_schedule_timeout
vmlinux 0xffffffffb738547b
Build id: 3.10.0-1127.19.1.el7.x86_64
0x8b
4
io_schedule
vmlinux 0xffffffffb7385538
Build id: 3.10.0-1127.19.1.el7.x86_64
0x18
5
bit_wait_io
vmlinux 0xffffffffb7383f01
Build id: 3.10.0-1127.19.1.el7.x86_64
0x11
6
__wait_on_bit
vmlinux 0xffffffffb7383a27
Build id: 3.10.0-1127.19.1.el7.x86_64
0x67
7
wait_on_page_bit_killable
vmlinux 0xffffffffb6dc0c93
Build id: 3.10.0-1127.19.1.el7.x86_64
0x83
8
? wake_bit_function
vmlinux 0xffffffffb6cc7840
Build id: 3.10.0-1127.19.1.el7.x86_64
0x40
9
__lock_page_or_retry
vmlinux 0xffffffffb6dc0d62
Build id: 3.10.0-1127.19.1.el7.x86_64
0xb2
10
filemap_fault
vmlinux 0xffffffffb6dc1157
Build id: 3.10.0-1127.19.1.el7.x86_64
0x3e7
11
__xfs_filemap_fault
xfs 0xffffffffc033d98e
Build id: 3.10.0-1127.19.1.el7.x86_64
0x7e
12
xfs_filemap_fault
xfs 0xffffffffc033db8c
Build id: 3.10.0-1127.19.1.el7.x86_64
0x2c
13
__do_fault.isra.61
vmlinux 0xffffffffb6dedf6a
Build id: 3.10.0-1127.19.1.el7.x86_64
0x8a
14
do_read_fault.isra.63
vmlinux 0xffffffffb6dee51c
Build id: 3.10.0-1127.19.1.el7.x86_64
0x4c
15
? xfs_readdir
xfs 0xffffffffc033bcde
Build id: 3.10.0-1127.19.1.el7.x86_64
0xfe
16
handle_mm_fault
vmlinux 0xffffffffb6df5d80
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa20
17
__do_page_fault
vmlinux 0xffffffffb738d653
Build id: 3.10.0-1127.19.1.el7.x86_64
0x213
18
do_page_fault
vmlinux 0xffffffffb738d975
Build id: 3.10.0-1127.19.1.el7.x86_64
0x35
19
? error_swapgs
vmlinux 0xffffffffb7389ac9
Build id: 3.10.0-1127.19.1.el7.x86_64
0xaa
20
page_fault
vmlinux 0xffffffffb7389778
Build id: 3.10.0-1127.19.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 2203s! [gnome-shell:23375]
Modules linked in: cmac rfcomm bnep btusb btrtl btbcm btintel bluetooth rfkill tcp_lp fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc squashfs intel_pmc_core intel_powerclamp iosf_mbi crc32_pclmul loop ghash_clmulni_intel snd_intel8x0 joydev snd_ac97_codec ac97_bus snd_seq ppdev snd_seq_device aesni_intel snd_pcm lrw gf128mul glue_helper
ablk_helper cryptd sg pcspkr snd_timer vboxguest(OE) parport_pc parport video snd soundcore i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci ata_piix libata e1000 crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 23375 Comm: gnome-shell Kdump: loaded Tainted: G           OEL ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffffa04f29550000 ti: ffffa04f2a6cc000 task.ti: ffffa04f2a6cc000
RIP: 0010:[<ffffffffb6d06d80>]  [<ffffffffb6d06d80>] ktime_get_ts64+0xa0/0xf0
RSP: 0000:ffffa04f2a6cfae0  EFLAGS: 00000216
RAX: 50b5a06394617c47 RBX: ffffa04fd4af09c0 RCX: 000000000001e465
RDX: 00000000f0ddf5dd RSI: 000000000c264dea RDI: ffffa04fdff84000
RBP: ffffa04f2a6cfb00 R08: 00000000de38cc8c R09: 9d1a03ea75000000
R10: 62e5e35c0bfa9d40 R11: ffffa04f815f91c0 R12: 0000000000000000
R13: ffffa04ef45e0848 R14: ffffa04ef54e5190 R15: 0000000000000000
FS:  00007fedbc6a7a80(0000) GS:ffffa04fdfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fed6fa1e000 CR3: 0000000067f16000 CR4: 00000000000606f0
Call Trace:
[<ffffffffb6d5e572>] __delayacct_blkio_start+0x22/0x30
[<ffffffffb738547b>] io_schedule_timeout+0x8b/0x130
[<ffffffffb7385538>] io_schedule+0x18/0x20
[<ffffffffb7383f01>] bit_wait_io+0x11/0x50
[<ffffffffb7383a27>] __wait_on_bit+0x67/0x90
[<ffffffffb6dc0c93>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffffb6cc7840>] ? wake_bit_function+0x40/0x40
[<ffffffffb6dc0d62>] __lock_page_or_retry+0xb2/0xc0
[<ffffffffb6dc1157>] filemap_fault+0x3e7/0x420
[<ffffffffc033d98e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc033db8c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffffb6dedf6a>] __do_fault.isra.61+0x8a/0x100
[<ffffffffb6dee51c>] do_read_fault.isra.63+0x4c/0x1b0
[<ffffffffc033bcde>] ? xfs_readdir+0xfe/0x1f0 [xfs]
[<ffffffffb6df5d80>] handle_mm_fault+0xa20/0xfb0
[<ffffffffb738d653>] __do_page_fault+0x213/0x500
[<ffffffffb738d975>] do_page_fault+0x35/0x90
[<ffffffffb7389ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffb7389778>] page_fault+0x28/0x30
Code: 48 03 05 9c 26 01 01 48 d3 f8 48 8b 0d d2 26 01 01 44 3b 35 6b 26 01 01 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 <48> 2d 00 ca 9a 3b 83 c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24 
Complete report #1167468
Frame # Function Binary Source or offset Line
1
ktime_get_ts64
vmlinux 0xffffffff949010e0
Build id: 3.10.0-957.5.1.el7.x86_64
0xa0
2
__delayacct_blkio_start
vmlinux 0xffffffff94958312
Build id: 3.10.0-957.5.1.el7.x86_64
0x22
3
io_schedule_timeout
vmlinux 0xffffffff94f672cb
Build id: 3.10.0-957.5.1.el7.x86_64
0x8b
4
io_schedule
vmlinux 0xffffffff94f67388
Build id: 3.10.0-957.5.1.el7.x86_64
0x18
5
bit_wait_io
vmlinux 0xffffffff94f65d71
Build id: 3.10.0-957.5.1.el7.x86_64
0x11
6
__wait_on_bit
vmlinux 0xffffffff94f65897
Build id: 3.10.0-957.5.1.el7.x86_64
0x67
7
wait_on_page_bit_killable
vmlinux 0xffffffff949b8c73
Build id: 3.10.0-957.5.1.el7.x86_64
0x83
8
? wake_bit_function
vmlinux 0xffffffff948c2e00
Build id: 3.10.0-957.5.1.el7.x86_64
0x40
9
__lock_page_or_retry
vmlinux 0xffffffff949b8d42
Build id: 3.10.0-957.5.1.el7.x86_64
0xb2
10
filemap_fault
vmlinux 0xffffffff949b9190
Build id: 3.10.0-957.5.1.el7.x86_64
0x440
11
__xfs_filemap_fault
xfs 0xffffffffc03b1d0e
Build id: 3.10.0-957.5.1.el7.x86_64
0x7e
12
xfs_filemap_fault
xfs 0xffffffffc03b1f0c
Build id: 3.10.0-957.5.1.el7.x86_64
0x2c
13
__do_fault.isra.59
vmlinux 0xffffffff949e458a
Build id: 3.10.0-957.5.1.el7.x86_64
0x8a
14
? SYSC_semtimedop
vmlinux 0xffffffff94ae3dfd
Build id: 3.10.0-957.5.1.el7.x86_64
0x6bd
15
do_read_fault.isra.61
vmlinux 0xffffffff949e4b3c
Build id: 3.10.0-957.5.1.el7.x86_64
0x4c
16
handle_pte_fault
vmlinux 0xffffffff949e94e4
Build id: 3.10.0-957.5.1.el7.x86_64
0x2f4
17
? cputime_adjust
vmlinux 0xffffffff948da1c4
Build id: 3.10.0-957.5.1.el7.x86_64
0x94
18
handle_mm_fault
vmlinux 0xffffffff949ec01d
Build id: 3.10.0-957.5.1.el7.x86_64
0x39d
19
__do_page_fault
vmlinux 0xffffffff94f6f5e3
Build id: 3.10.0-957.5.1.el7.x86_64
0x203
20
do_page_fault
vmlinux 0xffffffff94f6f915
Build id: 3.10.0-957.5.1.el7.x86_64
0x35
21
? error_swapgs
vmlinux 0xffffffff94f6ba96
Build id: 3.10.0-957.5.1.el7.x86_64
0xa7
22
page_fault
vmlinux 0xffffffff94f6b758
Build id: 3.10.0-957.5.1.el7.x86_64
0x28
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 2480s! [oracle:21562]
Modules linked in: devlink nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter iTCO_wdt iTCO_vendor_support edac_mce_amd kvm_amd kvm irqbypass pcspkr joydev sg snd_hda_codec_generic i2c_i801 lpc_ich snd_hda_intel snd_hda_codec virtio_rng snd_hda_core snd_hwdep snd_seq virtio_gpu snd_seq_device ttm drm_kms_helper snd_pcm syscopyarea sysfillrect sysimgblt fb_sys_fops drm
snd_timer snd drm_panel_orientation_quirks soundcore nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic crct10dif_common virtio_console ahci libahci libata e1000 virtio_pci virtio_ring virtio dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 21562 Comm: oracle Kdump: loaded Tainted: G             L ------------   3.10.0-957.5.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org 04/01/2014
task: ffff911134b70000 ti: ffff911130fc0000 task.ti: ffff911130fc0000
RIP: 0010:[<ffffffff949010e0>]  [<ffffffff949010e0>] ktime_get_ts64+0xa0/0xf0
RSP: 0000:ffff911130fc3a68  EFLAGS: 00000212
RAX: 659c824906311be8 RBX: ffff911035dc2830 RCX: 000000000006862c
RDX: 00000000971817ff RSI: 0000000020f973b8 RDI: ffffffff9542ea80
RBP: ffff911130fc3a88 R08: ffff91117ff94a90 R09: a84313e263000000
R10: 57bcd62e61f898c0 R11: ffff91103b4de540 R12: ffff911035dc2848
R13: ffff911035e33990 R14: ffff911130c9a780 R15: ffff911130c9a000
FS:  00007f66ab9dd740(0000) GS:ffff91117fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 000000000824f5e0 CR3: 000000011cf8a000 CR4: 00000000000006f0
Call Trace:
[<ffffffff94958312>] __delayacct_blkio_start+0x22/0x30
[<ffffffff94f672cb>] io_schedule_timeout+0x8b/0x130
[<ffffffff94f67388>] io_schedule+0x18/0x20
[<ffffffff94f65d71>] bit_wait_io+0x11/0x50
[<ffffffff94f65897>] __wait_on_bit+0x67/0x90
[<ffffffff949b8c73>] wait_on_page_bit_killable+0x83/0xa0
[<ffffffff948c2e00>] ? wake_bit_function+0x40/0x40
[<ffffffff949b8d42>] __lock_page_or_retry+0xb2/0xc0
[<ffffffff949b9190>] filemap_fault+0x440/0x490
[<ffffffffc03b1d0e>] __xfs_filemap_fault+0x7e/0x1d0 [xfs]
[<ffffffffc03b1f0c>] xfs_filemap_fault+0x2c/0x30 [xfs]
[<ffffffff949e458a>] __do_fault.isra.59+0x8a/0x100
[<ffffffff94ae3dfd>] ? SYSC_semtimedop+0x6bd/0xc90
[<ffffffff949e4b3c>] do_read_fault.isra.61+0x4c/0x1b0
[<ffffffff949e94e4>] handle_pte_fault+0x2f4/0xd10
[<ffffffff948da1c4>] ? cputime_adjust+0x94/0x150
[<ffffffff949ec01d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff94f6f5e3>] __do_page_fault+0x203/0x500
[<ffffffff94f6f915>] do_page_fault+0x35/0x90
[<ffffffff94f6ba96>] ? error_swapgs+0xa7/0xbd
[<ffffffff94f6b758>] page_fault+0x28/0x30
Code: 48 03 05 fc 80 ff 00 48 d3 f8 48 8b 0d 32 81 ff 00 44 3b 35 cb 80 ff 00 75 95 48 01 f0 49 03 0c 24 48 3d ff c9 9a 3b 76 28 31 d2 <48> 2d 00 ca 9a 3b 83 c2 01 48 3d ff c9 9a 3b 77 ef 49 89 44 24