Info

Permalink
Function
copy_user_generic_unrolled
First occurrence
2020-10-30
Last occurrence
2020-10-30
State
NEW
Components
kernel
Quality
-15

Statistics

Operating system Count
CentOS 7 109
Architecture Count
x86_64 109
Related packages Count
kernel 109
 0:3.10.0-1127.19.1.el7 24
 0:3.10.0-327.el7 10
 0:3.10.0-1160.el7 6
 0:3.10.0-1062.4.1.el7 6
 0:3.10.0-1160.31.1.el7 5
 0:3.10.0-957.el7 4
 0:3.10.0-1160.102.1.el7 4
 0:3.10.0-1160.108.1.el7 4
 0:3.10.0-862.9.1.el7 3
 0:3.10.0-1160.118.1.el7 3
 0:3.10.0-1160.59.1.el7 3
 0:3.10.0-1160.62.1.el7 3
 0:3.10.0-1160.88.1.el7 3
 0:3.10.0-1160.92.1.el7 3
 0:3.10.0-1127.el7 2
 0:3.10.0-957.21.2.el7 2
 0:3.10.0-1160.49.1.el7 2
 0:3.10.0-1160.53.1.el7 2
 0:3.10.0-693.2.2.el7 2
 0:3.10.0-1160.119.1.el7 2
 0:3.10.0-327.4.5.el7 1
 0:3.10.0-1062.el7 1
 0:3.10.0-1127.13.1.el7 1
 0:3.10.0-693.11.1.el7 1
 0:3.10.0-862.3.3.el7 1
 0:3.10.0-957.12.1.el7 1
 0:3.10.0-957.12.2.el7 1
 0:3.10.0-1160.15.2.el7 1
 0:3.10.0-1160.2.2.el7 1
 0:3.10.0-1160.36.2.el7 1
 0:3.10.0-1160.83.1.el7 1
 0:3.10.0-514.2.2.el7 1
 0:3.10.0-1062.1.1.el7 1
 0:3.10.0-1160.45.1.el7 1
 0:3.10.0-1160.71.1.el7 1
 0:3.10.0-327.22.2.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

No reports in the last 20 days.

Report backtrace


Complete report #194283
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffa15951e2
Build id: 3.10.0-1160.31.1.el7.x86_64
0x32
2
? file_read_actor
vmlinux 0xffffffffa13bdb8c
Build id: 3.10.0-1160.31.1.el7.x86_64
0x6c
3
do_generic_file_read.constprop.52
vmlinux 0xffffffffa13bf08c
Build id: 3.10.0-1160.31.1.el7.x86_64
0x2cc
4
generic_file_aio_read
vmlinux 0xffffffffa13bfc79
Build id: 3.10.0-1160.31.1.el7.x86_64
0x1c9
5
xfs_file_buffered_aio_read
xfs 0xffffffffc0322f55
Build id: 3.10.0-1160.31.1.el7.x86_64
0x95
6
xfs_file_aio_read
xfs 0xffffffffc03235a7
Build id: 3.10.0-1160.31.1.el7.x86_64
0x87
7
do_sync_read
vmlinux 0xffffffffa144d4b3
Build id: 3.10.0-1160.31.1.el7.x86_64
0x93
8
vfs_read
vmlinux 0xffffffffa144deef
Build id: 3.10.0-1160.31.1.el7.x86_64
0x9f
9
SyS_pread64
vmlinux 0xffffffffa144ef62
Build id: 3.10.0-1160.31.1.el7.x86_64
0x92
10
system_call_fastpath
vmlinux 0xffffffffa1995f92
Build id: 3.10.0-1160.31.1.el7.x86_64
0x25
11
? system_call_after_swapgs
vmlinux 0xffffffffa1995ed5
Build id: 3.10.0-1160.31.1.el7.x86_64
0xa2
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [osqueryi:25452]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables vsock_diag tcp_diag udp_diag inet_diag unix_diag tun devlink bridge stp llc ip_set vmw_vsock_vmci_transport vsock iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 nfsd nfs_acl lockd grace auth_rpcgss
sunrpc xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops serio_raw ttm vmxnet3 mptspi drm ata_piix scsi_transport_spi mptscsih nfit mptbase libata libnvdimm drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: ip_tables]
CPU: 0 PID: 25452 Comm: osqueryi Kdump: loaded Tainted: G             L ------------   3.10.0-1160.31.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9df4d3a22100 ti: ffff9df24a7f4000 task.ti: ffff9df24a7f4000
RIP: 0010:[<ffffffffa15951e2>]  [<ffffffffa15951e2>] copy_user_generic_unrolled+0x32/0xc0
RSP: 0018:ffff9df24a7f7c38  EFLAGS: 00010202
RAX: ffffffffa1c91b68 RBX: ffffffffffffff10 RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffff9df144a3d000 RDI: 00005574b377a4f0
RBP: ffff9df24a7f7c68 R08: 0000000000000001 R09: ffffe90e42128f5c
R10: ffff9df24a7f7fd8 R11: ffff9df47eaad7c8 R12: ffff9df24a7f7bf0
R13: 000000000000ab8e R14: 0000000000000000 R15: 000000000000002e
FS:  00007fb63157d5c0(0000) GS:ffff9df4ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005574b4236000 CR3: 0000000297544000 CR4: 00000000000407f0
Call Trace:
[<ffffffffa13bdb8c>] ? file_read_actor+0x6c/0xa0
[<ffffffffa13bf08c>] do_generic_file_read.constprop.52+0x2cc/0x510
[<ffffffffa13bfc79>] generic_file_aio_read+0x1c9/0x290
[<ffffffffc0322f55>] xfs_file_buffered_aio_read+0x95/0x110 [xfs]
[<ffffffffc03235a7>] xfs_file_aio_read+0x87/0x100 [xfs]
[<ffffffffa144d4b3>] do_sync_read+0x93/0xe0
[<ffffffffa144deef>] vfs_read+0x9f/0x170
[<ffffffffa144ef62>] SyS_pread64+0x92/0xc0
[<ffffffffa1995f92>] system_call_fastpath+0x25/0x2a
[<ffffffffa1995ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: 82 8c 00 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a <4c> 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 
Complete report #1157266
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffacdab932
Build id: 3.10.0-1160.119.1.el7.x86_64
0x32
2
? file_read_actor
vmlinux 0xffffffffacbc8d9c
Build id: 3.10.0-1160.119.1.el7.x86_64
0x6c
3
do_generic_file_read.constprop.52
vmlinux 0xffffffffacbca2fc
Build id: 3.10.0-1160.119.1.el7.x86_64
0x2cc
4
generic_file_aio_read
vmlinux 0xffffffffacbcaf41
Build id: 3.10.0-1160.119.1.el7.x86_64
0x1d1
5
? pick_next_entity
vmlinux 0xffffffffacae8699
Build id: 3.10.0-1160.119.1.el7.x86_64
0xa9
6
? set_next_entity
vmlinux 0xffffffffacae918c
Build id: 3.10.0-1160.119.1.el7.x86_64
0x3c
7
xfs_file_buffered_aio_read
xfs 0xffffffffc04da675
Build id: 3.10.0-1160.119.1.el7.x86_64
0x95
8
xfs_file_aio_read
xfs 0xffffffffc04dacf7
Build id: 3.10.0-1160.119.1.el7.x86_64
0x87
9
do_sync_read
vmlinux 0xffffffffacc5b1d3
Build id: 3.10.0-1160.119.1.el7.x86_64
0x93
10
vfs_read
vmlinux 0xffffffffacc5bbef
Build id: 3.10.0-1160.119.1.el7.x86_64
0x9f
11
SyS_pread64
vmlinux 0xffffffffacc5cc42
Build id: 3.10.0-1160.119.1.el7.x86_64
0x92
12
system_call_fastpath
vmlinux 0xffffffffad1c539a
Build id: 3.10.0-1160.119.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [rpm:27091]
Modules linked in: tcp_diag inet_diag xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 ipt_REJECT nf_reject_ipv4 xt_NFQUEUE tun ip6table_nat bridge nf_nat_ipv6 stp llc nf_conntrack_ipv6 ip6table_mangle iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 ebtable_filter xt_TPROXY nf_defrag_ipv6 ebtables nf_defrag_ipv4 xt_addrtype xt_connmark devlink xt_mark iptable_mangle ip6table_filter ip6_tables iptable_filter nfnetlink_queue xt_conntrack nf_conntrack nls_utf8 cifs ccm dns_resolver vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw ppdev gf128mul glue_helper ablk_helper cryptd pcspkr vmw_balloon joydev sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect
sysimgblt fb_sys_fops nfit sd_mod ttm crc_t10dif libnvdimm crct10dif_generic ahci drm ata_piix libahci crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 27091 Comm: rpm Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff8a1bad20d280 ti: ffff8a1833834000 task.ti: ffff8a1833834000
RIP: 0010:[<ffffffffacdab932>]  [<ffffffffacdab932>] copy_user_generic_unrolled+0x32/0xc0
RSP: 0018:ffff8a1833837c40  EFLAGS: 00050202
RAX: ffff8a1ad3fcd230 RBX: ffffd9c7cdb420c0 RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffff8a1aea436000 RDI: 00007f70d5150600
RBP: ffff8a1833837c70 R08: ffff8a1833838000 R09: ffffd9c7cda90d9c
R10: ffff8a1833837fd8 R11: ffff8a17b5a99f48 R12: ffffffffc04ce4d5
R13: ffff8a1baa13c9c0 R14: 0000000000000003 R15: 0000000000101000
FS:  00007f70dff6d840(0000) GS:ffff8a1bbfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f70d5126000 CR3: 00000000ae942000 CR4: 00000000007607f0
PKRU: 55555554
Call Trace:
[<ffffffffacbc8d9c>] ? file_read_actor+0x6c/0xa0
[<ffffffffacbca2fc>] do_generic_file_read.constprop.52+0x2cc/0x510
[<ffffffffacbcaf41>] generic_file_aio_read+0x1d1/0x2a0
[<ffffffffacae8699>] ? pick_next_entity+0xa9/0x190
[<ffffffffacae918c>] ? set_next_entity+0x3c/0x100
[<ffffffffc04da675>] xfs_file_buffered_aio_read+0x95/0x110 [xfs]
[<ffffffffc04dacf7>] xfs_file_aio_read+0x87/0x100 [xfs]
[<ffffffffacc5b1d3>] do_sync_read+0x93/0xe0
[<ffffffffacc5bbef>] vfs_read+0x9f/0x170
[<ffffffffacc5cc42>] SyS_pread64+0x92/0xc0
[<ffffffffad1c539a>] system_call_fastpath+0x25/0x2a
Code: 82 8c 00 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a <4c> 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 
Complete report #923808
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffa3fab7d4
Build id: 3.10.0-1160.92.1.el7.x86_64
0x64
2
? file_read_actor
vmlinux 0xffffffffa3dc8cdc
Build id: 3.10.0-1160.92.1.el7.x86_64
0x6c
3
do_generic_file_read.constprop.52
vmlinux 0xffffffffa3dca23c
Build id: 3.10.0-1160.92.1.el7.x86_64
0x2cc
4
generic_file_aio_read
vmlinux 0xffffffffa3dcae81
Build id: 3.10.0-1160.92.1.el7.x86_64
0x1d1
5
? __mem_cgroup_commit_charge
vmlinux 0xffffffffa3e4bea2
Build id: 3.10.0-1160.92.1.el7.x86_64
0xe2
6
xfs_file_buffered_aio_read
xfs 0xffffffffc03a2675
Build id: 3.10.0-1160.92.1.el7.x86_64
0x95
7
xfs_file_aio_read
xfs 0xffffffffc03a2cf7
Build id: 3.10.0-1160.92.1.el7.x86_64
0x87
8
do_sync_read
vmlinux 0xffffffffa3e5b113
Build id: 3.10.0-1160.92.1.el7.x86_64
0x93
9
vfs_read
vmlinux 0xffffffffa3e5bb2f
Build id: 3.10.0-1160.92.1.el7.x86_64
0x9f
10
SyS_pread64
vmlinux 0xffffffffa3e5cb82
Build id: 3.10.0-1160.92.1.el7.x86_64
0x92
11
system_call_fastpath
vmlinux 0xffffffffa43c539a
Build id: 3.10.0-1160.92.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [rpm:24961]
Modules linked in: ppdev sg pcspkr parport_pc i2c_piix4 parport joydev virtio_balloon nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod crct10dif_generic cdrom crct10dif_common bochs_drm ata_generic pata_acpi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops virtio_net ttm net_failover failover drm ata_piix libata virtio_pci virtio_ring serio_raw virtio drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 24961 Comm: rpm Tainted: G             L ------------   3.10.0-1160.92.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.12.1-0-ga5cab58e9a3f-prebuilt.qemu.org 04/01/2014
task: ffff91209b015280 ti: ffff9120976d4000 task.ti: ffff9120976d4000
RIP: 0010:[<ffffffffa3fab7d4>]  [<ffffffffa3fab7d4>] copy_user_generic_unrolled+0x64/0xc0
RSP: 0018:ffff9120976d7c40  EFLAGS: 00000206
RAX: ffffffffa4692df0 RBX: ffff91209ffb9800 RCX: 0000000000000027
RDX: 0000000000000000 RSI: ffff912086874640 RDI: 00007f09e2b1c900
RBP: ffff9120976d7c70 R08: 585420657355203a R09: 726f66204f495020
R10: 6963696666757320 R11: 6d7320796c746e65 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000000030 R15: 0000000000000018
FS:  00007f09ed9cd840(0000) GS:ffff91209fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f09e2b0a000 CR3: 000000001e2cc000 CR4: 00000000000006f0
Call Trace:
[<ffffffffa3dc8cdc>] ? file_read_actor+0x6c/0xa0
[<ffffffffa3dca23c>] do_generic_file_read.constprop.52+0x2cc/0x510
[<ffffffffa3dcae81>] generic_file_aio_read+0x1d1/0x2a0
[<ffffffffa3e4bea2>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffffc03a2675>] xfs_file_buffered_aio_read+0x95/0x110 [xfs]
[<ffffffffc03a2cf7>] xfs_file_aio_read+0x87/0x100 [xfs]
[<ffffffffa3e5b113>] do_sync_read+0x93/0xe0
[<ffffffffa3e5bb2f>] vfs_read+0x9f/0x170
[<ffffffffa3e5cb82>] SyS_pread64+0x92/0xc0
[<ffffffffa43c539a>] system_call_fastpath+0x25/0x2a
Code: 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 4e 28 4c 8b 56 30 4c 8b 5e 38 4c 89 47 20 <4c> 89 4f 28 4c 89 57 30 4c 89 5f 38 48 8d 76 40 48 8d 7f 40 ff 
Complete report #799831
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffb9f93bf2
Build id: 3.10.0-1127.el7.x86_64
0x32
2
? file_read_actor
vmlinux 0xffffffffb9dbe69c
Build id: 3.10.0-1127.el7.x86_64
0x6c
3
generic_file_aio_read
vmlinux 0xffffffffb9dc022d
Build id: 3.10.0-1127.el7.x86_64
0x4bd
4
xfs_file_buffered_aio_read
xfs 0xffffffffc063e085
Build id: 3.10.0-1127.el7.x86_64
0x95
5
xfs_file_aio_read
xfs 0xffffffffc063e6d7
Build id: 3.10.0-1127.el7.x86_64
0x87
6
do_sync_read
vmlinux 0xffffffffb9e4c583
Build id: 3.10.0-1127.el7.x86_64
0x93
7
vfs_read
vmlinux 0xffffffffb9e4cfbf
Build id: 3.10.0-1127.el7.x86_64
0x9f
8
SyS_pread64
vmlinux 0xffffffffb9e4e022
Build id: 3.10.0-1127.el7.x86_64
0x92
9
system_call_fastpath
vmlinux 0xffffffffba392ed2
Build id: 3.10.0-1127.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 27s! [rpm:64174]
Modules linked in: mfe_fileaccess_100610110(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter mfe_aac_100610110(OE) vmw_vsock_vmci_transport vsock sunrpc ppdev iosf_mbi crc32_pclmul vmw_balloon ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg joydev pcspkr vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit drm libnvdimm ata_piix mptspi libata scsi_transport_spi crct10dif_pclmul
crct10dif_common mptscsih crc32c_intel mptbase serio_raw vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 64174 Comm: rpm Kdump: loaded Tainted: G           OE  ------------   3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff95f1e7ba5230 ti: ffff95f14d628000 task.ti: ffff95f14d628000
RIP: 0010:[<ffffffffb9f93bf2>]  [<ffffffffb9f93bf2>] copy_user_generic_unrolled+0x32/0xc0
RSP: 0018:ffff95f14d62bc70  EFLAGS: 00010202
RAX: ffff95efe4d9a279 RBX: 0000000000000001 RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffff95f11e267000 RDI: 00007fcc54fba058
RBP: ffff95f14d62bca0 R08: 0000000000000001 R09: ffffe011857899dc
R10: ffff95f14d62bfd8 R11: ffff95f1e6b47940 R12: ffffffffb9cd7daf
R13: ffff95f14d62bc00 R14: 0000000000000001 R15: ffff95f1e98dacc0
FS:  00007fcc5fd9e840(0000) GS:ffff95f1e9800000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000e88ff0 CR3: 000000019cb94000 CR4: 00000000001607f0
Call Trace:
[<ffffffffb9dbe69c>] ? file_read_actor+0x6c/0xa0
[<ffffffffb9dc022d>] generic_file_aio_read+0x4bd/0x790
[<ffffffffc063e085>] xfs_file_buffered_aio_read+0x95/0x110 [xfs]
[<ffffffffc063e6d7>] xfs_file_aio_read+0x87/0x100 [xfs]
[<ffffffffb9e4c583>] do_sync_read+0x93/0xe0
[<ffffffffb9e4cfbf>] vfs_read+0x9f/0x170
[<ffffffffb9e4e022>] SyS_pread64+0x92/0xc0
[<ffffffffba392ed2>] system_call_fastpath+0x25/0x2a
Code: 82 8c 00 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a <4c> 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 
Complete report #705346
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff9f783fa2
Build id: 3.10.0-957.el7.x86_64
0x32
2
? file_read_actor
vmlinux 0xffffffff9f5b62ac
Build id: 3.10.0-957.el7.x86_64
0x6c
3
generic_file_aio_read
vmlinux 0xffffffff9f5b800d
Build id: 3.10.0-957.el7.x86_64
0x4bd
4
xfs_file_buffered_aio_read
xfs 0xffffffffc046b345
Build id: 3.10.0-957.el7.x86_64
0x95
5
xfs_file_aio_read
xfs 0xffffffffc046bb57
Build id: 3.10.0-957.el7.x86_64
0x87
6
do_sync_read
vmlinux 0xffffffff9f6404d3
Build id: 3.10.0-957.el7.x86_64
0x93
7
vfs_read
vmlinux 0xffffffff9f640f0f
Build id: 3.10.0-957.el7.x86_64
0x9f
8
SyS_pread64
vmlinux 0xffffffff9f641fc2
Build id: 3.10.0-957.el7.x86_64
0x92
9
system_call_fastpath
vmlinux 0xffffffff9fb74ddb
Build id: 3.10.0-957.el7.x86_64
0x22
NMI watchdog: BUG: soft lockup - CPU#11 stuck for 25s! [rpm:124837]
Modules linked in: veth xt_nat xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock fuse vmhgfs(OE) overlay(T) sunrpc snd_seq_midi snd_seq_midi_event sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm joydev snd_timer snd pcspkr sg soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic
pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm serio_raw ata_piix mptspi libata scsi_transport_spi e1000 nfit mptscsih libnvdimm mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 11 PID: 124837 Comm: rpm Kdump: loaded Tainted: G        W  OEL ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff8b76dc664100 ti: ffff8b76726c8000 task.ti: ffff8b76726c8000
RIP: 0010:[<ffffffff9f783fa2>]  [<ffffffff9f783fa2>] copy_user_generic_unrolled+0x32/0xc0
RSP: 0018:ffff8b76726cbc70  EFLAGS: 00050202
RAX: ffffffff9fe84aba RBX: ffffffffc04798ec RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffff8b7537c85000 RDI: 00007f1be87ebe10
RBP: ffff8b76726cbca0 R08: 0000000000000001 R09: ffffefb409df215c
R10: ffff8b76726cbfd8 R11: ffff8b765f03df20 R12: ffff8b76ab291878
R13: 000000009fb66e72 R14: ffff8b76000000a8 R15: ffff8b7630e3f6c0
FS:  00007f1bf3556840(0000) GS:ffff8b76ed8c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f1bf3570500 CR3: 00000003cabd0000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9f5b62ac>] ? file_read_actor+0x6c/0xa0
[<ffffffff9f5b800d>] generic_file_aio_read+0x4bd/0x790
[<ffffffffc046b345>] xfs_file_buffered_aio_read+0x95/0x110 [xfs]
[<ffffffffc046bb57>] xfs_file_aio_read+0x87/0x100 [xfs]
[<ffffffff9f6404d3>] do_sync_read+0x93/0xe0
[<ffffffff9f640f0f>] vfs_read+0x9f/0x170
[<ffffffff9f641fc2>] SyS_pread64+0x92/0xc0
[<ffffffff9fb74ddb>] system_call_fastpath+0x22/0x27
Code: 82 8c 00 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a <4c> 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 
Complete report #414106
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff813007c2
Build id: 3.10.0-327.22.2.el7.x86_64
0x32
2
? file_read_actor
vmlinux 0xffffffff811689c3
Build id: 3.10.0-327.22.2.el7.x86_64
0x133
3
generic_file_aio_read
vmlinux 0xffffffff8116b098
Build id: 3.10.0-327.22.2.el7.x86_64
0x478
4
xfs_file_aio_read
xfs 0xffffffffa0224ec1
Build id: 3.10.0-327.22.2.el7.x86_64
0x151
5
do_sync_read
vmlinux 0xffffffff811de32d
Build id: 3.10.0-327.22.2.el7.x86_64
0x8d
6
vfs_read
vmlinux 0xffffffff811dea8c
Build id: 3.10.0-327.22.2.el7.x86_64
0x9c
7
SyS_pread64
vmlinux 0xffffffff811df7b2
Build id: 3.10.0-327.22.2.el7.x86_64
0x92
8
tracesys
vmlinux 0xffffffff81646a92
Build id: 3.10.0-327.22.2.el7.x86_64
0xdd
BUG: soft lockup - CPU#0 stuck for 38s! [rpm:13103]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13402(E) falcon_lsm_pinned_13207(E) falcon_lsm_pinned_13109(E) falcon_lsm_pinned_13005(E) tcp_diag udp_diag inet_diag falcon_lsm_pinned_12905(E) falcon_lsm_pinned_12803(E) nfsv3 nfs_acl nfs lockd grace fscache binfmt_misc vmw_vsock_vmci_transport vsock sunrpc ppdev vmw_balloon crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr ext4 mbcache jbd2 vmw_vmci sg parport_pc parport i2c_piix4 shpchp ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common vmwgfx drm_kms_helper ttm drm crc32c_intel ata_generic pata_acpi serio_raw i2c_core vmw_pvscsi ata_piix vmxnet3 libata floppy dm_mirror dm_region_hash
dm_log dm_mod [last unloaded: falcon_kal]
CPU: 0 PID: 13103 Comm: rpm Tainted: P            EL ------------   3.10.0-327.22.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff880425a6c500 ti: ffff880058728000 task.ti: ffff880058728000
RIP: 0010:[<ffffffff813007c2>]  [<ffffffff813007c2>] copy_user_generic_unrolled+0x32/0xc0
RSP: 0018:ffff88005872bcb0  EFLAGS: 00010202
RAX: ffff880353fba000 RBX: 0000000000000000 RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffff880353fba000 RDI: 00000000007d4280
RBP: ffff88005872bcf0 R08: 0000000000000001 R09: ffffea000d4fee9c
R10: ffff88005872bcc0 R11: 0000000000000246 R12: 00000000000000d6
R13: ffff880139420000 R14: ffff88005872bc78 R15: 0000000000000000
FS:  00007f22cd1b6840(0000) GS:ffff88043fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000008d9ff0 CR3: 00000000586bd000 CR4: 00000000001407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffffffff811689c3 ffff880353fba000 00001000c3e346a8 ffff880283270fc8
00000000000024fe 0000000000001000 ffff88001cf96100 ffffea000d4fee80
ffff88005872bdc0 ffffffff8116b098 ffff88001cf96110 ffff88005872be30
Call Trace:
[<ffffffff811689c3>] ? file_read_actor+0x133/0x180
[<ffffffff8116b098>] generic_file_aio_read+0x478/0x750
[<ffffffffa0224ec1>] xfs_file_aio_read+0x151/0x2f0 [xfs]
[<ffffffff811de32d>] do_sync_read+0x8d/0xd0
[<ffffffff811dea8c>] vfs_read+0x9c/0x170
[<ffffffff811df7b2>] SyS_pread64+0x92/0xc0
[<ffffffff81646a92>] tracesys+0xdd/0xe2
Code: 82 8c 00 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a <4c> 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 
Complete report #239908
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff81325590
Build id: 3.10.0-514.2.2.el7.x86_64
0x60
2
? file_read_actor
vmlinux 0xffffffff8117fbf3
Build id: 3.10.0-514.2.2.el7.x86_64
0x133
3
generic_file_aio_read
vmlinux 0xffffffff811825bb
Build id: 3.10.0-514.2.2.el7.x86_64
0x48b
4
do_sync_read
vmlinux 0xffffffff811fd94d
Build id: 3.10.0-514.2.2.el7.x86_64
0x8d
5
vfs_read
vmlinux 0xffffffff811fe0fe
Build id: 3.10.0-514.2.2.el7.x86_64
0x9e
6
SyS_pread64
vmlinux 0xffffffff811feea2
Build id: 3.10.0-514.2.2.el7.x86_64
0x92
7
system_call_fastpath
vmlinux 0xffffffff816967c9
Build id: 3.10.0-514.2.2.el7.x86_64
0x16
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 25s! [kworker/u8:1:330]
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 41s! [mysqld:1974]
Modules linked in: binfmt_misc vmw_vsock_vmci_transport vsock intel_powerclamp coretemp crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon pcspkr sg vmw_vmci i2c_piix4 shpchp parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata mptspi scsi_transport_spi e1000 mptscsih mptbase i2c_core floppy fjes dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 1974 Comm: mysqld Not tainted 3.10.0-514.2.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 01/07/2011
task: ffff88007a159f60 ti: ffff88007ad88000 task.ti: ffff88007ad88000
RIP: 0010:[<ffffffff81325590>]  [<ffffffff81325590>] copy_user_generic_unrolled+0x60/0xc0
RSP: 0018:ffff88007ad8bd08  EFLAGS: 00000207
RAX: ffff88006aa94020 RBX: 0000000000000088 RCX: 0000000000000003
RDX: 0000000000000024 RSI: ffff88006aa94104 RDI: 00007f534c62ac20
RBP: ffff88007ad8bd48 R08: 20736f6d61747365 R09: 6f7073696420a0c3
R10: 2e6fa3c3a7c36973 R11: 6726702f3b746c26 R12: ffff88007ad9cc00
R13: ffff88007b4d5800 R14: ffff88007ad9cc00 R15: ffffffff810bc0bf
FS:  00007f53841a3700(0000) GS:ffff88007fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f6656475000 CR3: 000000007b846000 CR4: 00000000000007f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffffffff8117fbf3 ffff88006aa94000 000001e85f09dc30 ffff88006ccbe6e8
0000000000009895 0000000000001000 ffff880079665d00 ffffea0001aaa500
ffff88007ad8be18 ffffffff811825bb ffff880079665d10 ffff88007ad8be28
Call Trace:
[<ffffffff8117fbf3>] ? file_read_actor+0x133/0x180
[<ffffffff811825bb>] generic_file_aio_read+0x48b/0x790
[<ffffffff811fd94d>] do_sync_read+0x8d/0xd0
[<ffffffff811fe0fe>] vfs_read+0x9e/0x170
[<ffffffff811feea2>] SyS_pread64+0x92/0xc0
[<ffffffff816967c9>] system_call_fastpath+0x16/0x1b
Code: 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 4e 28 4c 8b 56 30 4c 8b 5e 38 <4c> 89 47 20 4c 89 4f 28 4c 89 57 30 4c 89 5f 38 48 8d 76 40 48 
Complete report #175724
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff812ffff2
Build id: 3.10.0-327.el7.x86_64
0x32
2
? file_read_actor
vmlinux 0xffffffff81168573
Build id: 3.10.0-327.el7.x86_64
0x133
3
generic_file_aio_read
vmlinux 0xffffffff8116ac58
Build id: 3.10.0-327.el7.x86_64
0x478
4
xfs_file_aio_read
xfs 0xffffffffa0248e41
Build id: 3.10.0-327.el7.x86_64
0x151
5
do_sync_read
vmlinux 0xffffffff811ddcdd
Build id: 3.10.0-327.el7.x86_64
0x8d
6
vfs_read
vmlinux 0xffffffff811de43c
Build id: 3.10.0-327.el7.x86_64
0x9c
7
SyS_pread64
vmlinux 0xffffffff811df162
Build id: 3.10.0-327.el7.x86_64
0x92
8
system_call_fastpath
vmlinux 0xffffffff81645909
Build id: 3.10.0-327.el7.x86_64
0x16
BUG: soft lockup - CPU#2 stuck for 21s! [ora_j001_pdborc:116897]
Modules linked in: nfsd nfs_acl tcp_lp bnep bluetooth rfkill fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ppdev vmw_balloon snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq crc32_pclmul snd_seq_device ghash_clmulni_intel snd_pcm snd_timer snd aesni_intel lrw gf128mul soundcore glue_helper ablk_helper cryptd sg pcspkr parport_pc parport vmw_vmci i2c_piix4 shpchp binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic
ata_generic pata_acpi vmwgfx drm_kms_helper ttm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix drm mptspi scsi_transport_spi mptscsih e1000 mptbase serio_raw i2c_core libata dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 116897 Comm: ora_j001_pdborc Tainted: G             L ------------   3.10.0-327.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff880448526780 ti: ffff8805f0118000 task.ti: ffff8805f0118000
RIP: 0010:[<ffffffff812ffff2>]  [<ffffffff812ffff2>] copy_user_generic_unrolled+0x32/0xc0
RSP: 0018:ffff8805f011bcb0  EFLAGS: 00050202
RAX: ffff880361303000 RBX: ffff880127a0be80 RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffff880361303000 RDI: 000000009428d000
RBP: ffff8805f011bcf0 R08: 0000000000000001 R09: ffffea000d84c0dc
R10: ffff8805f011bcc0 R11: d1430602ffffffff R12: ffff880448526e18
R13: 0000000126654800 R14: ffffffff8101360b R15: ffff8805f011bc58
FS:  00007f6567e07f40(0000) GS:ffff880626640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd144d30000 CR3: 000000012f0b3000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
ffffffff81168573 ffff880361303000 000010002f4d5f60 ffff8805ef2bd808
00000000001c93f6 0000000000001000 ffff8805e27f2700 ffffea000d84c0c0
ffff8805f011bdc0 ffffffff8116ac58 ffff8805e27f2710 ffff8805f011be30
Call Trace:
[<ffffffff81168573>] ? file_read_actor+0x133/0x180
[<ffffffff8116ac58>] generic_file_aio_read+0x478/0x750
[<ffffffffa0248e41>] xfs_file_aio_read+0x151/0x2f0 [xfs]
[<ffffffff811ddcdd>] do_sync_read+0x8d/0xd0
[<ffffffff811de43c>] vfs_read+0x9c/0x170
[<ffffffff811df162>] SyS_pread64+0x92/0xc0
[<ffffffff81645909>] system_call_fastpath+0x16/0x1b
Code: 82 8c 00 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a <4c> 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 
Complete report #12430
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff812fff72
Build id: 3.10.0-327.4.5.el7.x86_64
0x32
2
? file_read_actor
vmlinux 0xffffffff81168563
Build id: 3.10.0-327.4.5.el7.x86_64
0x133
3
generic_file_aio_read
vmlinux 0xffffffff8116ac48
Build id: 3.10.0-327.4.5.el7.x86_64
0x478
4
xfs_file_aio_read
xfs 0xffffffffa022de41
Build id: 3.10.0-327.4.5.el7.x86_64
0x151
5
do_sync_read
vmlinux 0xffffffff811ddc5d
Build id: 3.10.0-327.4.5.el7.x86_64
0x8d
6
vfs_read
vmlinux 0xffffffff811de3bc
Build id: 3.10.0-327.4.5.el7.x86_64
0x9c
7
SyS_pread64
vmlinux 0xffffffff811df0e2
Build id: 3.10.0-327.4.5.el7.x86_64
0x92
8
system_call_fastpath
vmlinux 0xffffffff816458c9
Build id: 3.10.0-327.4.5.el7.x86_64
0x16
BUG: soft lockup - CPU#0 stuck for 224s! [rpm:45253]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock fuse vmhgfs(OE) bnep dm_mirror dm_region_hash dm_log snd_seq_midi snd_seq_midi_event ext4 mbcache jbd2 coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus pcspkr snd_seq snd_seq_device snd_pcm snd_timer snd soundcore btusb bluetooth rfkill sg i2c_piix4 vmw_vmci shpchp dm_mod parport_pc parport binfmt_misc nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod
cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmwgfx drm_kms_helper ttm mptspi scsi_transport_spi drm mptscsih e1000 mptbase i2c_core ata_piix libata
CPU: 0 PID: 45253 Comm: rpm Tainted: G           OE  ------------   3.10.0-327.4.5.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff880077a25c00 ti: ffff8800b456c000 task.ti: ffff8800b456c000
RIP: 0010:[<ffffffff812fff72>]  [<ffffffff812fff72>] copy_user_generic_unrolled+0x32/0xc0
RSP: 0018:ffff8800b456fcb0  EFLAGS: 00010202
RAX: ffff88001e721000 RBX: 0008000000000010 RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffff88001e721000 RDI: 00007f8394093028
RBP: ffff8800b456fcf0 R08: 0000000000000001 R09: ffffea000079c85c
R10: ffff8800b456fcc0 R11: 0000000000000246 R12: 0000000000000082
R13: 0000000000000082 R14: ffff8800b456fc60 R15: 0000000000971b40
FS:  00007f8398551800(0000) GS:ffff880100600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000400f028 CR3: 00000000b529c000 CR4: 00000000001407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffffffff81168563 ffff88001e721000 00001000b3e8f968 ffff8800a2589848
0000000000005a8b 0000000000001000 ffff880085278c00 ffffea000079c840
ffff8800b456fdc0 ffffffff8116ac48 ffff880085278c10 ffff8800b456fe30
Call Trace:
[<ffffffff81168563>] ? file_read_actor+0x133/0x180
[<ffffffff8116ac48>] generic_file_aio_read+0x478/0x750
[<ffffffffa022de41>] xfs_file_aio_read+0x151/0x2f0 [xfs]
[<ffffffff811ddc5d>] do_sync_read+0x8d/0xd0
[<ffffffff811de3bc>] vfs_read+0x9c/0x170
[<ffffffff811df0e2>] SyS_pread64+0x92/0xc0
[<ffffffff816458c9>] system_call_fastpath+0x16/0x1b
Code: 82 8c 00 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a <4c> 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 
[sched_delayed] sched: RT throttling activated
Complete report #545839
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff813303e2
Build id: 3.10.0-693.2.2.el7.x86_64
0x32
2
? file_read_actor
vmlinux 0xffffffff81181b76
Build id: 3.10.0-693.2.2.el7.x86_64
0x56
3
generic_file_aio_read
vmlinux 0xffffffff8118427b
Build id: 3.10.0-693.2.2.el7.x86_64
0x48b
4
xfs_file_buffered_aio_read
xfs 0xffffffffc02990a5
Build id: 3.10.0-693.2.2.el7.x86_64
0x95
5
xfs_file_aio_read
xfs 0xffffffffc0299907
Build id: 3.10.0-693.2.2.el7.x86_64
0x87
6
do_sync_read
vmlinux 0xffffffff812001ad
Build id: 3.10.0-693.2.2.el7.x86_64
0x8d
7
vfs_read
vmlinux 0xffffffff81200bac
Build id: 3.10.0-693.2.2.el7.x86_64
0x9c
8
SyS_pread64
vmlinux 0xffffffff81201c42
Build id: 3.10.0-693.2.2.el7.x86_64
0x92
9
system_call_fastpath
vmlinux 0xffffffff816b5009
Build id: 3.10.0-693.2.2.el7.x86_64
0x16
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [rpm:30973]
Modules linked in: gsch(OE) redirfs(OE) dsa_filter(POE) nfsv3 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg ppdev parport_pc joydev pcspkr vmw_balloon i2c_piix4 parport shpchp vmw_vmci nfsd auth_rpcgss nfs_acl
lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm_kms_helper mptspi syscopyarea sysfillrect scsi_transport_spi sysimgblt fb_sys_fops ttm mptscsih ata_piix drm libata mptbase vmxnet3 i2c_core dm_mirror dm_region_hash dm_log dm_mod [last unloaded: redirfs]
CPU: 0 PID: 30973 Comm: rpm Tainted: P           OEL ------------   3.10.0-693.2.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff88022df18fd0 ti: ffff880004bc4000 task.ti: ffff880004bc4000
RIP: 0010:[<ffffffff813303e2>]  [<ffffffff813303e2>] copy_user_generic_unrolled+0x32/0xc0
RSP: 0018:ffff880004bc7ca8  EFLAGS: 00010202
RAX: 0000000000000000 RBX: ffff8800369a5938 RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffff88003529e000 RDI: 00007f4db3fab2a0
RBP: ffff880004bc7cd8 R08: 0000000000000001 R09: ffffea0000d4a79c
R10: ffff880004bc7ca8 R11: ffff8800369a6310 R12: ffffea00089a2000
R13: ffffea00089a2000 R14: ffff8800369a5920 R15: 00000000ffffffff
FS:  00007f4dbe972840(0000) GS:ffff88023fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4db3fab250 CR3: 00000000ae833000 CR4: 00000000001407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffffffff81181b76 ffff8800369a6460 000000000000244e 0000000000001000
ffff88022d669900 ffffea0000d4a780 ffff880004bc7da8 ffffffff8118427b
ffff88022d669910 ffff880004bc7e30 0000000000000000 ffff880004bc7e40
Call Trace:
[<ffffffff81181b76>] ? file_read_actor+0x56/0x90
[<ffffffff8118427b>] generic_file_aio_read+0x48b/0x790
[<ffffffffc02990a5>] xfs_file_buffered_aio_read+0x95/0x110 [xfs]
[<ffffffffc0299907>] xfs_file_aio_read+0x87/0x100 [xfs]
[<ffffffff812001ad>] do_sync_read+0x8d/0xd0
[<ffffffff81200bac>] vfs_read+0x9c/0x170
[<ffffffff81201c42>] SyS_pread64+0x92/0xc0
[<ffffffff816b5009>] system_call_fastpath+0x16/0x1b
Code: 82 8c 00 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a <4c> 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 
Complete report #480790
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffb3b8e9f2
Build id: 3.10.0-1062.4.1.el7.x86_64
0x32
2
? file_read_actor
vmlinux 0xffffffffb39bc06c
Build id: 3.10.0-1062.4.1.el7.x86_64
0x6c
3
generic_file_aio_read
vmlinux 0xffffffffb39bdbdd
Build id: 3.10.0-1062.4.1.el7.x86_64
0x4bd
4
? do_wp_page
vmlinux 0xffffffffb39ee66e
Build id: 3.10.0-1062.4.1.el7.x86_64
0x65e
5
xfs_file_buffered_aio_read
xfs 0xffffffffc05eeb95
Build id: 3.10.0-1062.4.1.el7.x86_64
0x95
6
xfs_file_aio_read
xfs 0xffffffffc05ef1e7
Build id: 3.10.0-1062.4.1.el7.x86_64
0x87
7
do_sync_read
vmlinux 0xffffffffb3a48353
Build id: 3.10.0-1062.4.1.el7.x86_64
0x93
8
vfs_read
vmlinux 0xffffffffb3a48d8f
Build id: 3.10.0-1062.4.1.el7.x86_64
0x9f
9
SyS_pread64
vmlinux 0xffffffffb3a49e42
Build id: 3.10.0-1062.4.1.el7.x86_64
0x92
10
system_call_fastpath
vmlinux 0xffffffffb3f8bede
Build id: 3.10.0-1062.4.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [abrt-action-lis:28319]
Modules linked in: nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink overlay(T) vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw ppdev gf128mul vmw_balloon glue_helper ablk_helper cryptd pcspkr sg joydev parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi ata_piix scsi_transport_spi mptscsih
libata crct10dif_pclmul crct10dif_common serio_raw mptbase crc32c_intel vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 28319 Comm: abrt-action-lis Kdump: loaded Tainted: G             L ------------ T 3.10.0-1062.4.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff88cf016762a0 ti: ffff88cf54ae0000 task.ti: ffff88cf54ae0000
RIP: 0010:[<ffffffffb3b8e9f2>]  [<ffffffffb3b8e9f2>] copy_user_generic_unrolled+0x32/0xc0
RSP: 0018:ffff88cf54ae3c70  EFLAGS: 00010202
RAX: ffffffffb428d820 RBX: 00000000e2a70ae6 RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffff88cc23c4e000 RDI: 00007fe938c3ea48
RBP: ffff88cf54ae3ca0 R08: 0000000000000001 R09: fffffb2fc28f139c
R10: ffff88cf54ae3fd8 R11: ffff88cc37bc8c80 R12: 00000001c05fd0f4
R13: ffff88cf54ae3c48 R14: ffff88cc37bc9040 R15: ffffffffc05ee644
FS:  00007fe944d7a740(0000) GS:ffff88cfbfc40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe938baee28 CR3: 00000003af234000 CR4: 00000000001607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffb39bc06c>] ? file_read_actor+0x6c/0xa0
[<ffffffffb39bdbdd>] generic_file_aio_read+0x4bd/0x790
[<ffffffffb39ee66e>] ? do_wp_page+0x65e/0x720
[<ffffffffc05eeb95>] xfs_file_buffered_aio_read+0x95/0x110 [xfs]
[<ffffffffc05ef1e7>] xfs_file_aio_read+0x87/0x100 [xfs]
[<ffffffffb3a48353>] do_sync_read+0x93/0xe0
[<ffffffffb3a48d8f>] vfs_read+0x9f/0x170
[<ffffffffb3a49e42>] SyS_pread64+0x92/0xc0
[<ffffffffb3f8bede>] system_call_fastpath+0x25/0x2a
Code: 82 8c 00 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a <4c> 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 
Complete report #403935
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff86395745
Build id: 3.10.0-1160.59.1.el7.x86_64
0x35
2
? file_read_actor
vmlinux 0xffffffff861be08c
Build id: 3.10.0-1160.59.1.el7.x86_64
0x6c
3
do_generic_file_read.constprop.52
vmlinux 0xffffffff861bf58c
Build id: 3.10.0-1160.59.1.el7.x86_64
0x2cc
4
generic_file_aio_read
vmlinux 0xffffffff861c0179
Build id: 3.10.0-1160.59.1.el7.x86_64
0x1c9
5
? __cond_resched
vmlinux 0xffffffff860d7726
Build id: 3.10.0-1160.59.1.el7.x86_64
0x26
6
xfs_file_buffered_aio_read
xfs 0xffffffffc03e7f55
Build id: 3.10.0-1160.59.1.el7.x86_64
0x95
7
xfs_file_aio_read
xfs 0xffffffffc03e85a7
Build id: 3.10.0-1160.59.1.el7.x86_64
0x87
8
do_sync_read
vmlinux 0xffffffff8624d9c3
Build id: 3.10.0-1160.59.1.el7.x86_64
0x93
9
vfs_read
vmlinux 0xffffffff8624e3ff
Build id: 3.10.0-1160.59.1.el7.x86_64
0x9f
10
SyS_pread64
vmlinux 0xffffffff8624f472
Build id: 3.10.0-1160.59.1.el7.x86_64
0x92
11
system_call_fastpath
vmlinux 0xffffffff86799f92
Build id: 3.10.0-1160.59.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [rpm:18288]
Modules linked in: vsock_diag tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc iosf_mbi ppdev crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon sg joydev pcspkr parport_pc parport i2c_piix4 vmw_vmci binfmt_misc ip_tables xfs libcrc32c ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common
e1000e drm crc32c_intel serio_raw ahci ptp pps_core libahci vmw_pvscsi ata_piix drm_panel_orientation_quirks nfit libata libnvdimm dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 18288 Comm: rpm Kdump: loaded Tainted: G             L ------------   3.10.0-1160.59.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/28/2017
task: ffff940b89aa0000 ti: ffff940ce56e4000 task.ti: ffff940ce56e4000
RIP: 0010:[<ffffffff86395745>]  [<ffffffff86395745>] copy_user_generic_unrolled+0x35/0xc0
RSP: 0018:ffff940ce56e7c38  EFLAGS: 00000206
RAX: ffffffff86a921e0 RBX: 00000000544c2851 RCX: 000000000000002b
RDX: 0000000000000000 RSI: ffff940a77376540 RDI: 00007f0af6c76298
RBP: ffff940ce56e7c68 R08: 7327444920656369 R09: 706d205d69736373
R10: 41203a7361733374 R11: 7665442064656464 R12: ffffffff8638dc54
R13: ffff940ce56e7be0 R14: ffff940e3ffda068 R15: ffff940e3ffdb000
FS:  00007f0b01aa8840(0000) GS:ffff940e3fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0af72bebe0 CR3: 000000019e466000 CR4: 00000000001607f0
Call Trace:
[<ffffffff861be08c>] ? file_read_actor+0x6c/0xa0
[<ffffffff861bf58c>] do_generic_file_read.constprop.52+0x2cc/0x510
[<ffffffff861c0179>] generic_file_aio_read+0x1c9/0x290
[<ffffffff860d7726>] ? __cond_resched+0x26/0x30
[<ffffffffc03e7f55>] xfs_file_buffered_aio_read+0x95/0x110 [xfs]
[<ffffffffc03e85a7>] xfs_file_aio_read+0x87/0x100 [xfs]
[<ffffffff8624d9c3>] do_sync_read+0x93/0xe0
[<ffffffff8624e3ff>] vfs_read+0x9f/0x170
[<ffffffff8624f472>] SyS_pread64+0x92/0xc0
[<ffffffff86799f92>] system_call_fastpath+0x25/0x2a
Code: 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 <4c> 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 08 4c 89 
Complete report #334121
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffbaf95735
Build id: 3.10.0-1160.49.1.el7.x86_64
0x35
2
? file_read_actor
vmlinux 0xffffffffbadbe08c
Build id: 3.10.0-1160.49.1.el7.x86_64
0x6c
3
do_generic_file_read.constprop.52
vmlinux 0xffffffffbadbf58c
Build id: 3.10.0-1160.49.1.el7.x86_64
0x2cc
4
generic_file_aio_read
vmlinux 0xffffffffbadc0179
Build id: 3.10.0-1160.49.1.el7.x86_64
0x1c9
5
? __do_fault.isra.61
vmlinux 0xffffffffbadee7aa
Build id: 3.10.0-1160.49.1.el7.x86_64
0x8a
6
xfs_file_buffered_aio_read
xfs 0xffffffffc0595f55
Build id: 3.10.0-1160.49.1.el7.x86_64
0x95
7
xfs_file_aio_read
xfs 0xffffffffc05965a7
Build id: 3.10.0-1160.49.1.el7.x86_64
0x87
8
do_sync_read
vmlinux 0xffffffffbae4d9c3
Build id: 3.10.0-1160.49.1.el7.x86_64
0x93
9
vfs_read
vmlinux 0xffffffffbae4e3ff
Build id: 3.10.0-1160.49.1.el7.x86_64
0x9f
10
SyS_pread64
vmlinux 0xffffffffbae4f472
Build id: 3.10.0-1160.49.1.el7.x86_64
0x92
11
system_call_fastpath
vmlinux 0xffffffffbb395f92
Build id: 3.10.0-1160.49.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [rpm:30743]
Modules linked in: vsock_diag tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd vmw_balloon sg joydev pcspkr parport_pc parport vmw_vmci i2c_piix4 binfmt_misc ip_tables xfs libcrc32c ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx ahci e1000e drm_kms_helper ata_piix libahci syscopyarea sysfillrect sysimgblt
fb_sys_fops ttm crct10dif_pclmul crct10dif_common nfit libata crc32c_intel drm libnvdimm serio_raw ptp pps_core vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 30743 Comm: rpm Kdump: loaded Tainted: G             L ------------   3.10.0-1160.49.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/28/2017
task: ffff90e9d115e300 ti: ffff90e68e710000 task.ti: ffff90e68e710000
RIP: 0010:[<ffffffffbaf95735>]  [<ffffffffbaf95735>] copy_user_generic_unrolled+0x35/0xc0
RSP: 0018:ffff90e68e713c38  EFLAGS: 00040206
RAX: ffff90e631b9d27a RBX: 6570205d736c6f6f RCX: 0000000000000011
RDX: 0000000000000000 RSI: ffff90e87b1debc0 RDI: 00007f2ac0131c38
RBP: ffff90e68e713c68 R08: 697a616c206e6f69 R09: 67756c70746f6820
R10: 646e616d6d6f6320 R11: 74656c706d6f6320 R12: ffffffffbaf8dc44
R13: ffff90e68e713c20 R14: ffff90ea3ffd8068 R15: ffff90ea3ffd9000
FS:  00007f2acaf3e840(0000) GS:ffff90ea3fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2ac9f21010 CR3: 0000000389530000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffbadbe08c>] ? file_read_actor+0x6c/0xa0
[<ffffffffbadbf58c>] do_generic_file_read.constprop.52+0x2cc/0x510
[<ffffffffbadc0179>] generic_file_aio_read+0x1c9/0x290
[<ffffffffbadee7aa>] ? __do_fault.isra.61+0x8a/0x100
[<ffffffffc0595f55>] xfs_file_buffered_aio_read+0x95/0x110 [xfs]
[<ffffffffc05965a7>] xfs_file_aio_read+0x87/0x100 [xfs]
[<ffffffffbae4d9c3>] do_sync_read+0x93/0xe0
[<ffffffffbae4e3ff>] vfs_read+0x9f/0x170
[<ffffffffbae4f472>] SyS_pread64+0x92/0xc0
[<ffffffffbb395f92>] system_call_fastpath+0x25/0x2a
Code: 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 <4c> 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 08 4c 89 
Complete report #307010
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffa5795732
Build id: 3.10.0-1160.45.1.el7.x86_64
0x32
2
? file_read_actor
vmlinux 0xffffffffa55be08c
Build id: 3.10.0-1160.45.1.el7.x86_64
0x6c
3
do_generic_file_read.constprop.52
vmlinux 0xffffffffa55bf58c
Build id: 3.10.0-1160.45.1.el7.x86_64
0x2cc
4
generic_file_aio_read
vmlinux 0xffffffffa55c0179
Build id: 3.10.0-1160.45.1.el7.x86_64
0x1c9
5
xfs_file_buffered_aio_read
xfs 0xffffffffc05b0f55
Build id: 3.10.0-1160.45.1.el7.x86_64
0x95
6
xfs_file_aio_read
xfs 0xffffffffc05b15a7
Build id: 3.10.0-1160.45.1.el7.x86_64
0x87
7
do_sync_read
vmlinux 0xffffffffa564d9c3
Build id: 3.10.0-1160.45.1.el7.x86_64
0x93
8
vfs_read
vmlinux 0xffffffffa564e3ff
Build id: 3.10.0-1160.45.1.el7.x86_64
0x9f
9
SyS_pread64
vmlinux 0xffffffffa564f472
Build id: 3.10.0-1160.45.1.el7.x86_64
0x92
10
system_call_fastpath
vmlinux 0xffffffffa5b95f92
Build id: 3.10.0-1160.45.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 91s! [ThreadPoolForeg:81361]
Modules linked in: arc4 md4 cifs ccm dns_resolver tcp_lp nls_utf8 isofs xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun binfmt_misc devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmhgfs(OE) vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul snd_ens1371 ghash_clmulni_intel snd_rawmidi ppdev snd_ac97_codec ac97_bus aesni_intel
uas lrw gf128mul glue_helper ablk_helper snd_seq cryptd vmw_balloon usb_storage snd_seq_device snd_pcm snd_timer pcspkr joydev snd soundcore sg vmw_vmci parport_pc parport ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel nfit libata libnvdimm drm_panel_orientation_quirks mptspi serio_raw scsi_transport_spi mptscsih e1000 mptbase fuse
CPU: 0 PID: 81361 Comm: ThreadPoolForeg Kdump: loaded Tainted: G           OEL ------------   3.10.0-1160.45.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff9fa240980000 ti: ffff9fa54d68c000 task.ti: ffff9fa54d68c000
RIP: 0010:[<ffffffffa5795732>]  [<ffffffffa5795732>] copy_user_generic_unrolled+0x32/0xc0
RSP: 0018:ffff9fa54d68fc38  EFLAGS: 00050202
RAX: ffffffffa5e91cb0 RBX: 000000cf00000000 RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffff9fa30a07f000 RDI: 00007ffa7070a720
RBP: ffff9fa54d68fc68 R08: 0000000000000001 R09: ffffef0d07281fdc
R10: 227669642228746e R11: 4e7373616c637b2c R12: ffff9fa3ba5e65a0
R13: ffff9fa54d713300 R14: 0000000000000001 R15: ffffffffa54e4d1c
FS:  00007ffa51fbf700(0000) GS:ffff9fa56d600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00002bfa00470940 CR3: 0000000388e14000 CR4: 00000000003607f0
Call Trace:
[<ffffffffa55be08c>] ? file_read_actor+0x6c/0xa0
[<ffffffffa55bf58c>] do_generic_file_read.constprop.52+0x2cc/0x510
[<ffffffffa55c0179>] generic_file_aio_read+0x1c9/0x290
[<ffffffffc05b0f55>] xfs_file_buffered_aio_read+0x95/0x110 [xfs]
[<ffffffffc05b15a7>] xfs_file_aio_read+0x87/0x100 [xfs]
[<ffffffffa564d9c3>] do_sync_read+0x93/0xe0
[<ffffffffa564e3ff>] vfs_read+0x9f/0x170
[<ffffffffa564f472>] SyS_pread64+0x92/0xc0
[<ffffffffa5b95f92>] system_call_fastpath+0x25/0x2a
Code: 82 8c 00 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a <4c> 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 
Complete report #269337
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffac159672
Build id: 3.10.0-862.9.1.el7.x86_64
0x32
2
? file_read_actor
vmlinux 0xffffffffabf93596
Build id: 3.10.0-862.9.1.el7.x86_64
0x56
3
generic_file_aio_read
vmlinux 0xffffffffabf95e8d
Build id: 3.10.0-862.9.1.el7.x86_64
0x4bd
4
xfs_file_buffered_aio_read
xfs 0xffffffffc0561d05
Build id: 3.10.0-862.9.1.el7.x86_64
0x95
5
xfs_file_aio_read
xfs 0xffffffffc0562517
Build id: 3.10.0-862.9.1.el7.x86_64
0x87
6
do_sync_read
vmlinux 0xffffffffac01a8d3
Build id: 3.10.0-862.9.1.el7.x86_64
0x93
7
vfs_read
vmlinux 0xffffffffac01b2ff
Build id: 3.10.0-862.9.1.el7.x86_64
0x9f
8
SyS_pread64
vmlinux 0xffffffffac01c3c2
Build id: 3.10.0-862.9.1.el7.x86_64
0x92
9
system_call_fastpath
vmlinux 0xffffffffac520795
Build id: 3.10.0-862.9.1.el7.x86_64
0x1c
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [ora_m000_pdbhdf:125513]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_ens1371 snd_rawmidi ppdev snd_ac97_codec ac97_bus vmw_balloon snd_seq snd_seq_device snd_pcm snd_timer pcspkr joydev snd soundcore sg vmw_vmci i2c_piix4 shpchp nfit libnvdimm parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod sr_mod cdrom
crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel libata serio_raw e1000 mptspi scsi_transport_spi mptscsih mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 125513 Comm: ora_m000_pdbhdf Kdump: loaded Tainted: G        W    L ------------   3.10.0-862.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff8b66d1bccf10 ti: ffff8b6008c0c000 task.ti: ffff8b6008c0c000
RIP: 0010:[<ffffffffac159672>]  [<ffffffffac159672>] copy_user_generic_unrolled+0x32/0xc0
RSP: 0018:ffff8b6008c0fc70  EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffff8b66ee103000 RDI: 000000015312c000
RBP: ffff8b6008c0fca0 R08: 0000000000000001 R09: ffffc9509bb840dc
R10: 048001ffff393903 R11: 55d00601393903c3 R12: ffff8b62f4bf76c0
R13: ffff8b66f8058b40 R14: ffff8b66f3ce0000 R15: ffff8b62f4bf76c0
FS:  00007fcc37fd5700(0000) GS:ffff8b66f8040000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fcd081c8000 CR3: 000000062ef26000 CR4: 00000000001607e0
Call Trace:
[<ffffffffabf93596>] ? file_read_actor+0x56/0x90
[<ffffffffabf95e8d>] generic_file_aio_read+0x4bd/0x790
[<ffffffffc0561d05>] xfs_file_buffered_aio_read+0x95/0x110 [xfs]
[<ffffffffc0562517>] xfs_file_aio_read+0x87/0x100 [xfs]
[<ffffffffac01a8d3>] do_sync_read+0x93/0xe0
[<ffffffffac01b2ff>] vfs_read+0x9f/0x170
[<ffffffffac01c3c2>] SyS_pread64+0x92/0xc0
[<ffffffffac520795>] system_call_fastpath+0x1c/0x21
Code: 82 8c 00 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a <4c> 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 
Complete report #175668
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffb4f94ad2
Build id: 3.10.0-1160.el7.x86_64
0x32
2
? file_read_actor
vmlinux 0xffffffffb4dbdbcc
Build id: 3.10.0-1160.el7.x86_64
0x6c
3
do_generic_file_read.constprop.52
vmlinux 0xffffffffb4dbf0cc
Build id: 3.10.0-1160.el7.x86_64
0x2cc
4
generic_file_aio_read
vmlinux 0xffffffffb4dbfcb9
Build id: 3.10.0-1160.el7.x86_64
0x1c9
5
xfs_file_buffered_aio_read
xfs 0xffffffffc030af55
Build id: 3.10.0-1160.el7.x86_64
0x95
6
xfs_file_aio_read
xfs 0xffffffffc030b5a7
Build id: 3.10.0-1160.el7.x86_64
0x87
7
do_sync_read
vmlinux 0xffffffffb4e4cf83
Build id: 3.10.0-1160.el7.x86_64
0x93
8
vfs_read
vmlinux 0xffffffffb4e4d9bf
Build id: 3.10.0-1160.el7.x86_64
0x9f
9
SyS_pread64
vmlinux 0xffffffffb4e4ea32
Build id: 3.10.0-1160.el7.x86_64
0x92
10
system_call_fastpath
vmlinux 0xffffffffb5393f92
Build id: 3.10.0-1160.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [rpm:3329]
Modules linked in: tcp_lp nls_utf8 isofs xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ppdev snd_ens1371 coretemp snd_rawmidi snd_ac97_codec iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ac97_bus lrw gf128mul glue_helper snd_seq ablk_helper snd_seq_device cryptd snd_pcm
vmw_balloon snd_timer pcspkr joydev snd soundcore sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi nfit vmwgfx libnvdimm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm ata_piix mptspi libata serio_raw scsi_transport_spi mptscsih e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 3329 Comm: rpm Kdump: loaded Tainted: G             L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff9b733bb5c200 ti: ffff9b7317d90000 task.ti: ffff9b7317d90000
RIP: 0010:[<ffffffffb4f94ad2>]  [<ffffffffb4f94ad2>] copy_user_generic_unrolled+0x32/0xc0
RSP: 0018:ffff9b7317d93c38  EFLAGS: 00050202
RAX: ffffffffb56913c8 RBX: 0000000000000000 RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffff9b731310d000 RDI: 0000000000f30500
RBP: ffff9b7317d93c68 R08: 0000000000000001 R09: ffffe4b2c04c435c
R10: ffff9b7317d93fd8 R11: ffff9b732003e688 R12: 0000000000000800
R13: 0000000000000001 R14: ffff9b737ffdb008 R15: 0000000000000000
FS:  00007f30b75d9840(0000) GS:ffff9b737b640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd1464bc000 CR3: 0000000017d8c000 CR4: 00000000003607e0
Call Trace:
[<ffffffffb4dbdbcc>] ? file_read_actor+0x6c/0xa0
[<ffffffffb4dbf0cc>] do_generic_file_read.constprop.52+0x2cc/0x510
[<ffffffffb4dbfcb9>] generic_file_aio_read+0x1c9/0x290
[<ffffffffc030af55>] xfs_file_buffered_aio_read+0x95/0x110 [xfs]
[<ffffffffc030b5a7>] xfs_file_aio_read+0x87/0x100 [xfs]
[<ffffffffb4e4cf83>] do_sync_read+0x93/0xe0
[<ffffffffb4e4d9bf>] vfs_read+0x9f/0x170
[<ffffffffb4e4ea32>] SyS_pread64+0x92/0xc0
[<ffffffffb5393f92>] system_call_fastpath+0x25/0x2a
Code: 82 8c 00 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a <4c> 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [CRTC:37:crtc-0] flip_done timed out
Complete report #19839
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff9e584822
Build id: 3.10.0-957.21.2.el7.x86_64
0x32
2
? file_read_actor
vmlinux 0xffffffff9e3b686c
Build id: 3.10.0-957.21.2.el7.x86_64
0x6c
3
generic_file_aio_read
vmlinux 0xffffffff9e3b85cd
Build id: 3.10.0-957.21.2.el7.x86_64
0x4bd
4
xfs_file_buffered_aio_read
xfs 0xffffffffc04480d5
Build id: 3.10.0-957.21.2.el7.x86_64
0x95
5
xfs_file_aio_read
xfs 0xffffffffc04488e7
Build id: 3.10.0-957.21.2.el7.x86_64
0x87
6
do_sync_read
vmlinux 0xffffffff9e440cc3
Build id: 3.10.0-957.21.2.el7.x86_64
0x93
7
vfs_read
vmlinux 0xffffffff9e4416ff
Build id: 3.10.0-957.21.2.el7.x86_64
0x9f
8
SyS_pread64
vmlinux 0xffffffff9e4427b2
Build id: 3.10.0-957.21.2.el7.x86_64
0x92
9
system_call_fastpath
vmlinux 0xffffffff9e975ddb
Build id: 3.10.0-957.21.2.el7.x86_64
0x22
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [rpm:122246]
Modules linked in: cmac arc4 md4 nls_utf8 cifs ccm dns_resolver vmw_vsock_vmci_transport vsock iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel snd_seq_midi snd_seq_midi_event lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr snd_ens1371 joydev snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd soundcore sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi e1000 scsi_transport_spi mptscsih libata nfit mptbase drm_panel_orientation_quirks libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 122246 Comm: rpm Tainted: G             L ------------   3.10.0-957.21.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff955539ac1040 ti: ffff955537d80000 task.ti: ffff955537d80000
RIP: 0010:[<ffffffff9e584822>]  [<ffffffff9e584822>] copy_user_generic_unrolled+0x32/0xc0
RSP: 0018:ffff955537d83c70  EFLAGS: 00050202
RAX: ffffffff9ec852da RBX: ffff95553ffd9800 RCX: 0000000000000040
RDX: 0000000000000000 RSI: ffff9555144d6000 RDI: 00007fc6c5dc3c18
RBP: ffff955537d83ca0 R08: 0000000000000001 R09: ffffc3b40051359c
R10: ffff955537d83fd8 R11: ffff955538d5aaa0 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000000030 R15: 000000000000001f
FS:  00007fc6d0b1e840(0000) GS:ffff95553c600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc6c58282d0 CR3: 000000001bd02000 CR4: 00000000003607f0
Call Trace:
[<ffffffff9e3b686c>] ? file_read_actor+0x6c/0xa0
[<ffffffff9e3b85cd>] generic_file_aio_read+0x4bd/0x790
[<ffffffffc04480d5>] xfs_file_buffered_aio_read+0x95/0x110 [xfs]
[<ffffffffc04488e7>] xfs_file_aio_read+0x87/0x100 [xfs]
[<ffffffff9e440cc3>] do_sync_read+0x93/0xe0
[<ffffffff9e4416ff>] vfs_read+0x9f/0x170
[<ffffffff9e4427b2>] SyS_pread64+0x92/0xc0
[<ffffffff9e975ddb>] system_call_fastpath+0x22/0x27
Code: 82 8c 00 00 00 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a <4c> 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f