Info

Permalink
Function
copy_user_generic_unrolled
First occurrence
2020-09-29
Last occurrence
2026-03-05
State
NEW
Components
kernel
Quality
-29

Statistics

Operating system Count
CentOS 7 207
Architecture Count
x86_64 207
Related packages Count
kernel 207
 0:3.10.0-1160.80.1.el7 58
 0:3.10.0-1160.el7 32
 0:3.10.0-1127.19.1.el7 26
 0:3.10.0-1062.12.1.el7 15
 0:3.10.0-1160.25.1.el7 11
 0:3.10.0-1160.76.1.el7 10
 0:3.10.0-1160.21.1.el7 7
 0:3.10.0-1160.66.1.el7 6
 0:3.10.0-1127.10.1.el7 5
 0:3.10.0-1160.71.1.el7 3
 0:3.10.0-1160.24.1.el7 3
 0:3.10.0-1160.15.2.el7 3
 0:3.10.0-1160.36.2.el7 3
 0:3.10.0-1160.49.1.el7 2
 0:3.10.0-1160.11.1.el7 2
 0:3.10.0-1160.108.1.el7 2
 0:3.10.0-1160.90.1.el7 2
 0:3.10.0-1160.31.1.el7 2
 0:3.10.0-1062.9.1.el7 2
 0:3.10.0-1160.119.1.el7 2
 0:3.10.0-1160.45.1.el7 1
 0:3.10.0-1160.53.1.el7 1
 0:3.10.0-1160.6.1.el7 1
 0:3.10.0-1127.8.2.el7 1
 0:3.10.0-1062.18.1.el7 1
 0:3.10.0-1160.102.1.el7 1
 0:3.10.0-1160.59.1.el7 1
 0:3.10.0-1160.83.1.el7 1
 0:3.10.0-1160.62.1.el7 1
 0:3.10.0-1160.99.1.el7 1
 0:3.10.0-1160.114.2.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #1401991
Frame # Function Binary Source or offset Line
1
copy_user_enhanced_fast_string
vmlinux 0xffffffff84f93d89
Build id: 3.10.0-1127.10.1.el7.x86_64
0x9
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff84dbdd45
Build id: 3.10.0-1127.10.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff84eba4c3
Build id: 3.10.0-1127.10.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff84eba3c0
Build id: 3.10.0-1127.10.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff84eba87a
Build id: 3.10.0-1127.10.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff84eba9c1
Build id: 3.10.0-1127.10.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff84eba3c0
Build id: 3.10.0-1127.10.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc01c77ed
Build id: 3.10.0-1127.10.1.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc01c7b0d
Build id: 3.10.0-1127.10.1.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffff84e4c6c3
Build id: 3.10.0-1127.10.1.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffff84e4d1b0
Build id: 3.10.0-1127.10.1.el7.x86_64
0xc0
12
SyS_pwrite64
vmlinux 0xffffffff84e4e142
Build id: 3.10.0-1127.10.1.el7.x86_64
0x92
13
system_call_fastpath
vmlinux 0xffffffff85392ed2
Build id: 3.10.0-1127.10.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [mysqld:9272]
Modules linked in: binfmt_misc drbg ansi_cprng cmac arc4 md4 nls_utf8 cifs ccm dns_resolver veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc cirrus ttm drm_kms_helper syscopyarea squashfs sysfillrect sysimgblt iosf_mbi crc32_pclmul
fb_sys_fops ghash_clmulni_intel aesni_intel drm loop drm_panel_orientation_quirks joydev virtio_balloon ppdev i2c_piix4 lrw sg gf128mul parport_pc parport glue_helper ablk_helper cryptd pcspkr ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_blk net_failover failover crct10dif_pclmul crct10dif_common ata_piix serio_raw libata crc32c_intel virtio_pci virtio_ring virtio floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 9272 Comm: mysqld Kdump: loaded Tainted: G             L ------------   3.10.0-1127.10.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
task: ffff8d8ce40562a0 ti: ffff8d8c50994000 task.ti: ffff8d8c50994000
RIP: 0010:[<ffffffff84f93d89>]  [<ffffffff84f93d89>] copy_user_enhanced_fast_string+0x9/0x20
RSP: 0018:ffff8d8c50997b30  EFLAGS: 00010206
RAX: 00007f8057d8ac00 RBX: ffff8d8c4ced9750 RCX: 0000000000000a00
RDX: 0000000000000a00 RSI: 00007f8057d8ac00 RDI: ffff8d8bfae70000
RBP: ffff8d8c50997b48 R08: 0000000000001000 R09: 0000000000000a00
R10: ffffe85144eb9c00 R11: 0000000000000000 R12: 0000000084dbe820
R13: ffff8d8c50997ac0 R14: ffff8d8b7a364290 R15: ffff8d8b7a364140
FS:  00007f80495a7700(0000) GS:ffff8d8cf9d80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f804364e000 CR3: 000000009e090000 CR4: 00000000001606e0
Call Trace:
[<ffffffff84dbdd45>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff84eba4c3>] iomap_write_actor+0x103/0x1f0
[<ffffffff84eba3c0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff84eba87a>] iomap_apply+0xba/0x160
[<ffffffff84eba9c1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff84eba3c0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc01c77ed>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc01c7b0d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff84e4c6c3>] do_sync_write+0x93/0xe0
[<ffffffff84e4d1b0>] vfs_write+0xc0/0x1f0
[<ffffffff84e4e142>] SyS_pwrite64+0x92/0xc0
[<ffffffff85392ed2>] system_call_fastpath+0x25/0x2a
Code: 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 c1 e9 03 83 e2 07 f3 48 a5 89 d1 f3 a4 31 c0 66 66 90 c3 0f 1f 00 66 66 90 21 d2 74 04 89 d1 <f3> a4 31 c0 66 66 90 c3 90 90 90 90 90 90 90 90 90 90 90 90 90 
Complete report #1192863
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff9b3ab941
Build id: 3.10.0-1160.119.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff9b1c86f5
Build id: 3.10.0-1160.119.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff9b2cb723
Build id: 3.10.0-1160.119.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff9b2cb620
Build id: 3.10.0-1160.119.1.el7.x86_64
0x1e0
5
iomap_apply
vmlinux 0xffffffff9b2cbada
Build id: 3.10.0-1160.119.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff9b2cbc21
Build id: 3.10.0-1160.119.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff9b2cb620
Build id: 3.10.0-1160.119.1.el7.x86_64
0x1e0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc04e1f3d
Build id: 3.10.0-1160.119.1.el7.x86_64
0x12d
9
? put_prev_entity
vmlinux 0xffffffff9b0ec651
Build id: 3.10.0-1160.119.1.el7.x86_64
0x31
10
xfs_file_aio_write
xfs 0xffffffffc04e226d
Build id: 3.10.0-1160.119.1.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffff9b25b2b3
Build id: 3.10.0-1160.119.1.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffff9b25bd80
Build id: 3.10.0-1160.119.1.el7.x86_64
0xc0
13
SyS_write
vmlinux 0xffffffff9b25cb35
Build id: 3.10.0-1160.119.1.el7.x86_64
0x55
14
system_call_fastpath
vmlinux 0xffffffff9b7c539a
Build id: 3.10.0-1160.119.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [kesl:1943]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink nls_utf8 cifs ccm dns_resolver vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw ppdev gf128mul glue_helper ablk_helper joydev sg cryptd pcspkr vmw_balloon parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c ata_generic sr_mod cdrom pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper ahci libahci nfit ata_piix syscopyarea crct10dif_pclmul libata libnvdimm sysfillrect floppy sysimgblt fb_sys_fops crct10dif_common ttm drm crc32c_intel
vmxnet3 serio_raw vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 1943 Comm: kesl Kdump: loaded Tainted: G             L ------------   3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9b5ef0fb2100 ti: ffff9b5eca1c4000 task.ti: ffff9b5eca1c4000
RIP: 0010:[<ffffffff9b3ab941>]  [<ffffffff9b3ab941>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff9b5eca1c7b38  EFLAGS: 00050202
RAX: 00007f52ab9de780 RBX: ffff9b6013734000 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 00007f52ab9de780 RDI: ffff9b5ec018b000
RBP: ffff9b5eca1c7b50 R08: a0e68e4277044903 R09: 00000000000000bb
R10: 4d6d41054903921d R11: 0000000000bba17f R12: ffff9b5eca1c7ac8
R13: ffff9b5835a31918 R14: ffff9b5835a317c8 R15: 0000000000000000
FS:  00007f52a7b42700(0000) GS:ffff9b603fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f55627f9000 CR3: 00000006f0c20000 CR4: 00000000007607f0
PKRU: 55555554
Call Trace:
[<ffffffff9b1c86f5>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff9b2cb723>] iomap_write_actor+0x103/0x1f0
[<ffffffff9b2cb620>] ? iomap_dirty_actor+0x1e0/0x1e0
[<ffffffff9b2cbada>] iomap_apply+0xba/0x160
[<ffffffff9b2cbc21>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff9b2cb620>] ? iomap_dirty_actor+0x1e0/0x1e0
[<ffffffffc04e1f3d>] xfs_file_buffered_aio_write+0x12d/0x2d0 [xfs]
[<ffffffff9b0ec651>] ? put_prev_entity+0x31/0x400
[<ffffffffc04e226d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff9b25b2b3>] do_sync_write+0x93/0xe0
[<ffffffff9b25bd80>] vfs_write+0xc0/0x1f0
[<ffffffff9b25cb35>] SyS_write+0x55/0xd0
[<ffffffff9b7c539a>] system_call_fastpath+0x25/0x2a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #1124063
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffb17ab941
Build id: 3.10.0-1160.119.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffffb15c86f5
Build id: 3.10.0-1160.119.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffffb16cb723
Build id: 3.10.0-1160.119.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffffb16cb620
Build id: 3.10.0-1160.119.1.el7.x86_64
0x1e0
5
iomap_apply
vmlinux 0xffffffffb16cbada
Build id: 3.10.0-1160.119.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffffb16cbc21
Build id: 3.10.0-1160.119.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffffb16cb620
Build id: 3.10.0-1160.119.1.el7.x86_64
0x1e0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc03d5f3d
Build id: 3.10.0-1160.119.1.el7.x86_64
0x12d
9
? xfs_iunlock
xfs 0xffffffffc03e2ebc
Build id: 3.10.0-1160.119.1.el7.x86_64
0x10c
10
xfs_file_aio_write
xfs 0xffffffffc03d626d
Build id: 3.10.0-1160.119.1.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffffb165b2b3
Build id: 3.10.0-1160.119.1.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffffb165bd80
Build id: 3.10.0-1160.119.1.el7.x86_64
0xc0
13
SyS_pwrite64
vmlinux 0xffffffffb165cd02
Build id: 3.10.0-1160.119.1.el7.x86_64
0x92
14
system_call_fastpath
vmlinux 0xffffffffb1bc539a
Build id: 3.10.0-1160.119.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 31s! [cpptools:88899]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr vmw_balloon joydev sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit drm libnvdimm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel libata mptspi scsi_transport_spi
e1000 mptscsih serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 88899 Comm: cpptools Kdump: loaded Tainted: G             L ------------   3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff881a8d6fc200 ti: ffff8817c280c000 task.ti: ffff8817c280c000
RIP: 0010:[<ffffffffb17ab941>]  [<ffffffffb17ab941>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff8817c280fb38  EFLAGS: 00050202
RAX: 00007fc097a61118 RBX: ffff8814ef87eb60 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 00007fc097a61118 RDI: ffff8814cf6c5000
RBP: ffff8817c280fb50 R08: 313474616b043503 R09: 6f72746e655f3533
R10: 013272706e697970 R11: 6b0435031bfb6143 R12: ffff8817c280fac8
R13: ffff8818b374a458 R14: ffff8818b374a308 R15: 0000000000000000
FS:  00007fc098185b30(0000) GS:ffff881ab5240000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc0979f3000 CR3: 0000000342812000 CR4: 00000000003607e0
Call Trace:
[<ffffffffb15c86f5>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffffb16cb723>] iomap_write_actor+0x103/0x1f0
[<ffffffffb16cb620>] ? iomap_dirty_actor+0x1e0/0x1e0
[<ffffffffb16cbada>] iomap_apply+0xba/0x160
[<ffffffffb16cbc21>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffffb16cb620>] ? iomap_dirty_actor+0x1e0/0x1e0
[<ffffffffc03d5f3d>] xfs_file_buffered_aio_write+0x12d/0x2d0 [xfs]
[<ffffffffc03e2ebc>] ? xfs_iunlock+0x10c/0x130 [xfs]
[<ffffffffc03d626d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffffb165b2b3>] do_sync_write+0x93/0xe0
[<ffffffffb165bd80>] vfs_write+0xc0/0x1f0
[<ffffffffb165cd02>] SyS_pwrite64+0x92/0xc0
[<ffffffffb1bc539a>] system_call_fastpath+0x25/0x2a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #1060037
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff83dab921
Build id: 3.10.0-1160.114.2.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff83bc86c5
Build id: 3.10.0-1160.114.2.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff83ccb6f3
Build id: 3.10.0-1160.114.2.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff83ccb5f0
Build id: 3.10.0-1160.114.2.el7.x86_64
0x1e0
5
iomap_apply
vmlinux 0xffffffff83ccbaaa
Build id: 3.10.0-1160.114.2.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff83ccbbf1
Build id: 3.10.0-1160.114.2.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff83ccb5f0
Build id: 3.10.0-1160.114.2.el7.x86_64
0x1e0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc0654f3d
Build id: 3.10.0-1160.114.2.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc065526d
Build id: 3.10.0-1160.114.2.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffff83c5b283
Build id: 3.10.0-1160.114.2.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffff83c5bd50
Build id: 3.10.0-1160.114.2.el7.x86_64
0xc0
12
SyS_write
vmlinux 0xffffffff83c5cb05
Build id: 3.10.0-1160.114.2.el7.x86_64
0x55
13
tracesys
vmlinux 0xffffffff841c562e
Build id: 3.10.0-1160.114.2.el7.x86_64
0xa6
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 24s! [cp:16111]
Modules linked in: vsock_diag unix_diag af_packet_diag netlink_diag udp_diag tcp_diag inet_diag xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg i2c_piix4 vmw_vmci parport_pc parport
binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod ata_piix nfit crc_t10dif drm crct10dif_generic libnvdimm libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 16111 Comm: cp Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-1160.114.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9d87f5ea0000 ti: ffff9d860f644000 task.ti: ffff9d860f644000
RIP: 0010:[<ffffffff83dab921>]  [<ffffffff83dab921>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff9d860f647b38  EFLAGS: 00010202
RAX: 000000000253a000 RBX: ffff9d88612fa680 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 000000000253a000 RDI: ffff9d889cfd5000
RBP: ffff9d860f647b50 R08: e0e93866b2846c23 R09: 459c961622e98f27
R10: f5fc3afbb9abe09a R11: 2858734c47a731dc R12: ffffffff00001000
R13: fffff64e8a73f540 R14: ffff9d861e5f4c88 R15: 0000000000000000
FS:  00007f1d00795840(0000) GS:ffff9d8a3fd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd491c35000 CR3: 00000002fe0e8000 CR4: 00000000001607e0
Call Trace:
[<ffffffff83bc86c5>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff83ccb6f3>] iomap_write_actor+0x103/0x1f0
[<ffffffff83ccb5f0>] ? iomap_dirty_actor+0x1e0/0x1e0
[<ffffffff83ccbaaa>] iomap_apply+0xba/0x160
[<ffffffff83ccbbf1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff83ccb5f0>] ? iomap_dirty_actor+0x1e0/0x1e0
[<ffffffffc0654f3d>] xfs_file_buffered_aio_write+0x12d/0x2d0 [xfs]
[<ffffffffc065526d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff83c5b283>] do_sync_write+0x93/0xe0
[<ffffffff83c5bd50>] vfs_write+0xc0/0x1f0
[<ffffffff83c5cb05>] SyS_write+0x55/0xd0
[<ffffffff841c562e>] tracesys+0xa6/0xcc
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #1050452
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff94593cc1
Build id: 3.10.0-1127.10.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff943bdd45
Build id: 3.10.0-1127.10.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff944ba4c3
Build id: 3.10.0-1127.10.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff944ba3c0
Build id: 3.10.0-1127.10.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff944ba87a
Build id: 3.10.0-1127.10.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff944ba9c1
Build id: 3.10.0-1127.10.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff944ba3c0
Build id: 3.10.0-1127.10.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc04d07ed
Build id: 3.10.0-1127.10.1.el7.x86_64
0x12d
9
? xfs_iunlock
xfs 0xffffffffc04dd35c
Build id: 3.10.0-1127.10.1.el7.x86_64
0xfc
10
xfs_file_aio_write
xfs 0xffffffffc04d0b0d
Build id: 3.10.0-1127.10.1.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffff9444c6c3
Build id: 3.10.0-1127.10.1.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffff9444d1b0
Build id: 3.10.0-1127.10.1.el7.x86_64
0xc0
13
SyS_write
vmlinux 0xffffffff9444df7f
Build id: 3.10.0-1127.10.1.el7.x86_64
0x7f
14
tracesys
vmlinux 0xffffffff94993166
Build id: 3.10.0-1127.10.1.el7.x86_64
0xa6
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 123s! [mysqld:9944]
Modules linked in: binfmt_misc veth xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw sg gf128mul vmw_balloon glue_helper ablk_helper cryptd pcspkr joydev parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c
sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi crct10dif_pclmul crct10dif_common ata_piix scsi_transport_spi drm mptscsih crc32c_intel libata serio_raw mptbase vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 9944 Comm: mysqld Kdump: loaded Tainted: G             L ------------ T 3.10.0-1127.10.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff9aceba9720e0 ti: ffff9ad0387d4000 task.ti: ffff9ad0387d4000
RIP: 0010:[<ffffffff94593cc1>]  [<ffffffff94593cc1>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff9ad0387d7b38  EFLAGS: 00010202
RAX: 00007f59383ddf20 RBX: ffff9acea3dbbaf8 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 00007f59383ddf20 RDI: ffff9aceae17a000
RBP: ffff9ad0387d7b50 R08: 3643300020363430 R09: 3343464632344145
R10: 4237423732303443 R11: 3734394434364245 R12: ffff9ad0387d7ac8
R13: ffff9ace1e7cfa90 R14: ffff9ace1e7cf940 R15: 0000000000000000
FS:  00007f59fc2da700(0000) GS:ffff9ad23fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9f94804410 CR3: 0000000394ffc000 CR4: 00000000001607f0
Call Trace:
[<ffffffff943bdd45>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff944ba4c3>] iomap_write_actor+0x103/0x1f0
[<ffffffff944ba3c0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff944ba87a>] iomap_apply+0xba/0x160
[<ffffffff944ba9c1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff944ba3c0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc04d07ed>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc04dd35c>] ? xfs_iunlock+0xfc/0x120 [xfs]
[<ffffffffc04d0b0d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff9444c6c3>] do_sync_write+0x93/0xe0
[<ffffffff9444d1b0>] vfs_write+0xc0/0x1f0
[<ffffffff9444df7f>] SyS_write+0x7f/0xf0
[<ffffffff94993166>] tracesys+0xa6/0xcc
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #995298
Frame # Function Binary Source or offset Line
1
copy_user_enhanced_fast_string
vmlinux 0xffffffff90d95629
Build id: 3.10.0-1160.71.1.el7.x86_64
0x9
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff90bbda85
Build id: 3.10.0-1160.71.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff90cbb7b3
Build id: 3.10.0-1160.71.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff90cbb6b0
Build id: 3.10.0-1160.71.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff90cbbb6a
Build id: 3.10.0-1160.71.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff90cbbcb1
Build id: 3.10.0-1160.71.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff90cbb6b0
Build id: 3.10.0-1160.71.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc064e7bd
Build id: 3.10.0-1160.71.1.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc064eadd
Build id: 3.10.0-1160.71.1.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffff90c4da43
Build id: 3.10.0-1160.71.1.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffff90c4e4d0
Build id: 3.10.0-1160.71.1.el7.x86_64
0xc0
12
SyS_write
vmlinux 0xffffffff90c4f255
Build id: 3.10.0-1160.71.1.el7.x86_64
0x55
13
system_call_fastpath
vmlinux 0xffffffff91199f92
Build id: 3.10.0-1160.71.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 30s! [l502.exe:3013]
Modules linked in: tcp_lp nls_utf8 isofs rfcomm xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bnep vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel snd_ens1371 ppdev snd_rawmidi snd_ac97_codec ac97_bus vmw_balloon snd_seq snd_seq_device btusb aesni_intel btrtl lrw gf128mul glue_helper btbcm btintel ablk_helper
cryptd snd_pcm bluetooth snd_timer snd joydev sg pcspkr soundcore rfkill vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit libnvdimm drm mptspi ata_piix crct10dif_pclmul crct10dif_common crc32c_intel libata scsi_transport_spi mptscsih serio_raw e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 3013 Comm: l502.exe Tainted: G             L ------------   3.10.0-1160.71.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9100f959d280 ti: ffff9107850c4000 task.ti: ffff9107850c4000
RIP: 0010:[<ffffffff90d95629>]  [<ffffffff90d95629>] copy_user_enhanced_fast_string+0x9/0x20
RSP: 0018:ffff9107850c7b38  EFLAGS: 00050206
RAX: 00002b565c92f0d8 RBX: ffff9100f4083750 RCX: 0000000000001000
RDX: 0000000000001000 RSI: 00002b565c92f0d8 RDI: ffff9100e8888000
RBP: ffff9107850c7b50 R08: 0000000000001000 R09: 0000000000001000
R10: ffffd791c2a22200 R11: 0000000000000000 R12: ffffffff00001000
R13: ffffd791c2a22200 R14: ffff9107818bdf08 R15: 0000000000000000
FS:  00002b56552fcac0(0000) GS:ffff9107d6800000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000005ffc030 CR3: 00000000bba64000 CR4: 0000000000360ff0
Call Trace:
[<ffffffff90bbda85>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff90cbb7b3>] iomap_write_actor+0x103/0x1f0
[<ffffffff90cbb6b0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff90cbbb6a>] iomap_apply+0xba/0x160
[<ffffffff90cbbcb1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff90cbb6b0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc064e7bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc064eadd>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff90c4da43>] do_sync_write+0x93/0xe0
[<ffffffff90c4e4d0>] vfs_write+0xc0/0x1f0
[<ffffffff90c4f255>] SyS_write+0x55/0xd0
[<ffffffff91199f92>] system_call_fastpath+0x25/0x2a
Code: 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 c1 e9 03 83 e2 07 f3 48 a5 89 d1 f3 a4 31 c0 0f 01 ca c3 0f 1f 00 0f 01 cb 21 d2 74 04 89 d1 <f3> a4 31 c0 0f 01 ca c3 90 90 90 90 90 90 90 90 90 90 90 90 90 
Complete report #828086
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffa07ab901
Build id: 3.10.0-1160.99.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffffa05c86a5
Build id: 3.10.0-1160.99.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffffa06cb6d3
Build id: 3.10.0-1160.99.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffffa06cb5d0
Build id: 3.10.0-1160.99.1.el7.x86_64
0x1e0
5
iomap_apply
vmlinux 0xffffffffa06cba8a
Build id: 3.10.0-1160.99.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffffa06cbbd1
Build id: 3.10.0-1160.99.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffffa06cb5d0
Build id: 3.10.0-1160.99.1.el7.x86_64
0x1e0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc0679f3d
Build id: 3.10.0-1160.99.1.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc067a26d
Build id: 3.10.0-1160.99.1.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffffa065b263
Build id: 3.10.0-1160.99.1.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffffa065bd30
Build id: 3.10.0-1160.99.1.el7.x86_64
0xc0
12
SyS_write
vmlinux 0xffffffffa065cae5
Build id: 3.10.0-1160.99.1.el7.x86_64
0x55
13
system_call_fastpath
vmlinux 0xffffffffa0bc539a
Build id: 3.10.0-1160.99.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [cmk-update-agen:32643]
Modules linked in: ip6table_filter ip6_tables ip_set_hash_net xt_set ip_set ipt_REJECT nf_reject_ipv4 xt_multiport iptable_filter nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg vmw_vmci i2c_piix4 parport_pc parport binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx crct10dif_pclmul crct10dif_common ata_piix crc32c_intel drm_kms_helper libata serio_raw syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm vmxnet3 vmw_pvscsi nfit drm_panel_orientation_quirks libnvdimm floppy dm_mirror dm_region_hash dm_log dm_mod
fuse
CPU: 0 PID: 32643 Comm: cmk-update-agen Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.99.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff8afd15f32100 ti: ffff8afd19b18000 task.ti: ffff8afd19b18000
RIP: 0010:[<ffffffffa07ab901>]  [<ffffffffa07ab901>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff8afd19b1bb38  EFLAGS: 00010202
RAX: 00007efdf4763010 RBX: ffff8afe142db208 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 00007efdf4763010 RDI: ffff8afd38487000
RBP: ffff8afd19b1bb50 R08: c318c4834810246c R09: 0000000000841f0f
R10: 48d6894808478b48 R11: fffcc828e818788b R12: ffffffff00001000
R13: ffffedfe00e121c0 R14: ffff8afd459c48c8 R15: 0000000000000000
FS:  00007efdf5b31740(0000) GS:ffff8afe7fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007efdf513f000 CR3: 000000002ae12000 CR4: 00000000001607f0
Call Trace:
[<ffffffffa05c86a5>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffffa06cb6d3>] iomap_write_actor+0x103/0x1f0
[<ffffffffa06cb5d0>] ? iomap_dirty_actor+0x1e0/0x1e0
[<ffffffffa06cba8a>] iomap_apply+0xba/0x160
[<ffffffffa06cbbd1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffffa06cb5d0>] ? iomap_dirty_actor+0x1e0/0x1e0
[<ffffffffc0679f3d>] xfs_file_buffered_aio_write+0x12d/0x2d0 [xfs]
[<ffffffffc067a26d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffffa065b263>] do_sync_write+0x93/0xe0
[<ffffffffa065bd30>] vfs_write+0xc0/0x1f0
[<ffffffffa065cae5>] SyS_write+0x55/0xd0
[<ffffffffa0bc539a>] system_call_fastpath+0x25/0x2a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #772231
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffb1595521
Build id: 3.10.0-1160.62.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffffb13bda35
Build id: 3.10.0-1160.62.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffffb14bb773
Build id: 3.10.0-1160.62.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffffb14bb670
Build id: 3.10.0-1160.62.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffffb14bbb2a
Build id: 3.10.0-1160.62.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffffb14bbc71
Build id: 3.10.0-1160.62.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffffb14bb670
Build id: 3.10.0-1160.62.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc058d7bd
Build id: 3.10.0-1160.62.1.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc058dadd
Build id: 3.10.0-1160.62.1.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffffb144da03
Build id: 3.10.0-1160.62.1.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffffb144e490
Build id: 3.10.0-1160.62.1.el7.x86_64
0xc0
12
SyS_write
vmlinux 0xffffffffb144f215
Build id: 3.10.0-1160.62.1.el7.x86_64
0x55
13
tracesys
vmlinux 0xffffffffb199a226
Build id: 3.10.0-1160.62.1.el7.x86_64
0xa6
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 28s! [prometheus:5986]
Modules linked in: veth xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event snd_ens1371 sb_edac snd_rawmidi snd_ac97_codec ac97_bus snd_seq iosf_mbi snd_seq_device crc32_pclmul snd_pcm joydev ghash_clmulni_intel aesni_intel snd_timer snd lrw gf128mul soundcore ppdev pcspkr vmw_balloon glue_helper sg ablk_helper cryptd parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common ata_piix syscopyarea sysfillrect sysimgblt crc32c_intel
fb_sys_fops ttm libata drm serio_raw e1000 nfit mptspi scsi_transport_spi mptscsih libnvdimm mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 5986 Comm: prometheus Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.62.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff8c974d7fa100 ti: ffff8c93f5ad0000 task.ti: ffff8c93f5ad0000
RIP: 0010:[<ffffffffb1595521>]  [<ffffffffb1595521>] copy_user_generic_unrolled+0x41/0xc0
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [CRTC:37:crtc-0] flip_done timed out
RSP: 0018:ffff8c93f5ad3b38  EFLAGS: 00010202
RAX: 000000c00b9b8ff8 RBX: ffff8c94912b11a0 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 000000c00b9b8ff8 RDI: ffff8c9465908000
RBP: ffff8c93f5ad3b50 R08: 0000000000000000 R09: 96000143f584ad98
R10: 454062b6f29bdae0 R11: 4e90000000000000 R12: ffffffff00001000
R13: ffffd1a404964200 R14: ffff8c93f1e96e08 R15: 0000000000000000
FS:  000000c000600890(0000) GS:ffff8c976d640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff4a126d000 CR3: 00000000bb1f8000 CR4: 00000000001607e0
Call Trace:
[<ffffffffb13bda35>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffffb14bb773>] iomap_write_actor+0x103/0x1f0
[<ffffffffb14bb670>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffb14bbb2a>] iomap_apply+0xba/0x160
[<ffffffffb14bbc71>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffffb14bb670>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc058d7bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc058dadd>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffffb144da03>] do_sync_write+0x93/0xe0
[<ffffffffb144e490>] vfs_write+0xc0/0x1f0
[<ffffffffb144f215>] SyS_write+0x55/0xd0
[<ffffffffb199a226>] tracesys+0xa6/0xcc
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #752966
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff9e995091
Build id: 3.10.0-1160.25.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff9e7bd7f5
Build id: 3.10.0-1160.25.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff9e8bb3b3
Build id: 3.10.0-1160.25.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff9e8bb2b0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff9e8bb76a
Build id: 3.10.0-1160.25.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff9e8bb8b1
Build id: 3.10.0-1160.25.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff9e8bb2b0
Build id: 3.10.0-1160.25.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc04e87bd
Build id: 3.10.0-1160.25.1.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc04e8add
Build id: 3.10.0-1160.25.1.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffff9e84d313
Build id: 3.10.0-1160.25.1.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffff9e84de00
Build id: 3.10.0-1160.25.1.el7.x86_64
0xc0
12
SyS_write
vmlinux 0xffffffff9e84ebdf
Build id: 3.10.0-1160.25.1.el7.x86_64
0x7f
13
ia32_do_call
vmlinux 0xffffffff9ed9a66e
Build id: 3.10.0-1160.25.1.el7.x86_64
0x4c
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [Mue_InUse:78071]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables mfe_fileaccess_100712495(OE) tun devlink bridge stp llc ip_set nfnetlink mfe_aac_100712495(OE) vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ext4 ghash_clmulni_intel mbcache jbd2 aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev sg vmw_balloon pcspkr joydev parport_pc parport vmw_vmci i2c_piix4
binfmt_misc xfs libcrc32c sr_mod cdrom vmwgfx ata_generic pata_acpi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops sd_mod ttm crc_t10dif crct10dif_generic ahci ata_piix drm libahci crct10dif_pclmul crct10dif_common nfit libata crc32c_intel serio_raw libnvdimm drm_panel_orientation_quirks vmw_pvscsi vmxnet3 dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: ip_tables]
CPU: 2 PID: 78071 Comm: Mue_InUse Tainted: G           OEL ------------   3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff93a4a4a5d280 ti: ffff93a3c46c8000 task.ti: ffff93a3c46c8000
RIP: 0010:[<ffffffff9e995091>]  [<ffffffff9e995091>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0000:ffff93a3c46cbb38  EFLAGS: 00050202
RAX: 00000000ff91069c RBX: ffff93a16bff9ea0 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 00000000ff91069c RDI: ffff93a0faae0000
RBP: ffff93a3c46cbb50 R08: 6c85592a111a24ba R09: 8ddc5c221ed47ad3
R10: 1e24b607ccfe8285 R11: c9a48b589b63a152 R12: ffff93a3c46cbac8
R13: ffff93a49f8a2bd8 R14: ffff93a49f8a2a88 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff93a4ed680000(0063) knlGS:00000000f6dc16c0
CS:  0010 DS: 002b ES: 002b CR0: 0000000080050033
CR2: 00000000f2ef6f5a CR3: 000000024f9f6000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffff9e7bd7f5>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff9e8bb3b3>] iomap_write_actor+0x103/0x1f0
[<ffffffff9e8bb2b0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff9e8bb76a>] iomap_apply+0xba/0x160
[<ffffffff9e8bb8b1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff9e8bb2b0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc04e87bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc04e8add>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff9e84d313>] do_sync_write+0x93/0xe0
[<ffffffff9e84de00>] vfs_write+0xc0/0x1f0
[<ffffffff9e84ebdf>] SyS_write+0x7f/0xf0
[<ffffffff9ed9a66e>] ia32_do_call+0x4c/0x4c
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #720735
Frame # Function Binary Source or offset Line
1
copy_user_enhanced_fast_string
vmlinux 0xffffffff91994ba9
Build id: 3.10.0-1160.el7.x86_64
0x9
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff917bd555
Build id: 3.10.0-1160.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff918baf73
Build id: 3.10.0-1160.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff918bae70
Build id: 3.10.0-1160.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff918bb32a
Build id: 3.10.0-1160.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff918bb471
Build id: 3.10.0-1160.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff918bae70
Build id: 3.10.0-1160.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc045f7bd
Build id: 3.10.0-1160.el7.x86_64
0x12d
9
? __mem_cgroup_commit_charge
vmlinux 0xffffffff9183e322
Build id: 3.10.0-1160.el7.x86_64
0xe2
10
xfs_file_aio_write
xfs 0xffffffffc045fadd
Build id: 3.10.0-1160.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffff9184d063
Build id: 3.10.0-1160.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffff9184db50
Build id: 3.10.0-1160.el7.x86_64
0xc0
13
SyS_pwrite64
vmlinux 0xffffffff9184eaf2
Build id: 3.10.0-1160.el7.x86_64
0x92
14
system_call_fastpath
vmlinux 0xffffffff91d93f92
Build id: 3.10.0-1160.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 40s! [mysqld:5070]
Modules linked in: binfmt_misc ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vmw_vmci vsock sunrpc snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel ppdev vmw_balloon aesni_intel lrw gf128mul snd_ens1371 glue_helper ablk_helper cryptd snd_rawmidi btusb snd_ac97_codec btrtl btbcm ac97_bus btintel snd_seq bluetooth joydev snd_seq_device pcspkr snd_pcm snd_timer rfkill sg
snd soundcore i2c_piix4 parport_pc parport sch_fq_codel ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm ata_piix mptspi e1000 scsi_transport_spi serio_raw mptscsih mptbase nfit libata drm_panel_orientation_quirks libnvdimm dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 5070 Comm: mysqld Kdump: loaded Not tainted 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff8d5bf53fc200 ti: ffff8d5be6a80000 task.ti: ffff8d5be6a80000
RIP: 0010:[<ffffffff91994ba9>]  [<ffffffff91994ba9>] copy_user_enhanced_fast_string+0x9/0x20
RSP: 0018:ffff8d5be6a83b30  EFLAGS: 00040206
RAX: 00002b93f198d000 RBX: ffff8d5cee4f2478 RCX: 0000000000001000
RDX: 0000000000001000 RSI: 00002b93f198d000 RDI: ffff8d5cebb84000
RBP: ffff8d5be6a83b48 R08: 0000000000001000 R09: 0000000000001000
R10: ffffe71fc5aee100 R11: 0000000000000000 R12: 0000000000001000
R13: ffffffff00001000 R14: ffffe71fc5aee100 R15: ffff8d5bdbf0d788
FS:  00002b93a7892700(0000) GS:ffff8d5db5680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00002b93f1a82000 CR3: 000000023405a000 CR4: 0000000000340fe0
Call Trace:
[<ffffffff917bd555>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff918baf73>] iomap_write_actor+0x103/0x1f0
[<ffffffff918bae70>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff918bb32a>] iomap_apply+0xba/0x160
[<ffffffff918bb471>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff918bae70>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc045f7bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffff9183e322>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffffc045fadd>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff9184d063>] do_sync_write+0x93/0xe0
[<ffffffff9184db50>] vfs_write+0xc0/0x1f0
[<ffffffff9184eaf2>] SyS_pwrite64+0x92/0xc0
[<ffffffff91d93f92>] system_call_fastpath+0x25/0x2a
Code: 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 c1 e9 03 83 e2 07 f3 48 a5 89 d1 f3 a4 31 c0 0f 01 ca c3 0f 1f 00 0f 01 cb 21 d2 74 04 89 d1 <f3> a4 31 c0 0f 01 ca c3 90 90 90 90 90 90 90 90 90 90 90 90 90 
Complete report #703574
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff97bab7b1
Build id: 3.10.0-1160.90.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff979c8635
Build id: 3.10.0-1160.90.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff97acb663
Build id: 3.10.0-1160.90.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff97acb560
Build id: 3.10.0-1160.90.1.el7.x86_64
0x1e0
5
iomap_apply
vmlinux 0xffffffff97acba1a
Build id: 3.10.0-1160.90.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff97acbb61
Build id: 3.10.0-1160.90.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff97acb560
Build id: 3.10.0-1160.90.1.el7.x86_64
0x1e0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc0693f3d
Build id: 3.10.0-1160.90.1.el7.x86_64
0x12d
9
? unlock_page
vmlinux 0xffffffff979c908b
Build id: 3.10.0-1160.90.1.el7.x86_64
0x2b
10
xfs_file_aio_write
xfs 0xffffffffc069426d
Build id: 3.10.0-1160.90.1.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffff97a5b1f3
Build id: 3.10.0-1160.90.1.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffff97a5bcc0
Build id: 3.10.0-1160.90.1.el7.x86_64
0xc0
13
SyS_write
vmlinux 0xffffffff97a5ca75
Build id: 3.10.0-1160.90.1.el7.x86_64
0x55
14
system_call_fastpath
vmlinux 0xffffffff97fc539a
Build id: 3.10.0-1160.90.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 27s! [redis-server:25366]
Modules linked in: binfmt_misc ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack bridge stp llc ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev snd_ens1371 aesni_intel snd_rawmidi snd_ac97_codec ac97_bus lrw gf128mul vmw_balloon glue_helper ablk_helper snd_seq cryptd snd_seq_device snd_pcm joydev pcspkr snd_timer sg snd soundcore
 vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi scsi_transport_spi nfit mptscsih ahci crct10dif_pclmul crct10dif_common mptbase e1000 libahci libnvdimm ata_piix crc32c_intel serio_raw libata drm_panel_orientation_quirks fuse
CPU: 0 PID: 25366 Comm: redis-server Kdump: loaded Not tainted 3.10.0-1160.90.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9e833a439080 ti: ffff9e8371ad4000 task.ti: ffff9e8371ad4000
RIP: 0010:[<ffffffff97bab7b1>]  [<ffffffff97bab7b1>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff9e8371ad7b38  EFLAGS: 00010202
RAX: 00007f99ecfa0000 RBX: ffff9e83636d1820 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 00007f99ecfa0000 RDI: ffff9e82f3186000
RBP: ffff9e8371ad7b50 R08: 7365640676602e73 R09: 7a60654070697263
R10: 20745c5c6e5c5c05 R11: 65726313833fe002 R12: ffffffff00001000
R13: fffff15604cc6180 R14: ffff9e8377e1c888 R15: 0000000000000000
FS:  00007f99ecf87780(0000) GS:ffff9e83f5600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f99d9ce6104 CR3: 00000001f3ada000 CR4: 00000000001607f0
Call Trace:
 [<ffffffff979c8635>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
 [<ffffffff97acb663>] iomap_write_actor+0x103/0x1f0
 [<ffffffff97acb560>] ? iomap_dirty_actor+0x1e0/0x1e0
 [<ffffffff97acba1a>] iomap_apply+0xba/0x160
 [<ffffffff97acbb61>] iomap_file_buffered_write+0xa1/0xe0
 [<ffffffff97acb560>] ? iomap_dirty_actor+0x1e0/0x1e0
 [<ffffffffc0693f3d>] xfs_file_buffered_aio_write+0x12d/0x2d0 [xfs]
 [<ffffffff979c908b>] ? unlock_page+0x2b/0x40
 [<ffffffffc069426d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
 [<ffffffff97a5b1f3>] do_sync_write+0x93/0xe0
 [<ffffffff97a5bcc0>] vfs_write+0xc0/0x1f0
 [<ffffffff97a5ca75>] SyS_write+0x55/0xd0
 [<ffffffff97fc539a>] system_call_fastpath+0x25/0x2a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #590611
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff949ab281
Build id: 3.10.0-1160.80.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff947c84d5
Build id: 3.10.0-1160.80.1.el7.x86_64
0x55
3
? iomap_write_actor
vmlinux 0xffffffff948cb133
Build id: 3.10.0-1160.80.1.el7.x86_64
0x103
4
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff947c84d5
Build id: 3.10.0-1160.80.1.el7.x86_64
0x55
5
? iomap_write_actor
vmlinux 0xffffffff948cb133
Build id: 3.10.0-1160.80.1.el7.x86_64
0x103
6
? iomap_dirty_actor
vmlinux 0xffffffff948cb030
Build id: 3.10.0-1160.80.1.el7.x86_64
0x1e0
7
? iomap_apply
vmlinux 0xffffffff948cb4ea
Build id: 3.10.0-1160.80.1.el7.x86_64
0xba
8
? iomap_file_buffered_write
vmlinux 0xffffffff948cb631
Build id: 3.10.0-1160.80.1.el7.x86_64
0xa1
9
? iomap_dirty_actor
vmlinux 0xffffffff948cb030
Build id: 3.10.0-1160.80.1.el7.x86_64
0x1e0
10
? xfs_file_buffered_aio_write
xfs 0xffffffffc03d2f3d
Build id: 3.10.0-1160.80.1.el7.x86_64
0x12d
11
? try_to_wake_up
vmlinux 0xffffffff946e0d42
Build id: 3.10.0-1160.80.1.el7.x86_64
0x192
12
? xfs_file_aio_write
xfs 0xffffffffc03d326d
Build id: 3.10.0-1160.80.1.el7.x86_64
0x18d
13
? do_sync_write
vmlinux 0xffffffff9485ae33
Build id: 3.10.0-1160.80.1.el7.x86_64
0x93
14
? vfs_write
vmlinux 0xffffffff9485b900
Build id: 3.10.0-1160.80.1.el7.x86_64
0xc0
15
? SyS_write
vmlinux 0xffffffff9485c6b5
Build id: 3.10.0-1160.80.1.el7.x86_64
0x55
16
? system_call_fastpath
vmlinux 0xffffffff94dc539a
Build id: 3.10.0-1160.80.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 735s! [wings:2827]
[<ffffffff949ab281>] copy_user_generic_unrolled+0x41/0xc0
[<ffffffff947c84d5>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff948cb133>] ? iomap_write_actor+0x103/0x1f0
[<ffffffff947c84d5>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff948cb133>] ? iomap_write_actor+0x103/0x1f0
[<ffffffff948cb030>] ? iomap_dirty_actor+0x1e0/0x1e0
[<ffffffff948cb4ea>] ? iomap_apply+0xba/0x160
[<ffffffff948cb631>] ? iomap_file_buffered_write+0xa1/0xe0
[<ffffffff948cb030>] ? iomap_dirty_actor+0x1e0/0x1e0
[<ffffffffc03d2f3d>] ? xfs_file_buffered_aio_write+0x12d/0x2d0 [xfs]
[<ffffffff946e0d42>] ? try_to_wake_up+0x192/0x3a0
[<ffffffffc03d326d>] ? xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff9485ae33>] ? do_sync_write+0x93/0xe0
[<ffffffff9485b900>] ? vfs_write+0xc0/0x1f0
[<ffffffff9485c6b5>] ? SyS_write+0x55/0xd0
[<ffffffff94dc539a>] ? system_call_fastpath+0x25/0x2a
Complete report #513196
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff90395541
Build id: 3.10.0-1160.76.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff901bda65
Build id: 3.10.0-1160.76.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff902bb793
Build id: 3.10.0-1160.76.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff902bb690
Build id: 3.10.0-1160.76.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff902bbb4a
Build id: 3.10.0-1160.76.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff902bbc91
Build id: 3.10.0-1160.76.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff902bb690
Build id: 3.10.0-1160.76.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc04d67bd
Build id: 3.10.0-1160.76.1.el7.x86_64
0x12d
9
? xfs_iunlock
xfs 0xffffffffc04e33ec
Build id: 3.10.0-1160.76.1.el7.x86_64
0xfc
10
xfs_file_aio_write
xfs 0xffffffffc04d6add
Build id: 3.10.0-1160.76.1.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffff9024da23
Build id: 3.10.0-1160.76.1.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffff9024e4b0
Build id: 3.10.0-1160.76.1.el7.x86_64
0xc0
13
SyS_write
vmlinux 0xffffffff9024f235
Build id: 3.10.0-1160.76.1.el7.x86_64
0x55
14
? system_call_after_swapgs
vmlinux 0xffffffff90799ed5
Build id: 3.10.0-1160.76.1.el7.x86_64
0xa2
15
system_call_fastpath
vmlinux 0xffffffff90799f92
Build id: 3.10.0-1160.76.1.el7.x86_64
0x25
16
? system_call_after_swapgs
vmlinux 0xffffffff90799ed5
Build id: 3.10.0-1160.76.1.el7.x86_64
0xa2
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [abrt-action-ins:14666]
<EOI> 
Modules linked in:
tcp_lp xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel ppdev snd_ens1371 snd_rawmidi vmw_balloon aesni_intel lrw gf128mul glue_helper snd_ac97_codec ablk_helper cryptd ac97_bus snd_seq snd_seq_device snd_pcm joydev
pcspkr snd_timer sg snd vmw_vmci i2c_piix4 soundcore parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt crct10dif_pclmul fb_sys_fops ttm crct10dif_common crc32c_intel drm ata_piix libata mptspi scsi_transport_spi nfit mptscsih serio_raw e1000 libnvdimm mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 14666 Comm: abrt-action-ins Kdump: loaded Not tainted 3.10.0-1160.76.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff93a67bfc0000 ti: ffff93a67c5b4000 task.ti: ffff93a67c5b4000
RIP: 0010:[<ffffffff90395541>]  [<ffffffff90395541>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff93a67c5b7b38  EFLAGS: 00010202
RAX: 000000000147d344 RBX: ffff93a7b93b2618 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 000000000147d344 RDI: ffff93a7b0d3f000
RBP: ffff93a67c5b7b50 R08: 001800060000000d R09: 04018001fc014702
R10: 0000000018008800 R11: 7b5d020552b4ba6c R12: ffffffff00001000
R13: ffffd26886c34fc0 R14: ffff93a7c621fd08 R15: 0000000000000000
FS:  00007fcdc2db2740(0000) GS:ffff93a835600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fcdc2ce8000 CR3: 000000007c680000 CR4: 00000000000607f0
Call Trace:
[<ffffffff901bda65>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff902bb793>] iomap_write_actor+0x103/0x1f0
[<ffffffff902bb690>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff902bbb4a>] iomap_apply+0xba/0x160
[<ffffffff902bbc91>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff902bb690>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc04d67bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc04e33ec>] ? xfs_iunlock+0xfc/0x120 [xfs]
[<ffffffffc04d6add>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff9024da23>] do_sync_write+0x93/0xe0
[<ffffffff9024e4b0>] vfs_write+0xc0/0x1f0
[<ffffffff9024f235>] SyS_write+0x55/0xd0
[<ffffffff90799ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff90799f92>] system_call_fastpath+0x25/0x2a
[<ffffffff90799ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #455891
Frame # Function Binary Source or offset Line
1
copy_user_enhanced_fast_string
vmlinux 0xffffffffa13955f9
Build id: 3.10.0-1160.66.1.el7.x86_64
0x9
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffffa11bda45
Build id: 3.10.0-1160.66.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffffa12bb783
Build id: 3.10.0-1160.66.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffffa12bb680
Build id: 3.10.0-1160.66.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffffa12bbb3a
Build id: 3.10.0-1160.66.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffffa12bbc81
Build id: 3.10.0-1160.66.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffffa12bb680
Build id: 3.10.0-1160.66.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc04bc7bd
Build id: 3.10.0-1160.66.1.el7.x86_64
0x12d
9
? xfs_iunlock
xfs 0xffffffffc04c93ac
Build id: 3.10.0-1160.66.1.el7.x86_64
0xfc
10
xfs_file_aio_write
xfs 0xffffffffc04bcadd
Build id: 3.10.0-1160.66.1.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffffa124da13
Build id: 3.10.0-1160.66.1.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffffa124e4a0
Build id: 3.10.0-1160.66.1.el7.x86_64
0xc0
13
SyS_write
vmlinux 0xffffffffa124f225
Build id: 3.10.0-1160.66.1.el7.x86_64
0x55
14
system_call_fastpath
vmlinux 0xffffffffa1799f92
Build id: 3.10.0-1160.66.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [yumBackend.py:30618]
Modules linked in: tcp_lp uinput xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink arc4 md4 nls_utf8 cifs ccm dns_resolver sunrpc ext4 mbcache snd_hda_codec_generic jbd2 snd_hda_intel snd_hda_codec snd_hda_core iosf_mbi snd_hwdep snd_seq crc32_pclmul ghash_clmulni_intel aesni_intel snd_seq_device snd_pcm snd_timer lrw snd soundcore i2c_piix4 ppdev gf128mul glue_helper ablk_helper cryptd parport_pc virtio_balloon parport joydev pcspkr ip_tables xfs libcrc32c qxl drm_kms_helper ata_generic syscopyarea sysfillrect pata_acpi sysimgblt fb_sys_fops ttm virtio_net ata_piix
virtio_console net_failover drm virtio_blk failover libata crct10dif_pclmul crct10dif_common serio_raw floppy virtio_pci crc32c_intel virtio_ring virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 6 PID: 30618 Comm: yumBackend.py Kdump: loaded Tainted: G             L ------------   3.10.0-1160.66.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
task: ffff8b22fd6f6300 ti: ffff8b20d7528000 task.ti: ffff8b20d7528000
RIP: 0010:[<ffffffffa13955f9>]  [<ffffffffa13955f9>] copy_user_enhanced_fast_string+0x9/0x20
RSP: 0018:ffff8b20d752bb38  EFLAGS: 00050206
RAX: 0000000003b81284 RBX: 0000000000001000 RCX: 0000000000001000
RDX: 0000000000001000 RSI: 0000000003b81284 RDI: ffff8b228dbe7000
RBP: ffff8b20d752bb50 R08: 0000000000001000 R09: 0000000000001000
R10: ffffe46a8b36f9c0 R11: 0000000000000000 R12: 0000000000001000
R13: 0000000000000000 R14: ffff8b1fc7c5bd48 R15: 00000000011ad000
FS:  00007f5541281740(0000) GS:ffff8b22ffd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000acb60006 CR3: 0000000119300000 CR4: 00000000003606e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa11bda45>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffffa12bb783>] iomap_write_actor+0x103/0x1f0
[<ffffffffa12bb680>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffa12bbb3a>] iomap_apply+0xba/0x160
[<ffffffffa12bbc81>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffffa12bb680>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc04bc7bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc04c93ac>] ? xfs_iunlock+0xfc/0x120 [xfs]
[<ffffffffc04bcadd>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffffa124da13>] do_sync_write+0x93/0xe0
[<ffffffffa124e4a0>] vfs_write+0xc0/0x1f0
[<ffffffffa124f225>] SyS_write+0x55/0xd0
[<ffffffffa1799f92>] system_call_fastpath+0x25/0x2a
Code: 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 c1 e9 03 83 e2 07 f3 48 a5 89 d1 f3 a4 31 c0 0f 01 ca c3 0f 1f 00 0f 01 cb 21 d2 74 04 89 d1 <f3> a4 31 c0 0f 01 ca c3 90 90 90 90 90 90 90 90 90 90 90 90 90 
Complete report #406289
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffb99951f1
Build id: 3.10.0-1160.31.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffffb97bd515
Build id: 3.10.0-1160.31.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffffb98bb3e3
Build id: 3.10.0-1160.31.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffffb98bb2e0
Build id: 3.10.0-1160.31.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffffb98bb79a
Build id: 3.10.0-1160.31.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffffb98bb8e1
Build id: 3.10.0-1160.31.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffffb98bb2e0
Build id: 3.10.0-1160.31.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc03427bd
Build id: 3.10.0-1160.31.1.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc0342add
Build id: 3.10.0-1160.31.1.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffffb984d593
Build id: 3.10.0-1160.31.1.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffffb984e080
Build id: 3.10.0-1160.31.1.el7.x86_64
0xc0
12
SyS_write
vmlinux 0xffffffffb984ee5f
Build id: 3.10.0-1160.31.1.el7.x86_64
0x7f
13
system_call_fastpath
vmlinux 0xffffffffb9d95f92
Build id: 3.10.0-1160.31.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [urlgrabber-ext-:3711]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter talpa_vfshook(OE) talpa_pedconnector(OE) talpa_pedevice(OE) talpa_vcdevice(OE) talpa_core(OE) talpa_linux(OE) talpa_syscallhook(OE) vboxdrv(OE) vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm
snd_timer iosf_mbi snd soundcore crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm serio_raw drm mptspi nfit scsi_transport_spi libnvdimm e1000 mptscsih ata_piix mptbase libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 3711 Comm: urlgrabber-ext- Kdump: loaded Tainted: G           OE  ------------   3.10.0-1160.31.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff8f11a5790000 ti: ffff8f119a414000 task.ti: ffff8f119a414000
RIP: 0010:[<ffffffffb99951f1>]  [<ffffffffb99951f1>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff8f119a417b38  EFLAGS: 00050202
RAX: 0000000001e02027 RBX: ffff8f127220bd68 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 0000000001e02027 RDI: ffff8f1241d0b000
RBP: ffff8f119a417b50 R08: 334c62fae36192a0 R09: b9d037c8d4a3e905
R10: 7c422f63c41992ed R11: 747ba501b2daa4d9 R12: ffffffff00001000
R13: ffffe274440742c0 R14: ffff8f1179dd97c8 R15: 0000000000000000
FS:  00007fe350279740(0000) GS:ffff8f1279600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000001e05008 CR3: 000000005237c000 CR4: 00000000003607f0
Call Trace:
[<ffffffffb97bd515>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffffb98bb3e3>] iomap_write_actor+0x103/0x1f0
[<ffffffffb98bb2e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffb98bb79a>] iomap_apply+0xba/0x160
[<ffffffffb98bb8e1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffffb98bb2e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc03427bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc0342add>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffffb984d593>] do_sync_write+0x93/0xe0
[<ffffffffb984e080>] vfs_write+0xc0/0x1f0
[<ffffffffb984ee5f>] SyS_write+0x7f/0xf0
[<ffffffffb9d95f92>] system_call_fastpath+0x25/0x2a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #382613
Frame # Function Binary Source or offset Line
1
copy_user_enhanced_fast_string
vmlinux 0xffffffff90d90419
Build id: 3.10.0-1062.9.1.el7.x86_64
0x9
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff90bbcf85
Build id: 3.10.0-1062.9.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff90cb6d83
Build id: 3.10.0-1062.9.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff90cb6c80
Build id: 3.10.0-1062.9.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff90cb713a
Build id: 3.10.0-1062.9.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff90cb7281
Build id: 3.10.0-1062.9.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff90cb6c80
Build id: 3.10.0-1062.9.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc069e3bd
Build id: 3.10.0-1062.9.1.el7.x86_64
0x12d
9
? try_to_wake_up
vmlinux 0xffffffff90adb200
Build id: 3.10.0-1062.9.1.el7.x86_64
0x190
10
xfs_file_aio_write
xfs 0xffffffffc069e6dd
Build id: 3.10.0-1062.9.1.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffff90c49d03
Build id: 3.10.0-1062.9.1.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffff90c4a7f0
Build id: 3.10.0-1062.9.1.el7.x86_64
0xc0
13
SyS_write
vmlinux 0xffffffff90c4b60f
Build id: 3.10.0-1062.9.1.el7.x86_64
0x7f
14
system_call_fastpath
vmlinux 0xffffffff9118dede
Build id: 3.10.0-1062.9.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#12 stuck for 26s! [influxd:4403]
Modules linked in: uinput binfmt_misc xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ppdev sg iosf_mbi crc32_pclmul virtio_rng ghash_clmulni_intel parport_pc i2c_piix4 parport aesni_intel pcspkr joydev nfsd nfs_acl lockd auth_rpcgss grace sunrpc ip_tables
xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif ata_generic pata_acpi virtio_net virtio_console virtio_scsi qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata crct10dif_pclmul virtio_pci virtio_ring floppy serio_raw virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log authenc cmac zlib wp512 twofish_generic twofish_avx_x86_64 twofish_x86_64_3way twofish_x86_64 twofish_common tea sha512_ssse3 sha512_generic serpent_avx2 serpent_avx_x86_64 serpent_sse2_x86_64 serpent_generic seed salsa20_generic salsa20_x86_64 rmd320 rmd256 rmd160 rmd128 michael_mic md4 khazad ghash_generic gcm fcrypt drbg dm_crypt dm_mod des_generic deflate cts crypto_null crct10dif_generic crct10dif_common crc32c_intel ccm cast6_avx_x86_64 cast6_generic cast_common camellia_generic
camellia_aesni_avx2 camellia_aesni_avx_x86_64 ablk_helper cryptd camellia_x86_64 xts lrw gf128mul glue_helper blowfish_generic blowfish_x86_64 blowfish_common arc4 ansi_cprng [last unloaded: tcrypt]
CPU: 12 PID: 4403 Comm: influxd Kdump: loaded Tainted: G             L ------------   3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: oVirt oVirt Node, BIOS 1.11.0-2.el7 04/01/2014
task: ffffa110f5c61070 ti: ffffa17f8f2f0000 task.ti: ffffa17f8f2f0000
RIP: 0010:[<ffffffff90d90419>]  [<ffffffff90d90419>] copy_user_enhanced_fast_string+0x9/0x20
RSP: 0018:ffffa17f8f2f3b38  EFLAGS: 00050206
RAX: 000000c00b23342f RBX: 0000000000001000 RCX: 0000000000001000
RDX: 0000000000001000 RSI: 000000c00b23342f RDI: ffffa125db8ef000
RBP: ffffa17f8f2f3b50 R08: 0000000000001000 R09: 0000000000001000
R10: ffffee1b546e3bc0 R11: 0000000000000000 R12: 0000000000001000
R13: 0000000000000000 R14: ffffa17f95973200 R15: 0000000000248000
FS:  00007f06257fa700(0000) GS:ffffa17fbd300000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000001655900c CR3: 0000006ee229e000 CR4: 00000000003606e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff90bbcf85>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff90cb6d83>] iomap_write_actor+0x103/0x1f0
[<ffffffff90cb6c80>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff90cb713a>] iomap_apply+0xba/0x160
[<ffffffff90cb7281>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff90cb6c80>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc069e3bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffff90adb200>] ? try_to_wake_up+0x190/0x390
[<ffffffffc069e6dd>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff90c49d03>] do_sync_write+0x93/0xe0
[<ffffffff90c4a7f0>] vfs_write+0xc0/0x1f0
[<ffffffff90c4b60f>] SyS_write+0x7f/0xf0
[<ffffffff9118dede>] system_call_fastpath+0x25/0x2a
Code: 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 c1 e9 03 83 e2 07 f3 48 a5 89 d1 f3 a4 31 c0 0f 01 ca c3 0f 1f 00 0f 01 cb 21 d2 74 04 89 d1 <f3> a4 31 c0 0f 01 ca c3 90 90 90 90 90 90 90 90 90 90 90 90 90 
Complete report #371936
Frame # Function Binary Source or offset Line
1
copy_user_enhanced_fast_string
vmlinux 0xffffffff81d957b9
Build id: 3.10.0-1160.36.2.el7.x86_64
0x9
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff81bbd9f5
Build id: 3.10.0-1160.36.2.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff81cbb8d3
Build id: 3.10.0-1160.36.2.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff81cbb7d0
Build id: 3.10.0-1160.36.2.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff81cbbc8a
Build id: 3.10.0-1160.36.2.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff81cbbdd1
Build id: 3.10.0-1160.36.2.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff81cbb7d0
Build id: 3.10.0-1160.36.2.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc05337bd
Build id: 3.10.0-1160.36.2.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc0533add
Build id: 3.10.0-1160.36.2.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffff81c4da53
Build id: 3.10.0-1160.36.2.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffff81c4e540
Build id: 3.10.0-1160.36.2.el7.x86_64
0xc0
12
SyS_write
vmlinux 0xffffffff81c4f31f
Build id: 3.10.0-1160.36.2.el7.x86_64
0x7f
13
tracesys
vmlinux 0xffffffff82196226
Build id: 3.10.0-1160.36.2.el7.x86_64
0xa6
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 21s! [scheduling-1:4323]
Modules linked in: tcp_lp rfcomm xt_nat veth nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bnep vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 crc32_pclmul ppdev ext4 snd_rawmidi mbcache ghash_clmulni_intel jbd2 snd_ac97_codec btusb ac97_bus btrtl btbcm snd_seq btintel
snd_seq_device bluetooth vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_pcm joydev pcspkr snd_timer rfkill sg snd soundcore i2c_piix4 vmw_vmci parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix crct10dif_pclmul crct10dif_common drm libata crc32c_intel nfit mptspi scsi_transport_spi serio_raw libnvdimm mptscsih e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 4323 Comm: scheduling-1 Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.36.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff90c5b681b180 ti: ffff90c5cf9e8000 task.ti: ffff90c5cf9e8000
RIP: 0010:[<ffffffff81d957b9>]  [<ffffffff81d957b9>] copy_user_enhanced_fast_string+0x9/0x20
RSP: 0018:ffff90c5cf9ebb38  EFLAGS: 00050206
RAX: 00007f31c41a8617 RBX: ffff90c7d82acb60 RCX: 0000000000001000
RDX: 0000000000001000 RSI: 00007f31c41a8617 RDI: ffff90c6f69cf000
RBP: ffff90c5cf9ebb50 R08: 0000000000001000 R09: 0000000000001000
R10: fffff2dfc6da73c0 R11: 0000000000000000 R12: ffffffff00001000
R13: fffff2dfc6da73c0 R14: ffff90c649c8d008 R15: 0000000000000000
FS:  00007f315f2f2700(0000) GS:ffff90c96d680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f32039ea420 CR3: 00000000b4b68000 CR4: 0000000000360fe0
Call Trace:
[<ffffffff81bbd9f5>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff81cbb8d3>] iomap_write_actor+0x103/0x1f0
[<ffffffff81cbb7d0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff81cbbc8a>] iomap_apply+0xba/0x160
[<ffffffff81cbbdd1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff81cbb7d0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc05337bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc0533add>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff81c4da53>] do_sync_write+0x93/0xe0
[<ffffffff81c4e540>] vfs_write+0xc0/0x1f0
[<ffffffff81c4f31f>] SyS_write+0x7f/0xf0
[<ffffffff82196226>] tracesys+0xa6/0xcc
Code: 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 c1 e9 03 83 e2 07 f3 48 a5 89 d1 f3 a4 31 c0 0f 01 ca c3 0f 1f 00 0f 01 cb 21 d2 74 04 89 d1 <f3> a4 31 c0 0f 01 ca c3 90 90 90 90 90 90 90 90 90 90 90 90 90 
Complete report #359449
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff8e394ae1
Build id: 3.10.0-1160.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff8e1bd555
Build id: 3.10.0-1160.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff8e2baf73
Build id: 3.10.0-1160.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff8e2bae70
Build id: 3.10.0-1160.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff8e2bb32a
Build id: 3.10.0-1160.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff8e2bb471
Build id: 3.10.0-1160.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff8e2bae70
Build id: 3.10.0-1160.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc04de7bd
Build id: 3.10.0-1160.el7.x86_64
0x12d
9
? __mem_cgroup_commit_charge
vmlinux 0xffffffff8e23e322
Build id: 3.10.0-1160.el7.x86_64
0xe2
10
xfs_file_aio_write
xfs 0xffffffffc04deadd
Build id: 3.10.0-1160.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffff8e24d063
Build id: 3.10.0-1160.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffff8e24db50
Build id: 3.10.0-1160.el7.x86_64
0xc0
13
SyS_write
vmlinux 0xffffffff8e24e92f
Build id: 3.10.0-1160.el7.x86_64
0x7f
14
system_call_fastpath
vmlinux 0xffffffff8e793f92
Build id: 3.10.0-1160.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [postgres:2452]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq iosf_mbi snd_seq_device crc32_pclmul snd_pcm ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd snd_timer snd joydev soundcore
pcspkr vmw_balloon sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops mptspi scsi_transport_spi mptscsih ata_piix ttm crct10dif_pclmul crct10dif_common drm crc32c_intel libata nfit serio_raw mptbase e1000 drm_panel_orientation_quirks libnvdimm dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 2452 Comm: postgres Kdump: loaded Not tainted 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff9c384f2f8000 ti: ffff9c3854604000 task.ti: ffff9c3854604000
RIP: 0010:[<ffffffff8e394ae1>]  [<ffffffff8e394ae1>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff9c3854607b38  EFLAGS: 00050202
RAX: 00007f57e4362000 RBX: ffff9c382df4caf8 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 00007f57e4362000 RDI: ffff9c38299e6000
RBP: ffff9c3854607b50 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: ffffffff00001000
R13: ffffd71a01a67980 R14: ffff9c37e5a8a308 R15: 0000000000000000
FS:  00007f57e434a740(0000) GS:ffff9c387a640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f57e4362000 CR3: 000000009307c000 CR4: 00000000003607e0
Call Trace:
[<ffffffff8e1bd555>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff8e2baf73>] iomap_write_actor+0x103/0x1f0
[<ffffffff8e2bae70>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff8e2bb32a>] iomap_apply+0xba/0x160
[<ffffffff8e2bb471>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff8e2bae70>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc04de7bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffff8e23e322>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffffc04deadd>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff8e24d063>] do_sync_write+0x93/0xe0
[<ffffffff8e24db50>] vfs_write+0xc0/0x1f0
[<ffffffff8e24e92f>] SyS_write+0x7f/0xf0
[<ffffffff8e793f92>] system_call_fastpath+0x25/0x2a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #240711
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffa15951f1
Build id: 3.10.0-1160.31.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffffa13bd515
Build id: 3.10.0-1160.31.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffffa14bb3e3
Build id: 3.10.0-1160.31.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffffa14bb2e0
Build id: 3.10.0-1160.31.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffffa14bb79a
Build id: 3.10.0-1160.31.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffffa14bb8e1
Build id: 3.10.0-1160.31.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffffa14bb2e0
Build id: 3.10.0-1160.31.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc03247bd
Build id: 3.10.0-1160.31.1.el7.x86_64
0x12d
9
? __mem_cgroup_commit_charge
vmlinux 0xffffffffa143e802
Build id: 3.10.0-1160.31.1.el7.x86_64
0xe2
10
xfs_file_aio_write
xfs 0xffffffffc0324add
Build id: 3.10.0-1160.31.1.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffffa144d593
Build id: 3.10.0-1160.31.1.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffffa144e080
Build id: 3.10.0-1160.31.1.el7.x86_64
0xc0
13
? system_call_after_swapgs
vmlinux 0xffffffffa1995ed5
Build id: 3.10.0-1160.31.1.el7.x86_64
0xa2
14
SyS_write
vmlinux 0xffffffffa144ee5f
Build id: 3.10.0-1160.31.1.el7.x86_64
0x7f
15
system_call_fastpath
vmlinux 0xffffffffa1995f92
Build id: 3.10.0-1160.31.1.el7.x86_64
0x25
16
? system_call_after_swapgs
vmlinux 0xffffffffa1995ed5
Build id: 3.10.0-1160.31.1.el7.x86_64
0xa2
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 27s! [wdavdaemon:3831]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables vsock_diag tcp_diag udp_diag inet_diag unix_diag tun devlink bridge stp llc ip_set vmw_vsock_vmci_transport vsock iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 nfsd nfs_acl lockd grace auth_rpcgss
sunrpc xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops serio_raw ttm vmxnet3 mptspi drm ata_piix scsi_transport_spi mptscsih nfit mptbase libata libnvdimm drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: ip_tables]
CPU: 1 PID: 3831 Comm: wdavdaemon Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.31.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9df23631a100 ti: ffff9df4d6dbc000 task.ti: ffff9df4d6dbc000
RIP: 0010:[<ffffffffa15951f1>]  [<ffffffffa15951f1>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff9df4d6dbfb38  EFLAGS: 00010202
RAX: 000055c3be9d4f9c RBX: ffff9df1723c2d00 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 000055c3be9d4f9c RDI: ffff9df3957c7000
RBP: ffff9df4d6dbfb50 R08: 5a9e21facedcec0f R09: 3d6d2e2d1af69270
R10: 1cfd890b16890957 R11: 6fd25679b71fc85b R12: ffffffff00001000
R13: ffffe90e4b55f1c0 R14: ffff9df1f35b3d48 R15: 0000000000000000
FS:  00007fa803c01700(0000) GS:ffff9df4ffc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa812d3c000 CR3: 000000041b7be000 CR4: 00000000000407e0
Call Trace:
[<ffffffffa13bd515>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffffa14bb3e3>] iomap_write_actor+0x103/0x1f0
[<ffffffffa14bb2e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffa14bb79a>] iomap_apply+0xba/0x160
[<ffffffffa14bb8e1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffffa14bb2e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc03247bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffa143e802>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffffc0324add>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffffa144d593>] do_sync_write+0x93/0xe0
[<ffffffffa144e080>] vfs_write+0xc0/0x1f0
[<ffffffffa1995ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffffa144ee5f>] SyS_write+0x7f/0xf0
[<ffffffffa1995f92>] system_call_fastpath+0x25/0x2a
[<ffffffffa1995ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #195102
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff84394fc1
Build id: 3.10.0-1160.15.2.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff841bd745
Build id: 3.10.0-1160.15.2.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff842bb2e3
Build id: 3.10.0-1160.15.2.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff842bb1e0
Build id: 3.10.0-1160.15.2.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff842bb69a
Build id: 3.10.0-1160.15.2.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff842bb7e1
Build id: 3.10.0-1160.15.2.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff842bb1e0
Build id: 3.10.0-1160.15.2.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc054e7bd
Build id: 3.10.0-1160.15.2.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc054eadd
Build id: 3.10.0-1160.15.2.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffff8424d243
Build id: 3.10.0-1160.15.2.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffff8424dd30
Build id: 3.10.0-1160.15.2.el7.x86_64
0xc0
12
SyS_pwrite64
vmlinux 0xffffffff8424ecd2
Build id: 3.10.0-1160.15.2.el7.x86_64
0x92
13
system_call_fastpath
vmlinux 0xffffffff84794f92
Build id: 3.10.0-1160.15.2.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 37s! [ora_dbw0_xe:2355]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon sg pcspkr joydev parport_pc parport vmw_vmci i2c_piix4 binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx
drm_kms_helper syscopyarea sysfillrect nfit sysimgblt fb_sys_fops ttm drm libnvdimm e1000e ahci ata_piix libahci sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw ptp pps_core vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 2355 Comm: ora_dbw0_xe Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9e87f5fcb180 ti: ffff9e87362a0000 task.ti: ffff9e87362a0000
RIP: 0010:[<ffffffff84394fc1>]  [<ffffffff84394fc1>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff9e87362a3b30  EFLAGS: 00050202
RAX: 000000006c7a7000 RBX: ffff9e87735d28f0 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 000000006c7a7000 RDI: ffff9e8715a28000
RBP: ffff9e87362a3b48 R08: 2020202020202020 R09: 6520202020202020
R10: 200a3b666920646e R11: 2020202020202020 R12: 00000000841be220
R13: ffff9e87362a3ac0 R14: ffff9e8766f43718 R15: ffff9e8766f435c8
FS:  00007fba0f817980(0000) GS:ffff9e87ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00001df1a1344010 CR3: 0000000130944000 CR4: 00000000007607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffff841bd745>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff842bb2e3>] iomap_write_actor+0x103/0x1f0
[<ffffffff842bb1e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff842bb69a>] iomap_apply+0xba/0x160
[<ffffffff842bb7e1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff842bb1e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc054e7bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc054eadd>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff8424d243>] do_sync_write+0x93/0xe0
[<ffffffff8424dd30>] vfs_write+0xc0/0x1f0
[<ffffffff8424ecd2>] SyS_pwrite64+0x92/0xc0
[<ffffffff84794f92>] system_call_fastpath+0x25/0x2a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #186796
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff90d94ae1
Build id: 3.10.0-1160.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff90bbd555
Build id: 3.10.0-1160.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff90cbaf73
Build id: 3.10.0-1160.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff90cbae70
Build id: 3.10.0-1160.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff90cbb32a
Build id: 3.10.0-1160.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff90cbb471
Build id: 3.10.0-1160.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff90cbae70
Build id: 3.10.0-1160.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc06217bd
Build id: 3.10.0-1160.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc0621add
Build id: 3.10.0-1160.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffff90c4d063
Build id: 3.10.0-1160.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffff90c4db50
Build id: 3.10.0-1160.el7.x86_64
0xc0
12
SyS_pwrite64
vmlinux 0xffffffff90c4eaf2
Build id: 3.10.0-1160.el7.x86_64
0x92
13
? system_call_after_swapgs
vmlinux 0xffffffff91193ec9
Build id: 3.10.0-1160.el7.x86_64
0x96
14
system_call_fastpath
vmlinux 0xffffffff91193f92
Build id: 3.10.0-1160.el7.x86_64
0x25
15
? system_call_after_swapgs
vmlinux 0xffffffff91193ed5
Build id: 3.10.0-1160.el7.x86_64
0xa2
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 25s! [oracle:17177]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper pcspkr cryptd joydev sg parport_pc vmw_vmci parport i2c_piix4 binfmt_misc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif
crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi crct10dif_pclmul crct10dif_common libata scsi_transport_spi crc32c_intel serio_raw mptscsih vmxnet3 mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 4 PID: 17177 Comm: oracle Kdump: loaded Not tainted 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/30/2013
task: ffff9ff6fb768000 ti: ffff9ff81a0d0000 task.ti: ffff9ff81a0d0000
RIP: 0010:[<ffffffff90d94ae1>]  [<ffffffff90d94ae1>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff9ff81a0d3b30  EFLAGS: 00010202
RAX: 00007f0871fb3000 RBX: ffff9ff0f1e101a0 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 00007f0871fb3000 RDI: ffff9ff08fa3c000
RBP: ffff9ff81a0d3b48 R08: 0008feab0000a200 R09: 0501000000000000
R10: 00000000000059a3 R11: 0000000000000000 R12: 0000000000001000
R13: ffffffff00001000 R14: fffff20d143e8f00 R15: ffff9ff66ab662c8
FS:  00007f0875cec740(0000) GS:ffff9ff115000000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f087205c000 CR3: 000000016eb9a000 CR4: 00000000000407e0
Call Trace:
[<ffffffff90bbd555>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff90cbaf73>] iomap_write_actor+0x103/0x1f0
[<ffffffff90cbae70>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff90cbb32a>] iomap_apply+0xba/0x160
[<ffffffff90cbb471>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff90cbae70>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc06217bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc0621add>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff90c4d063>] do_sync_write+0x93/0xe0
[<ffffffff90c4db50>] vfs_write+0xc0/0x1f0
[<ffffffff90c4eaf2>] SyS_pwrite64+0x92/0xc0
[<ffffffff91193ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff91193f92>] system_call_fastpath+0x25/0x2a
[<ffffffff91193ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #184122
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffbc994ae1
Build id: 3.10.0-1160.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffffbc7bd555
Build id: 3.10.0-1160.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffffbc8baf73
Build id: 3.10.0-1160.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffffbc8bae70
Build id: 3.10.0-1160.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffffbc8bb32a
Build id: 3.10.0-1160.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffffbc8bb471
Build id: 3.10.0-1160.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffffbc8bae70
Build id: 3.10.0-1160.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc064e7bd
Build id: 3.10.0-1160.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc064eadd
Build id: 3.10.0-1160.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffffbc84d063
Build id: 3.10.0-1160.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffffbc84db50
Build id: 3.10.0-1160.el7.x86_64
0xc0
12
? system_call_after_swapgs
vmlinux 0xffffffffbcd93ed5
Build id: 3.10.0-1160.el7.x86_64
0xa2
13
SyS_write
vmlinux 0xffffffffbc84e92f
Build id: 3.10.0-1160.el7.x86_64
0x7f
14
? system_call_after_swapgs
vmlinux 0xffffffffbcd93ed5
Build id: 3.10.0-1160.el7.x86_64
0xa2
15
system_call_fastpath
vmlinux 0xffffffffbcd93f92
Build id: 3.10.0-1160.el7.x86_64
0x25
16
? system_call_after_swapgs
vmlinux 0xffffffffbcd93ed5
Build id: 3.10.0-1160.el7.x86_64
0xa2
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [build-locale-ar:59740]
Modules linked in: tcp_lp nls_utf8 isofs xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd iosf_mbi crc32_pclmul ppdev soundcore ghash_clmulni_intel pcspkr
cryptd joydev sg vmw_balloon parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit mptspi scsi_transport_spi crct10dif_pclmul crct10dif_common ata_piix libnvdimm mptscsih crc32c_intel drm e1000 libata mptbase serio_raw drm_panel_orientation_quirks fuse
CPU: 0 PID: 59740 Comm: build-locale-ar Tainted: G             L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff91bf2f3b4200 ti: ffff91bf300d0000 task.ti: ffff91bf300d0000
RIP: 0010:[<ffffffffbc994ae1>]  [<ffffffffbc994ae1>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff91bf300d3b38  EFLAGS: 00010202
RAX: 00007fba36993000 RBX: ffff91be8abcb820 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 00007fba36993000 RDI: ffff91bf21364000
RBP: ffff91bf300d3b50 R08: 0000000000000000 R09: 0000000000000000
R10: 000009a60000099f R11: 0000000000000000 R12: ffffffff00001000
R13: ffffda0c4484d900 R14: ffff91be3fe1f948 R15: 0000000000000000
FS:  00000000022b9880(0063) GS:ffff91bf39600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fba14f796c4 CR3: 00000000618c0000 CR4: 00000000000607f0
Call Trace:
[<ffffffffbc7bd555>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffffbc8baf73>] iomap_write_actor+0x103/0x1f0
[<ffffffffbc8bae70>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffbc8bb32a>] iomap_apply+0xba/0x160
[<ffffffffbc8bb471>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffffbc8bae70>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc064e7bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc064eadd>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffffbc84d063>] do_sync_write+0x93/0xe0
[<ffffffffbc84db50>] vfs_write+0xc0/0x1f0
[<ffffffffbcd93ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffffbc84e92f>] SyS_write+0x7f/0xf0
[<ffffffffbcd93ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffffbcd93f92>] system_call_fastpath+0x25/0x2a
[<ffffffffbcd93ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #142902
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff8bd93d01
Build id: 3.10.0-1127.19.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff8bbbdd95
Build id: 3.10.0-1127.19.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff8bcba4e3
Build id: 3.10.0-1127.19.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff8bcba3e0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff8bcba89a
Build id: 3.10.0-1127.19.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff8bcba9e1
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff8bcba3e0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc045b7ed
Build id: 3.10.0-1127.19.1.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc045bb0d
Build id: 3.10.0-1127.19.1.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffff8bc4c713
Build id: 3.10.0-1127.19.1.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffff8bc4d200
Build id: 3.10.0-1127.19.1.el7.x86_64
0xc0
12
? vfs_write
vmlinux 0xffffffff8bc4d2c2
Build id: 3.10.0-1127.19.1.el7.x86_64
0x182
13
SyS_pwrite64
vmlinux 0xffffffff8bc4e192
Build id: 3.10.0-1127.19.1.el7.x86_64
0x92
14
system_call_fastpath
vmlinux 0xffffffff8c192ed2
Build id: 3.10.0-1127.19.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [ora_lg00_xe:1891]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr joydev vmxnet3 vmw_balloon sg vmw_vmci parport_pc parport i2c_piix4 binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper ata_piix syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw
drm libata vmw_pvscsi drm_panel_orientation_quirks nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 1891 Comm: ora_lg00_xe Kdump: loaded Tainted: G             L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff996fe636a0e0 ti: ffff996daeb34000 task.ti: ffff996daeb34000
RIP: 0010:[<ffffffff8bd93d01>]  [<ffffffff8bd93d01>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff996daeb37b30  EFLAGS: 00010202
RAX: 00000000e0169200 RBX: ffff996d4cf6b410 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 00000000e0169200 RDI: ffff996f9df6f000
RBP: ffff996daeb37b48 R08: 000a221000002201 R09: 23b680700000001f
R10: 00418f2800400260 R11: 0000000000000009 R12: 000000008bbbe870
R13: ffff996daeb37ac0 R14: ffff996db8e39550 R15: ffff996db8e39400
FS:  00007fb59a3edf40(0000) GS:ffff99703fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fcf148e5e50 CR3: 00000000aeb76000 CR4: 00000000001607f0
Call Trace:
[<ffffffff8bbbdd95>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff8bcba4e3>] iomap_write_actor+0x103/0x1f0
[<ffffffff8bcba3e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff8bcba89a>] iomap_apply+0xba/0x160
[<ffffffff8bcba9e1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff8bcba3e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc045b7ed>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc045bb0d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff8bc4c713>] do_sync_write+0x93/0xe0
[<ffffffff8bc4d200>] vfs_write+0xc0/0x1f0
[<ffffffff8bc4d2c2>] ? vfs_write+0x182/0x1f0
[<ffffffff8bc4e192>] SyS_pwrite64+0x92/0xc0
[<ffffffff8c192ed2>] system_call_fastpath+0x25/0x2a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #136564
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffbad93d01
Build id: 3.10.0-1127.19.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffffbabbdd95
Build id: 3.10.0-1127.19.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffffbacba4e3
Build id: 3.10.0-1127.19.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffffbacba3e0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffffbacba89a
Build id: 3.10.0-1127.19.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffffbacba9e1
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffffbacba3e0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc02fb7ed
Build id: 3.10.0-1127.19.1.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc02fbb0d
Build id: 3.10.0-1127.19.1.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffffbac4c713
Build id: 3.10.0-1127.19.1.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffffbac4d200
Build id: 3.10.0-1127.19.1.el7.x86_64
0xc0
12
SyS_pwrite64
vmlinux 0xffffffffbac4e192
Build id: 3.10.0-1127.19.1.el7.x86_64
0x92
13
system_call_fastpath
vmlinux 0xffffffffbb192ed2
Build id: 3.10.0-1127.19.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 24s! [ora_lgwr_xe:1933]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev joydev vmw_balloon pcspkr sg vmxnet3 parport_pc parport i2c_piix4 vmw_vmci binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sd_mod crc_t10dif nfit sysimgblt fb_sys_fops crct10dif_generic ttm libnvdimm ata_piix libata drm crct10dif_pclmul crct10dif_common
crc32c_intel serio_raw vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 1933 Comm: ora_lgwr_xe Kdump: loaded Tainted: G             L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff9f48af07e2a0 ti: ffff9f4838250000 task.ti: ffff9f4838250000
RIP: 0010:[<ffffffffbad93d01>]  [<ffffffffbad93d01>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff9f4838253b30  EFLAGS: 00010202
RAX: 00000000e03ad000 RBX: ffff9f47d776ddd0 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 00000000e03ad000 RDI: ffff9f47ce085000
RBP: ffff9f4838253b48 R08: 000a81e000002201 R09: 3b79802800000007
R10: 0100096000000408 R11: 0000400100010154 R12: 0000000000000000
R13: ffffffffbabbf1dc R14: ffff9f4838253ac0 R15: ffff9f4637041b80
FS:  00007f4b1c95cf40(0000) GS:ffff9f48bfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f228cc84e98 CR3: 00000002b8276000 CR4: 00000000001607f0
Call Trace:
[<ffffffffbabbdd95>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffffbacba4e3>] iomap_write_actor+0x103/0x1f0
[<ffffffffbacba3e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffbacba89a>] iomap_apply+0xba/0x160
[<ffffffffbacba9e1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffffbacba3e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc02fb7ed>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc02fbb0d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffffbac4c713>] do_sync_write+0x93/0xe0
[<ffffffffbac4d200>] vfs_write+0xc0/0x1f0
[<ffffffffbac4e192>] SyS_pwrite64+0x92/0xc0
[<ffffffffbb192ed2>] system_call_fastpath+0x25/0x2a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #66855
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff9df94fc1
Build id: 3.10.0-1160.15.2.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff9ddbd745
Build id: 3.10.0-1160.15.2.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff9debb2e3
Build id: 3.10.0-1160.15.2.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff9debb1e0
Build id: 3.10.0-1160.15.2.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff9debb69a
Build id: 3.10.0-1160.15.2.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff9debb7e1
Build id: 3.10.0-1160.15.2.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff9debb1e0
Build id: 3.10.0-1160.15.2.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc04587bd
Build id: 3.10.0-1160.15.2.el7.x86_64
0x12d
9
xfs_file_aio_write
xfs 0xffffffffc0458add
Build id: 3.10.0-1160.15.2.el7.x86_64
0x18d
10
do_sync_write
vmlinux 0xffffffff9de4d243
Build id: 3.10.0-1160.15.2.el7.x86_64
0x93
11
vfs_write
vmlinux 0xffffffff9de4dd30
Build id: 3.10.0-1160.15.2.el7.x86_64
0xc0
12
SyS_write
vmlinux 0xffffffff9de4eb0f
Build id: 3.10.0-1160.15.2.el7.x86_64
0x7f
13
system_call_fastpath
vmlinux 0xffffffff9e394f92
Build id: 3.10.0-1160.15.2.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#9 stuck for 43s! [virtuoso:3866]
Modules linked in: tcp_lp rfcomm xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle vmw_vsock_vmci_transport vsock iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter fuse bnep sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi kvm_intel kvm irqbypass snd_ens1371 crc32_pclmul snd_rawmidi btusb snd_ac97_codec ghash_clmulni_intel btrtl btbcm ac97_bus btintel ppdev snd_seq bluetooth vmw_balloon aesni_intel lrw
gf128mul snd_seq_device glue_helper ablk_helper cryptd snd_pcm rfkill joydev snd_timer sg snd pcspkr vmw_vmci soundcore i2c_piix4 parport_pc parport binfmt_misc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect nfit sysimgblt fb_sys_fops ttm ata_piix libnvdimm crct10dif_pclmul crct10dif_common crc32c_intel libata drm mptspi scsi_transport_spi e1000 mptscsih serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 9 PID: 3866 Comm: virtuoso Kdump: loaded Not tainted 3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff98b2fb69e300 ti: ffff98b30187c000 task.ti: ffff98b30187c000
RIP: 0010:[<ffffffff9df94fc1>]  [<ffffffff9df94fc1>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff98b30187fb38  EFLAGS: 00050202
RAX: 00007f76ca51a000 RBX: ffff98b32fdf1548 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 00007f76ca51a000 RDI: ffff98b3048c4000
RBP: ffff98b30187fb50 R08: 616e612a2c353938 R09: 725f62694c676f6c
R10: 74636570735f7365 R11: 697365722a2c6572 R12: ffffffff00001000
R13: fffff8064a123100 R14: ffff98b2c3d071c8 R15: 0000000000000000
FS:  00007f76ca51bd40(0000) GS:ffff98b333840000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f76ca518000 CR3: 000000017ab94000 CR4: 00000000003607e0
Call Trace:
[<ffffffff9ddbd745>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff9debb2e3>] iomap_write_actor+0x103/0x1f0
[<ffffffff9debb1e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff9debb69a>] iomap_apply+0xba/0x160
[<ffffffff9debb7e1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff9debb1e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc04587bd>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc0458add>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff9de4d243>] do_sync_write+0x93/0xe0
[<ffffffff9de4dd30>] vfs_write+0xc0/0x1f0
[<ffffffff9de4eb0f>] SyS_write+0x7f/0xf0
[<ffffffff9e394f92>] system_call_fastpath+0x25/0x2a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #19961
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff9d393d1c
Build id: 3.10.0-1127.19.1.el7.x86_64
0x5c
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff9d1bdd95
Build id: 3.10.0-1127.19.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff9d2ba4e3
Build id: 3.10.0-1127.19.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff9d2ba3e0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff9d2ba89a
Build id: 3.10.0-1127.19.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff9d2ba9e1
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff9d2ba3e0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc04827ed
Build id: 3.10.0-1127.19.1.el7.x86_64
0x12d
9
? xfs_iunlock
xfs 0xffffffffc048f35c
Build id: 3.10.0-1127.19.1.el7.x86_64
0xfc
10
xfs_file_aio_write
xfs 0xffffffffc0482b0d
Build id: 3.10.0-1127.19.1.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffff9d24c713
Build id: 3.10.0-1127.19.1.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffff9d24d200
Build id: 3.10.0-1127.19.1.el7.x86_64
0xc0
13
? vfs_read
vmlinux 0xffffffff9d24d0c8
Build id: 3.10.0-1127.19.1.el7.x86_64
0xf8
14
SyS_write
vmlinux 0xffffffff9d24dfcf
Build id: 3.10.0-1127.19.1.el7.x86_64
0x7f
15
system_call_fastpath
vmlinux 0xffffffff9d792ed2
Build id: 3.10.0-1127.19.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 40s! [mysqld:3674]
Modules linked in: nf_conntrack_netbios_ns nf_conntrack_broadcast nf_log_ipv4 nf_log_common xt_LOG ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables lp rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache bridge stp llc ip_set nfnetlink vmw_vsock_vmci_transport vsock iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev vmw_balloon cryptd sg pcspkr joydev vmw_vmci parport_pc i2c_piix4
parport auth_rpcgss sunrpc xfs libcrc32c ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm sd_mod crc_t10dif drm crc32c_intel ahci ata_piix libahci serio_raw nfit crct10dif_generic crct10dif_pclmul crct10dif_common libata libnvdimm vmxnet3 vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
CPU: 1 PID: 3674 Comm: mysqld Kdump: loaded Tainted: G             L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff98c25c6a41c0 ti: ffff98c352b4c000 task.ti: ffff98c352b4c000
RIP: 0010:[<ffffffff9d393d1c>]  [<ffffffff9d393d1c>] copy_user_generic_unrolled+0x5c/0xc0
RSP: 0018:ffff98c352b4fb38  EFLAGS: 00040202
RAX: 00007f3abaf28f90 RBX: ffff98cf4367d8f0 RCX: 0000000000000031
RDX: 0000000000000000 RSI: 00007f3abaf29350 RDI: ffff98ce064c73c0
RBP: ffff98c352b4fb50 R08: 0209020902090209 R09: 0209020902090209
R10: 0209020902090209 R11: 0209020902090209 R12: ffff98c352b4fac8
R13: ffff98c41880bad0 R14: ffff98c41880b980 R15: 0000000000000000
FS:  00007f3b0757a700(0000) GS:ffff98d23fc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9ed94d5000 CR3: 0000000fecb44000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffff9d1bdd95>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff9d2ba4e3>] iomap_write_actor+0x103/0x1f0
[<ffffffff9d2ba3e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff9d2ba89a>] iomap_apply+0xba/0x160
[<ffffffff9d2ba9e1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff9d2ba3e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc04827ed>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc048f35c>] ? xfs_iunlock+0xfc/0x120 [xfs]
[<ffffffffc0482b0d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff9d24c713>] do_sync_write+0x93/0xe0
[<ffffffff9d24d200>] vfs_write+0xc0/0x1f0
[<ffffffff9d24d0c8>] ? vfs_read+0xf8/0x170
[<ffffffff9d24dfcf>] SyS_write+0x7f/0xf0
[<ffffffff9d792ed2>] system_call_fastpath+0x25/0x2a
Code: 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 4c 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 4e 28 4c 8b 56 30 <4c> 8b 5e 38 4c 89 47 20 4c 89 4f 28 4c 89 57 30 4c 89 5f 38 48 
Complete report #13006
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffaeb93c81
Build id: 3.10.0-1127.8.2.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffffae9bdd45
Build id: 3.10.0-1127.8.2.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffffaeaba4c3
Build id: 3.10.0-1127.8.2.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffffaeaba3c0
Build id: 3.10.0-1127.8.2.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffffaeaba87a
Build id: 3.10.0-1127.8.2.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffffaeaba9c1
Build id: 3.10.0-1127.8.2.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffffaeaba3c0
Build id: 3.10.0-1127.8.2.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc04eb8ad
Build id: 3.10.0-1127.8.2.el7.x86_64
0x12d
9
? xfs_iunlock
xfs 0xffffffffc04f841c
Build id: 3.10.0-1127.8.2.el7.x86_64
0xfc
10
xfs_file_aio_write
xfs 0xffffffffc04ebbcd
Build id: 3.10.0-1127.8.2.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffffaea4c6c3
Build id: 3.10.0-1127.8.2.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffffaea4d1b0
Build id: 3.10.0-1127.8.2.el7.x86_64
0xc0
13
? system_call_after_swapgs
vmlinux 0xffffffffaef92e15
Build id: 3.10.0-1127.8.2.el7.x86_64
0xa2
14
SyS_write
vmlinux 0xffffffffaea4df7f
Build id: 3.10.0-1127.8.2.el7.x86_64
0x7f
15
? system_call_after_swapgs
vmlinux 0xffffffffaef92e15
Build id: 3.10.0-1127.8.2.el7.x86_64
0xa2
16
system_call_fastpath
vmlinux 0xffffffffaef92ed2
Build id: 3.10.0-1127.8.2.el7.x86_64
0x25
17
? system_call_after_swapgs
vmlinux 0xffffffffaef92e15
Build id: 3.10.0-1127.8.2.el7.x86_64
0xa2
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 30s! [yum:20705]
Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables nfsv3 nfs fscache ip_set_hash_ip ses enclosure scsi_transport_sas iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi bridge stp llc ip_set nfnetlink vmw_vsock_vmci_transport vsock crc32_pclmul ppdev ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl
lockd grace sunrpc binfmt_misc xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect crct10dif_pclmul sysimgblt fb_sys_fops crct10dif_common ttm crc32c_intel serio_raw drm ata_piix nfit mptspi scsi_transport_spi libata mptscsih libnvdimm mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
CPU: 2 PID: 20705 Comm: yum Kdump: loaded Tainted: G             L ------------   3.10.0-1127.8.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff9412cb693150 ti: ffff940e475b4000 task.ti: ffff940e475b4000
RIP: 0010:[<ffffffffaeb93c81>]  [<ffffffffaeb93c81>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff940e475b7b38  EFLAGS: 00010202
RAX: 000000000408e370 RBX: ffff940d8a83e8f0 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 000000000408e370 RDI: ffff940ff77e4000
RBP: ffff940e475b7b50 R08: 0000000001f70152 R09: 0062015200620152
R10: 0062015200620152 R11: 0062015200620152 R12: ffffffff00001000
R13: fffffa5454ddf900 R14: ffff940d12b1c140 R15: 0000000000000000
FS:  00007fafed163740(0000) GS:ffff9412ffd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000024f7f78 CR3: 0000000784a16000 CR4: 00000000000007e0
Call Trace:
[<ffffffffae9bdd45>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffffaeaba4c3>] iomap_write_actor+0x103/0x1f0
[<ffffffffaeaba3c0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffaeaba87a>] iomap_apply+0xba/0x160
[<ffffffffaeaba9c1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffffaeaba3c0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc04eb8ad>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc04f841c>] ? xfs_iunlock+0xfc/0x120 [xfs]
[<ffffffffc04ebbcd>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffffaea4c6c3>] do_sync_write+0x93/0xe0
[<ffffffffaea4d1b0>] vfs_write+0xc0/0x1f0
[<ffffffffaef92e15>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffffaea4df7f>] SyS_write+0x7f/0xf0
[<ffffffffaef92e15>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffffaef92ed2>] system_call_fastpath+0x25/0x2a
[<ffffffffaef92e15>] ? system_call_after_swapgs+0xa2/0x13a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #11471
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffffba793d01
Build id: 3.10.0-1127.19.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffffba5bdd95
Build id: 3.10.0-1127.19.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffffba6ba4e3
Build id: 3.10.0-1127.19.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffffba6ba3e0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffffba6ba89a
Build id: 3.10.0-1127.19.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffffba6ba9e1
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffffba6ba3e0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc04927ed
Build id: 3.10.0-1127.19.1.el7.x86_64
0x12d
9
? xfs_iunlock
xfs 0xffffffffc049f35c
Build id: 3.10.0-1127.19.1.el7.x86_64
0xfc
10
xfs_file_aio_write
xfs 0xffffffffc0492b0d
Build id: 3.10.0-1127.19.1.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffffba64c713
Build id: 3.10.0-1127.19.1.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffffba64d200
Build id: 3.10.0-1127.19.1.el7.x86_64
0xc0
13
SyS_write
vmlinux 0xffffffffba64dfcf
Build id: 3.10.0-1127.19.1.el7.x86_64
0x7f
14
system_call_fastpath
vmlinux 0xffffffffbab92ed2
Build id: 3.10.0-1127.19.1.el7.x86_64
0x25
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [needs-restartin:630]
Modules linked in: binfmt_misc tcp_lp fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper vmw_balloon ablk_helper cryptd joydev pcspkr sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic
sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci ata_piix nfit drm libnvdimm libahci crct10dif_pclmul crct10dif_common crc32c_intel libata serio_raw e1000 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 630 Comm: needs-restartin Kdump: loaded Not tainted 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff9c1c034562a0 ti: ffff9c1c5a760000 task.ti: ffff9c1c5a760000
RIP: 0010:[<ffffffffba793d01>]  [<ffffffffba793d01>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff9c1c5a763b38  EFLAGS: 00050202
RAX: 00000000030706d4 RBX: ffff9c1c02c27d68 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 00000000030706d4 RDI: ffff9c1c69316000
RBP: ffff9c1c5a763b50 R08: 007d001e0000000d R09: 130e760ee80e520f
R10: fc0bb10c410d9b0d R11: c4095a0ace0a470b R12: ffffffff00001000
R13: ffffeef601a4c580 R14: ffff9c1c26b7d040 R15: 0000000000000000
FS:  00007fd8e479e740(0000) GS:ffff9c1d3fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd07e844001 CR3: 00000000430e8000 CR4: 00000000003607f0
Call Trace:
[<ffffffffba5bdd95>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffffba6ba4e3>] iomap_write_actor+0x103/0x1f0
[<ffffffffba6ba3e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffba6ba89a>] iomap_apply+0xba/0x160
[<ffffffffba6ba9e1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffffba6ba3e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc04927ed>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc049f35c>] ? xfs_iunlock+0xfc/0x120 [xfs]
[<ffffffffc0492b0d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffffba64c713>] do_sync_write+0x93/0xe0
[<ffffffffba64d200>] vfs_write+0xc0/0x1f0
[<ffffffffba64dfcf>] SyS_write+0x7f/0xf0
[<ffffffffbab92ed2>] system_call_fastpath+0x25/0x2a
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b 
Complete report #3843
Frame # Function Binary Source or offset Line
1
copy_user_generic_unrolled
vmlinux 0xffffffff81f93d01
Build id: 3.10.0-1127.19.1.el7.x86_64
0x41
2
? iov_iter_copy_from_user_atomic
vmlinux 0xffffffff81dbdd95
Build id: 3.10.0-1127.19.1.el7.x86_64
0x55
3
iomap_write_actor
vmlinux 0xffffffff81eba4e3
Build id: 3.10.0-1127.19.1.el7.x86_64
0x103
4
? iomap_dirty_actor
vmlinux 0xffffffff81eba3e0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1d0
5
iomap_apply
vmlinux 0xffffffff81eba89a
Build id: 3.10.0-1127.19.1.el7.x86_64
0xba
6
iomap_file_buffered_write
vmlinux 0xffffffff81eba9e1
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa1
7
? iomap_dirty_actor
vmlinux 0xffffffff81eba3e0
Build id: 3.10.0-1127.19.1.el7.x86_64
0x1d0
8
xfs_file_buffered_aio_write
xfs 0xffffffffc06357ed
Build id: 3.10.0-1127.19.1.el7.x86_64
0x12d
9
? xfs_iunlock
xfs 0xffffffffc064235c
Build id: 3.10.0-1127.19.1.el7.x86_64
0xfc
10
xfs_file_aio_write
xfs 0xffffffffc0635b0d
Build id: 3.10.0-1127.19.1.el7.x86_64
0x18d
11
do_sync_write
vmlinux 0xffffffff81e4c713
Build id: 3.10.0-1127.19.1.el7.x86_64
0x93
12
vfs_write
vmlinux 0xffffffff81e4d200
Build id: 3.10.0-1127.19.1.el7.x86_64
0xc0
13
SyS_write
vmlinux 0xffffffff81e4dfcf
Build id: 3.10.0-1127.19.1.el7.x86_64
0x7f
14
tracesys
vmlinux 0xffffffff82393166
Build id: 3.10.0-1127.19.1.el7.x86_64
0xa6
NMI watchdog: BUG: soft lockup - CPU#41 stuck for 23s! [tar:71909]
Modules linked in: fuse veeamsnap(OE) veth binfmt_misc nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter nls_utf8 cifs ccm dns_resolver overlay(T) vmw_vsock_vmci_transport vsock ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg vmw_vmci i2c_piix4 parport_pc parport nfsd nfs_acl lockd grace auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ttm ahci nfit ata_piix libahci drm crct10dif_pclmul libnvdimm crct10dif_common libata crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 41 PID: 71909 Comm: tar Kdump: loaded Tainted: G           OEL ------------ T 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/28/2017
task: ffff9c04b49b20e0 ti: ffff9c122fde0000 task.ti: ffff9c122fde0000
RIP: 0010:[<ffffffff81f93d01>]  [<ffffffff81f93d01>] copy_user_generic_unrolled+0x41/0xc0
RSP: 0018:ffff9c122fde3b38  EFLAGS: 00050202
RAX: 000000000133c800 RBX: ffff9bfbff3371a0 RCX: 0000000000000040
RDX: 0000000000000000 RSI: 000000000133c800 RDI: ffff9bedbc89b000
RBP: ffff9c122fde3b50 R08: cc0003639f005590 R09: 0016ba7501000363
R10: d01900000363de01 R11: fb0d018b69000d77 R12: ffffffff00001000
R13: fffff75879f226c0 R14: ffff9c03ef981f40 R15: 0000000000000000
FS:  00007fd7536d6840(0000) GS:ffff9c1d81c40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd7536de000 CR3: 00000038744d6000 CR4: 00000000007607e0
DR0: 00000000006050d4 DR1: 0000000000601048 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600
PKRU: 55555554
Call Trace:
[<ffffffff81dbdd95>] ? iov_iter_copy_from_user_atomic+0x55/0xb0
[<ffffffff81eba4e3>] iomap_write_actor+0x103/0x1f0
[<ffffffff81eba3e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffff81eba89a>] iomap_apply+0xba/0x160
[<ffffffff81eba9e1>] iomap_file_buffered_write+0xa1/0xe0
[<ffffffff81eba3e0>] ? iomap_dirty_actor+0x1d0/0x1d0
[<ffffffffc06357ed>] xfs_file_buffered_aio_write+0x12d/0x2c0 [xfs]
[<ffffffffc064235c>] ? xfs_iunlock+0xfc/0x120 [xfs]
[<ffffffffc0635b0d>] xfs_file_aio_write+0x18d/0x1b0 [xfs]
[<ffffffff81e4c713>] do_sync_write+0x93/0xe0
[<ffffffff81e4d200>] vfs_write+0xc0/0x1f0
[<ffffffff81e4dfcf>] SyS_write+0x7f/0xf0
[<ffffffff82393166>] tracesys+0xa6/0xcc
Code: f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 83 e2 3f c1 e9 06 74 4a 4c 8b 06 4c 8b 4e 08 4c 8b 56 10 4c 8b 5e 18 <4c> 89 07 4c 89 4f 08 4c 89 57 10 4c 89 5f 18 4c 8b 46 20 4c 8b