Complete report #1286941
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
memcpy
|
vmlinux |
0xffffffffb859057d
Build id: 3.10.0-1062.1.2.el7.x86_64
|
0xbd
|
|
2
|
|
vmlinux |
0xffffffffb858c984
Build id: 3.10.0-1062.1.2.el7.x86_64
|
0x234
|
|
3
|
|
vmlinux |
0xffffffffb897f5fd
Build id: 3.10.0-1062.1.2.el7.x86_64
|
0x11d
|
|
4
|
kthread_create_on_node
|
vmlinux |
0xffffffffb82c4f6b
Build id: 3.10.0-1062.1.2.el7.x86_64
|
0xeb
|
|
5
|
|
vmlinux |
0xffffffffb82be0f0
Build id: 3.10.0-1062.1.2.el7.x86_64
|
0x2a0
|
|
6
|
create_worker
|
vmlinux |
0xffffffffb82bdcbb
Build id: 3.10.0-1062.1.2.el7.x86_64
|
0xeb
|
|
7
|
manage_workers.isra.26
|
vmlinux |
0xffffffffb82bdf46
Build id: 3.10.0-1062.1.2.el7.x86_64
|
0xf6
|
|
8
|
worker_thread
|
vmlinux |
0xffffffffb82be473
Build id: 3.10.0-1062.1.2.el7.x86_64
|
0x383
|
|
9
|
|
vmlinux |
0xffffffffb82be0f0
Build id: 3.10.0-1062.1.2.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffffb82c50d1
Build id: 3.10.0-1062.1.2.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffffb82c5000
Build id: 3.10.0-1062.1.2.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffb898cd37
Build id: 3.10.0-1062.1.2.el7.x86_64
|
0x21
|
|
13
|
|
vmlinux |
0xffffffffb82c5000
Build id: 3.10.0-1062.1.2.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 58s! [kworker/0:0:20809]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_14108(E) vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper sg cryptd vmw_balloon pcspkr joydev parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci ata_piix libahci crct10dif_pclmul nfit crct10dif_common libata crc32c_intel serio_raw libnvdimm vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 20809 Comm: kworker/0:0 Kdump: loaded Tainted: P EL ------------ 3.10.0-1062.1.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9c7210e2a0e0 ti: ffff9c7212aa8000 task.ti: ffff9c7212aa8000
RIP: 0010:[<ffffffffb859057d>] [<ffffffffb859057d>] memcpy+0xbd/0x110
RSP: 0018:ffff9c7212aabca8 EFLAGS: 00010246
RAX: ffff9c71f6270678 RBX: 0000000000003462 RCX: 0000000000000008
RDX: 0000000000000008 RSI: ffffffffb8c7e0dc RDI: ffff9c71f6270678
RBP: ffff9c7212aabd10 R08: 2f72656b726f776b R09: 2f72656b726f776b
R10: 0000000000000000 R11: 0000000000000000 R12: 7fffffffffffffff
R13: ffffffffb897cbb1 R14: ffff9c7212aabcb0 R15: ffffffffb897f229
FS: 0000000000000000(0000) GS:ffff9c722f200000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000000000b8 CR3: 000000040739e000 CR4: 00000000003607f0
Call Trace:
[<ffffffffb858c984>] ? vsnprintf+0x234/0x6a0
[<ffffffffb897f5fd>] ? wait_for_completion+0x11d/0x140
[<ffffffffb82c4f6b>] kthread_create_on_node+0xeb/0x140
[<ffffffffb82be0f0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffb82bdcbb>] create_worker+0xeb/0x200
[<ffffffffb82bdf46>] manage_workers.isra.26+0xf6/0x2a0
[<ffffffffb82be473>] worker_thread+0x383/0x3c0
[<ffffffffb82be0f0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffb82c50d1>] kthread+0xd1/0xe0
[<ffffffffb82c5000>] ? insert_kthread_work+0x40/0x40
[<ffffffffb898cd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffb82c5000>] ? insert_kthread_work+0x40/0x40
Code: 08 4c 8b 54 16 f0 4c 8b 5c 16 f8 4c 89 07 4c 89 4f 08 4c 89 54 17 f0 4c 89 5c 17 f8 c3 90 83 fa 08 72 1b 4c 8b 06 4c 8b 4c 16 f8 <4c> 89 07 4c 89 4c 17 f8 c3 66 2e 0f 1f 84 00 00 00 00 00 83 fa
Complete report #939902
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
__list_add
|
vmlinux |
0xffffffff99dbd17e
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x2e
|
|
2
|
kthread_create_on_node
|
vmlinux |
0xffffffff99acb456
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x86
|
|
3
|
|
vmlinux |
0xffffffff99ac4310
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x2b0
|
|
4
|
create_worker
|
vmlinux |
0xffffffff99ac3ebb
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0xeb
|
|
5
|
manage_workers.isra.26
|
vmlinux |
0xffffffff99ac415e
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0xfe
|
|
6
|
worker_thread
|
vmlinux |
0xffffffff99ac4693
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x383
|
|
7
|
|
vmlinux |
0xffffffff99ac4310
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x2b0
|
|
8
|
kthread
|
vmlinux |
0xffffffff99acb621
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0xd1
|
|
9
|
|
vmlinux |
0xffffffff99acb550
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x40
|
|
10
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffff9a1c51f7
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x21
|
|
11
|
|
vmlinux |
0xffffffff99acb550
Build id: 3.10.0-1160.88.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 23s! [kworker/5:0:17846]
Modules linked in: vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 nfit libnvdimm coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg i2c_piix4 parport_pc vmw_vmci parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix mptspi drm libata scsi_transport_spi crct10dif_pclmul crct10dif_common mptscsih vmxnet3 crc32c_intel serio_raw mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 5 PID: 17846 Comm: kworker/5:0 Kdump: loaded Tainted: G L ------------ 3.10.0-1160.88.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff8f143a894200 ti: ffff8f1405d14000 task.ti: ffff8f1405d14000
RIP: 0010:[<ffffffff99dbd17e>] [<ffffffff99dbd17e>] __list_add+0x2e/0xc0
RSP: 0018:ffff8f1405d17cf8 EFLAGS: 00010287
RAX: 0000000000000000 RBX: 00000000000005f8 RCX: ffffffff9a483856
RDX: ffffffff9a656fc0 RSI: ffffffff9a656fc0 RDI: ffff8f1405d17d78
RBP: ffff8f1405d17d10 R08: ffffffff9a656fc0 R09: 000000000000ffff
R10: 0000000000000000 R11: 0000000000000293 R12: ffff8f13bdb11c00
R13: 0000000000000002 R14: 000000004b55cbb3 R15: 0000000000000001
FS: 0000000000000000(0000) GS:ffff8f143bc80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000000000b8 CR3: 0000000438b50000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff99acb456>] kthread_create_on_node+0x86/0x140
[<ffffffff99ac4310>] ? manage_workers.isra.26+0x2b0/0x2b0
[<ffffffff99ac3ebb>] create_worker+0xeb/0x200
[<ffffffff99ac415e>] manage_workers.isra.26+0xfe/0x2b0
[<ffffffff99ac4693>] worker_thread+0x383/0x3c0
[<ffffffff99ac4310>] ? manage_workers.isra.26+0x2b0/0x2b0
[<ffffffff99acb621>] kthread+0xd1/0xe0
[<ffffffff99acb550>] ? insert_kthread_work+0x40/0x40
[<ffffffff9a1c51f7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff99acb550>] ? insert_kthread_work+0x40/0x40
Code: e5 41 55 49 89 f5 41 54 49 89 d4 53 4c 8b 42 08 48 89 fb 49 39 f0 75 2e 4d 8b 45 00 4d 39 c4 75 6c 4c 39 e3 74 42 4c 39 eb 74 3d <49> 89 5c 24 08 4c 89 6b 08 4c 89 23 49 89 5d 00 5b 41 5c 41 5d
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [CRTC:37:crtc-0] flip_done timed out
Complete report #330888
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
_raw_spin_unlock_irqrestore
|
vmlinux |
0xffffffffbb78b795
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x15
|
|
2
|
try_to_wake_up
|
vmlinux |
0xffffffffbb0dab32
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x192
|
|
3
|
wake_up_process
|
vmlinux |
0xffffffffbb0dad45
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x15
|
|
4
|
kthread_create_on_node
|
vmlinux |
0xffffffffbb0c5cb0
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0xa0
|
|
5
|
|
vmlinux |
0xffffffffbb0bee80
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x2a0
|
|
6
|
create_worker
|
vmlinux |
0xffffffffbb0bea4b
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0xeb
|
|
7
|
manage_workers.isra.26
|
vmlinux |
0xffffffffbb0becd6
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0xf6
|
|
8
|
worker_thread
|
vmlinux |
0xffffffffbb0bf203
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x383
|
|
9
|
|
vmlinux |
0xffffffffbb0bee80
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x2a0
|
|
10
|
kthread
|
vmlinux |
0xffffffffbb0c5e61
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0xd1
|
|
11
|
|
vmlinux |
0xffffffffbb0c5d90
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x40
|
|
12
|
ret_from_fork_nospec_begin
|
vmlinux |
0xffffffffbb795df7
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x21
|
|
13
|
|
vmlinux |
0xffffffffbb0c5d90
Build id: 3.10.0-1160.45.1.el7.x86_64
|
0x40
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [kworker/1:0:8780]
Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper sg ablk_helper cryptd joydev pcspkr vmw_balloon parport_pc vmw_vmci parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt ata_generic fb_sys_fops pata_acpi ttm ahci drm ata_piix
libahci sd_mod libata crc_t10dif crct10dif_generic nfit crct10dif_pclmul crct10dif_common libnvdimm crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 8780 Comm: kworker/1:0 Kdump: loaded Tainted: G L ------------ 3.10.0-1160.45.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/03/2018
task: ffff8d76f405a100 ti: ffff8d765522c000 task.ti: ffff8d765522c000
RIP: 0010:[<ffffffffbb78b795>] [<ffffffffbb78b795>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff8d765522fcb0 EFLAGS: 00000286
RAX: ffff8d76f5f09000 RBX: 00000010bb0dfbd8 RCX: ffff8d76f5f090a0
RDX: ffff8d76ffc1b6e0 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff8d765522fcb0 R08: 0000000000000000 R09: ffffffffbc109bc0
R10: 0000000007000000 R11: 0000000000000800 R12: ffffffffbb0e0c46
R13: ffff8d765522fcb0 R14: ffff8d76ffc5ad40 R15: ffff8d76ffc5ad40
FS: 0000000000000000(0000) GS:ffff8d76ffc40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000000000b8 CR3: 00000000b179a000 CR4: 00000000001607e0
Call Trace:
[<ffffffffbb0dab32>] try_to_wake_up+0x192/0x390
[<ffffffffbb0dad45>] wake_up_process+0x15/0x20
[<ffffffffbb0c5cb0>] kthread_create_on_node+0xa0/0x140
[<ffffffffbb0bee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffbb0bea4b>] create_worker+0xeb/0x200
[<ffffffffbb0becd6>] manage_workers.isra.26+0xf6/0x2a0
[<ffffffffbb0bf203>] worker_thread+0x383/0x3c0
[<ffffffffbb0bee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffbb0c5e61>] kthread+0xd1/0xe0
[<ffffffffbb0c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffffbb795df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffbb0c5d90>] ? insert_kthread_work+0x40/0x40
Code: 07 00 0f 1f 40 00 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48