Info

Permalink
Function
finish_task_switch
First occurrence
2020-12-06
Last occurrence
2024-09-19
State
NEW
Components
kernel
Quality
-21

Statistics

Operating system Count
CentOS 7 52
Architecture Count
x86_64 52
Related packages Count
kernel 52
 0:3.10.0-957.el7 5
 0:3.10.0-1160.45.1.el7 5
 0:3.10.0-957.5.1.el7 4
 0:3.10.0-1160.31.1.el7 4
 0:3.10.0-1160.42.2.el7 3
 0:3.10.0-1062.4.3.el7 2
 0:3.10.0-1062.9.1.el7 2
 0:3.10.0-1127.18.2.el7 2
 0:3.10.0-1127.el7 2
 0:3.10.0-1160.108.1.el7 2
 0:3.10.0-1160.66.1.el7 2
 0:3.10.0-1160.76.1.el7 2
 0:3.10.0-1062.12.1.el7 2
 0:3.10.0-1127.19.1.el7 1
 0:3.10.0-1160.11.1.el7 1
 0:3.10.0-1160.2.2.el7 1
 0:3.10.0-1160.24.1.el7 1
 0:3.10.0-1160.el7 1
 0:3.10.0-862.3.2.el7 1
 0:3.10.0-862.el7 1
 0:3.10.0-693.2.2.el7 1
 0:3.10.0-957.21.2.el7 1
 0:3.10.0-1160.102.1.el7 1
 0:3.10.0-1160.114.2.el7 1
 0:3.10.0-1160.119.1.el7 1
 0:3.10.0-1160.59.1.el7 1
 0:3.10.0-1160.88.1.el7 1
 0:3.10.0-1160.62.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #857816
Frame # Function Binary Source or offset Line
1
finish_task_switch
vmlinux 0xffffffff818d0887
Build id: 3.10.0-957.el7.x86_64
0x57
2
__schedule
vmlinux 0xffffffff81f6770f
Build id: 3.10.0-957.el7.x86_64
0x3ff
3
? process_one_work
vmlinux 0xffffffff818b9dea
Build id: 3.10.0-957.el7.x86_64
0x21a
4
schedule
vmlinux 0xffffffff81f67bc9
Build id: 3.10.0-957.el7.x86_64
0x29
5
worker_thread
vmlinux 0xffffffff818bae99
Build id: 3.10.0-957.el7.x86_64
0x1d9
6
? manage_workers.isra.25
vmlinux 0xffffffff818bacc0
Build id: 3.10.0-957.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffff818c1c31
Build id: 3.10.0-957.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffff818c1b60
Build id: 3.10.0-957.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffff81f74c37
Build id: 3.10.0-957.el7.x86_64
0x21
10
? insert_kthread_work
vmlinux 0xffffffff818c1b60
Build id: 3.10.0-957.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 28s! [kworker/2:2:25264]
Modules linked in: xt_nat veth xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) symap_custom_3_10_0_957_el7_x86_64(POE) symev_custom_3_10_0_957_el7_x86_64(OE) vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod ppdev sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 floppy vmwgfx drm_kms_helper syscopyarea
ahci sysfillrect sysimgblt fb_sys_fops ttm vmw_pvscsi nfit libahci libnvdimm ata_piix drm libata drm_panel_orientation_quirks
CPU: 2 PID: 25264 Comm: kworker/2:2 Kdump: loaded Tainted: P           OEL ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff9774bd125140 ti: ffff9774957f4000 task.ti: ffff9774957f4000
RIP: 0010:[<ffffffff818d0887>]  [<ffffffff818d0887>] finish_task_switch+0x57/0x1c0
RSP: 0018:ffff9774957f7da8  EFLAGS: 00000282
RAX: ffff9774fa7330c0 RBX: 00000000000493e0 RCX: 0000000000000000
RDX: ffff9774957f5fd8 RSI: ffff9774bd125140 RDI: ffff97757fd1ab80
RBP: ffff9774957f7dc8 R08: ffff9774957f4000 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000000 R12: ffff9774fb7896a0
R13: ffffffff818e05ac R14: ffff9774957f7d50 R15: 0000000000000001
FS:  0000000000000000(0000) GS:ffff97757fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000000000b8 CR3: 00000000b8b98000 CR4: 00000000001607e0
Call Trace:
[<ffffffff81f6770f>] __schedule+0x3ff/0x890
[<ffffffff818b9dea>] ? process_one_work+0x21a/0x440
[<ffffffff81f67bc9>] schedule+0x29/0x70
[<ffffffff818bae99>] worker_thread+0x1d9/0x3c0
[<ffffffff818bacc0>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff818c1c31>] kthread+0xd1/0xe0
[<ffffffff818c1b60>] ? insert_kthread_work+0x40/0x40
[<ffffffff81f74c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff818c1b60>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 65 48 8b 34 25 80 0e 01 00 0f 1f 44 00 00 41 c7 45 28 00 00 00 00 48 89 df c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <65> 48 8b 04 25 80 0e 01 00 48 8b 98 78 01 00 00 48 85 db 74 22 
Complete report #527552
Frame # Function Binary Source or offset Line
1
finish_task_switch
vmlinux 0xffffffff9c6d4ac7
Build id: 3.10.0-1160.45.1.el7.x86_64
0x57
2
__schedule
vmlinux 0xffffffff9cd88df0
Build id: 3.10.0-1160.45.1.el7.x86_64
0x320
3
schedule
vmlinux 0xffffffff9cd89179
Build id: 3.10.0-1160.45.1.el7.x86_64
0x29
4
worker_thread
vmlinux 0xffffffff9c6bf059
Build id: 3.10.0-1160.45.1.el7.x86_64
0x1d9
5
? manage_workers.isra.26
vmlinux 0xffffffff9c6bee80
Build id: 3.10.0-1160.45.1.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffff9c6c5e61
Build id: 3.10.0-1160.45.1.el7.x86_64
0xd1
7
? system_call_after_swapgs
vmlinux 0xffffffff9cd95ec9
Build id: 3.10.0-1160.45.1.el7.x86_64
0x96
8
? insert_kthread_work
vmlinux 0xffffffff9c6c5d90
Build id: 3.10.0-1160.45.1.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffff9cd95df7
Build id: 3.10.0-1160.45.1.el7.x86_64
0x21
10
? insert_kthread_work
vmlinux 0xffffffff9c6c5d90
Build id: 3.10.0-1160.45.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [kworker/0:0:15861]
Modules linked in: tcp_lp nls_utf8 isofs vboxsf(OE) nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter overlay(T) binfmt_misc snd_intel8x0 snd_ac97_codec ac97_bus snd_seq joydev snd_seq_device ppdev snd_pcm vboxguest(OE) iosf_mbi pcspkr snd_timer sg snd soundcore i2c_piix4 parport_pc parport video nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod cdrom crct10dif_generic crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm
ahci libahci ata_piix drm e1000 libata crc32c_intel serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 0 PID: 15861 Comm: kworker/0:0 Kdump: loaded Tainted: G           OEL ------------ T 3.10.0-1160.45.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff8ba837c60000 ti: ffff8ba836f04000 task.ti: ffff8ba836f04000
RIP: 0010:[<ffffffff9c6d4ac7>]  [<ffffffff9c6d4ac7>] finish_task_switch+0x57/0x1c0
RSP: 0000:ffff8ba836f07dd0  EFLAGS: 00010286
RAX: ffff8ba8d69eb180 RBX: 00000000acd735f5 RCX: 0000000000000000
RDX: ffff8ba836f05fd8 RSI: ffff8ba837c60000 RDI: ffff8ba8df21acc0
RBP: ffff8ba836f07df0 R08: ffff8ba836f04000 R09: 0000000000000001
R10: 0000000000000009 R11: fffff0cb00a64440 R12: 0000000000000046
R13: 0000000000000086 R14: ffffffff9c6e4d1c R15: ffff8ba836f07d78
FS:  0000000000000000(0000) GS:ffff8ba8df200000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000000000b8 CR3: 00000000cd2bc000 CR4: 00000000000206f0
Call Trace:
[<ffffffff9cd88df0>] __schedule+0x320/0x680
[<ffffffff9cd89179>] schedule+0x29/0x70
[<ffffffff9c6bf059>] worker_thread+0x1d9/0x3c0
[<ffffffff9c6bee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff9c6c5e61>] kthread+0xd1/0xe0
[<ffffffff9cd95ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff9c6c5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffff9cd95df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff9c6c5d90>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 65 48 8b 34 25 c0 0e 01 00 0f 1f 44 00 00 41 c7 45 28 00 00 00 00 48 89 df c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <65> 48 8b 04 25 c0 0e 01 00 48 8b 98 78 01 00 00 48 85 db 74 22 
Complete report #419258
Frame # Function Binary Source or offset Line
1
finish_task_switch
vmlinux 0xffffffffaecd4c14
Build id: 3.10.0-1160.62.1.el7.x86_64
0x54
2
__schedule
vmlinux 0xffffffffaf38c050
Build id: 3.10.0-1160.62.1.el7.x86_64
0x320
3
schedule
vmlinux 0xffffffffaf38c3d9
Build id: 3.10.0-1160.62.1.el7.x86_64
0x29
4
worker_thread
vmlinux 0xffffffffaecbf1a9
Build id: 3.10.0-1160.62.1.el7.x86_64
0x1d9
5
? manage_workers.isra.26
vmlinux 0xffffffffaecbefd0
Build id: 3.10.0-1160.62.1.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffffaecc5fb1
Build id: 3.10.0-1160.62.1.el7.x86_64
0xd1
7
? system_call_after_swapgs
vmlinux 0xffffffffaf399ec9
Build id: 3.10.0-1160.62.1.el7.x86_64
0x96
8
? insert_kthread_work
vmlinux 0xffffffffaecc5ee0
Build id: 3.10.0-1160.62.1.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffffaf399df7
Build id: 3.10.0-1160.62.1.el7.x86_64
0x21
10
? insert_kthread_work
vmlinux 0xffffffffaecc5ee0
Build id: 3.10.0-1160.62.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/0:2:14475]
Modules linked in: tcp_diag udp_diag inet_diag xt_nat xt_mark xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun devlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_tables bridge stp llc ip_set vmw_vsock_vmci_transport vsock sunrpc ppdev vmw_balloon coretemp pcspkr joydev sg i2c_piix4 vmw_vmci parport_pc parport binfmt_misc xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod crct10dif_common cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops serio_raw ttm drm mptspi ata_piix scsi_transport_spi libata e1000 mptscsih mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash
dm_log dm_mod fuse [last unloaded: ip_tables]
CPU: 0 PID: 14475 Comm: kworker/0:2 Kdump: loaded Tainted: G             L ------------   3.10.0-1160.62.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff96ec39189080 ti: ffff96eb4b4ac000 task.ti: ffff96eb4b4ac000
RIP: 0010:[<ffffffffaecd4c14>]  [<ffffffffaecd4c14>] finish_task_switch+0x54/0x1c0
RSP: 0018:ffff96eb4b4afdd0  EFLAGS: 00000286
RAX: ffff96ebb96ab180 RBX: ffffffffaece2429 RCX: 0000000000000000
RDX: ffff96eb4b4adfd8 RSI: ffff96ec39189080 RDI: ffff96ec4641acc0
RBP: ffff96eb4b4afdf0 R08: ffff96eb4b4ac000 R09: 0000000000000001
R10: 0000000000000003 R11: fffff13780d41800 R12: ffffffffaece6471
R13: ffff96eb4b4afd80 R14: ffffffffaece4e6c R15: ffff96eb4b4afd78
FS:  0000000000000000(0000) GS:ffff96ec46400000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000000000b8 CR3: 00000000b95f6000 CR4: 00000000000407f0
Call Trace:
[<ffffffffaf38c050>] __schedule+0x320/0x680
[<ffffffffaf38c3d9>] schedule+0x29/0x70
[<ffffffffaecbf1a9>] worker_thread+0x1d9/0x3c0
[<ffffffffaecbefd0>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffaecc5fb1>] kthread+0xd1/0xe0
[<ffffffffaf399ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffffaecc5ee0>] ? insert_kthread_work+0x40/0x40
[<ffffffffaf399df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffaecc5ee0>] ? insert_kthread_work+0x40/0x40
Code: 8b 36 66 66 66 66 90 65 48 8b 34 25 c0 0e 01 00 66 66 66 66 90 41 c7 45 28 00 00 00 00 48 89 df c6 07 00 66 66 66 90 fb 66 66 90 <66> 66 90 65 48 8b 04 25 c0 0e 01 00 48 8b 98 78 01 00 00 48 85 
Complete report #342291
Frame # Function Binary Source or offset Line
1
finish_task_switch
vmlinux 0xffffffffabad4ac7
Build id: 3.10.0-1160.45.1.el7.x86_64
0x57
2
__schedule
vmlinux 0xffffffffac188df0
Build id: 3.10.0-1160.45.1.el7.x86_64
0x320
3
schedule
vmlinux 0xffffffffac189179
Build id: 3.10.0-1160.45.1.el7.x86_64
0x29
4
worker_thread
vmlinux 0xffffffffababf059
Build id: 3.10.0-1160.45.1.el7.x86_64
0x1d9
5
? manage_workers.isra.26
vmlinux 0xffffffffababee80
Build id: 3.10.0-1160.45.1.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffffabac5e61
Build id: 3.10.0-1160.45.1.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffffabac5d90
Build id: 3.10.0-1160.45.1.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffffac195df7
Build id: 3.10.0-1160.45.1.el7.x86_64
0x21
9
? insert_kthread_work
vmlinux 0xffffffffabac5d90
Build id: 3.10.0-1160.45.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 28s! [kworker/1:0:12666]
Modules linked in: ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop overlay ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ampnetworkflow(OE) ampfsm(OE) vmw_vsock_vmci_transport vsock ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg parport_pc
parport vmw_vmci i2c_piix4 nfsd nfs_acl lockd grace auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops crct10dif_pclmul ttm crct10dif_common crc32c_intel serio_raw vmxnet3 drm ata_piix mptspi scsi_transport_spi mptscsih mptbase libata nfit libnvdimm drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 12666 Comm: kworker/1:0 Kdump: loaded Tainted: G           OE  ------------   3.10.0-1160.45.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff94ac45ffa100 ti: ffff94aaa025c000 task.ti: ffff94aaa025c000
RIP: 0010:[<ffffffffabad4ac7>]  [<ffffffffabad4ac7>] finish_task_switch+0x57/0x1c0
RSP: 0000:ffff94aaa025fdd0  EFLAGS: 00000286
RAX: ffff94abbaf90000 RBX: ffff94ac45ffa168 RCX: 0000000000000000
RDX: ffff94aaa025dfd8 RSI: ffff94ac45ffa100 RDI: ffff94ac7fc9acc0
RBP: ffff94aaa025fdf0 R08: ffff94aaa025c000 R09: 0000000000000001
R10: 0000000000000003 R11: 0000000000000000 R12: 0000000000000082
R13: 00000000a025fd58 R14: ffffffffabae4d1c R15: ffff94aaa025fd78
FS:  0000000000000000(0000) GS:ffff94ac7fc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000000000b8 CR3: 00000000b9bfa000 CR4: 00000000000407e0
Call Trace:
[<ffffffffac188df0>] __schedule+0x320/0x680
[<ffffffffac189179>] schedule+0x29/0x70
[<ffffffffababf059>] worker_thread+0x1d9/0x3c0
[<ffffffffababee80>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffabac5e61>] kthread+0xd1/0xe0
[<ffffffffabac5d90>] ? insert_kthread_work+0x40/0x40
[<ffffffffac195df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffabac5d90>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 65 48 8b 34 25 c0 0e 01 00 0f 1f 44 00 00 41 c7 45 28 00 00 00 00 48 89 df c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <65> 48 8b 04 25 c0 0e 01 00 48 8b 98 78 01 00 00 48 85 db 74 22 
Complete report #224462
Frame # Function Binary Source or offset Line
1
finish_task_switch
vmlinux 0xffffffff8c2d4a97
Build id: 3.10.0-1160.31.1.el7.x86_64
0x57
2
__schedule
vmlinux 0xffffffff8c988e60
Build id: 3.10.0-1160.31.1.el7.x86_64
0x320
3
schedule
vmlinux 0xffffffff8c9891e9
Build id: 3.10.0-1160.31.1.el7.x86_64
0x29
4
worker_thread
vmlinux 0xffffffff8c2bf029
Build id: 3.10.0-1160.31.1.el7.x86_64
0x1d9
5
? manage_workers.isra.26
vmlinux 0xffffffff8c2bee50
Build id: 3.10.0-1160.31.1.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffff8c2c5e31
Build id: 3.10.0-1160.31.1.el7.x86_64
0xd1
7
? insert_kthread_work
vmlinux 0xffffffff8c2c5d60
Build id: 3.10.0-1160.31.1.el7.x86_64
0x40
8
ret_from_fork_nospec_begin
vmlinux 0xffffffff8c995df7
Build id: 3.10.0-1160.31.1.el7.x86_64
0x21
9
? insert_kthread_work
vmlinux 0xffffffff8c2c5d60
Build id: 3.10.0-1160.31.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kworker/2:1:7871]
Modules linked in: tcp_lp cfg80211 rfkill veth xt_nat xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink tun xt_addrtype br_netfilter devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr ppdev joydev sg vmw_balloon parport_pc parport vmw_vmci
i2c_piix4 sch_fq_codel ip_tables xfs libcrc32c ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm sd_mod crc_t10dif ahci crct10dif_generic libahci ata_piix nfit crct10dif_pclmul crct10dif_common crc32c_intel libnvdimm libata serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 7871 Comm: kworker/2:1 Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.31.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9f54f2324200 ti: ffff9f559caf4000 task.ti: ffff9f559caf4000
RIP: 0010:[<ffffffff8c2d4a97>]  [<ffffffff8c2d4a97>] finish_task_switch+0x57/0x1c0
RSP: 0000:ffff9f559caf7dd0  EFLAGS: 00000286
RAX: ffff9f56b2ace300 RBX: ffffffff8c2e22e9 RCX: 0000000000000000
RDX: ffff9f559caf5fd8 RSI: ffff9f54f2324200 RDI: ffff9f56bfc9acc0
RBP: ffff9f559caf7df0 R08: ffff9f559caf4000 R09: 0000000000000001
R10: 0000000000000005 R11: 0000000000000000 R12: ffffffff8c2e6021
R13: ffff9f559caf7d80 R14: ffffffff8c2e4a1c R15: ffff9f559caf7d78
FS:  0000000000000000(0000) GS:ffff9f56bfc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000000000b8 CR3: 000000022feda000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8c988e60>] __schedule+0x320/0x680
[<ffffffff8c9891e9>] schedule+0x29/0x70
[<ffffffff8c2bf029>] worker_thread+0x1d9/0x3c0
[<ffffffff8c2bee50>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff8c2c5e31>] kthread+0xd1/0xe0
[<ffffffff8c2c5d60>] ? insert_kthread_work+0x40/0x40
[<ffffffff8c995df7>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff8c2c5d60>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 65 48 8b 34 25 c0 0e 01 00 0f 1f 44 00 00 41 c7 45 28 00 00 00 00 48 89 df c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <65> 48 8b 04 25 c0 0e 01 00 48 8b 98 78 01 00 00 48 85 db 74 22 
Complete report #96091
Frame # Function Binary Source or offset Line
1
finish_task_switch
vmlinux 0xffffffff960d08c7
Build id: 3.10.0-957.5.1.el7.x86_64
0x57
2
__schedule
vmlinux 0xffffffff9676778f
Build id: 3.10.0-957.5.1.el7.x86_64
0x3ff
3
? process_one_work
vmlinux 0xffffffff960b9e2a
Build id: 3.10.0-957.5.1.el7.x86_64
0x21a
4
schedule
vmlinux 0xffffffff96767c49
Build id: 3.10.0-957.5.1.el7.x86_64
0x29
5
worker_thread
vmlinux 0xffffffff960baed9
Build id: 3.10.0-957.5.1.el7.x86_64
0x1d9
6
? manage_workers.isra.25
vmlinux 0xffffffff960bad00
Build id: 3.10.0-957.5.1.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffff960c1c71
Build id: 3.10.0-957.5.1.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffff960c1ba0
Build id: 3.10.0-957.5.1.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffff96774c37
Build id: 3.10.0-957.5.1.el7.x86_64
0x21
10
? insert_kthread_work
vmlinux 0xffffffff960c1ba0
Build id: 3.10.0-957.5.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [kworker/0:1:23111]
Modules linked in: rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg vmw_vmci parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif
crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm vmw_pvscsi ata_piix libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 23111 Comm: kworker/0:1 Kdump: loaded Tainted: G             L ------------   3.10.0-957.5.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff93f33c84c100 ti: ffff93f3ecaa8000 task.ti: ffff93f3ecaa8000
RIP: 0010:[<ffffffff960d08c7>]  [<ffffffff960d08c7>] finish_task_switch+0x57/0x1c0
RSP: 0000:ffff93f3ecaabda8  EFLAGS: 00000282
RAX: ffff93f33cf130c0 RBX: 0000000000001400 RCX: 0000000000000000
RDX: ffff93f3ecaa9fd8 RSI: ffff93f33c84c100 RDI: ffff93f3ffc1ab80
RBP: ffff93f3ecaabdc8 R08: ffff93f3ecaa8000 R09: 0000000000000001
R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000086
R13: ffffffff960e064c R14: ffff93f3ecaabd50 R15: 0000000000000001
FS:  0000000000000000(0000) GS:ffff93f3ffc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000000000b8 CR3: 0000000236d80000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9676778f>] __schedule+0x3ff/0x890
[<ffffffff960b9e2a>] ? process_one_work+0x21a/0x440
[<ffffffff96767c49>] schedule+0x29/0x70
[<ffffffff960baed9>] worker_thread+0x1d9/0x3c0
[<ffffffff960bad00>] ? manage_workers.isra.25+0x2a0/0x2a0
[<ffffffff960c1c71>] kthread+0xd1/0xe0
[<ffffffff960c1ba0>] ? insert_kthread_work+0x40/0x40
[<ffffffff96774c37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff960c1ba0>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 65 48 8b 34 25 80 0e 01 00 0f 1f 44 00 00 41 c7 45 28 00 00 00 00 48 89 df c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <65> 48 8b 04 25 80 0e 01 00 48 8b 98 78 01 00 00 48 85 db 74 22 
Complete report #60928
Frame # Function Binary Source or offset Line
1
finish_task_switch
vmlinux 0xffffffff810bf107
Build id: 3.10.0-693.2.2.el7.x86_64
0x57
2
__schedule
vmlinux 0xffffffff816a8fad
Build id: 3.10.0-693.2.2.el7.x86_64
0x39d
3
schedule
vmlinux 0xffffffff816a94e9
Build id: 3.10.0-693.2.2.el7.x86_64
0x29
4
worker_thread
vmlinux 0xffffffff810a9599
Build id: 3.10.0-693.2.2.el7.x86_64
0x1d9
5
? manage_workers.isra.24
vmlinux 0xffffffff810a93c0
Build id: 3.10.0-693.2.2.el7.x86_64
0x2a0
6
kthread
vmlinux 0xffffffff810b098f
Build id: 3.10.0-693.2.2.el7.x86_64
0xcf
7
? finish_task_switch
vmlinux 0xffffffff810bf107
Build id: 3.10.0-693.2.2.el7.x86_64
0x57
8
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.2.2.el7.x86_64
0x40
9
ret_from_fork
vmlinux 0xffffffff816b4f58
Build id: 3.10.0-693.2.2.el7.x86_64
0x58
10
? insert_kthread_work
vmlinux 0xffffffff810b08c0
Build id: 3.10.0-693.2.2.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kworker/u256:1:2397]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter lp vmw_vsock_vmci_transport vsock fuse vmhgfs(OE) snd_seq_midi snd_seq_midi_event ext4 mbcache jbd2 sb_edac edac_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr ppdev joydev snd_ens1371 vmw_balloon snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd soundcore nfit sg libnvdimm parport_pc parport shpchp vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi
sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel libata mptspi serio_raw scsi_transport_spi mptscsih mptbase vmxnet3 i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 2397 Comm: kworker/u256:1 Tainted: G           OEL ------------   3.10.0-693.2.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff8800447b0fd0 ti: ffff88004efdc000 task.ti: ffff88004efdc000
RIP: 0010:[<ffffffff810bf107>]  [<ffffffff810bf107>] finish_task_switch+0x57/0x160
RSP: 0018:ffff88004efdfdd0  EFLAGS: 00000286
RAX: ffff880078838000 RBX: ffff88007b616cc0 RCX: 0000000000000000
RDX: ffff88004efddfd8 RSI: ffff8800447b0fd0 RDI: ffff88007b616cc0
RBP: ffff88004efdfdf0 R08: ffff88004efdc000 R09: ffff88007a5d8079
R10: 0000000000000000 R11: 0000000000000000 R12: ffff8800447b1038
R13: ffffffff8109a048 R14: ffff88004efdfd40 R15: 0000000000002000
FS:  0000000000000000(0000) GS:ffff88007b600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000000000b8 CR3: 000000005f257000 CR4: 00000000001407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000000000 ffff88007b616cc0 ffff880035a55dc0 0000000000000006
ffff88004efdfe50 ffffffff816a8fad ffff8800447b0fd0 ffff88004efdffd8
ffff88004efdffd8 ffff88004efdffd8 ffff8800447b0fd0 ffff88007a5c1820
Call Trace:
[<ffffffff816a8fad>] __schedule+0x39d/0x8b0
[<ffffffff816a94e9>] schedule+0x29/0x70
[<ffffffff810a9599>] worker_thread+0x1d9/0x3c0
[<ffffffff810a93c0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffff810b098f>] kthread+0xcf/0xe0
[<ffffffff810bf107>] ? finish_task_switch+0x57/0x160
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
[<ffffffff816b4f58>] ret_from_fork+0x58/0x90
[<ffffffff810b08c0>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 65 48 8b 34 25 00 ce 00 00 0f 1f 44 00 00 41 c7 45 28 00 00 00 00 48 89 df c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <65> 48 8b 04 25 00 ce 00 00 48 8b 98 78 01 00 00 48 85 db 74 1c 
Complete report #22585
Frame # Function Binary Source or offset Line
1
finish_task_switch
vmlinux 0xffffffffa42c9664
Build id: 3.10.0-862.el7.x86_64
0x54
2
__schedule
vmlinux 0xffffffffa491291c
Build id: 3.10.0-862.el7.x86_64
0x41c
3
? process_one_work
vmlinux 0xffffffffa42b2e9a
Build id: 3.10.0-862.el7.x86_64
0x21a
4
schedule
vmlinux 0xffffffffa4912f49
Build id: 3.10.0-862.el7.x86_64
0x29
5
worker_thread
vmlinux 0xffffffffa42b3b79
Build id: 3.10.0-862.el7.x86_64
0x1d9
6
? manage_workers.isra.24
vmlinux 0xffffffffa42b39a0
Build id: 3.10.0-862.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffffa42bae31
Build id: 3.10.0-862.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffffa42bad60
Build id: 3.10.0-862.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffffa491f637
Build id: 3.10.0-862.el7.x86_64
0x21
10
? insert_kthread_work
vmlinux 0xffffffffa42bad60
Build id: 3.10.0-862.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 21s! [kworker/u64:3:25243]
<EOI> 
Modules linked in:
xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 xt_addrtype nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat xt_conntrack nf_conntrack br_netfilter ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink overlay(T) vmw_vsock_vmci_transport vsock sunrpc coretemp kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd vmw_balloon joydev pcspkr sg parport_pc floppy parport vmw_vmci shpchp i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom vmwgfx ata_generic drm_kms_helper syscopyarea sysfillrect sysimgblt pata_acpi fb_sys_fops ttm mptspi scsi_transport_spi mptscsih drm ata_piix crct10dif_pclmul crct10dif_common
libata e1000 crc32c_intel mptbase serio_raw i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 25243 Comm: kworker/u64:3 Kdump: loaded Tainted: G             L ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff9867f6363f40 ti: ffff986849208000 task.ti: ffff986849208000
RIP: 0010:[<ffffffffa42c9664>]  [<ffffffffa42c9664>] finish_task_switch+0x54/0x170
RSP: 0000:ffff98684920bda8  EFLAGS: 00000286
RAX: ffff986afebc8000 RBX: ffff986b6ee98b80 RCX: 0000000000000000
RDX: ffff986849209fd8 RSI: ffff9867f6363f40 RDI: ffff986b6ee98b00
RBP: ffff98684920bdc8 R08: ffff986849208000 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000001 R12: 0000000200000000
R13: 0000000000000000 R14: ffff986b6eed8b00 R15: ffffffffa42d865c
FS:  0000000000000000(0000) GS:ffff986b6ee80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00000000000000b8 CR3: 0000000313e0e000 CR4: 00000000000007e0
Call Trace:
[<ffffffffa491291c>] __schedule+0x41c/0xa20
[<ffffffffa42b2e9a>] ? process_one_work+0x21a/0x440
[<ffffffffa4912f49>] schedule+0x29/0x70
[<ffffffffa42b3b79>] worker_thread+0x1d9/0x3c0
[<ffffffffa42b39a0>] ? manage_workers.isra.24+0x2a0/0x2a0
[<ffffffffa42bae31>] kthread+0xd1/0xe0
[<ffffffffa42bad60>] ? insert_kthread_work+0x40/0x40
[<ffffffffa491f637>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffa42bad60>] ? insert_kthread_work+0x40/0x40
Code: 8b 36 66 66 66 66 90 65 48 8b 34 25 40 0e 01 00 66 66 66 66 90 41 c7 45 28 00 00 00 00 48 89 df c6 07 00 66 66 66 90 fb 66 66 90 <66> 66 90 65 48 8b 04 25 40 0e 01 00 48 8b 98 78 01 00 00 48 85 
Complete report #20170
Frame # Function Binary Source or offset Line
1
finish_task_switch
vmlinux 0xffffffff81ed5007
Build id: 3.10.0-1062.9.1.el7.x86_64
0x57
2
__schedule
vmlinux 0xffffffff825805a2
Build id: 3.10.0-1062.9.1.el7.x86_64
0x402
3
? process_one_work
vmlinux 0xffffffff81ebe2ba
Build id: 3.10.0-1062.9.1.el7.x86_64
0x21a
4
schedule
vmlinux 0xffffffff82580a09
Build id: 3.10.0-1062.9.1.el7.x86_64
0x29
5
worker_thread
vmlinux 0xffffffff81ebf3e9
Build id: 3.10.0-1062.9.1.el7.x86_64
0x1d9
6
? manage_workers.isra.26
vmlinux 0xffffffff81ebf210
Build id: 3.10.0-1062.9.1.el7.x86_64
0x2a0
7
kthread
vmlinux 0xffffffff81ec61f1
Build id: 3.10.0-1062.9.1.el7.x86_64
0xd1
8
? insert_kthread_work
vmlinux 0xffffffff81ec6120
Build id: 3.10.0-1062.9.1.el7.x86_64
0x40
9
ret_from_fork_nospec_begin
vmlinux 0xffffffff8258dd37
Build id: 3.10.0-1062.9.1.el7.x86_64
0x21
10
? insert_kthread_work
vmlinux 0xffffffff81ec6120
Build id: 3.10.0-1062.9.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [kworker/4:0:9604]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink tcp_diag inet_diag vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg joydev pcspkr parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix crct10dif_pclmul crct10dif_common drm mptspi crc32c_intel scsi_transport_spi mptscsih
libata serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 4 PID: 9604 Comm: kworker/4:0 Kdump: loaded Tainted: G             L ------------   3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/30/2013
task: ffff92d2552f5230 ti: ffff92d068224000 task.ti: ffff92d068224000
RIP: 0010:[<ffffffff81ed5007>]  [<ffffffff81ed5007>] finish_task_switch+0x57/0x1c0
RSP: 0000:ffff92d068227da8  EFLAGS: 00000282
RAX: ffff92ce7ca420e0 RBX: ffff92d068227d58 RCX: 0000000000000000
RDX: ffff92d068225fd8 RSI: ffff92d2552f5230 RDI: ffff92d26ef1ac80
RBP: ffff92d068227dc8 R08: ffff92d068224000 R09: 0000000000000001
R10: 0000000000000027 R11: 000000000000000c R12: ffff92d068227d58
R13: ffffffff81ee4ebc R14: ffff92d068227d50 R15: 0000000000000001
FS:  0000000000000000(0000) GS:ffff92d26ef00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000000000b8 CR3: 0000000230d4c000 CR4: 00000000000407e0
Call Trace:
[<ffffffff825805a2>] __schedule+0x402/0x840
[<ffffffff81ebe2ba>] ? process_one_work+0x21a/0x440
[<ffffffff82580a09>] schedule+0x29/0x70
[<ffffffff81ebf3e9>] worker_thread+0x1d9/0x3c0
[<ffffffff81ebf210>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffff81ec61f1>] kthread+0xd1/0xe0
[<ffffffff81ec6120>] ? insert_kthread_work+0x40/0x40
[<ffffffff8258dd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffff81ec6120>] ? insert_kthread_work+0x40/0x40
Code: 1f 44 00 00 65 48 8b 34 25 80 0e 01 00 0f 1f 44 00 00 41 c7 45 28 00 00 00 00 48 89 df c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <65> 48 8b 04 25 80 0e 01 00 48 8b 98 78 01 00 00 48 85 db 74 22 
Complete report #803367
Frame # Function Binary Source or offset Line
1
finish_task_switch
vmlinux 0xffffffffbaad5004
Build id: 3.10.0-1062.12.1.el7.x86_64
0x54
2
__schedule
vmlinux 0xffffffffbb1805c2
Build id: 3.10.0-1062.12.1.el7.x86_64
0x402
3
? xfs_end_io
xfs 0xffffffffc054f8a5
Build id: 3.10.0-1062.12.1.el7.x86_64
0x55
4
? process_one_work
vmlinux 0xffffffffbaabe2ba
Build id: 3.10.0-1062.12.1.el7.x86_64
0x21a
5
schedule
vmlinux 0xffffffffbb180a29
Build id: 3.10.0-1062.12.1.el7.x86_64
0x29
6
worker_thread
vmlinux 0xffffffffbaabf3e9
Build id: 3.10.0-1062.12.1.el7.x86_64
0x1d9
7
? manage_workers.isra.26
vmlinux 0xffffffffbaabf210
Build id: 3.10.0-1062.12.1.el7.x86_64
0x2a0
8
kthread
vmlinux 0xffffffffbaac61f1
Build id: 3.10.0-1062.12.1.el7.x86_64
0xd1
9
? insert_kthread_work
vmlinux 0xffffffffbaac6120
Build id: 3.10.0-1062.12.1.el7.x86_64
0x40
10
ret_from_fork_nospec_begin
vmlinux 0xffffffffbb18dd37
Build id: 3.10.0-1062.12.1.el7.x86_64
0x21
11
? insert_kthread_work
vmlinux 0xffffffffbaac6120
Build id: 3.10.0-1062.12.1.el7.x86_64
0x40
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 23s! [kworker/7:2:15371]
Modules linked in: nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev vmw_balloon coretemp pcspkr joydev sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi libata scsi_transport_spi mptscsih vmxnet3 mptbase serio_raw crc32c_intel floppy drm_panel_orientation_quirks
dm_mirror dm_region_hash dm_log dm_mod
CPU: 7 PID: 15371 Comm: kworker/7:2 Kdump: loaded Tainted: G             L ------------   3.10.0-1062.12.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff993a63ae62a0 ti: ffff993b1b6e8000 task.ti: ffff993b1b6e8000
RIP: 0010:[<ffffffffbaad5004>]  [<ffffffffbaad5004>] finish_task_switch+0x54/0x1c0
RSP: 0018:ffff993b1b6ebda8  EFLAGS: 00000282
RAX: ffff993a3b0a62a0 RBX: ffff993b1b6ebd30 RCX: 0000000000000000
RDX: ffff993b1b6e9fd8 RSI: ffff993a63ae62a0 RDI: ffff993bbfddac80
RBP: ffff993b1b6ebdc8 R08: ffff993b1b6e8000 R09: 0000000000000001
R10: 0000000000000003 R11: 7fffffffffffffff R12: ffff993ba3e51e00
R13: ffffffffbaae4ecc R14: ffff993b1b6ebd50 R15: 0000000000000001
FS:  0000000000000000(0000) GS:ffff993bbfdc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000000000b8 CR3: 00000002e4f26000 CR4: 00000000000007e0
Call Trace:
[<ffffffffbb1805c2>] __schedule+0x402/0x840
[<ffffffffc054f8a5>] ? xfs_end_io+0x55/0x90 [xfs]
[<ffffffffbaabe2ba>] ? process_one_work+0x21a/0x440
[<ffffffffbb180a29>] schedule+0x29/0x70
[<ffffffffbaabf3e9>] worker_thread+0x1d9/0x3c0
[<ffffffffbaabf210>] ? manage_workers.isra.26+0x2a0/0x2a0
[<ffffffffbaac61f1>] kthread+0xd1/0xe0
[<ffffffffbaac6120>] ? insert_kthread_work+0x40/0x40
[<ffffffffbb18dd37>] ret_from_fork_nospec_begin+0x21/0x21
[<ffffffffbaac6120>] ? insert_kthread_work+0x40/0x40
Code: 8b 36 66 66 66 66 90 65 48 8b 34 25 80 0e 01 00 66 66 66 66 90 41 c7 45 28 00 00 00 00 48 89 df c6 07 00 66 66 66 90 fb 66 66 90 <66> 66 90 65 48 8b 04 25 80 0e 01 00 48 8b 98 78 01 00 00 48 85