NMI watchdog: BUG: soft lockup - CPU#3 stuck for 58s! [kcml:5639]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter tcp_lp nls_utf8 isofs vboxsf(OE) sunrpc crc32_pclmul snd_intel8x0 ppdev ghash_clmulni_intel snd_ac97_codec ac97_bus snd_seq snd_seq_device aesni_intel snd_pcm lrw gf128mul glue_helper ablk_helper cryptd joydev sg pcspkr snd_timer snd vboxguest(OE) parport_pc soundcore i2c_piix4 parport video ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci ata_piix crct10dif_pclmul
crct10dif_common serio_raw crc32c_intel libata e1000 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 5639 Comm: kcml Tainted: G           OEL ------------   3.10.0-1160.81.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff91b1be388000 ti: ffff91b22df84000 task.ti: ffff91b22df84000
RIP: 0010:[<ffffffff8d8016d8>]  [<ffffffff8d8016d8>] handle_mm_fault+0x138/0xfb0
RSP: 0000:ffff91b22df87df0  EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffffffff8d7c8f2b RCX: 0000000000000000
RDX: 0000000000000029 RSI: 00000000080000d5 RDI: 0000000000000000
RBP: ffff91b22df87ea8 R08: ffff91b338163200 R09: 0000000000000000
R10: ffff91b22df87e20 R11: 000000000207e9e0 R12: 00000000dca2b6f1
R13: 0000000000000000 R14: 0000000000000000 R15: ffffeefdc58769c0
FS:  00007f77203af740(0000) GS:ffff91b39fd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f76d7f2b370 CR3: 0000000102a82000 CR4: 00000000000606e0
Call Trace:
[<ffffffff8ddbf7d3>] __do_page_fault+0x213/0x510
[<ffffffff8ddbfb05>] do_page_fault+0x35/0x90
[<ffffffff8ddbb7b8>] page_fault+0x28/0x30
Code: e1 00 03 00 00 4d 8b 45 40 75 20 65 48 8b 04 25 c0 0e 01 00 48 83 b8 68 04 00 00 00 74 0d 4c 3b 80 68 04 00 00 0f 84 40 06 00 00 <f7> c6 00 00 40 00 0f 85 87 0d 00 00 4d 89 fc 49 c1 ec 24 41 81 

list_del corruption, fffffddf897bb560->next is LIST_POISON1 (dead000000000100)
[<ffffffffb07f66a2>] handle_mm_fault+0xb22/0xfb0
[<ffffffffb0d94975>] do_page_fault+0x35/0x90
[<ffffffffb0d90778>] page_fault+0x28/0x30

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 21s! [sshd:9573]
Modules linked in: binfmt_misc tcp_lp nls_utf8 isofs veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon pcspkr joydev
sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci ata_piix libahci mptspi scsi_transport_spi libata mptscsih crct10dif_pclmul crct10dif_common crc32c_intel mptbase serio_raw vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 9573 Comm: sshd Kdump: loaded Tainted: G               ------------ T 3.10.0-1160.6.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff9bec9ebec200 ti: ffff9beceef70000 task.ti: ffff9beceef70000
RIP: 0010:[<ffffffff93bf533a>]  [<ffffffff93bf533a>] handle_mm_fault+0xea/0xfb0
RSP: 0000:ffff9beceef73df0  EFLAGS: 00010286
RAX: ffff9becc53a6c00 RBX: ffff9bec9ebec200 RCX: 0000000000000000
RDX: 0000000000000002 RSI: 0000000008100073 RDI: ffff9beceef73e78
RBP: ffff9beceef73ea8 R08: 00007ffe9e26bf64 R09: ffff9beca2bd75f0
R10: ffff9beceef73e20 R11: 0000000000000000 R12: ffffffff9421e640
R13: ffff9bec9ebec7e8 R14: ffff9becce7d7338 R15: fffff4b37b259940
FS:  00007f4925a9b8c0(0000) GS:ffff9c0b3d680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4925490324 CR3: 00000001ed79e000 CR4: 00000000001607e0
Call Trace:
[<ffffffff9418f653>] __do_page_fault+0x213/0x500
[<ffffffff9418f975>] do_page_fault+0x35/0x90
[<ffffffff9418b778>] page_fault+0x28/0x30
Code: 49 2b 45 00 48 c1 e8 0c 49 03 85 98 00 00 00 48 89 45 80 49 8b 85 a0 00 00 00 4c 89 7d 88 4c 89 6d b0 48 85 c0 0f 84 66 05 00 00 <48> 8b 80 d0 00 00 00 48 8b 80 80 00 00 00 25 ff ff ff 01 0c c0 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [ondot-redis-kee:20773]
Modules linked in: vsock_diag tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_16108(E) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc ppdev vmw_balloon pcspkr joydev sg vmw_vmci parport_pc parport i2c_piix4 binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic crct10dif_common vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops
ttm crc32c_intel drm ata_piix serio_raw nfit libnvdimm libata vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 20773 Comm: ondot-redis-kee Kdump: loaded Tainted: P            EL ------------   3.10.0-1160.83.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff905148cd3180 ti: ffff90513bfdc000 task.ti: ffff90513bfdc000
RIP: 0010:[<ffffffff91dbf69b>]  [<ffffffff91dbf69b>] __do_page_fault+0xdb/0x510
RSP: 0000:ffff90513bfdfeb8  EFLAGS: 00000206
RAX: ffff90513bfdffd8 RBX: 00007fb0925c08b0 RCX: 0000000000000000
RDX: 000000000046a860 RSI: 0000000000000014 RDI: ffff90513bfdff58
RBP: ffff90513bfdff18 R08: 0000000000000000 R09: 00007ffcb0389300
R10: 0000000000000008 R11: 0000000000000246 R12: 00000000000002a8
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
FS:  00007fb092e4c740(0000) GS:ffff90527fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000046a860 CR3: 000000029630e000 CR4: 00000000000007e0
Call Trace:
[<ffffffff91dbfb05>] do_page_fault+0x35/0x90
[<ffffffff91dbb7b8>] page_fault+0x28/0x30
Code: f7 80 44 c0 ff ff ff ff ff ef 0f 85 40 02 00 00 4d 85 ff 0f 84 37 02 00 00 41 f6 86 88 00 00 00 03 0f 84 a9 00 00 00 fb 66 66 90 <66> 66 90 41 bc a8 00 00 00 48 83 cb 04 66 66 66 66 90 44 89 e0 
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [CRTC:37:crtc-0] flip_done timed out
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [PLANE:33:plane-0] flip_done timed out

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 2467s! [python3.9:14753]
Modules linked in: ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter binfmt_misc overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc loop squashfs vboxvideo(OE) ttm ppdev drm_kms_helper snd_intel8x0 syscopyarea sysfillrect snd_ac97_codec ac97_bus sysimgblt fb_sys_fops snd_seq snd_seq_device snd_pcm drm pcspkr snd_timer joydev sg parport_pc snd parport vboxguest(OE) soundcore
video drm_panel_orientation_quirks i2c_piix4 ip_tables xfs libcrc32c dm_crypt drbg hid_multitouch sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi ata_piix crct10dif_pclmul crct10dif_common crc32_pclmul ahci crc32c_intel ghash_clmulni_intel libahci aesni_intel libata glue_helper lrw gf128mul e1000 ablk_helper cryptd serio_raw dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 14753 Comm: python3.9 Kdump: loaded Tainted: G           OEL ------------ T 3.10.0-1160.83.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff9f7b3f484200 ti: ffff9f7a4026c000 task.ti: ffff9f7a4026c000
RIP: 0010:[<ffffffffbd7bf69e>]  [<ffffffffbd7bf69e>] __do_page_fault+0xde/0x510
RSP: 0000:ffff9f7a4026feb8  EFLAGS: 00000206
RAX: ffff9f7a4026ffd8 RBX: ffffffffc02e9ea4 RCX: 0000000000000000
RDX: 00007fe827d80024 RSI: 0000000000000006 RDI: ffff9f7a4026ff58
RBP: ffff9f7a4026ff18 R08: 000000000094ba10 R09: 0000000001a33028
R10: 0000000001a33048 R11: 00000000ffffffff R12: 0007ffffffffffff
R13: fffffffffffffffe R14: 0000000000000001 R15: 0000000001a64cb3
FS:  00007fe83c9e6740(0000) GS:ffff9f7e25d80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe827d80024 CR3: 000000010cffa000 CR4: 00000000000606e0
Call Trace:
[<ffffffffbd7bfb05>] do_page_fault+0x35/0x90
[<ffffffffbd7bb7b8>] page_fault+0x28/0x30
Code: c0 ff ff ff ff ff ef 0f 85 40 02 00 00 4d 85 ff 0f 84 37 02 00 00 41 f6 86 88 00 00 00 03 0f 84 a9 00 00 00 fb 66 0f 1f 44 00 00 <41> bc a8 00 00 00 48 83 cb 04 0f 1f 44 00 00 44 89 e0 48 89 d9 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [check_jstat.sh:13861]
Modules linked in: vsock_diag tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink ipmi_devintf ipmi_msghandler vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev vmw_balloon pcspkr sg parport_pc parport vmw_vmci i2c_piix4 binfmt_misc ip_tables xfs libcrc32c ata_generic pata_acpi vmwgfx sd_mod crc_t10dif drm_kms_helper crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci libahci
nfit drm libnvdimm crct10dif_pclmul crct10dif_common ata_piix e1000e crc32c_intel serio_raw libata ptp pps_core vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 13861 Comm: check_jstat.sh Kdump: loaded Tainted: G        W    L ------------   3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/28/2017
task: ffff9ece030b9070 ti: ffff9ecd034e8000 task.ti: ffff9ecd034e8000
RIP: 0010:[<ffffffffbdf8d51e>]  [<ffffffffbdf8d51e>] __do_page_fault+0xde/0x500
RSP: 0000:ffff9ecd034ebeb8  EFLAGS: 00000206
RAX: ffff9ecd034ebfd8 RBX: 0000000001f1b69c RCX: 0000000000000000
RDX: 0000000001f231f0 RSI: 0000000000000007 RDI: ffff9ecd034ebf58
RBP: ffff9ecd034ebf18 R08: 0000000001f18710 R09: 0000000001f231f0
R10: fffffffffffff294 R11: 0000000001f20000 R12: 00000000000000a9
R13: ffff9ece461901b0 R14: ffff9ecd034ebe28 R15: 0000000000003626
FS:  00007fb99cc77740(0000) GS:ffff9ed13fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000001f231f0 CR3: 0000000003442000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffbdf8d975>] do_page_fault+0x35/0x90
[<ffffffffbdf89778>] page_fault+0x28/0x30
Code: c0 ff ff ff ff ff ef 0f 85 40 02 00 00 4d 85 ff 0f 84 37 02 00 00 41 f6 86 88 00 00 00 03 0f 84 a9 00 00 00 fb 66 0f 1f 44 00 00 <41> bc a8 00 00 00 48 83 cb 04 0f 1f 44 00 00 44 89 e0 48 89 d9 

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 21s! [df:116881]
Modules linked in: nls_utf8 cifs ccm dns_resolver binfmt_misc fuse devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev vmw_balloon sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper nfit cryptd libnvdimm sg joydev pcspkr i2c_piix4 vmw_vmci parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi
sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 116881 Comm: df Kdump: loaded Tainted: G             L ------------   3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff910232778000 ti: ffff9101ed12c000 task.ti: ffff9101ed12c000
RIP: 0010:[<ffffffffb2f8851e>]  [<ffffffffb2f8851e>] __do_page_fault+0xde/0x500
RSP: 0000:ffff9101ed12feb8  EFLAGS: 00000206
RAX: ffff9101ed12ffd8 RBX: 00007f2cc4e16dce RCX: 0000000000000000
RDX: 00007f2cc4e0d29c RSI: 0000000000000004 RDI: ffff9101ed12ff58
RBP: ffff9101ed12ff18 R08: 00007f2cc4e0755d R09: 00007f2cc4c17598
R10: 0000000000646c2d R11: 0000000000000207 R12: 00000000000000a8
R13: 00007f2cc4e04000 R14: 00007f2cc4e04000 R15: 0000000000000001
FS:  0000000000000000(0000) GS:ffff910235680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2cc4e0d29c CR3: 00000001ed3c6000 CR4: 00000000001607e0
Call Trace:
[<ffffffffb2f88975>] do_page_fault+0x35/0x90
[<ffffffffb2f84778>] page_fault+0x28/0x30
Code: c0 ff ff ff ff ff ef 0f 85 40 02 00 00 4d 85 ff 0f 84 37 02 00 00 41 f6 86 88 00 00 00 03 0f 84 a9 00 00 00 fb 66 0f 1f 44 00 00 <41> bc a8 00 00 00 48 83 cb 04 0f 1f 44 00 00 44 89 e0 48 89 d9 
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [CRTC:37:crtc-0] flip_done timed out
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [PLANE:33:plane-0] flip_done timed out
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [CRTC:37:crtc-0] flip_done timed out