NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [4_scheduler:108705]
Modules linked in: binfmt_misc ipt_rpfilter xt_multiport xt_set iptable_raw ip_set_hash_ip ip_set_hash_net ip_set vxlan ip6_udp_tunnel udp_tunnel ipt_REJECT nf_reject_ipv4 ip6t_MASQUERADE nf_nat_masquerade_ipv6 xt_mark xt_comment ip6table_filter ip6table_mangle iptable_mangle ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables nf_tables veth xt_nat xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat xt_addrtype iptable_filter br_netfilter bridge stp llc overlay(T) ip_vs nf_conntrack vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi sb_edac snd_ac97_codec ac97_bus btusb btrtl ppdev iosf_mbi btbcm snd_seq crc32_pclmul btintel ghash_clmulni_intel
vmw_balloon snd_seq_device bluetooth snd_pcm aesni_intel lrw gf128mul glue_helper snd_timer ablk_helper cryptd snd joydev rfkill pcspkr sg soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul ata_piix crct10dif_common drm nfit crc32c_intel nvme libata e1000 serio_raw libnvdimm nvme_core drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod synosnap(OE)
CPU: 6 PID: 108705 Comm: 4_scheduler Kdump: loaded Tainted: G        W  OEL ------------ T 3.10.0-1160.102.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff96f592e46300 ti: ffff96f65b0b4000 task.ti: ffff96f65b0b4000
RIP: 0010:[<ffffffff83d1db82>]  [<ffffffff83d1db82>] generic_exec_single+0x102/0x1c0
RSP: 0000:ffff96f65b0b7b60  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff96f65b0b7b30 RCX: 0000000000000005
RDX: ffffffff84414350 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff96f65b0b7ba8 R08: ffffffff84414348 R09: ffffd6108f6a6c40
R10: 0000000000004b35 R11: ffff96f2ae5a5368 R12: 0000000000000000
R13: ffffffffffffffff R14: 0000000000000002 R15: 0000000000000030
FS:  00007fde2a528700(0000) GS:ffff96f65d780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fdd71ed1000 CR3: 0000000127c86000 CR4: 00000000003607e0
Call Trace:
[<ffffffff83c81b10>] ? leave_mm+0x130/0x130
[<ffffffff83c81b10>] ? leave_mm+0x130/0x130
[<ffffffff83c81b10>] ? leave_mm+0x130/0x130
[<ffffffff83d1dc9f>] smp_call_function_single+0x5f/0xa0
[<ffffffff83f9c5d5>] ? cpumask_next_and+0x35/0x50
[<ffffffff83d1e25b>] smp_call_function_many+0x22b/0x270
[<ffffffff83c81fa8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff83c82144>] flush_tlb_page+0x54/0xa0
[<ffffffff83e14228>] ptep_clear_flush+0x68/0xa0
[<ffffffff83dfb65e>] wp_page_copy.isra.73+0x32e/0x5d0
[<ffffffff83dfdb6b>] do_wp_page+0xfb/0x730
[<ffffffff83ce0e92>] ? try_to_wake_up+0x192/0x3a0
[<ffffffff83ce111b>] ? wake_up_q+0x5b/0x90
[<ffffffff83e0228a>] handle_mm_fault+0xb3a/0x1190
[<ffffffff843bf7d3>] __do_page_fault+0x213/0x510
[<ffffffff843bfb05>] do_page_fault+0x35/0x90
[<ffffffff843bb7b8>] page_fault+0x28/0x30
Code: 89 de 48 03 14 c5 40 19 95 84 48 89 df e8 97 67 29 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 25s! [nagios:2309]
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 25s! [nagios:2283]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter tun bridge stp llc nfsv3 nfs_acl nfs lockd grace fscache vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev joydev sg vmw_balloon pcspkr i2c_piix4 vmw_vmci parport_pc parport auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit sd_mod drm ahci crc_t10dif libnvdimm crct10dif_generic
libahci ata_piix libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks fuse
CPU: 4 PID: 2283 Comm: nagios Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.53.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff959152659080 ti: ffff958f701b0000 task.ti: ffff958f701b0000
RIP: 0010:[<ffffffffa5d16a32>]  [<ffffffffa5d16a32>] generic_exec_single+0x102/0x1c0
RSP: 0000:ffff958f701b3b60  EFLAGS: 00000202
RAX: 0000000000000006 RBX: ffff958f701b3b30 RCX: 000000000000003a
RDX: 000000000000003f RSI: 0000000000000006 RDI: 0000000000000286
RBP: ffff958f701b3ba8 R08: ffffffffa64137c0 R09: 622030203a706f72
R10: 29212128732f7469 R11: 7963696c6f50202c R12: 000000000000001f
R13: ffffffffffffffff R14: 0000000000000002 R15: 0000000000000030
FS:  00007ff24f6f5740(0000) GS:ffff95917fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000020aedc8 CR3: 00000000b01fa000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffffa5c7ddd0>] ? leave_mm+0x120/0x120
[<ffffffffa5c7ddd0>] ? leave_mm+0x120/0x120
[<ffffffffa5c7ddd0>] ? leave_mm+0x120/0x120
[<ffffffffa5d16b4f>] smp_call_function_single+0x5f/0xa0
[<ffffffffa5f86a45>] ? cpumask_next_and+0x35/0x50
[<ffffffffa5d170fb>] smp_call_function_many+0x22b/0x270
[<ffffffffa5c7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa5c7e3f4>] flush_tlb_page+0x54/0xa0
[<ffffffffa5e08108>] ptep_clear_flush+0x68/0xa0
[<ffffffffa5defc05>] wp_page_copy.isra.73+0x335/0x5b0
[<ffffffffa5df202b>] do_wp_page+0xfb/0x720
[<ffffffffa5e723a4>] ? mntput+0x24/0x40
[<ffffffffa5e5f4e6>] ? path_openat+0x176/0x5a0
[<ffffffffa5e61562>] ? user_path_at_empty+0x72/0xc0
[<ffffffffa5df66a2>] handle_mm_fault+0xb22/0xfb0
[<ffffffffa5e6168d>] ? do_filp_open+0x4d/0xb0
[<ffffffffa6390653>] __do_page_fault+0x213/0x500
[<ffffffffa6390975>] do_page_fault+0x35/0x90
[<ffffffffa638c778>] page_fault+0x28/0x30
Code: 89 de 48 03 14 c5 60 15 95 a6 48 89 df e8 87 71 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [grafana-server:4927]
Modules linked in: veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc snd_hda_codec_idt snd_hda_codec_generic snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device snd_pcm ppdev snd_timer snd soundcore sg parport_pc joydev parport i2c_piix4 video pcspkr ip_tables
xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_common ahci libahci crc32c_intel libata serio_raw e1000 dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 4927 Comm: grafana-server Kdump: loaded Tainted: G               ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff919ac07b1080 ti: ffff9199c3ea0000 task.ti: ffff9199c3ea0000
RIP: 0010:[<ffffffffadd16562>]  [<ffffffffadd16562>] generic_exec_single+0x102/0x1c0
RSP: 0000:ffff9199c3ea3b60  EFLAGS: 00010202
RAX: 00000000000008fd RBX: 00000000000000fb RCX: 0000000000000000
RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000282
RBP: ffff9199c3ea3ba8 R08: 0000000000000001 R09: ffffdede026e54c0
R10: 0000000000003ef0 R11: ffff919a62134360 R12: 0000000000000000
R13: 00000000000008fd R14: 0000000000000001 R15: ffffdede026e54c0
FS:  00007f823f5fe700(0000) GS:ffff919b1f500000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c00010c200 CR3: 0000000003f92000 CR4: 00000000000006e0
Call Trace:
[<ffffffffadc7e6a0>] ? leave_mm+0x120/0x120
[<ffffffffadc7e6a0>] ? leave_mm+0x120/0x120
[<ffffffffadc7e6a0>] ? leave_mm+0x120/0x120
[<ffffffffadd1667f>] smp_call_function_single+0x5f/0xa0
[<ffffffffadf85de5>] ? cpumask_next_and+0x35/0x50
[<ffffffffadd16c2b>] smp_call_function_many+0x22b/0x270
[<ffffffffadc7e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffadc7ea04>] flush_tlb_page+0x54/0xa0
[<ffffffffade07728>] ptep_clear_flush+0x68/0xa0
[<ffffffffaddef295>] wp_page_copy.isra.73+0x335/0x5b0
[<ffffffffaddf16bb>] do_wp_page+0xfb/0x720
[<ffffffffadcda830>] ? try_to_wake_up+0x190/0x390
[<ffffffffadcdaaab>] ? wake_up_q+0x5b/0x80
[<ffffffffaddf5d32>] handle_mm_fault+0xb22/0xfb0
[<ffffffffae38e653>] __do_page_fault+0x213/0x500
[<ffffffffae38e975>] do_page_fault+0x35/0x90
[<ffffffffae38aac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffae38a778>] page_fault+0x28/0x30
Code: 89 de 48 03 14 c5 e0 13 95 ae 48 89 df e8 f7 69 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kube-controller:24191]
Modules linked in: vsock_diag tcp_diag udp_diag inet_diag unix_diag binfmt_misc nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver ip_vs nfs nf_conntrack lockd grace libcrc32c fscache vmw_vsock_vmci_transport vsock sunrpc ppdev coretemp joydev pcspkr sg vmw_balloon parport_pc parport i2c_piix4 vmw_vmci ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_common ata_generic pata_acpi serio_raw vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix vmxnet3 mptspi scsi_transport_spi libata mptscsih drm_panel_orientation_quirks mptbase dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 24191 Comm: kube-controller Tainted: G        W    L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff924ae4c8b0c0 ti: ffff924b42858000 task.ti: ffff924b42858000
RIP: 0010:[<ffffffffbab1109a>]  [<ffffffffbab1109a>] generic_exec_single+0xfa/0x1b0
RSP: 0000:ffff924b4285bae0  EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffff924b4285bab0 RCX: 000000000000003c
RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000282
RBP: ffff924b4285bb30 R08: ffffffffbb213000 R09: fffff289405142c0
R10: 00000000000041e1 R11: 00003ffffffff000 R12: ffff924b4285bb08
R13: 0000000000000002 R14: ffff924b7ffd8008 R15: 0000000000000000
FS:  000000c0002f4790(0000) GS:ffff924b7fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f66503b0088 CR3: 000000010941e000 CR4: 00000000000007f0
Call Trace:
[<ffffffffbaa7a3d0>] ? leave_mm+0x110/0x110
[<ffffffffbaa7a3d0>] ? leave_mm+0x110/0x110
[<ffffffffbaa7a3d0>] ? leave_mm+0x110/0x110
[<ffffffffbab111af>] smp_call_function_single+0x5f/0xa0
[<ffffffffbad75465>] ? cpumask_next_and+0x35/0x50
[<ffffffffbab1175b>] smp_call_function_many+0x22b/0x270
[<ffffffffbaa7a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffbaa7a734>] flush_tlb_page+0x54/0xa0
[<ffffffffbabfd587>] ptep_clear_flush+0x67/0xa0
[<ffffffffbabe55bb>] wp_page_copy.isra.71+0x30b/0x560
[<ffffffffbabe782b>] do_wp_page+0xfb/0x720
[<ffffffffbb0bfeb9>] ? inet_sendmsg+0x69/0xb0
[<ffffffffbaad2ed9>] ? ttwu_do_wakeup+0x19/0xe0
[<ffffffffbb01857d>] ? sock_aio_write+0x15d/0x180
[<ffffffffbabe91bd>] handle_pte_fault+0x37d/0xd10
[<ffffffffbabebc6d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffbb16f5e3>] __do_page_fault+0x203/0x500
[<ffffffffbb16f915>] do_page_fault+0x35/0x90
[<ffffffffbb16ba96>] ? error_swapgs+0xa7/0xbd
[<ffffffffbb16b758>] page_fault+0x28/0x30
Code: 00 b7 01 00 48 89 de 48 03 14 c5 60 b9 74 bb 48 89 df e8 1a b2 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [python3:23119]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event coretemp iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper vmw_balloon ablk_helper cryptd snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm joydev pcspkr snd_timer snd soundcore sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic ata_generic pata_acpi crct10dif_pclmul
crct10dif_common crc32c_intel vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops serio_raw ttm drm mptspi e1000 scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks ata_piix libata nfit libnvdimm
CPU: 6 PID: 23119 Comm: python3 Kdump: loaded Tainted: G             L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff98353992d140 ti: ffff9837c2b2c000 task.ti: ffff9837c2b2c000
RIP: 0010:[<ffffffff88f1109a>]  [<ffffffff88f1109a>] generic_exec_single+0xfa/0x1b0
RSP: 0000:ffff9837c2b2fae0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff9837c2b2fab0 RCX: 0000000000000005
RDX: ffffffff89613790 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff9837c2b2fb30 R08: ffffffff89613788 R09: 0000000000000000
R10: 0000000000000000 R11: 202934362d363878 R12: 0000000000000141
R13: 0000000000000002 R14: ffff9837fffdb008 R15: 0000000000000000
FS:  00007eff63675740(0000) GS:ffff9837ed780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000001e26590 CR3: 00000003fdad4000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff88e7a3d0>] ? leave_mm+0x110/0x110
[<ffffffff88e7a3d0>] ? leave_mm+0x110/0x110
[<ffffffff88e7a3d0>] ? leave_mm+0x110/0x110
[<ffffffff88f111af>] smp_call_function_single+0x5f/0xa0
[<ffffffff89175465>] ? cpumask_next_and+0x35/0x50
[<ffffffff88f1175b>] smp_call_function_many+0x22b/0x270
[<ffffffff88e7a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff88e7a734>] flush_tlb_page+0x54/0xa0
[<ffffffff88ffd587>] ptep_clear_flush+0x67/0xa0
[<ffffffff88fe55bb>] wp_page_copy.isra.71+0x30b/0x560
[<ffffffff88fe782b>] do_wp_page+0xfb/0x720
[<ffffffff894bfeb9>] ? inet_sendmsg+0x69/0xb0
[<ffffffff890fc4d3>] ? selinux_socket_sendmsg+0x23/0x30
[<ffffffff8941857d>] ? sock_aio_write+0x15d/0x180
[<ffffffff88fe91bd>] handle_pte_fault+0x37d/0xd10
[<ffffffff88febc6d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff8956f5e3>] __do_page_fault+0x203/0x500
[<ffffffff8956f915>] do_page_fault+0x35/0x90
[<ffffffff8956b758>] page_fault+0x28/0x30
Code: 00 b7 01 00 48 89 de 48 03 14 c5 60 b9 b4 89 48 89 df e8 1a b2 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [pgrep:73157]
Modules linked in: tcp_lp fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ppdev crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer
sg snd soundcore parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod crc_t10dif crct10dif_generic cdrom ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel vmwgfx serio_raw drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm e1000 ata_piix libata mptspi scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 73157 Comm: pgrep Kdump: loaded Tainted: G             L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff97da135a30c0 ti: ffff97da07104000 task.ti: ffff97da07104000
RIP: 0010:[<ffffffff84b1109a>]  [<ffffffff84b1109a>] generic_exec_single+0xfa/0x1b0
RSP: 0000:ffff97da07107ae0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff97da07107ab0 RCX: 0000000000000001
RDX: ffffffff85212d90 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff97da07107b30 R08: ffffffff85212d88 R09: ffffefee01ef65c0
R10: 0000000000004193 R11: 00003ffffffff000 R12: ffff97da07107ad8
R13: 0000000000000002 R14: ffff97dabffdb008 R15: 0000000000000000
FS:  00007f0c951e7880(0000) GS:ffff97dab9680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0c93eae7c0 CR3: 0000000087306000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffff84a7a3d0>] ? leave_mm+0x110/0x110
[<ffffffff84a7a3d0>] ? leave_mm+0x110/0x110
[<ffffffff84a7a3d0>] ? leave_mm+0x110/0x110
[<ffffffff84b111af>] smp_call_function_single+0x5f/0xa0
[<ffffffff84d75465>] ? cpumask_next_and+0x35/0x50
[<ffffffff84b1175b>] smp_call_function_many+0x22b/0x270
[<ffffffff84a7a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff84a7a734>] flush_tlb_page+0x54/0xa0
[<ffffffff84bfd587>] ptep_clear_flush+0x67/0xa0
[<ffffffff84be55bb>] wp_page_copy.isra.71+0x30b/0x560
[<ffffffff84be782b>] do_wp_page+0xfb/0x720
[<ffffffff84bb64fb>] ? unlock_page+0x2b/0x30
[<ffffffff84be4879>] ? do_read_fault.isra.61+0x139/0x1b0
[<ffffffff84be91bd>] handle_pte_fault+0x37d/0xd10
[<ffffffff84c1b311>] ? __slab_free+0x81/0x2f0
[<ffffffff84bebc6d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff8516f5e3>] __do_page_fault+0x203/0x500
[<ffffffff8516f915>] do_page_fault+0x35/0x90
[<ffffffff8516b758>] page_fault+0x28/0x30
Code: 00 b7 01 00 48 89 de 48 03 14 c5 60 b9 74 85 48 89 df e8 1a b2 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [httpd:4359]
Modules linked in: binfmt_misc nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr joydev i2c_piix4 parport_pc parport vmw_vmci sg ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmwgfx floppy ata_generic pata_acpi drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ttm drm mptspi scsi_transport_spi vmxnet3 mptscsih ata_piix mptbase libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 4359 Comm: httpd Kdump: loaded Tainted: G             L ------------   3.10.0-957.5.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff9c9d75c39040 ti: ffff9c9db7cdc000 task.ti: ffff9c9db7cdc000
RIP: 0010:[<ffffffffb7b111ba>]  [<ffffffffb7b111ba>] generic_exec_single+0xfa/0x1b0
RSP: 0000:ffff9c9db7cdfae0  EFLAGS: 00000202
RAX: 0000000000000002 RBX: ffff9c9db7cdfab0 RCX: 000000000000003e
RDX: 0000000000000003 RSI: 0000000000000002 RDI: 0000000000000282
RBP: ffff9c9db7cdfb30 R08: ffffffffb8212dc0 R09: ffffe0b301806f40
R10: 0000000000003688 R11: 00003ffffffff000 R12: 0000000000000286
R13: 0000000000000001 R14: ffff9c9dbffdb008 R15: 0000000000000000
FS:  00007fb77f7f6700(0000) GS:ffff9c9dbfd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb73766a080 CR3: 0000000077832000 CR4: 00000000000607e0
Call Trace:
[<ffffffffb7a7a400>] ? leave_mm+0x110/0x110
[<ffffffffb7a7a400>] ? leave_mm+0x110/0x110
[<ffffffffb7a7a400>] ? leave_mm+0x110/0x110
[<ffffffffb7b112cf>] smp_call_function_single+0x5f/0xa0
[<ffffffffb7d75a45>] ? cpumask_next_and+0x35/0x50
[<ffffffffb7b1187b>] smp_call_function_many+0x22b/0x270
[<ffffffffb7a7a5c8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb7a7a764>] flush_tlb_page+0x54/0xa0
[<ffffffffb7bfd937>] ptep_clear_flush+0x67/0xa0
[<ffffffffb7be596b>] wp_page_copy.isra.71+0x30b/0x560
[<ffffffffb7be7bdb>] do_wp_page+0xfb/0x720
[<ffffffffb7c32de2>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffffb7be956d>] handle_pte_fault+0x37d/0xd10
[<ffffffffb7ac3b70>] ? cpu_timer_sample_group+0x30/0xa0
[<ffffffffb7bec01d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffb816f5e3>] __do_page_fault+0x203/0x500
[<ffffffffb816f915>] do_page_fault+0x35/0x90
[<ffffffffb816ba96>] ? error_swapgs+0xa7/0xbd
[<ffffffffb816b758>] page_fault+0x28/0x30
Code: 00 b7 01 00 48 89 de 48 03 14 c5 60 b9 74 b8 48 89 df e8 da b6 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#7 stuck for 22s! [runc:65739]
Modules linked in: xt_comment xt_mark xt_nat veth nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock bnep sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi
snd_ac97_codec sb_edac ac97_bus snd_seq iosf_mbi snd_seq_device crc32_pclmul snd_pcm ghash_clmulni_intel aesni_intel lrw gf128mul snd_timer btusb btrtl snd btbcm glue_helper btintel soundcore bluetooth ablk_helper cryptd ppdev rfkill sg pcspkr vmw_balloon joydev parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit drm libnvdimm ata_piix libata mptspi scsi_transport_spi crct10dif_pclmul mptscsih e1000 crct10dif_common mptbase crc32c_intel serio_raw drm_panel_orientation_quirks fuse
CPU: 7 PID: 65739 Comm: runc Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.66.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff9b41f580b180 ti: ffff9b417c36c000 task.ti: ffff9b417c36c000
RIP: 0010:[<ffffffffbab16b62>]  [<ffffffffbab16b62>] generic_exec_single+0x102/0x1c0
RSP: 0000:ffff9b417c36fb60  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff9b417c36fb30 RCX: 0000000000000006
RDX: ffffffffbb214450 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff9b417c36fba8 R08: ffffffffbb214448 R09: ffffd19a453b9240
R10: 00000000000043b2 R11: ffff9b42e051d518 R12: ffff9b41681ba100
R13: ffffffffffffffff R14: 0000000000000002 R15: 0000000000000030
FS:  00007f8ba9f33700(0000) GS:ffff9b436d7c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8ba9f3d3f8 CR3: 0000000228ccc000 CR4: 00000000003607e0
Call Trace:
[<ffffffffbaa7ddd0>] ? leave_mm+0x120/0x120
[<ffffffffbaa7ddd0>] ? leave_mm+0x120/0x120
[<ffffffffbaa7ddd0>] ? leave_mm+0x120/0x120
[<ffffffffbab16c7f>] smp_call_function_single+0x5f/0xa0
[<ffffffffbad86835>] ? cpumask_next_and+0x35/0x50
[<ffffffffbab1722b>] smp_call_function_many+0x22b/0x270
[<ffffffffbaa7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffbaa7e3f4>] flush_tlb_page+0x54/0xa0
[<ffffffffbac08108>] ptep_clear_flush+0x68/0xa0
[<ffffffffbabefc05>] wp_page_copy.isra.73+0x335/0x5b0
[<ffffffffbabf202b>] do_wp_page+0xfb/0x720
[<ffffffffbac267ed>] ? __slab_free+0x9d/0x290
[<ffffffffbac27022>] ? kmem_cache_free+0x1e2/0x200
[<ffffffffbabf66a2>] handle_mm_fault+0xb22/0xfb0
[<ffffffffbb194653>] __do_page_fault+0x213/0x500
[<ffffffffbb194975>] do_page_fault+0x35/0x90
[<ffffffffbb190778>] page_fault+0x28/0x30
Code: 89 de 48 03 14 c5 60 18 75 bb 48 89 df e8 47 6e 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [runc:7999]
Modules linked in: xt_recent veth nf_tables ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache xt_CHECKSUM tun ebtable_filter ebtables ip6table_filter devlink ip6_tables nf_conntrack_netlink xt_statistic xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 ipt_REJECT nf_reject_ipv4 xt_mark xt_addrtype xt_comment xt_conntrack iptable_filter iptable_nat nf_nat_ipv4 nf_nat iptable_mangle ip_set nfnetlink nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nf_conntrack vmw_vsock_vmci_transport vsock dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio sb_edac ppdev iosf_mbi vmw_balloon crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper parport_pc pcspkr joydev sg i2c_piix4 cryptd parport
vmw_vmci br_netfilter auth_rpcgss bridge stp sunrpc llc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper ata_piix syscopyarea sysfillrect sysimgblt fb_sys_fops ttm libata mptspi crct10dif_pclmul crct10dif_common scsi_transport_spi drm serio_raw crc32c_intel mptscsih vmxnet3 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 6 PID: 7999 Comm: runc Kdump: loaded Tainted: G             L ------------   3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff955d0bc45230 ti: ffff955f8026c000 task.ti: ffff955f8026c000
RIP: 0010:[<ffffffff88514a22>]  [<ffffffff88514a22>] generic_exec_single+0x102/0x1c0
RSP: 0000:ffff955f8026fad0  EFLAGS: 00000202
RAX: 0000000000000010 RBX: ffff955f8026faa0 RCX: 0000000000000030
RDX: 000000000000ffff RSI: 0000000000000010 RDI: 0000000000000286
RBP: ffff955f8026fb20 R08: ffffffff88c13500 R09: ffffc6ed0c557ec0
R10: 0000000000002ccc R11: 00003ffffffff000 R12: ffff955d0bc45230
R13: 0000000000000002 R14: ffff955e7ffdb008 R15: 0000000000000000
FS:  00007f9d38476740(0000) GS:ffff955e6fd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c000140000 CR3: 000000013c87c000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8847d1d0>] ? leave_mm+0x110/0x110
[<ffffffff8847d1d0>] ? leave_mm+0x110/0x110
[<ffffffff8847d1d0>] ? leave_mm+0x110/0x110
[<ffffffff88514b3f>] smp_call_function_single+0x5f/0xa0
[<ffffffff8877f475>] ? cpumask_next_and+0x35/0x50
[<ffffffff885150eb>] smp_call_function_many+0x22b/0x270
[<ffffffff8847d398>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8847d534>] flush_tlb_page+0x54/0xa0
[<ffffffff88603b18>] ptep_clear_flush+0x68/0xa0
[<ffffffff885eb6f5>] wp_page_copy.isra.73+0x335/0x5b0
[<ffffffff885edb1b>] do_wp_page+0xfb/0x720
[<ffffffff88639cc2>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffff885ef4a5>] handle_pte_fault+0x3d5/0xe20
[<ffffffff885f200d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff88b86633>] __do_page_fault+0x213/0x500
[<ffffffff88b86955>] do_page_fault+0x35/0x90
[<ffffffff88b82768>] page_fault+0x28/0x30
Code: 89 de 48 03 14 c5 e0 d7 14 89 48 89 df e8 d7 1a 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [gnome-shell:20188]
Modules linked in: fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm sg snd_timer snd soundcore vmw_vmci i2c_piix4 parport_pc parport sch_fq_codel ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw
vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm e1000 libata drm_panel_orientation_quirks mptspi scsi_transport_spi mptscsih mptbase nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 20188 Comm: gnome-shell Kdump: loaded Not tainted 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff944e35075140 ti: ffff944ea9000000 task.ti: ffff944ea9000000
RIP: 0010:[<ffffffff9d91109a>]  [<ffffffff9d91109a>] generic_exec_single+0xfa/0x1b0
RSP: 0000:ffff944ea9003ae0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff944ea9003ab0 RCX: 0000000000000001
RDX: ffffffff9e012d90 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff944ea9003b30 R08: ffffffff9e012d88 R09: fffffbeb049eb300
R10: 0000000000001494 R11: 00003ffffffff000 R12: 0000000039655900
R13: 0000000000000002 R14: ffff944f3ffd9008 R15: 0000000000000000
FS:  00007f19f909ea80(0000) GS:ffff944f39640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000338e000 CR3: 00000000ad7b6000 CR4: 0000000000740fe0
PKRU: 55555554
Call Trace:
[<ffffffff9d87a3d0>] ? leave_mm+0x110/0x110
[<ffffffff9d87a3d0>] ? leave_mm+0x110/0x110
[<ffffffff9d87a3d0>] ? leave_mm+0x110/0x110
[<ffffffff9d9111af>] smp_call_function_single+0x5f/0xa0
[<ffffffff9db75465>] ? cpumask_next_and+0x35/0x50
[<ffffffff9d91175b>] smp_call_function_many+0x22b/0x270
[<ffffffff9d87a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9d87a734>] flush_tlb_page+0x54/0xa0
[<ffffffff9d9fd587>] ptep_clear_flush+0x67/0xa0
[<ffffffff9d9e55bb>] wp_page_copy.isra.71+0x30b/0x560
[<ffffffff9d9e782b>] do_wp_page+0xfb/0x720
[<ffffffff9da329b2>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffff9d9e91bd>] handle_pte_fault+0x37d/0xd10
[<ffffffff9d9ebc6d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff9df6f5e3>] __do_page_fault+0x203/0x500
[<ffffffff9df6f915>] do_page_fault+0x35/0x90
[<ffffffff9df6b758>] page_fault+0x28/0x30
Code: 00 b7 01 00 48 89 de 48 03 14 c5 60 b9 54 9e 48 89 df e8 1a b2 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [containerd:118592]
Modules linked in: tcp_lp nls_utf8 isofs fuse veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6_tables iptable_filter devlink overlay(T) vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi snd_ac97_codec aesni_intel lrw ppdev ac97_bus gf128mul glue_helper snd_seq ablk_helper cryptd snd_seq_device vmw_balloon snd_pcm snd_timer snd pcspkr joydev nfit soundcore sg libnvdimm parport_pc vmw_vmci parport i2c_piix4 shpchp ip_tables xfs libcrc32c sr_mod cdrom ata_generic
pata_acpi sd_mod crc_t10dif crct10dif_generic ahci crct10dif_pclmul libahci crct10dif_common ata_piix vmwgfx drm_kms_helper mptspi scsi_transport_spi crc32c_intel syscopyarea mptscsih sysfillrect sysimgblt fb_sys_fops ttm drm e1000 libata serio_raw mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 118592 Comm: containerd Kdump: loaded Tainted: G             L ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff8dcb8d83eeb0 ti: ffff8dcbb8d48000 task.ti: ffff8dcbb8d48000
RIP: 0010:[<ffffffff9930779a>]  [<ffffffff9930779a>] generic_exec_single+0xfa/0x1b0
RSP: 0000:ffff8dcbb8d4baf0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff8dcbb8d4bac0 RCX: 0000000000000001
RDX: ffffffff99a13170 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff8dcbb8d4bb38 R08: ffffffff99a13168 R09: ffffc2d6c956f4c0
R10: ffffc2d6c956f4c0 R11: 00003ffffffff000 R12: 0000000100000000
R13: 00000000fffda000 R14: ffffffff9939b54a R15: 000280da00000000
FS:  00007f6187a48740(0000) GS:ffff8dcdf3640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c00015c4a0 CR3: 000000007d066000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff99276e50>] ? leave_mm+0x110/0x110
[<ffffffff99276e50>] ? leave_mm+0x110/0x110
[<ffffffff99276e50>] ? leave_mm+0x110/0x110
[<ffffffff993078af>] smp_call_function_single+0x5f/0xa0
[<ffffffff9954a275>] ? cpumask_next_and+0x35/0x50
[<ffffffff99307e5b>] smp_call_function_many+0x22b/0x270
[<ffffffff99277018>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff992771b4>] flush_tlb_page+0x54/0xa0
[<ffffffff993d8837>] ptep_clear_flush+0x67/0xa0
[<ffffffff993c18be>] wp_page_copy.isra.70+0x29e/0x4f0
[<ffffffff993c3abb>] do_wp_page+0xfb/0x710
[<ffffffff9940ca92>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffff993c536d>] handle_pte_fault+0x36d/0xc30
[<ffffffff99229621>] ? __switch_to+0x151/0x580
[<ffffffff993c747d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff9991a597>] __do_page_fault+0x197/0x4f0
[<ffffffff9991a925>] do_page_fault+0x35/0x90
[<ffffffff99916768>] page_fault+0x28/0x30
Code: 80 96 01 00 48 89 de 48 03 14 c5 a0 53 f3 99 48 89 df e8 4a 87 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 24s! [kworker/u256:2:3066]
[<ffffffffa307e6a0>] ? leave_mm+0x120/0x120
[<ffffffffa307e6a0>] ? leave_mm+0x120/0x120
[<ffffffffa311667f>] smp_call_function_single+0x5f/0xa0
[<ffffffffa3385de5>] ? cpumask_next_and+0x35/0x50
[<ffffffffa3116c2b>] smp_call_function_many+0x22b/0x270
[<ffffffffa307e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa307ea04>] flush_tlb_page+0x54/0xa0
[<ffffffffa3207728>] ptep_clear_flush+0x68/0xa0
[<ffffffffa31ef295>] wp_page_copy.isra.73+0x335/0x5b0
[<ffffffffa31f16bb>] do_wp_page+0xfb/0x720
[<ffffffffa323e322>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffffa31f5d32>] handle_mm_fault+0xb22/0xfb0
[<ffffffffa378e653>] __do_page_fault+0x213/0x500
[<ffffffffa378e975>] do_page_fault+0x35/0x90
[<ffffffffa378a778>] page_fault+0x28/0x30

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [kubelet:5353]
Modules linked in: tcp_lp nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter overlay(T) sunrpc snd_intel8x0 joydev vmwgfx snd_ac97_codec ac97_bus ttm ppdev drm_kms_helper snd_seq snd_seq_device pcspkr snd_pcm vboxguest(OE) syscopyarea sysfillrect sysimgblt fb_sys_fops sg drm snd_timer snd parport_pc drm_panel_orientation_quirks video parport soundcore i2c_piix4 ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif sr_mod crct10dif_generic cdrom crct10dif_common ata_generic pata_acpi ahci crc32c_intel ata_piix serio_raw
libahci libata e1000 dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 5353 Comm: kubelet Kdump: loaded Tainted: G           OE  ------------ T 3.10.0-1160.49.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff8cf0a343b180 ti: ffff8cf113ad0000 task.ti: ffff8cf113ad0000
RIP: 0010:[<ffffffff81b16a32>]  [<ffffffff81b16a32>] generic_exec_single+0x102/0x1c0
RSP: 0000:ffff8cf113ad3b60  EFLAGS: 00010202
RAX: 00000000000008fd RBX: 00000001000280da RCX: 0000000000000000
RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000282
RBP: ffff8cf113ad3ba8 R08: 0000000000000001 R09: ffffd20f81a88b80
R10: 00000000000034b1 R11: ffff8cf116ffb1b0 R12: 0000000000000000
R13: ffffffffffffffff R14: 0000000000000002 R15: 0000000000000030
FS:  00007fe7cce8a740(0000) GS:ffff8cf120100000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe7a50a8f88 CR3: 00000001a3774000 CR4: 00000000000006e0
Call Trace:
[<ffffffff81a7ddd0>] ? leave_mm+0x120/0x120
[<ffffffff81a7ddd0>] ? leave_mm+0x120/0x120
[<ffffffff81a7ddd0>] ? leave_mm+0x120/0x120
[<ffffffff81b16b4f>] smp_call_function_single+0x5f/0xa0
[<ffffffff81d86a45>] ? cpumask_next_and+0x35/0x50
[<ffffffff81b170fb>] smp_call_function_many+0x22b/0x270
[<ffffffff81a7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff81a7e3f4>] flush_tlb_page+0x54/0xa0
[<ffffffff81c08108>] ptep_clear_flush+0x68/0xa0
[<ffffffff81befc05>] wp_page_copy.isra.73+0x335/0x5b0
[<ffffffff81bf202b>] do_wp_page+0xfb/0x720
[<ffffffff81c3ed32>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffff81bf66a2>] handle_mm_fault+0xb22/0xfb0
[<ffffffff82190653>] __do_page_fault+0x213/0x500
[<ffffffff82190975>] do_page_fault+0x35/0x90
[<ffffffff8218cac9>] ? error_swapgs+0xaa/0xc0
[<ffffffff8218c778>] page_fault+0x28/0x30
Code: 89 de 48 03 14 c5 60 15 75 82 48 89 df e8 87 71 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#5 stuck for 23s! [systemd-machine:1434]
Modules linked in: nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM tun devlink overlay(T) ip6t_MASQUERADE nf_nat_masquerade_ipv6 xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_mark ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ppdev vmw_balloon iosf_mbi kvm_intel snd_ens1371 snd_rawmidi kvm snd_ac97_codec ac97_bus irqbypass crc32_pclmul
snd_seq ghash_clmulni_intel snd_seq_device snd_pcm aesni_intel lrw gf128mul glue_helper ablk_helper snd_timer cryptd snd soundcore joydev pcspkr i2c_piix4 sg vmw_vmci nfit libnvdimm parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix mptspi drm crct10dif_pclmul crct10dif_common crc32c_intel scsi_transport_spi libata mptscsih mptbase serio_raw e1000 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 1434 Comm: systemd-machine Kdump: loaded Tainted: G             L ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff9657c842b0c0 ti: ffff965b62ac4000 task.ti: ffff965b62ac4000
RIP: 0010:[<ffffffffa791109a>]  [<ffffffffa791109a>] generic_exec_single+0xfa/0x1b0
RSP: 0000:ffff965b62ac7ae0  EFLAGS: 00000202
RAX: 0000000000000040 RBX: 000000006831bc00 RCX: 0000000000000004
RDX: 0000000000000040 RSI: 0000000000000000 RDI: 0000000000000286
RBP: ffff965b62ac7b30 R08: ffffffffa8013508 R09: ffffec448a092fc0
R10: 00000000000047c9 R11: 00003ffffffff000 R12: ffff965b62ac7bc8
R13: 0000000000000002 R14: ffff965b7ffdb008 R15: 0000000000000000
FS:  00007f434f6bd880(0000) GS:ffff965b68740000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f434f4b87c0 CR3: 000000059ff38000 CR4: 00000000001607e0
Call Trace:
[<ffffffffa787a3d0>] ? leave_mm+0x110/0x110
[<ffffffffa787a3d0>] ? leave_mm+0x110/0x110
[<ffffffffa787a3d0>] ? leave_mm+0x110/0x110
[<ffffffffa79111af>] smp_call_function_single+0x5f/0xa0
[<ffffffffa7b75465>] ? cpumask_next_and+0x35/0x50
[<ffffffffa791175b>] smp_call_function_many+0x22b/0x270
[<ffffffffa787a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa787a734>] flush_tlb_page+0x54/0xa0
[<ffffffffa79fd587>] ptep_clear_flush+0x67/0xa0
[<ffffffffa79e55bb>] wp_page_copy.isra.71+0x30b/0x560
[<ffffffffa79e782b>] do_wp_page+0xfb/0x720
[<ffffffffa7a1b311>] ? __slab_free+0x81/0x2f0
[<ffffffffa79e91bd>] handle_pte_fault+0x37d/0xd10
[<ffffffffa79ebc6d>] handle_mm_fault+0x39d/0x9b0
[<ffffffffa7f6f5e3>] __do_page_fault+0x203/0x500
[<ffffffffa7f6f915>] do_page_fault+0x35/0x90
[<ffffffffa7f6b758>] page_fault+0x28/0x30
Code: 00 b7 01 00 48 89 de 48 03 14 c5 60 b9 54 a8 48 89 df e8 1a b2 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [service-catalog:57572]
Modules linked in: xt_statistic xt_recent vport_vxlan xt_REDIRECT nf_nat_redirect ip_vs_rr xt_ipvs ip_vs vxlan ip6_udp_tunnel udp_tunnel veth nf_conntrack_netlink nfnetlink openvswitch nf_conntrack_ipv6 nf_nat_ipv6 nf_defrag_ipv6 rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache nfsd auth_rpcgss nfs_acl lockd grace iptable_mangle br_netfilter bridge stp llc scsi_transport_iscsi ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_nat iptable_nat nf_nat_ipv4 nf_nat ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_comment xt_mark xt_addrtype xt_conntrack overlay(T) nf_conntrack iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon i2c_piix4 joydev pcspkr sg vmw_vmci
parport_pc parport ip_tables xfs sr_mod cdrom ata_generic pata_acpi sd_mod vmwgfx drm_kms_helper crc32c_intel e1000e syscopyarea sysfillrect sysimgblt fb_sys_fops ttm serio_raw drm ata_piix ptp mptsas libata pps_core scsi_transport_sas mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log fuse target_core_user uio target_core_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common dm_multipath dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio dm_mod libcrc32c
CPU: 1 PID: 57572 Comm: service-catalog Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff93e4da7de300 ti: ffff93e755220000 task.ti: ffff93e755220000
RIP: 0010:[<ffffffff83516842>]  [<ffffffff83516842>] generic_exec_single+0x102/0x1c0
RSP: 0000:ffff93e755223b60  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff93e755223b30 RCX: 0000000000000004
RDX: ffffffff83c13f50 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff93e755223ba8 R08: ffffffff83c13f48 R09: ffffdbdd44f3c700
R10: 00000000000043b2 R11: ffff93e4dc01a000 R12: 0000000000000002
R13: ffff93e8bffcf008 R14: 0000000000000000 R15: 00000003e9257700
FS:  00007f46d3d17700(0000) GS:ffff93e8ad640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c422405000 CR3: 000000034cbaa000 CR4: 00000000000607e0
Call Trace:
[<ffffffff8347e6a0>] ? leave_mm+0x120/0x120
[<ffffffff8347e6a0>] ? leave_mm+0x120/0x120
[<ffffffff8347e6a0>] ? leave_mm+0x120/0x120
[<ffffffff8351695f>] smp_call_function_single+0x5f/0xa0
[<ffffffff83786395>] ? cpumask_next_and+0x35/0x50
[<ffffffff83516f0b>] smp_call_function_many+0x22b/0x270
[<ffffffff8347e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8347ea04>] flush_tlb_page+0x54/0xa0
[<ffffffff836079d8>] ptep_clear_flush+0x68/0xa0
[<ffffffff835ef4e5>] wp_page_copy.isra.73+0x335/0x5b0
[<ffffffff835f190b>] do_wp_page+0xfb/0x720
[<ffffffff8363e5d2>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffff835f5f82>] handle_mm_fault+0xb22/0xfb0
[<ffffffff83b90653>] __do_page_fault+0x213/0x500
[<ffffffff83b90975>] do_page_fault+0x35/0x90
[<ffffffff83b8cac9>] ? error_swapgs+0xaa/0xc0
[<ffffffff83b8c778>] page_fault+0x28/0x30
Code: 89 de 48 03 14 c5 a0 15 15 84 48 89 df e8 c7 6c 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [containerd:3008]
Modules linked in: xt_set ip_set_hash_net vxlan ip6_udp_tunnel udp_tunnel xt_nat xt_mark xfrm6_mode_tunnel xfrm4_mode_tunnel veth esp4 drbg ansi_cprng nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event
snd_ens1371 snd_rawmidi snd_ac97_codec iosf_mbi ac97_bus snd_seq snd_seq_device crc32_pclmul snd_pcm ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper snd_timer cryptd snd pcspkr nfit ppdev vmw_balloon soundcore joydev sg libnvdimm parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common vmwgfx drm_kms_helper syscopyarea sysfillrect crc32c_intel sysimgblt fb_sys_fops mptspi ttm scsi_transport_spi ata_piix serio_raw mptscsih drm mptbase libata e1000 drm_panel_orientation_quirks
CPU: 1 PID: 3008 Comm: containerd Kdump: loaded Tainted: G               ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff98c16172a080 ti: ffff98c35f6c4000 task.ti: ffff98c35f6c4000
RIP: 0010:[<ffffffff9151109a>]  [<ffffffff9151109a>] generic_exec_single+0xfa/0x1b0
RSP: 0000:ffff98c35f6c7ae0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff98c35f6c7ab0 RCX: 0000000000000001
RDX: ffffffff91c12d90 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff98c35f6c7b30 R08: ffffffff91c12d88 R09: ffffe34c475f6d40
R10: 00000000000043b2 R11: 00003ffffffff000 R12: ffff98c4b5f687d0
R13: 0000000000000002 R14: ffff98c4fffdb008 R15: 0000000000000000
FS:  00007fbe8968b740(0000) GS:ffff98c4ed640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fbe84714bb8 CR3: 00000002dbfb2000 CR4: 00000000003607e0
Call Trace:
[<ffffffff9147a3d0>] ? leave_mm+0x110/0x110
[<ffffffff9147a3d0>] ? leave_mm+0x110/0x110
[<ffffffff9147a3d0>] ? leave_mm+0x110/0x110
[<ffffffff915111af>] smp_call_function_single+0x5f/0xa0
[<ffffffff91775465>] ? cpumask_next_and+0x35/0x50
[<ffffffff9151175b>] smp_call_function_many+0x22b/0x270
[<ffffffff9147a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9147a734>] flush_tlb_page+0x54/0xa0
[<ffffffff915fd587>] ptep_clear_flush+0x67/0xa0
[<ffffffff915e55bb>] wp_page_copy.isra.71+0x30b/0x560
[<ffffffff915e782b>] do_wp_page+0xfb/0x720
[<ffffffff916329b2>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffff915e91bd>] handle_pte_fault+0x37d/0xd10
[<ffffffff91628531>] ? set_huge_zero_page.isra.42.part.43+0xb1/0xd0
[<ffffffff915ebc6d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff91b6f5e3>] __do_page_fault+0x203/0x500
[<ffffffff91b6f915>] do_page_fault+0x35/0x90
[<ffffffff91b6b758>] page_fault+0x28/0x30
Code: 00 b7 01 00 48 89 de 48 03 14 c5 60 b9 14 92 48 89 df e8 1a b2 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [docker-containe:28781]
Modules linked in: xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ip_vs nf_conntrack devlink overlay(T) vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq coretemp snd_seq_device iosf_mbi crc32_pclmul snd_pcm ghash_clmulni_intel snd_timer ppdev aesni_intel snd lrw gf128mul glue_helper soundcore vmw_vmci ablk_helper sg vmw_balloon joydev cryptd pcspkr i2c_piix4 shpchp parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif
crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops mptspi ttm scsi_transport_spi ata_piix mptscsih crct10dif_pclmul drm crct10dif_common serio_raw e1000 mptbase libata crc32c_intel i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 6 PID: 28781 Comm: docker-containe Kdump: loaded Tainted: G             L ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/20/2014
task: ffff8f1ea6281fa0 ti: ffff8f1e7bcf8000 task.ti: ffff8f1e7bcf8000
RIP: 0010:[<ffffffff9390779e>]  [<ffffffff9390779e>] generic_exec_single+0xfe/0x1b0
RSP: 0000:ffff8f1e7bcfbaf0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff8f1e7bcfbac0 RCX: 0000000000000006
RDX: ffffffff94013df0 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff8f1e7bcfbb38 R08: ffffffff94013de8 R09: ffffe6f5048e9540
R10: ffffe6f5048e9540 R11: 00003ffffffff000 R12: 0000000100000000
R13: ffffffff938c7a6f R14: ffff8f1e7bcfba88 R15: 000280da00000000
FS:  00007f3da2ff9700(0000) GS:ffff8f1f39780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3da16a2038 CR3: 000000007bd74000 CR4: 00000000003607e0
Call Trace:
[<ffffffff93876e50>] ? leave_mm+0x110/0x110
[<ffffffff93876e50>] ? leave_mm+0x110/0x110
[<ffffffff93876e50>] ? leave_mm+0x110/0x110
[<ffffffff939078af>] smp_call_function_single+0x5f/0xa0
[<ffffffff93b4a275>] ? cpumask_next_and+0x35/0x50
[<ffffffff93907e5b>] smp_call_function_many+0x22b/0x270
[<ffffffff93877018>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff938771b4>] flush_tlb_page+0x54/0xa0
[<ffffffff939d8837>] ptep_clear_flush+0x67/0xa0
[<ffffffff939c18be>] wp_page_copy.isra.70+0x29e/0x4f0
[<ffffffff939c3abb>] do_wp_page+0xfb/0x710
[<ffffffff93a0ca92>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffff939c536d>] handle_pte_fault+0x36d/0xc30
[<ffffffff939c747d>] handle_mm_fault+0x39d/0x9b0
[<ffffffff93f1a597>] __do_page_fault+0x197/0x4f0
[<ffffffff93f1a925>] do_page_fault+0x35/0x90
[<ffffffff93f16768>] page_fault+0x28/0x30
Code: 48 89 de 48 03 14 c5 a0 53 53 94 48 89 df e8 4a 87 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 f6 43 20 01 <75> f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 00 0f 85 87 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 29s! [nginx:1584]
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [thread_pool.rb*:30625]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_lsm_pinned_10703(E) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache vmw_vsock_vmci_transport vsock falcon_lsm_pinned_10404(E) sunrpc iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd vmw_balloon nfit pcspkr joydev sg libnvdimm vmw_vmci shpchp i2c_piix4 parport_pc parport ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel mptspi serio_raw libata scsi_transport_spi mptscsih mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_lsm_serviceable]
CPU: 3 PID: 30625 Comm: thread_pool.rb* Kdump: loaded Tainted: P            E  ------------   3.10.0-862.14.4.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9b78c5b9cf10 ti: ffff9b7955f6c000 task.ti: ffff9b7955f6c000
RIP: 0010:[<ffffffffa810aa2a>]  [<ffffffffa810aa2a>] generic_exec_single+0xfa/0x1b0
RSP: 0000:ffff9b7955f6faf0  EFLAGS: 00000202
RAX: 0000000000000008 RBX: ffff9b7955f6fac0 RCX: 0000000000000038
RDX: 00000000000000ff RSI: 0000000000000008 RDI: 0000000000000282
RBP: ffff9b7955f6fb38 R08: ffffffffa88132a0 R09: fffff71888965840
R10: 00000000000043b5 R11: 00003ffffffff000 R12: 0000000000000001
R13: ffffffffa80beb31 R14: 0000000000000002 R15: ffff9b7cfffdb008
FS:  00007fac7c7ff700(0000) GS:ffff9b7cffcc0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fac6e53e3f0 CR3: 0000000007b14000 CR4: 00000000003607e0
Call Trace:
[<ffffffffa8079c90>] ? leave_mm+0x110/0x110
[<ffffffffa8079c90>] ? leave_mm+0x110/0x110
[<ffffffffa8079c90>] ? leave_mm+0x110/0x110
[<ffffffffa810ab3f>] smp_call_function_single+0x5f/0xa0
[<ffffffffa834edb5>] ? cpumask_next_and+0x35/0x50
[<ffffffffa810b0eb>] smp_call_function_many+0x22b/0x270
[<ffffffffa8079e58>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa8079ff4>] flush_tlb_page+0x54/0xa0
[<ffffffffa81dc0f7>] ptep_clear_flush+0x67/0xa0
[<ffffffffa81c49cb>] wp_page_copy.isra.70+0x30b/0x560
[<ffffffffa81c6c3b>] do_wp_page+0xfb/0x720
[<ffffffffa8210f12>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffffa81c85cd>] handle_pte_fault+0x37d/0xd10
[<ffffffffa81caefd>] handle_mm_fault+0x39d/0x9b0
[<ffffffffa8720547>] __do_page_fault+0x197/0x4f0
[<ffffffffa87208d5>] do_page_fault+0x35/0x90
[<ffffffffa871c758>] page_fault+0x28/0x30
Code: c0 96 01 00 48 89 de 48 03 14 c5 a0 54 d3 a8 48 89 df e8 6a a1 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#6 stuck for 28s! [docker-runc:81310]
Modules linked in: binfmt_misc veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink openvswitch nf_conntrack_ipv6 nf_nat_ipv6 nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_defrag_ipv6 nf_nat ip6table_filter ip6_tables xt_conntrack nf_conntrack iptable_filter sunrpc snd_seq_midi snd_seq_midi_event sb_edac snd_ens1371 snd_rawmidi snd_ac97_codec coretemp ac97_bus iosf_mbi snd_seq crc32_pclmul ghash_clmulni_intel aesni_intel snd_seq_device snd_pcm lrw gf128mul snd_timer glue_helper snd ablk_helper cryptd soundcore ppdev sg pcspkr joydev vmw_balloon parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c
sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ata_piix ttm libata mptspi scsi_transport_spi drm crct10dif_pclmul crct10dif_common mptscsih crc32c_intel e1000 mptbase serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod vfio_pci irqbypass vfio_iommu_type1 vfio
CPU: 6 PID: 81310 Comm: docker-runc Kdump: loaded Tainted: G             L ------------ T 3.10.0-1127.13.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff91f4bedf8000 ti: ffff91f417c30000 task.ti: ffff91f417c30000
RIP: 0010:[<ffffffffa0f16f26>]  [<ffffffffa0f16f26>] generic_exec_single+0x106/0x1c0
RSP: 0000:ffff91f417c33b60  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff91f417c33b30 RCX: 0000000000000008
RDX: ffffffffa1614850 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff91f417c33ba8 R08: ffffffffa1614848 R09: ffffea1b4af07800
R10: 00000000000043b2 R11: ffff91f5e9b6b1b8 R12: 0000000000000002
R13: ffff91f5fffdb008 R14: 0000000000000000 R15: 0000000300000010
FS:  00007f082b02b740(0000) GS:ffff91f5ed780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c420113000 CR3: 00000003004c6000 CR4: 00000000001607e0
Call Trace:
[<ffffffffa0e7e730>] ? leave_mm+0x120/0x120
[<ffffffffa0e7e730>] ? leave_mm+0x120/0x120
[<ffffffffa0e7e730>] ? leave_mm+0x120/0x120
[<ffffffffa0f1703f>] smp_call_function_single+0x5f/0xa0
[<ffffffffa1184fc5>] ? cpumask_next_and+0x35/0x50
[<ffffffffa0f175eb>] smp_call_function_many+0x22b/0x270
[<ffffffffa0e7e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa0e7ea94>] flush_tlb_page+0x54/0xa0
[<ffffffffa1007858>] ptep_clear_flush+0x68/0xa0
[<ffffffffa0fef3a5>] wp_page_copy.isra.73+0x335/0x5b0
[<ffffffffa0ff17cb>] do_wp_page+0xfb/0x720
[<ffffffffa103e262>] ? __mem_cgroup_commit_charge+0xe2/0x2f0
[<ffffffffa0ff5e62>] handle_mm_fault+0xb22/0xfb0
[<ffffffffa158d653>] __do_page_fault+0x213/0x500
[<ffffffffa158d975>] do_page_fault+0x35/0x90
[<ffffffffa1589778>] page_fault+0x28/0x30
Code: 14 c5 60 10 b5 a1 48 89 df e8 17 52 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 f6 43 20 01 <75> f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 00 0f 85 8f 

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [httpd:23745]
Modules linked in: nfsv3 nfs_acl nf_conntrack_netlink rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc snd_hda_codec_generic snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device snd_pcm ppdev snd_timer snd soundcore sg parport_pc pcspkr joydev parport virtio_balloon i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom
ata_generic pata_acpi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm virtio_blk drm ata_piix libata serio_raw 8139too virtio_pci virtio_ring virtio 8139cp mii drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 23745 Comm: httpd Kdump: loaded Tainted: G             L ------------   3.10.0-1127.18.2.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007
task: ffffa00342e4a0e0 ti: ffffa00355dd0000 task.ti: ffffa00355dd0000
RIP: 0010:[<ffffffffac316f72>]  [<ffffffffac316f72>] generic_exec_single+0x102/0x1c0
RSP: 0000:ffffa00355dd3b60  EFLAGS: 00000202
RAX: 00000000000008fd RBX: ffffa003059ab968 RCX: 0000000000000000
RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000282
RBP: ffffa00355dd3ba8 R08: 0000000000000001 R09: ffffea64011e0cc0
R10: 0000000000004a2d R11: ffffa00284b035e8 R12: 0000000000000002
R13: ffffa0039ffd7008 R14: 0000000000000000 R15: 0000000300000000
FS:  00007f4b76e4d880(0000) GS:ffffa0039fd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4b52f07000 CR3: 000000009a9a2000 CR4: 00000000000006e0
Call Trace:
[<ffffffffac27e730>] ? leave_mm+0x120/0x120
[<ffffffffac27e730>] ? leave_mm+0x120/0x120
[<ffffffffac27e730>] ? leave_mm+0x120/0x120
[<ffffffffac31708f>] smp_call_function_single+0x5f/0xa0
[<ffffffffac584fc5>] ? cpumask_next_and+0x35/0x50
[<ffffffffac31763b>] smp_call_function_many+0x22b/0x270
[<ffffffffac27e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffac27ea94>] flush_tlb_page+0x54/0xa0
[<ffffffffac407888>] ptep_clear_flush+0x68/0xa0
[<ffffffffac3ef3c5>] wp_page_copy.isra.73+0x335/0x5b0
[<ffffffffac3f17eb>] do_wp_page+0xfb/0x720
[<ffffffffc051335c>] ? xfs_iunlock+0xfc/0x120 [xfs]
[<ffffffffc0504fd5>] ? xfs_file_buffered_aio_read+0xa5/0x110 [xfs]
[<ffffffffac3f5e82>] handle_mm_fault+0xb22/0xfb0
[<ffffffffac98d653>] __do_page_fault+0x213/0x500
[<ffffffffac98d975>] do_page_fault+0x35/0x90
[<ffffffffac989ac9>] ? error_swapgs+0xaa/0xc0
[<ffffffffac989778>] page_fault+0x28/0x30
Code: 89 de 48 03 14 c5 a0 10 f5 ac 48 89 df e8 c7 51 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 

NMI watchdog: BUG: soft lockup - CPU#2 stuck for 304s! [vmtoolsd:1280]
[<ffffffffa3c7b5c0>] ? leave_mm+0x110/0x110
[<ffffffffa3d125df>] smp_call_function_single+0x5f/0xa0
[<ffffffffa3f77345>] ? cpumask_next_and+0x35/0x50
[<ffffffffa3d12b8b>] smp_call_function_many+0x22b/0x270
[<ffffffffa3c7b788>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa3c7b924>] flush_tlb_page+0x54/0xa0
[<ffffffffa3dfecc7>] ptep_clear_flush+0x67/0xa0
[<ffffffffa3de6d1b>] wp_page_copy.isra.71+0x30b/0x560
[<ffffffffa3de8f6b>] do_wp_page+0xfb/0x720
[<ffffffffa3dea8fd>] handle_pte_fault+0x37d/0xd10
[<ffffffffc03fb0e5>] ? xfs_file_buffered_aio_read+0xa5/0x110 [xfs]
[<ffffffffa3ded3ad>] handle_mm_fault+0x39d/0x9b0
[<ffffffffa4371603>] __do_page_fault+0x203/0x4f0
[<ffffffffa4371925>] do_page_fault+0x35/0x90
[<ffffffffa436d768>] page_fault+0x28/0x30