NMI watchdog: BUG: soft lockup - CPU#1 stuck for 44s! [C1 CompilerThre:18122]
Modules linked in: xt_nat veth nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc ppdev snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm joydev iosf_mbi snd_timer pcspkr vboxguest(OE) sg parport_pc snd soundcore parport video i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif
crct10dif_generic sr_mod crct10dif_common cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm e1000 crc32c_intel libata serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 18122 Comm: C1 CompilerThre Kdump: loaded Tainted: G           OE  ------------ T 3.10.0-1062.18.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff8c286b4dd230 ti: ffff8c27605f4000 task.ti: ffff8c27605f4000
RIP: 0010:[<ffffffffa8b83815>]  [<ffffffffa8b83815>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff8c27605f7d50  EFLAGS: 00010286
RAX: 0000000000000001 RBX: 00000010605f7ce0 RCX: ffffffffa9000000
RDX: 00000000000008fd RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff8c27605f7d50 R08: 0000000087054cd5 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: ffffffffa84e1236
R13: ffff8c27605f7d50 R14: ffffffffffffff10 R15: 0000000000000286
FS:  00007f4732cf4700(0000) GS:ffff8c2878d00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f46ec338010 CR3: 000000005bf9a000 CR4: 00000000000206e0
Call Trace:
[<ffffffffa84db340>] try_to_wake_up+0x190/0x390
[<ffffffffa84db5bb>] wake_up_q+0x5b/0x80
[<ffffffffa85121eb>] futex_wake+0x16b/0x180
[<ffffffffa8514dda>] do_futex+0x12a/0x5a0
[<ffffffffa84d512e>] ? finish_task_switch+0x4e/0x1c0
[<ffffffffa85152d0>] SyS_futex+0x80/0x190
[<ffffffffa8b8de15>] ? system_call_after_swapgs+0xa2/0x146
[<ffffffffa8b8de21>] ? system_call_after_swapgs+0xae/0x146
[<ffffffffa8b8de15>] ? system_call_after_swapgs+0xa2/0x146
[<ffffffffa8b8de21>] ? system_call_after_swapgs+0xae/0x146
[<ffffffffa8b8de15>] ? system_call_after_swapgs+0xa2/0x146
[<ffffffffa8b8de21>] ? system_call_after_swapgs+0xae/0x146
[<ffffffffa8b8dede>] system_call_fastpath+0x25/0x2a
[<ffffffffa8b8de21>] ? system_call_after_swapgs+0xae/0x146
Code: 66 38 99 ff 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 e8 46 38 99 ff 66 90 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 31s! [goa-identity-se:2910]
Modules linked in: tcp_lp btrfs raid6_pq xor vfat fat tcp_diag inet_diag ext4 mbcache jbd2 fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc uas coretemp usb_storage crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper cryptd vmw_balloon
sg pcspkr joydev vmw_vmci parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm serio_raw crct10dif_pclmul crct10dif_common crc32c_intel drm mptspi ata_piix scsi_transport_spi mptscsih libata mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 2910 Comm: goa-identity-se Kdump: loaded Tainted: G             L ------------   3.10.0-1127.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/17/2015
task: ffff9c85b7bca0e0 ti: ffff9c85b6df4000 task.ti: ffff9c85b6df4000
RIP: 0010:[<ffffffff92f883a5>]  [<ffffffff92f883a5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9c85b6df7d50  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff9c85bfc1acc0 RCX: ffff9c85b6df4000
RDX: 0000000000000000 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff9c85b6df7d50 R08: 0000000000000001 R09: ffff9c85b7bca0e0
R10: 0000000000000001 R11: 0000000000000000 R12: ffff9c85bfc1acc0
R13: 00000007babd0ec7 R14: 00000000b6df7d00 R15: ffffffff928e5fe6
FS:  00007fef8f390a80(0000) GS:ffff9c85bfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f1fd6abf7d0 CR3: 000000013894a000 CR4: 00000000000007f0
Call Trace:
[<ffffffff928db6d0>] try_to_wake_up+0x190/0x390
[<ffffffff928db94b>] wake_up_q+0x5b/0x80
[<ffffffff92912b3b>] futex_wake+0x16b/0x180
[<ffffffff9291572a>] do_futex+0x12a/0x5a0
[<ffffffff928e69fb>] ? put_prev_entity+0x8b/0x400
[<ffffffff9282b621>] ? __switch_to+0x151/0x580
[<ffffffff92915c20>] SyS_futex+0x80/0x190
[<ffffffff92f92e09>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff92f92e15>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff92f92e09>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff92f92e15>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff92f92e09>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff92f92e15>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff92f92ed2>] system_call_fastpath+0x25/0x2a
[<ffffffff92f92e15>] ? system_call_after_swapgs+0xa2/0x13a
Code: 07 00 66 66 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 c6 07 00 66 66 66 90 48 89 f7 57 9d <66> 66 90 66 90 5d c3 0f 1f 40 00 66 66 66 66 90 55 48 89 e5 48 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [Softwar~cThread:3523]
Modules linked in: xt_nat veth binfmt_misc tcp_lp xt_addrtype xt_CHECKSUM iptable_mangle br_netfilter ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter overlay(T) sunrpc snd_intel8x0 snd_ac97_codec ac97_bus snd_seq snd_seq_device ppdev snd_pcm joydev iosf_mbi pcspkr sg snd_timer snd parport_pc i2c_piix4 video parport soundcore ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect ata_piix sysimgblt fb_sys_fops ttm e1000 libata drm crc32c_intel serio_raw drm_panel_orientation_quirks dm_mirror
dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 3523 Comm: Softwar~cThread Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.36.2.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff9c9853e84200 ti: ffff9c9874434000 task.ti: ffff9c9874434000
RIP: 0010:[<ffffffff96b8b7b5>]  [<ffffffff96b8b7b5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9c9874437d50  EFLAGS: 00010286
RAX: 0000000000000001 RBX: 000000104092fb00 RCX: ffffffff97000000
RDX: 00000000000008fd RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff9c9874437d50 R08: 00000000de38b363 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: ffffffff964e0c26
R13: ffff9c9874437d50 R14: ffffffffffffff10 R15: 0000000000000292
FS:  00007f160a746700(0000) GS:ffff9c98dfd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fda73a95000 CR3: 000000008a3a8000 CR4: 00000000000206e0
Call Trace:
[<ffffffff964dab12>] try_to_wake_up+0x192/0x390
[<ffffffff964dad8b>] wake_up_q+0x5b/0x80
[<ffffffff9651272b>] futex_wake+0x16b/0x180
[<ffffffff965152aa>] do_futex+0x12a/0x4d0
[<ffffffff9642b621>] ? __switch_to+0x151/0x580
[<ffffffff965156d0>] SyS_futex+0x80/0x190
[<ffffffff96b95ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff96b95ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff96b95ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff96b95ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff96b95ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff96b95ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff96b95f92>] system_call_fastpath+0x25/0x2a
[<ffffffff96b95ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: c6 bc 98 ff 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 e8 a6 bc 98 ff 66 90 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 40 00 0f 1f 44 00 00 55 48 89 e5 48 

NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [containerd-shim:15445]
Modules linked in: xt_nat veth nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) tcp_lp xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper vmw_balloon cryptd pcspkr joydev sg vmw_vmci parport_pc parport i2c_piix4
ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix crct10dif_pclmul crct10dif_common drm crc32c_intel mptspi scsi_transport_spi serio_raw libata mptscsih mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 15445 Comm: containerd-shim Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.36.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff93171e350000 ti: ffff9317188a4000 task.ti: ffff9317188a4000
RIP: 0010:[<ffffffff8b38b7b5>]  [<ffffffff8b38b7b5>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9317188a7d50  EFLAGS: 00000286
RAX: 0000000000000000 RBX: ffff931a3fd1acc0 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff9317188a7d50 R08: ffffffff8b41e640 R09: ffff931775c43180
R10: 0000000000000001 R11: 0000000000000d6f R12: ffff931a3fd1acc0
R13: ffffffff8ace74e8 R14: ffff9317188a7d00 R15: ffff931a3fd1acc0
FS:  000000c000208090(0000) GS:ffff931a3fd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0fc0205000 CR3: 00000001338de000 CR4: 00000000000407e0
Call Trace:
[<ffffffff8acdab12>] try_to_wake_up+0x192/0x390
[<ffffffff8acdad8b>] wake_up_q+0x5b/0x80
[<ffffffff8ad1272b>] futex_wake+0x16b/0x180
[<ffffffff8ad152aa>] do_futex+0x12a/0x4d0
[<ffffffff8ad156d0>] SyS_futex+0x80/0x190
[<ffffffff8b395ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff8b395ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff8b395ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff8b395ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff8b395ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff8b395ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff8b395f92>] system_call_fastpath+0x25/0x2a
[<ffffffff8b395ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: 07 00 66 66 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 c6 07 00 66 66 66 90 48 89 f7 57 9d <66> 66 90 66 90 5d c3 0f 1f 40 00 66 66 66 66 90 55 48 89 e5 48 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 42s! [calico-node:14303]
Modules linked in: xt_set ipt_rpfilter iptable_raw ip_set_hash_ip ip_set_hash_net ip_set ipip tunnel4 ip_tunnel xt_nat nf_tables ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs ip6table_mangle ip6t_MASQUERADE nf_nat_masquerade_ipv6 ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 xt_comment xt_mark tcp_lp nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod ppdev joydev vboxguest(OE) parport_pc sg parport i2c_piix4 video pcspkr binfmt_misc ip_tables ext4 mbcache
jbd2 sr_mod cdrom sd_mod crc_t10dif ata_generic crct10dif_generic crct10dif_common pata_acpi crc32c_intel ata_piix ahci libahci vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm serio_raw drm_panel_orientation_quirks libata e1000 fuse
CPU: 0 PID: 14303 Comm: calico-node Kdump: loaded Tainted: G           OEL ------------ T 3.10.0-1160.31.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff9dccc68eb180 ti: ffff9dccc6894000 task.ti: ffff9dccc6894000
RIP: 0010:[<ffffffff9fb8b805>]  [<ffffffff9fb8b805>] _raw_spin_unlock_irqrestore+0x15/0x20
RSP: 0018:ffff9dccc6897d50  EFLAGS: 00010286
RAX: 0000000000000001 RBX: 00000010c6897da0 RCX: ffff9dcdfbed0000
RDX: 00000000000008fd RSI: 0000000000000286 RDI: 0000000000000286
RBP: ffff9dccc6897d50 R08: 0000000099fc2f2e R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: ffffffff9f4e0c46
R13: ffff9dccc6897d50 R14: ffffffff9fb891e9 R15: ffff9dccc6897cb8
FS:  00007fa0e5ffb700(0000) GS:ffff9dce1fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c01173d000 CR3: 000000008d38a000 CR4: 00000000000006f0
Call Trace:
[<ffffffff9f4dab02>] try_to_wake_up+0x192/0x390
[<ffffffff9f4dad7b>] wake_up_q+0x5b/0x80
[<ffffffff9f51224b>] futex_wake+0x16b/0x180
[<ffffffff9f514dca>] do_futex+0x12a/0x4d0
[<ffffffff9f5151f0>] SyS_futex+0x80/0x190
[<ffffffff9fb95ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff9fb95ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff9fb95ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff9fb95ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff9fb95ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff9fb95ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff9fb95f92>] system_call_fastpath+0x25/0x2a
[<ffffffff9fb95ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: 96 b7 98 ff 66 90 5d c3 0f 1f 40 00 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 e8 76 b7 98 ff 66 90 48 89 f7 57 9d <66> 66 90 66 90 5d c3 0f 1f 40 00 66 66 66 66 90 55 48 89 e5 48 
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [CRTC:37:crtc-0] flip_done timed out