NMI watchdog: BUG: soft lockup - CPU#0 stuck for 33s! [sadc:56501]
Modules linked in: ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter intel_powerclamp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg pcspkr hv_utils i2c_piix4 i2c_core ip_tables xfs libcrc32c sd_mod crc_t10dif sr_mod cdrom crct10dif_generic ata_generic pata_acpi hv_netvsc hyperv_keyboard hid_hyperv hv_storvsc crct10dif_pclmul crct10dif_common hyperv_fb crc32c_intel
ata_piix libata serio_raw hv_vmbus floppy fjes dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 56501 Comm: sadc Tainted: G             L ------------   3.10.0-514.10.2.el7.x86_64 #1
Hardware name: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS 090006  05/23/2012
task: ffff88003699de20 ti: ffff8800d0544000 task.ti: ffff8800d0544000
RIP: 0010:[<ffffffff81403700>]  [<ffffffff81403700>] uart_proc_show+0x1d0/0x600
RSP: 0018:ffff8800d0547df8  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff8800d0547d88 RCX: 0000000000000003
RDX: 0000000000000000 RSI: 00000000000003fe RDI: ffffffff81f84000
RBP: ffff8800d0547e68 R08: ffffffff819f1160 R09: 000000000000fffe
R10: 0000000000000000 R11: 000000000000000f R12: 0000000000000004
R13: ffffffff81a80240 R14: ffffffff81f84000 R15: ffff8800af69e000
FS:  00007fbf414a8740(0000) GS:ffff880102600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000001b99198 CR3: 00000000af4ac000 CR4: 00000000001406f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000700000004 ffffffff00000003 ffff8800368840d0 ffff8800af69e000
ffffffff811dd1b5 ffffffff812220f7 0000000000001000 ffff88003676ea00
00000000b5fb6ba9 0000000000000000 ffff88003676ea00 0000000000000001
Call Trace:
[<ffffffff811dd1b5>] ? __kmalloc+0x55/0x240
[<ffffffff812220f7>] ? seq_buf_alloc+0x17/0x40
[<ffffffff812225ea>] seq_read+0xfa/0x3a0
[<ffffffff8126b7fd>] proc_reg_read+0x3d/0x80
[<ffffffff811fe19e>] vfs_read+0x9e/0x170
[<ffffffff811fed6f>] SyS_read+0x7f/0xe0
[<ffffffff81696b09>] system_call_fastpath+0x16/0x1b
Code: e8 46 a8 28 00 49 8b 84 24 c8 00 00 00 4c 89 e7 ff 50 10 8b 4d 98 41 89 c6 0f 1f 44 00 00 66 41 83 04 24 02 fb 66 0f 1f 44 00 00 <85> c9 74 36 41 8b 97 38 01 00 00 49 8b bf 50 01 00 00 39 d1 74 

NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [sadc:84877]
Modules linked in: veeamsnap(OE) tcp_lp xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm iosf_mbi snd_timer crc32_pclmul snd ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper
ablk_helper soundcore cryptd ppdev vmw_balloon joydev i2c_piix4 pcspkr vmw_vmci sg parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit libnvdimm drm ata_piix libata e1000 crct10dif_pclmul crct10dif_common crc32c_intel mptspi scsi_transport_spi serio_raw mptscsih mptbase drm_panel_orientation_quirks fuse
CPU: 1 PID: 84877 Comm: sadc Kdump: loaded Tainted: G        W  OEL ------------   3.10.0-1160.41.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9f28e3cf3180 ti: ffff9f29a73e8000 task.ti: ffff9f29a73e8000
RIP: 0010:[<ffffffffa0c8ae5d>]  [<ffffffffa0c8ae5d>] uart_proc_show+0x1dd/0x5e0
RSP: 0018:ffff9f29a73ebdd0  EFLAGS: 00000202
RAX: 0000000000000160 RBX: ffffffffa0a76381 RCX: 0000000000000160
RDX: 0000000000000160 RSI: 00000000000003fe RDI: ffffffffa1a54e80
RBP: ffff9f29a73ebe40 R08: ffffffffa144e0c0 R09: 000000000000fffe
R10: 0000000000000000 R11: 000000000000000f R12: ffff9f29f3074000
R13: 0000000000000004 R14: ffffffffa14ebb20 R15: ffffffffa1a54e80
FS:  00007fbcad9ce740(0000) GS:ffff9f29f7640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fbcad9e5000 CR3: 000000016ad76000 CR4: 00000000003607e0
Call Trace:
[<ffffffffa0a76cf0>] seq_read+0x130/0x450
[<ffffffffa0ac7750>] proc_reg_read+0x40/0x80
[<ffffffffa0a4e3df>] vfs_read+0x9f/0x170
[<ffffffffa0a4f25f>] SyS_read+0x7f/0xf0
[<ffffffffa0f95f92>] system_call_fastpath+0x25/0x2a
Code: 0b 30 00 49 8b 84 24 c8 00 00 00 4c 89 e7 48 8b 40 10 e8 e7 d0 f0 ff 4c 89 e7 41 89 c6 c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <8b> 4d 98 85 c9 74 36 41 8b 97 38 01 00 00 49 8b bf 50 01 00 00 

BUG: soft lockup - CPU#7 stuck for 24s! [sadc:3428]
Modules linked in: ip6t_rpfilter ip6t_REJECT ipt_REJECT xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter i2c_piix4 sg virtio_balloon virtio_console mperf pcspkr serio_raw ip_tables xfs libcrc32c virtio_scsi virtio_blk virtio_net sr_mod cdrom ata_generic pata_acpi cirrus syscopyarea sysfillrect sysimgblt drm_kms_helper ttm drm ata_piix i2c_core libata virtio_pci virtio_ring virtio floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 7 PID: 3428 Comm: sadc Not tainted 3.10.0-123.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.7.5-0-ge51488c-20140602_164612-nilsson.home.kraxel.org 04/01/2014
task: ffff8807fbc48b60 ti: ffff88046fb06000 task.ti: ffff88046fb06000
RIP: 0010:[<ffffffff813907d0>]  [<ffffffff813907d0>] uart_proc_show+0x1d0/0x600
RSP: 0018:ffff88046fb07e00  EFLAGS: 00000206
RAX: 0000000000000160 RBX: 0000000000000004 RCX: 0000000000000003
RDX: 0000000000000160 RSI: 00000000000003fe RDI: ffffffff81e04240
RBP: ffff88046fb07e70 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 000000000000000f R12: 0000000000000015
R13: ffff8808066169c0 R14: 0000000065fe89c6 R15: ffffffff81e04240
FS:  00007f886bf12740(0000) GS:ffff88081e2e0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000004161c007 CR3: 000000046fbb5000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
0000000000000004 ffffffff00000003 ffff88080edfc0d0 ffff88080a610a00
ffff88080e9aea40 0000000000000003 ffffffff8119501c ffff88081dc07300
0000000065fe89c6 0000000000000000 ffff880800f86d00 0000000000000001
Call Trace:
[<ffffffff8119501c>] ? kmem_cache_alloc_trace+0x3c/0x1f0
[<ffffffff811d370e>] seq_read+0x16e/0x3b0
[<ffffffff81216b3d>] proc_reg_read+0x3d/0x80
[<ffffffff811af97c>] vfs_read+0x9c/0x170
[<ffffffff811b04a8>] SyS_read+0x58/0xb0
[<ffffffff815f2119>] system_call_fastpath+0x16/0x1b
Code: e8 06 8a 25 00 49 8b 84 24 c8 00 00 00 4c 89 e7 ff 50 10 8b 4d 98 41 89 c6 0f 1f 44 00 00 66 41 83 04 24 02 fb 66 0f 1f 44 00 00 <85> c9 74 36 41 8b 97 38 01 00 00 49 8b bf 50 01 00 00 39 d1 74 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 107s! [sadc:29242]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13109(E) falcon_lsm_pinned_13005(E) nls_utf8 isofs fuse rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache devlink binfmt_misc falcon_lsm_pinned_12905(E) ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_nat nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack iptable_filter ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel snd_hda_codec_generic
lrw gf128mul glue_helper ablk_helper cryptd snd_hda_intel joydev snd_hda_codec virtio_balloon snd_hda_core sg snd_hwdep snd_seq parport_pc snd_seq_device parport snd_pcm snd_timer snd pcspkr i2c_piix4 soundcore auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_blk cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata serio_raw crct10dif_pclmul crct10dif_common virtio_pci crc32c_intel floppy virtio_ring virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod [last unloaded: falcon_kal]
CPU: 0 PID: 29242 Comm: sadc Kdump: loaded Tainted: P            EL ------------   3.10.0-1062.4.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
task: ffffa0d7122d8000 ti: ffffa0d5b6f2c000 task.ti: ffffa0d5b6f2c000
RIP: 0010:[<ffffffffb828393d>]  [<ffffffffb828393d>] uart_proc_show+0x1dd/0x5e0
RSP: 0018:ffffa0d5b6f2fdd0  EFLAGS: 00000202
RAX: 0000000000000160 RBX: ffffffffb8070531 RCX: 0000000000000160
RDX: 0000000000000160 RSI: 00000000000003fe RDI: ffffffffb9052600
RBP: ffffa0d5b6f2fe40 R08: ffffffffb8a4d900 R09: 000000000000fffe
R10: 0000000000000000 R11: 000000000000000f R12: ffffa0d71aba4000
R13: 0000000000000004 R14: ffffffffb8ae9b40 R15: ffffffffb9052600
FS:  00007f9f66534740(0000) GS:ffffa0d71f000000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000e2c2e000 CR3: 0000002df6f9a000 CR4: 00000000001606f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffb8070ea0>] seq_read+0x130/0x440
[<ffffffffb80c1260>] proc_reg_read+0x40/0x80
[<ffffffffb8048d8f>] vfs_read+0x9f/0x170
[<ffffffffb8049c4f>] SyS_read+0x7f/0xf0
[<ffffffffb858bede>] system_call_fastpath+0x25/0x2a
Code: d9 2f 00 49 8b 84 24 c8 00 00 00 4c 89 e7 48 8b 40 10 e8 97 d8 f0 ff 4c 89 e7 41 89 c6 c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <8b> 4d 98 85 c9 74 36 41 8b 97 38 01 00 00 49 8b bf 50 01 00 00 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 21s! [sadc:18425]
Modules linked in: tcp_lp fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus aesni_intel snd_seq ppdev lrw gf128mul glue_helper ablk_helper cryptd snd_seq_device snd_pcm vmw_balloon
joydev pcspkr snd_timer snd soundcore sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel drm serio_raw libata mptspi nfit libnvdimm e1000 scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 18425 Comm: sadc Tainted: G        W    L ------------   3.10.0-1127.18.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff9dad88b441c0 ti: ffff9dad87390000 task.ti: ffff9dad87390000
RIP: 0010:[<ffffffffb5288ffd>]  [<ffffffffb5288ffd>] uart_proc_show+0x1dd/0x5e0
RSP: 0018:ffff9dad87393dd0  EFLAGS: 00000202
RAX: 0000000000000160 RBX: ffffffffb50750b1 RCX: 0000000000000160
RDX: 0000000000000160 RSI: 00000000000003fe RDI: ffffffffb6054e40
RBP: ffff9dad87393e40 R08: ffffffffb5a4dfc0 R09: 000000000000fffe
R10: 0000000000000000 R11: 000000000000000f R12: ffff9dad7676c000
R13: 0000000000000004 R14: ffffffffb5aeb940 R15: ffffffffb6054e40
FS:  00007f5198c79740(0000) GS:ffff9dad7c600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000704238 CR3: 0000000089958000 CR4: 00000000001607f0
Call Trace:
[<ffffffffb5075a20>] seq_read+0x130/0x440
[<ffffffffb50c6300>] proc_reg_read+0x40/0x80
[<ffffffffb504d03f>] vfs_read+0x9f/0x170
[<ffffffffb504deaf>] SyS_read+0x7f/0xf0
[<ffffffffb5592ed2>] system_call_fastpath+0x25/0x2a
Code: f5 2f 00 49 8b 84 24 c8 00 00 00 4c 89 e7 48 8b 40 10 e8 e7 d4 f0 ff 4c 89 e7 41 89 c6 c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 <8b> 4d 98 85 c9 74 36 41 8b 97 38 01 00 00 49 8b bf 50 01 00 00 

NMI watchdog: BUG: soft lockup - CPU#0 stuck for 33s! [sadc:24569]
Modules linked in: xt_multiport xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev pcspkr sg parport_pc virtio_balloon i2c_piix4 parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom cirrus ata_generic pata_acpi virtio_blk virtio_net drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul drm crct10dif_common crc32c_intel ata_piix serio_raw virtio_pci virtio_ring libata virtio i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 24569 Comm: sadc Not tainted 3.10.0-514.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2007
task: ffff88007b541f60 ti: ffff8800568f4000 task.ti: ffff8800568f4000
RIP: 0010:[<ffffffff8140331d>]  [<ffffffff8140331d>] uart_proc_show+0x1cd/0x600
RSP: 0018:ffff8800568f7df8  EFLAGS: 00000212
RAX: 0000000000000160 RBX: ffff8800568f7fd8 RCX: 0000000000000000
RDX: 0000000000000160 RSI: 00000000000002fe RDI: ffffffff81f84188
RBP: ffff8800568f7e68 R08: ffff8800568f4000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: ffff8800568f7fd8
R13: ffff88007b541f60 R14: ffffffff8168b070 R15: ffff8800568f7da8
FS:  00002b40704be680(0000) GS:ffff88007fc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007fabc5f8daa0 CR3: 0000000079c74000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000200000003 ffffffff00000000 ffff880077a78228 ffff880056812780
5253447c53544320 ffffffff0044437c 0000000000001000 ffff88007a453100
0000000028bd266a 0000000000000000 ffff88007a453100 0000000000000001
Call Trace:
[<ffffffff812223ea>] seq_read+0xfa/0x3a0
[<ffffffff8126b5fd>] proc_reg_read+0x3d/0x80
[<ffffffff811fdf9e>] vfs_read+0x9e/0x170
[<ffffffff811feb6f>] SyS_read+0x7f/0xe0
[<ffffffff816965c9>] system_call_fastpath+0x16/0x1b
Code: 89 4d 98 e8 e6 a6 28 00 49 8b 84 24 c8 00 00 00 4c 89 e7 ff 50 10 8b 4d 98 41 89 c6 66 66 66 66 90 66 41 83 04 24 02 fb 66 66 90 <66> 66 90 85 c9 74 36 41 8b 97 38 01 00 00 49 8b bf 50 01 00 00