| Operating system | Count |
|---|---|
| CentOS 7 | 6 |
| Architecture | Count |
|---|---|
| x86_64 | 6 |
| Related packages | Count |
|---|---|
| kernel | 6 |
Packages names with count less than the total count of reports are most probably not the cause of the problem.
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [kworker/u256:2:33241] Modules linked in: tcp_lp nls_utf8 isofs rfcomm xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink bnep vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel btusb snd_ens1371 btrtl snd_rawmidi aesni_intel snd_ac97_codec btbcm ac97_bus lrw gf128mul glue_helper btintel ablk_helper snd_seq cryptd bluetooth snd_seq_device ppdev snd_pcm vmw_balloon rfkill snd_timer joydev pcspkr snd sg vmw_vmci soundcore i2c_piix4 shpchp nfit parport_pc libnvdimm parport fuse ip_tables ext4 mbcache jbd2 sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel libata mptspi scsi_transport_spi mptscsih serio_raw e1000 mptbase i2c_core CPU: 6 PID: 33241 Comm: kworker/u256:2 Tainted: G L ------------ 3.10.0-862.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020 Workqueue: writeback bdi_writeback_workfn (flush-8:0) task: ffff9c4ae0601fa0 ti: ffff9c4aecbd0000 task.ti: ffff9c4aecbd0000 RIP: 0010:[<ffffffffbdb07e3a>] [<ffffffffbdb07e3a>] smp_call_function_many+0x20a/0x270 RSP: 0000:ffff9c4aecbd37e8 EFLAGS: 00000202 RAX: 0000000000000000 RBX: 00000000000000fc RCX: ffff9c4afa61cf00 RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000 RBP: ffff9c4aecbd3820 R08: ffff9c4ac65cc800 R09: ffffffffbdd4a3d9 R10: ffff9c4afa79bb00 R11: ffffe40982a9e400 R12: 0000000000000292 R13: ffff9c4aecbd3798 R14: ffff9c4aecbd3788 R15: 0000000000000000 FS: 0000000000000000(0000) GS:ffff9c4afa780000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f0d39edcec4 CR3: 0000000088e12000 CR4: 00000000007407e0 PKRU: 00000000 Call Trace: [<ffffffffbda77018>] native_flush_tlb_others+0xb8/0xc0 [<ffffffffbda771b4>] flush_tlb_page+0x54/0xa0 [<ffffffffbdbd8837>] ptep_clear_flush+0x67/0xa0 [<ffffffffbdbd1ba4>] page_mkclean+0x144/0x210 [<ffffffffbdb9f7d0>] clear_page_dirty_for_io+0x50/0xd0 [<ffffffffc0527ba4>] mpage_submit_page+0x24/0x70 [ext4] [<ffffffffc0527d00>] mpage_process_page_bufs+0x110/0x130 [ext4] [<ffffffffc0528c05>] mpage_prepare_extent_to_map+0x235/0x2e0 [ext4] [<ffffffffc052d57c>] ? ext4_writepages+0x42c/0xd40 [ext4] [<ffffffffc055b659>] ? __ext4_journal_start_sb+0x69/0xe0 [ext4] [<ffffffffc052d5a7>] ext4_writepages+0x457/0xd40 [ext4] [<ffffffffbe11291c>] ? __schedule+0x41c/0xa20 [<ffffffffbdba0e21>] do_writepages+0x21/0x50 [<ffffffffbdc48af0>] __writeback_single_inode+0x40/0x260 [<ffffffffbdc49584>] writeback_sb_inodes+0x1c4/0x490 [<ffffffffbdc498ef>] __writeback_inodes_wb+0x9f/0xd0 [<ffffffffbdc4a123>] wb_writeback+0x263/0x2f0 [<ffffffffbdc4aaab>] bdi_writeback_workfn+0x2cb/0x460 [<ffffffffbdab2dff>] process_one_work+0x17f/0x440 [<ffffffffbdab3ac6>] worker_thread+0x126/0x3c0 [<ffffffffbdab39a0>] ? manage_workers.isra.24+0x2a0/0x2a0 [<ffffffffbdabae31>] kthread+0xd1/0xe0 [<ffffffffbdabad60>] ? insert_kthread_work+0x40/0x40 [<ffffffffbe11f624>] ret_from_fork_nospec_begin+0xe/0x21 [<ffffffffbdabad60>] ? insert_kthread_work+0x40/0x40 Code: 48 63 35 8e b6 c3 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 53 73 be f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 5d b6 c3 00 eb b7 0f b6 4d cc 4c 89
NMI watchdog: BUG: soft lockup - CPU#9 stuck for 22s! [kworker/u256:9:75039] Modules linked in: vfat fat isofs xfs libcrc32c binfmt_misc bmhook(OE) tmhook(OE) dsa_filter(POE) dsa_filter_hook(OE) vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod btrfs sb_edac edac_core iosf_mbi ppdev crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd raid6_pq xor joydev pcspkr sg nfit parport_pc parport libnvdimm vmw_vmci shpchp i2c_piix4 ip_tables ext4 mbcache jbd2 sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ahci ata_piix libahci libata serio_raw vmxnet3 i2c_core vmw_pvscsi floppy CPU: 9 PID: 75039 Comm: kworker/u256:9 Tainted: P OEL ------------ 3.10.0-693.17.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018 Workqueue: writeback bdi_writeback_workfn (flush-8:0) task: ffff88058cacdee0 ti: ffff8800ba648000 task.ti: ffff8800ba648000 RIP: 0010:[<ffffffff810fb21a>] [<ffffffff810fb21a>] generic_exec_single+0xfa/0x1a0 RSP: 0018:ffff8800ba64b760 EFLAGS: 00000202 RAX: 0000000000000080 RBX: ffff8800ba64b730 RCX: 000000000000000f RDX: ffffffff816d8a70 RSI: 0000000000000080 RDI: 0000000000000286 RBP: ffff8800ba64b7a8 R08: ffffffff816d8a68 R09: ffff8801565ab328 R10: 0000000000000003 R11: 0000000000000220 R12: ffff88058cacdee0 R13: ffff8805a8efc840 R14: 0000000000011220 R15: ffff8800ba64b728 FS: 0000000000000000(0000) GS:ffff8805a7840000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fea89674000 CR3: 00000000019fa000 CR4: 00000000003607e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Call Trace: [<ffffffff8106f340>] ? leave_mm+0x110/0x110 [<ffffffff8106f340>] ? leave_mm+0x110/0x110 [<ffffffff8106f340>] ? leave_mm+0x110/0x110 [<ffffffff810fb31f>] smp_call_function_single+0x5f/0xa0 [<ffffffff81324bd5>] ? cpumask_next_and+0x35/0x50 [<ffffffff810fb8b3>] smp_call_function_many+0x223/0x260 [<ffffffff8106f508>] native_flush_tlb_others+0xb8/0xc0 [<ffffffff8106f704>] flush_tlb_page+0x54/0xa0 [<ffffffff811c45c4>] ptep_clear_flush+0x54/0x80 [<ffffffff811bdfce>] page_mkclean+0x12e/0x1f0 [<ffffffff8118f8c0>] clear_page_dirty_for_io+0x50/0xd0 [<ffffffffc02522a7>] mpage_submit_page+0x47/0x80 [ext4] [<ffffffffc02523f0>] mpage_process_page_bufs+0x110/0x130 [ext4] [<ffffffffc02532e5>] mpage_prepare_extent_to_map+0x235/0x2e0 [ext4] [<ffffffffc0257b37>] ext4_writepages+0x457/0xd30 [ext4] [<ffffffff81190efe>] do_writepages+0x1e/0x40 [<ffffffff8122fa80>] __writeback_single_inode+0x40/0x220 [<ffffffff812306c4>] writeback_sb_inodes+0x1c4/0x490 [<ffffffff81230a2f>] __writeback_inodes_wb+0x9f/0xd0 [<ffffffff81231263>] wb_writeback+0x263/0x2f0 [<ffffffff8123170b>] bdi_writeback_workfn+0x2cb/0x460 [<ffffffff810aa59a>] process_one_work+0x17a/0x440 [<ffffffff810ab266>] worker_thread+0x126/0x3c0 [<ffffffff810ab140>] ? manage_workers.isra.24+0x2a0/0x2a0 [<ffffffff810b270f>] kthread+0xcf/0xe0 [<ffffffff810b2640>] ? insert_kthread_work+0x40/0x40 [<ffffffff816b8798>] ret_from_fork+0x58/0x90 [<ffffffff810b2640>] ? insert_kthread_work+0x40/0x40 Code: 40 95 01 00 48 89 de 48 03 14 c5 20 8e b1 81 48 89 df e8 5a e0 23 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [kworker/u16:2:7172] Modules linked in: CyProtectDrv(OE) microsoft_dependency_agent(POE) bluechannel(POE) sctp_diag sctp dccp_diag dccp unix_diag af_packet_diag netlink_diag rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache udp_diag tcp_diag inet_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod sb_edac edac_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg nfit libnvdimm parport_pc vmw_vmci parport shpchp i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops crct10dif_pclmul ttm crct10dif_common crc32c_intel serio_raw drm ata_piix libata mptspi scsi_transport_spi mptscsih vmxnet3 mptbase i2c_core floppy [last unloaded: CyProtectDrv] CPU: 4 PID: 7172 Comm: kworker/u16:2 Tainted: P OEL ------------ 3.10.0-693.21.1.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/19/2018 Workqueue: writeback bdi_writeback_workfn (flush-8:0) task: ffff8803d9634f10 ti: ffff88001c72c000 task.ti: ffff88001c72c000 RIP: 0010:[<ffffffff810fcf5a>] [<ffffffff810fcf5a>] generic_exec_single+0xfa/0x1b0 RSP: 0018:ffff88001c72f760 EFLAGS: 00000202 RAX: 00000000000008fd RBX: 0000000000011200 RCX: 0000000000000000 RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000282 RBP: ffff88001c72f7a8 R08: 0000000000000001 R09: ffff88041f6a9960 R10: 0000000000000100 R11: 0000000000000220 R12: ffff88042b42e870 R13: ffff880106131080 R14: ffffffff811e406b R15: ffff88001c72f6f8 FS: 0000000000000000(0000) GS:ffff88043fd00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: 00007f4ceefd3034 CR3: 0000000001a02000 CR4: 00000000001607e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Call Trace: [<ffffffff810709d0>] ? leave_mm+0x110/0x110 [<ffffffff810709d0>] ? leave_mm+0x110/0x110 [<ffffffff810709d0>] ? leave_mm+0x110/0x110 [<ffffffff810fd06f>] smp_call_function_single+0x5f/0xa0 [<ffffffff813288a5>] ? cpumask_next_and+0x35/0x50 [<ffffffff810fd61b>] smp_call_function_many+0x22b/0x270 [<ffffffff81070b98>] native_flush_tlb_others+0xb8/0xc0 [<ffffffff81070d94>] flush_tlb_page+0x54/0xa0 [<ffffffff811c6db4>] ptep_clear_flush+0x54/0x80 [<ffffffff811c07ae>] page_mkclean+0x12e/0x1f0 [<ffffffff81191ee0>] clear_page_dirty_for_io+0x50/0xd0 [<ffffffffc022a2c7>] mpage_submit_page+0x47/0x80 [ext4] [<ffffffffc022a410>] mpage_process_page_bufs+0x110/0x130 [ext4] [<ffffffffc022b315>] mpage_prepare_extent_to_map+0x235/0x2e0 [ext4] [<ffffffffc0208a93>] ? jbd2__journal_start+0xf3/0x1f0 [jbd2] [<ffffffffc022fb4c>] ? ext4_writepages+0x42c/0xd40 [ext4] [<ffffffffc025dbc9>] ? __ext4_journal_start_sb+0x69/0xe0 [ext4] [<ffffffffc022fb77>] ext4_writepages+0x457/0xd40 [ext4] [<ffffffff810d1f8e>] ? dequeue_task_fair+0x41e/0x660 [<ffffffff810cb0b5>] ? sched_clock_cpu+0x85/0xc0 [<ffffffff81193531>] do_writepages+0x21/0x50 [<ffffffff812326d0>] __writeback_single_inode+0x40/0x250 [<ffffffff816b3b0c>] ? __schedule+0x47c/0xa30 [<ffffffff81233344>] writeback_sb_inodes+0x1c4/0x490 [<ffffffff812336af>] __writeback_inodes_wb+0x9f/0xd0 [<ffffffff81233ee3>] wb_writeback+0x263/0x2f0 [<ffffffff81220a6c>] ? get_nr_inodes+0x4c/0x70 [<ffffffff8123438b>] bdi_writeback_workfn+0x2cb/0x460 [<ffffffff810abe2f>] process_one_work+0x17f/0x440 [<ffffffff810acaf6>] worker_thread+0x126/0x3c0 [<ffffffff810ac9d0>] ? manage_workers.isra.24+0x2a0/0x2a0 [<ffffffff810b4031>] kthread+0xd1/0xe0 [<ffffffff810b3f60>] ? insert_kthread_work+0x40/0x40 [<ffffffff816c0577>] ret_from_fork+0x77/0xb0 [<ffffffff810b3f60>] ? insert_kthread_work+0x40/0x40 Code: 80 95 01 00 48 89 de 48 03 14 c5 a0 10 b2 81 48 89 df e8 7a 03 24 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 24s! [kworker/u256:2:107668] Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd nfit soundcore ppdev vmw_balloon sg libnvdimm joydev pcspkr parport_pc parport i2c_piix4 vmw_vmci shpchp ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common libata crc32c_intel mptspi scsi_transport_spi e1000 serio_raw mptscsih mptbase i2c_core CPU: 1 PID: 107668 Comm: kworker/u256:2 Tainted: G L ------------ 3.10.0-862.el7.x86_64 #1 Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019 Workqueue: writeback bdi_writeback_workfn (flush-8:0) task: ffff882aebb19fa0 ti: ffff882b786cc000 task.ti: ffff882b786cc000 RIP: 0010:[<ffffffff9f90779a>] [<ffffffff9f90779a>] generic_exec_single+0xfa/0x1b0 RSP: 0000:ffff882b786cf760 EFLAGS: 00000202 RAX: 0000000000000080 RBX: ffff882b786cf730 RCX: 0000000000000001 RDX: ffffffffa0013170 RSI: 0000000000000080 RDI: 0000000000000286 RBP: ffff882b786cf7a8 R08: ffffffffa0013168 R09: 000000017550b000 R10: ffff882c2fe21c30 R11: fffff01084e2ce00 R12: ffff882b786cf6e0 R13: ffff882aebb19fa0 R14: ffff882c34cb6840 R15: 0000000000011220 FS: 0000000000000000(0000) GS:ffff882c38640000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f42ba8fd000 CR3: 0000000107602000 CR4: 00000000003607e0 Call Trace: [<ffffffff9f876e50>] ? leave_mm+0x110/0x110 [<ffffffff9f876e50>] ? leave_mm+0x110/0x110 [<ffffffff9f876e50>] ? leave_mm+0x110/0x110 [<ffffffff9f9078af>] smp_call_function_single+0x5f/0xa0 [<ffffffff9fb4a275>] ? cpumask_next_and+0x35/0x50 [<ffffffff9f907e5b>] smp_call_function_many+0x22b/0x270 [<ffffffff9f877018>] native_flush_tlb_others+0xb8/0xc0 [<ffffffff9f8771b4>] flush_tlb_page+0x54/0xa0 [<ffffffff9f9d8837>] ptep_clear_flush+0x67/0xa0 [<ffffffff9f9d1ba4>] page_mkclean+0x144/0x210 [<ffffffff9f99f7d0>] clear_page_dirty_for_io+0x50/0xd0 [<ffffffffc0303ba4>] mpage_submit_page+0x24/0x70 [ext4] [<ffffffffc0303d00>] mpage_process_page_bufs+0x110/0x130 [ext4] [<ffffffffc0304c05>] mpage_prepare_extent_to_map+0x235/0x2e0 [ext4] [<ffffffffc030957c>] ? ext4_writepages+0x42c/0xd40 [ext4] [<ffffffffc0337659>] ? __ext4_journal_start_sb+0x69/0xe0 [ext4] [<ffffffffc03095a7>] ext4_writepages+0x457/0xd40 [ext4] [<ffffffff9ff12b08>] ? __schedule+0x608/0xa20 [<ffffffff9ff12b14>] ? __schedule+0x614/0xa20 [<ffffffff9ff12b08>] ? __schedule+0x608/0xa20 [<ffffffff9ff1291c>] ? __schedule+0x41c/0xa20 [<ffffffff9f9a0e21>] do_writepages+0x21/0x50 [<ffffffff9fa48af0>] __writeback_single_inode+0x40/0x260 [<ffffffff9fa49584>] writeback_sb_inodes+0x1c4/0x490 [<ffffffff9fa498ef>] __writeback_inodes_wb+0x9f/0xd0 [<ffffffff9fa4a123>] wb_writeback+0x263/0x2f0 [<ffffffff9fa4aaab>] bdi_writeback_workfn+0x2cb/0x460 [<ffffffff9f8b2dff>] process_one_work+0x17f/0x440 [<ffffffff9f8b3ac6>] worker_thread+0x126/0x3c0 [<ffffffff9f8b39a0>] ? manage_workers.isra.24+0x2a0/0x2a0 [<ffffffff9f8bae31>] kthread+0xd1/0xe0 [<ffffffff9f8bad60>] ? insert_kthread_work+0x40/0x40 [<ffffffff9ff1f637>] ret_from_fork_nospec_begin+0x21/0x21 [<ffffffff9f8bad60>] ? insert_kthread_work+0x40/0x40 Code: 80 96 01 00 48 89 de 48 03 14 c5 a0 53 53 a0 48 89 df e8 4a 87 25 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00