Info

Permalink
Function
generic_exec_single
First occurrence
2021-01-01
Last occurrence
2025-08-18
State
NEW
Components
kernel
Quality
-34

Statistics

Operating system Count
CentOS 7 400
Architecture Count
x86_64 400
Related packages Count
kernel 400
 0:3.10.0-1160.81.1.el7 78
 0:3.10.0-1160.el7 52
 0:3.10.0-1127.19.1.el7 45
 0:3.10.0-1160.6.1.el7 38
 0:3.10.0-1062.el7 32
 0:3.10.0-1160.88.1.el7 24
 0:3.10.0-1160.114.2.el7 23
 0:3.10.0-1160.76.1.el7 15
 0:3.10.0-1160.119.1.el7 14
 0:3.10.0-1160.71.1.el7 12
 0:3.10.0-1062.18.1.el7 11
 0:3.10.0-1160.15.2.el7 11
 0:3.10.0-1160.49.1.el7 11
 0:3.10.0-1160.92.1.el7 9
 0:3.10.0-1160.25.1.el7 6
 0:3.10.0-1160.11.1.el7 5
 0:3.10.0-1127.el7 3
 0:3.10.0-1160.24.1.el7 2
 0:3.10.0-1160.59.1.el7 2
 0:3.10.0-1160.41.1.el7 2
 0:3.10.0-1160.42.2.el7 1
 0:3.10.0-1127.13.1.el7 1
 0:3.10.0-1160.21.1.el7 1
 0:3.10.0-1160.36.2.el7 1
 0:3.10.0-1160.45.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #1405734
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffb7d1dba2
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffb7c81b10
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x130
3
? leave_mm
vmlinux 0xffffffffb7c81b10
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x130
4
? leave_mm
vmlinux 0xffffffffb7c81b10
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x130
5
smp_call_function_single
vmlinux 0xffffffffb7d1dcbf
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffb7f9c615
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffb7d1e27b
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffb7c81fa8
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffb7c8201b
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffb7dfa0ce
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xae
11
arch_tlb_finish_mmu
vmlinux 0xffffffffb7dfbc4f
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffb7dfbd83
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x23
13
zap_page_range
vmlinux 0xffffffffb7dff2ca
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xea
14
? finish_task_switch
vmlinux 0xffffffffb7cda89c
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x4c
15
? __schedule
vmlinux 0xffffffffb83b7920
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x320
16
SyS_madvise
vmlinux 0xffffffffb7df96bd
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x49d
17
? hrtimer_get_res
vmlinux 0xffffffffb7ccf340
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x50
18
? do_nanosleep
vmlinux 0xffffffffb83b6e1b
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x5b
19
system_call_fastpath
vmlinux 0xffffffffb83c539a
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [transport:2456]
Modules linked in: hids_driver(OE) xt_CHECKSUM tun devlink xt_set ip_set_hash_net ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack isofs ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sb_edac iosf_mbi kvm_intel kvm irqbypass sg joydev pcspkr virtio_balloon i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom 8021q garp mrp stp crct10dif_pclmul llc crct10dif_common virtio_console ata_generic crc32_pclmul virtio_net virtio_scsi pata_acpi crc32c_intel
virtio_blk cirrus net_failover failover ghash_clmulni_intel drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel lrw gf128mul ttm ata_piix glue_helper virtio_pci virtio_ring drm ablk_helper scsi_transport_iscsi libata cryptd serio_raw virtio drm_panel_orientation_quirks floppy sunrpc dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 2456 Comm: transport Kdump: loaded Tainted: G           OEL ------------   3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 1.16.0-1.module_el8.7.0+1140+ff0772f9 04/01/2014
task: ffff8e1722185280 ti: ffff8e13b616c000 task.ti: ffff8e13b616c000
RIP: 0010:[<ffffffffb7d1dba2>]  [<ffffffffb7d1dba2>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff8e13b616fbe0  EFLAGS: 00000202
RAX: ffff8e17228fba00 RBX: ffffffffb7e787b9 RCX: ffff8e17228fbad0
RDX: ffff8e172f35b840 RSI: ffff8e13b616fbe0 RDI: ffff8e13b616fbe0
RBP: ffff8e13b616fc30 R08: 0000000000000001 R09: 00003ffffffff000
R10: ffff8e171eab0798 R11: 0000000000000206 R12: 0000000000000004
R13: 0000000000000000 R14: 0000000000000000 R15: ffff8e13b616fc50
FS:  00007f5a11d21700(0000) GS:ffff8e172f280000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffffc001ba6b7000 CR3: 000000042ae7c000 CR4: 0000000000362fe0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffb7c81b10>] ? leave_mm+0x130/0x130
[<ffffffffb7c81b10>] ? leave_mm+0x130/0x130
[<ffffffffb7c81b10>] ? leave_mm+0x130/0x130
[<ffffffffb7d1dcbf>] smp_call_function_single+0x5f/0xa0
[<ffffffffb7f9c615>] ? cpumask_next_and+0x35/0x50
[<ffffffffb7d1e27b>] smp_call_function_many+0x22b/0x270
[<ffffffffb7c81fa8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb7c8201b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb7dfa0ce>] tlb_flush_mmu_tlbonly+0xae/0xd0
[<ffffffffb7dfbc4f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffb7dfbd83>] tlb_finish_mmu+0x23/0x40
[<ffffffffb7dff2ca>] zap_page_range+0xea/0x140
[<ffffffffb7cda89c>] ? finish_task_switch+0x4c/0x1c0
[<ffffffffb83b7920>] ? __schedule+0x320/0x680
[<ffffffffb7df96bd>] SyS_madvise+0x49d/0xac0
[<ffffffffb7ccf340>] ? hrtimer_get_res+0x50/0x50
[<ffffffffb83b6e1b>] ? do_nanosleep+0x5b/0x100
[<ffffffffb83c539a>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 c0 19 95 b8 48 89 df e8 b7 67 29 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #1319920
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff8d116562
Build id: 3.10.0-1160.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff8d07e6a0
Build id: 3.10.0-1160.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffff8d07e6a0
Build id: 3.10.0-1160.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffff8d07e6a0
Build id: 3.10.0-1160.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffff8d11667f
Build id: 3.10.0-1160.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff8d385de5
Build id: 3.10.0-1160.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff8d116c2b
Build id: 3.10.0-1160.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff8d07e868
Build id: 3.10.0-1160.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8d07e8db
Build id: 3.10.0-1160.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff8d1edd06
Build id: 3.10.0-1160.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffff8d1ef7cf
Build id: 3.10.0-1160.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff8d1ef8f3
Build id: 3.10.0-1160.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffff8d1ec3a6
Build id: 3.10.0-1160.el7.x86_64 		0x116
14
? ep_scan_ready_list.isra.7
vmlinux 0xffffffff8d29cb59
Build id: 3.10.0-1160.el7.x86_64 		0x1b9
15
SyS_madvise
vmlinux 0xffffffff8d1ed2e1
Build id: 3.10.0-1160.el7.x86_64 		0x4d1
16
system_call_fastpath
vmlinux 0xffffffff8d793f92
Build id: 3.10.0-1160.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [redis-server:1234]
Modules linked in: tun bridge stp llc ebtable_filter devlink ebtables ip6table_filter ip6_tables ipt_REJECT nf_reject_ipv4 xt_conntrack iptable_filter ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_CHECKSUM iptable_mangle vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 aesni_intel vmw_balloon snd_rawmidi snd_ac97_codec lrw gf128mul glue_helper ablk_helper ac97_bus cryptd snd_seq snd_seq_device snd_pcm joydev pcspkr snd_timer snd sg soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm crc32c_intel ata_piix nfit mptspi libata scsi_transport_spi libnvdimm serio_raw mptscsih e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 6 PID: 1234 Comm: redis-server Kdump: loaded Tainted: G             L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff9590773c3180 ti: ffff959130680000 task.ti: ffff959130680000
RIP: 0010:[<ffffffff8d116562>]  [<ffffffff8d116562>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff959130683be0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff959130683bb0 RCX: 0000000000000003
RDX: ffffffff8d813c90 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff959130683c30 R08: ffffffff8d813c88 R09: 00003ffffffff000
R10: ffff959134635008 R11: ffff959130683d88 R12: ffff959135797be0
R13: fffff66941b28100 R14: 000000000000000e R15: 000000005088fb36
FS:  00007f36e1bdff80(0000) GS:ffff959135780000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd5c662c000 CR3: 00000000b9e92000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8d07e6a0>] ? leave_mm+0x120/0x120
[<ffffffff8d07e6a0>] ? leave_mm+0x120/0x120
[<ffffffff8d07e6a0>] ? leave_mm+0x120/0x120
[<ffffffff8d11667f>] smp_call_function_single+0x5f/0xa0
[<ffffffff8d385de5>] ? cpumask_next_and+0x35/0x50
[<ffffffff8d116c2b>] smp_call_function_many+0x22b/0x270
[<ffffffff8d07e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8d07e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff8d1edd06>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffff8d1ef7cf>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff8d1ef8f3>] tlb_finish_mmu+0x23/0x30
[<ffffffff8d1ec3a6>] madvise_free_single_vma+0x116/0x180
[<ffffffff8d29cb59>] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0
[<ffffffff8d1ed2e1>] SyS_madvise+0x4d1/0xac0
[<ffffffff8d793f92>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 e0 13 d5 8d 48 89 df e8 f7 69 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #1266971
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff8f11db12
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff8f081b10
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x130
3
? leave_mm
vmlinux 0xffffffff8f081b10
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x130
4
? leave_mm
vmlinux 0xffffffff8f081b10
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x130
5
smp_call_function_single
vmlinux 0xffffffff8f11dc2f
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff8f39c485
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff8f11e1eb
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff8f081fa8
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8f08201b
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff8f1fa00e
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xae
11
arch_tlb_finish_mmu
vmlinux 0xffffffff8f1fbb8f
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff8f1fbcc3
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffff8f1f86f6
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x116
14
? do_sync_write
vmlinux 0xffffffff8f25b1f3
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x93
15
SyS_madvise
vmlinux 0xffffffff8f1f9631
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x4d1
16
? vfs_write
vmlinux 0xffffffff8f25bd82
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x182
17
system_call_fastpath
vmlinux 0xffffffff8f7c539a
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [prometheus:2044]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec iosf_mbi ac97_bus crc32_pclmul snd_seq snd_seq_device ghash_clmulni_intel ppdev snd_pcm vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_timer joydev snd sg pcspkr vmw_vmci soundcore i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ata_piix ttm libata drm crct10dif_pclmul crct10dif_common mptspi nfit crc32c_intel scsi_transport_spi libnvdimm mptscsih e1000 mptbase serio_raw drm_panel_orientation_quirks fuse
CPU: 5 PID: 2044 Comm: prometheus Kdump: loaded Tainted: G             L ------------   3.10.0-1160.92.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9105a4bc8000 ti: ffff9105a4bd0000 task.ti: ffff9105a4bd0000
RIP: 0010:[<ffffffff8f11db12>]  [<ffffffff8f11db12>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9105a4bd3be0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff9105a4bd3bb0 RCX: 0000000000000005
RDX: ffffffff8f814350 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff9105a4bd3c30 R08: ffffffff8f814348 R09: b64311cf67000000
R10: 49bcdbc15d73d9c0 R11: ffff9105a4bd3d88 R12: ffff9105a4bd3bd0
R13: 0000000001dcf813 R14: ffff9101734cae48 R15: 0000000000000022
FS:  00007fb76ceb7700(0000) GS:ffff9105dd740000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2f506b6008 CR3: 00000007f5de4000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffff8f081b10>] ? leave_mm+0x130/0x130
[<ffffffff8f081b10>] ? leave_mm+0x130/0x130
[<ffffffff8f081b10>] ? leave_mm+0x130/0x130
[<ffffffff8f11dc2f>] smp_call_function_single+0x5f/0xa0
[<ffffffff8f39c485>] ? cpumask_next_and+0x35/0x50
[<ffffffff8f11e1eb>] smp_call_function_many+0x22b/0x270
[<ffffffff8f081fa8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8f08201b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff8f1fa00e>] tlb_flush_mmu_tlbonly+0xae/0xd0
[<ffffffff8f1fbb8f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff8f1fbcc3>] tlb_finish_mmu+0x23/0x40
[<ffffffff8f1f86f6>] madvise_free_single_vma+0x116/0x180
[<ffffffff8f25b1f3>] ? do_sync_write+0x93/0xe0
[<ffffffff8f1f9631>] SyS_madvise+0x4d1/0xac0
[<ffffffff8f25bd82>] ? vfs_write+0x182/0x1f0
[<ffffffff8f7c539a>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 00 19 d5 8f 48 89 df e8 c7 66 29 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #1251665
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff87d16a36
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x106
2
? leave_mm
vmlinux 0xffffffff87c7ddd0
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffff87c7ddd0
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffff87c7ddd0
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffff87d16b4f
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff87f86a25
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff87d170fb
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff87c7e258
Build id: 3.10.0-1160.41.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff87c7e2cb
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff87dee676
Build id: 3.10.0-1160.41.1.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffff87df013f
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff87df0263
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffff87decd16
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x116
14
? handle_mm_fault
vmlinux 0xffffffff87df677d
Build id: 3.10.0-1160.41.1.el7.x86_64 		0xbfd
15
? do_sync_write
vmlinux 0xffffffff87e4da83
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x93
16
SyS_madvise
vmlinux 0xffffffff87dedc51
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x4d1
17
system_call_fastpath
vmlinux 0xffffffff88395f92
Build id: 3.10.0-1160.41.1.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [SystemLogFlush:1931]
Modules linked in: tcp_lp rfcomm xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink bnep vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi coretemp snd_ac97_codec ac97_bus btusb snd_seq btrtl crc32_pclmul ghash_clmulni_intel btbcm aesni_intel snd_seq_device snd_pcm btintel bluetooth rfkill lrw gf128mul snd_timer snd soundcore ppdev glue_helper ablk_helper cryptd sg joydev vmw_balloon pcspkr parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic
ata_generic pata_acpi vmwgfx drm_kms_helper nfit libnvdimm crct10dif_pclmul syscopyarea crct10dif_common sysfillrect sysimgblt fb_sys_fops ttm ata_piix crc32c_intel drm mptspi serio_raw e1000 libata scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks fuse
CPU: 3 PID: 1931 Comm: SystemLogFlush Kdump: loaded Tainted: G             L ------------   3.10.0-1160.41.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff91c273488000 ti: ffff91c273490000 task.ti: ffff91c273490000
RIP: 0010:[<ffffffff87d16a36>]  [<ffffffff87d16a36>] generic_exec_single+0x106/0x1c0
RSP: 0018:ffff91c273493be0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff91c273493bb0 RCX: 0000000000000001
RDX: ffffffff884137d0 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff91c273493c30 R08: ffffffff884137c8 R09: 00003ffffffff000
R10: ffff91c251cada28 R11: ffff91c273493d88 R12: 0000000000000000
R13: 00000003001be894 R14: ffff91c272bebd48 R15: ffffffff87dc862f
FS:  00007f72f03d1700(0000) GS:ffff91c2756c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f72a23a4008 CR3: 00000002204ec000 CR4: 00000000003607e0
Call Trace:
[<ffffffff87c7ddd0>] ? leave_mm+0x120/0x120
[<ffffffff87c7ddd0>] ? leave_mm+0x120/0x120
[<ffffffff87c7ddd0>] ? leave_mm+0x120/0x120
[<ffffffff87d16b4f>] smp_call_function_single+0x5f/0xa0
[<ffffffff87f86a25>] ? cpumask_next_and+0x35/0x50
[<ffffffff87d170fb>] smp_call_function_many+0x22b/0x270
[<ffffffff87c7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff87c7e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff87dee676>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffff87df013f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff87df0263>] tlb_finish_mmu+0x23/0x30
[<ffffffff87decd16>] madvise_free_single_vma+0x116/0x180
[<ffffffff87df677d>] ? handle_mm_fault+0xbfd/0xfb0
[<ffffffff87e4da83>] ? do_sync_write+0x93/0xe0
[<ffffffff87dedc51>] SyS_madvise+0x4d1/0xac0
[<ffffffff88395f92>] system_call_fastpath+0x25/0x2a
Code: 14 c5 60 15 95 88 48 89 df e8 67 71 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 f6 43 20 01 <75> f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 00 0f 85 8f
Complete report #1014873
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffb6b1dba2
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffb6a81b10
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x130
3
? leave_mm
vmlinux 0xffffffffb6a81b10
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x130
4
? leave_mm
vmlinux 0xffffffffb6a81b10
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x130
5
smp_call_function_single
vmlinux 0xffffffffb6b1dcbf
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffb6d9c615
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffb6b1e27b
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffb6a81fa8
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffb6a8201b
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffb6bfa0ce
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xae
11
arch_tlb_finish_mmu
vmlinux 0xffffffffb6bfbc4f
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffb6bfbd83
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffffb6bf87b6
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x116
14
SyS_madvise
vmlinux 0xffffffffb6bf96f1
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x4d1
15
? wake_up_state
vmlinux 0xffffffffb6ae1170
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x20
16
? SyS_epoll_wait
vmlinux 0xffffffffb6cae47c
Build id: 3.10.0-1160.119.1.el7.x86_64 		0xac
17
system_call_fastpath
vmlinux 0xffffffffb71c539a
Build id: 3.10.0-1160.119.1.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 28s! [rclone:16268]
Modules linked in: tcp_lp ext4 mbcache jbd2 drbg ansi_cprng xts gf128mul dm_crypt loop xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink cmac arc4 md4 nls_utf8 cifs ccm dns_resolver nf_conntrack_netbios_ns nf_conntrack_broadcast ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6_tables iptable_filter sunrpc snd_hda_codec_generic snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer edac_mce_amd sg snd joydev pcspkr virtio_balloon i2c_piix4 soundcore binfmt_misc ip_tables xfs libcrc32c virtio_net virtio_console net_failover failover virtio_blk sr_mod cdrom
ata_generic pata_acpi qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata serio_raw virtio_pci virtio_ring floppy virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 16268 Comm: rclone Kdump: loaded Tainted: G             L ------------   3.10.0-1160.119.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS e0d6339-dirty-20220919_024111-d528eb931742 04/01/2014
task: ffff9ac9d3196300 ti: ffff9ac9df388000 task.ti: ffff9ac9df388000
RIP: 0010:[<ffffffffb6b1dba2>]  [<ffffffffb6b1dba2>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9ac9df38bbe0  EFLAGS: 00000202
RAX: 0000000000000002 RBX: ffff9ac9df38bbb0 RCX: 000000000000003e
RDX: 0000000000000003 RSI: 0000000000000002 RDI: 0000000000000282
RBP: ffff9ac9df38bc30 R08: ffffffffb72139c0 R09: 00003ffffffff000
R10: ffff9aca20647360 R11: ffff9ac9df38bd88 R12: 00048073a0aca296
R13: ffffffffb6aeab04 R14: ffff9ac9df38bb80 R15: ffff9ac9d1c3c200
FS:  00007fbc4159f700(0000) GS:ffff9aca7fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff496c94c80 CR3: 000000000254e000 CR4: 00000000000007e0
Call Trace:
[<ffffffffb6a81b10>] ? leave_mm+0x130/0x130
[<ffffffffb6a81b10>] ? leave_mm+0x130/0x130
[<ffffffffb6a81b10>] ? leave_mm+0x130/0x130
[<ffffffffb6b1dcbf>] smp_call_function_single+0x5f/0xa0
[<ffffffffb6d9c615>] ? cpumask_next_and+0x35/0x50
[<ffffffffb6b1e27b>] smp_call_function_many+0x22b/0x270
[<ffffffffb6a81fa8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb6a8201b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb6bfa0ce>] tlb_flush_mmu_tlbonly+0xae/0xd0
[<ffffffffb6bfbc4f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffb6bfbd83>] tlb_finish_mmu+0x23/0x40
[<ffffffffb6bf87b6>] madvise_free_single_vma+0x116/0x180
[<ffffffffb6bf96f1>] SyS_madvise+0x4d1/0xac0
[<ffffffffb6ae1170>] ? wake_up_state+0x20/0x20
[<ffffffffb6cae47c>] ? SyS_epoll_wait+0xac/0x110
[<ffffffffb71c539a>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 c0 19 75 b7 48 89 df e8 b7 67 29 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #983845
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff88316562
Build id: 3.10.0-1160.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff8827e6a0
Build id: 3.10.0-1160.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffff8827e6a0
Build id: 3.10.0-1160.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffff8827e6a0
Build id: 3.10.0-1160.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffff8831667f
Build id: 3.10.0-1160.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff88585de5
Build id: 3.10.0-1160.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff88316c2b
Build id: 3.10.0-1160.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff8827e868
Build id: 3.10.0-1160.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8827e8db
Build id: 3.10.0-1160.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff883edd06
Build id: 3.10.0-1160.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffff883ef7cf
Build id: 3.10.0-1160.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff883ef8f3
Build id: 3.10.0-1160.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffff883ec3a6
Build id: 3.10.0-1160.el7.x86_64 		0x116
14
? handle_mm_fault
vmlinux 0xffffffff883f5e0d
Build id: 3.10.0-1160.el7.x86_64 		0xbfd
15
SyS_madvise
vmlinux 0xffffffff883ed2e1
Build id: 3.10.0-1160.el7.x86_64 		0x4d1
16
system_call_fastpath
vmlinux 0xffffffff88993f92
Build id: 3.10.0-1160.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 91s! [BgSchPool:1563]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter bnep vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event crc32_pclmul snd_ens1371 ghash_clmulni_intel snd_rawmidi snd_ac97_codec ppdev ac97_bus snd_seq btusb btrtl snd_seq_device btbcm btintel vmw_balloon aesni_intel bluetooth snd_pcm lrw gf128mul glue_helper ablk_helper cryptd snd_timer joydev snd pcspkr rfkill sg vmw_vmci soundcore i2c_piix4 parport_pc parport ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic
ata_generic pata_acpi crct10dif_pclmul vmwgfx crct10dif_common crc32c_intel drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm serio_raw drm mptspi scsi_transport_spi ata_piix e1000 mptscsih nfit libata libnvdimm mptbase drm_panel_orientation_quirks fuse
CPU: 0 PID: 1563 Comm: BgSchPool Not tainted 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff929ef16d3180 ti: ffff929ef16e8000 task.ti: ffff929ef16e8000
RIP: 0010:[<ffffffff88316562>]  [<ffffffff88316562>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff929ef16ebbe0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff929ef16ebbb0 RCX: 0000000000000003
RDX: ffffffff88a13c90 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff929ef16ebc30 R08: ffffffff88a13c88 R09: 6d9f09cd9c000000
R10: 9260d19a26736700 R11: ffff929ef16ebd88 R12: ffff92a075617be0
R13: ffffdb67c2736600 R14: 000000000000000e R15: 00000000045211c3
FS:  00007f715e554700(0000) GS:ffff92a075600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f719e68b010 CR3: 00000000b452c000 CR4: 00000000003407f0
Call Trace:
[<ffffffff8827e6a0>] ? leave_mm+0x120/0x120
[<ffffffff8827e6a0>] ? leave_mm+0x120/0x120
[<ffffffff8827e6a0>] ? leave_mm+0x120/0x120
[<ffffffff8831667f>] smp_call_function_single+0x5f/0xa0
[<ffffffff88585de5>] ? cpumask_next_and+0x35/0x50
[<ffffffff88316c2b>] smp_call_function_many+0x22b/0x270
[<ffffffff8827e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8827e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff883edd06>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffff883ef7cf>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff883ef8f3>] tlb_finish_mmu+0x23/0x30
[<ffffffff883ec3a6>] madvise_free_single_vma+0x116/0x180
[<ffffffff883f5e0d>] ? handle_mm_fault+0xbfd/0xfb0
[<ffffffff883ed2e1>] SyS_madvise+0x4d1/0xac0
[<ffffffff88993f92>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 e0 13 f5 88 48 89 df e8 f7 69 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #978609
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa191dba2
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffa1881b10
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x130
3
? leave_mm
vmlinux 0xffffffffa1881b10
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x130
4
? leave_mm
vmlinux 0xffffffffa1881b10
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x130
5
smp_call_function_single
vmlinux 0xffffffffa191dcbf
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffa1b9c5f5
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffa191e27b
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffa1881fa8
Build id: 3.10.0-1160.114.2.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffa188201b
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffa19fa09e
Build id: 3.10.0-1160.114.2.el7.x86_64 		0xae
11
arch_tlb_finish_mmu
vmlinux 0xffffffffa19fbc1f
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffa19fbd53
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffffa19f8786
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x116
14
? sk_run_filter
vmlinux 0xffffffffa1e9bc50
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x550
15
? futex_wake
vmlinux 0xffffffffa19196b0
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x90
16
SyS_madvise
vmlinux 0xffffffffa19f96c1
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x4d1
17
? __seccomp_filter
vmlinux 0xffffffffa195f95b
Build id: 3.10.0-1160.114.2.el7.x86_64 		0x5b
18
? pick_next_entity
vmlinux 0xffffffffa18e8699
Build id: 3.10.0-1160.114.2.el7.x86_64 		0xa9
19
tracesys
vmlinux 0xffffffffa1fc562e
Build id: 3.10.0-1160.114.2.el7.x86_64 		0xa6 
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [C2 CompilerThre:85300]
Modules linked in: veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink overlay(T) vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device iosf_mbi snd_pcm crc32_pclmul ghash_clmulni_intel aesni_intel lrw snd_timer snd gf128mul glue_helper ablk_helper cryptd soundcore ppdev joydev pcspkr vmw_balloon parport_pc parport i2c_piix4 sg vmw_vmci ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic
pata_acpi vmwgfx drm_kms_helper nfit libnvdimm crct10dif_pclmul crct10dif_common syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crc32c_intel drm ata_piix mptspi scsi_transport_spi serio_raw libata mptscsih e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 85300 Comm: C2 CompilerThre Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.114.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff9fd1d7a30000 ti: ffff9fd28df1c000 task.ti: ffff9fd28df1c000
RIP: 0010:[<ffffffffa191dba2>]  [<ffffffffa191dba2>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9fd28df1fbe0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff9fd28df1fbb0 RCX: 0000000000000003
RDX: ffffffffa2013ed0 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff9fd28df1fc30 R08: ffffffffa2013ec8 R09: 00003ffffffff000
R10: ffff9fd30ca82360 R11: ffff9fd28df1fd88 R12: 0000000000000010
R13: ffffffffa1867006 R14: ffffffffffffff10 R15: 0000000000000282
FS:  00007f4c213c6b38(0000) GS:ffff9fd395ec0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4c1acea000 CR3: 000000003dc00000 CR4: 00000000003607e0
Call Trace:
[<ffffffffa1881b10>] ? leave_mm+0x130/0x130
[<ffffffffa1881b10>] ? leave_mm+0x130/0x130
[<ffffffffa1881b10>] ? leave_mm+0x130/0x130
[<ffffffffa191dcbf>] smp_call_function_single+0x5f/0xa0
[<ffffffffa1b9c5f5>] ? cpumask_next_and+0x35/0x50
[<ffffffffa191e27b>] smp_call_function_many+0x22b/0x270
[<ffffffffa1881fa8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa188201b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa19fa09e>] tlb_flush_mmu_tlbonly+0xae/0xd0
[<ffffffffa19fbc1f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffa19fbd53>] tlb_finish_mmu+0x23/0x40
[<ffffffffa19f8786>] madvise_free_single_vma+0x116/0x180
[<ffffffffa1e9bc50>] ? sk_run_filter+0x550/0x760
[<ffffffffa19196b0>] ? futex_wake+0x90/0x190
[<ffffffffa19f96c1>] SyS_madvise+0x4d1/0xac0
[<ffffffffa195f95b>] ? __seccomp_filter+0x5b/0x310
[<ffffffffa18e8699>] ? pick_next_entity+0xa9/0x190
[<ffffffffa1fc562e>] tracesys+0xa6/0xcc
Code: 89 de 48 03 14 c5 c0 19 55 a2 48 89 df e8 b7 67 29 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #897662
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffbbf16562
Build id: 3.10.0-1160.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffbbe7e6a0
Build id: 3.10.0-1160.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffffbbe7e6a0
Build id: 3.10.0-1160.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffffbbe7e6a0
Build id: 3.10.0-1160.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffffbbf1667f
Build id: 3.10.0-1160.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffbc185de5
Build id: 3.10.0-1160.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffbbf16c2b
Build id: 3.10.0-1160.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffbbe7e868
Build id: 3.10.0-1160.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffbbe7e8db
Build id: 3.10.0-1160.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffbbfedd06
Build id: 3.10.0-1160.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffffbbfef7cf
Build id: 3.10.0-1160.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffbbfef8f3
Build id: 3.10.0-1160.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffffbbfec3a6
Build id: 3.10.0-1160.el7.x86_64 		0x116
14
SyS_madvise
vmlinux 0xffffffffbbfed2e1
Build id: 3.10.0-1160.el7.x86_64 		0x4d1
15
system_call_fastpath
vmlinux 0xffffffffbc593f92
Build id: 3.10.0-1160.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [SystemLogFlush:17972]
Modules linked in: tcp_diag inet_diag tcp_lp nls_utf8 isofs xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper vmw_balloon cryptd pcspkr joydev sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi drm nfit ata_piix mptscsih libata crct10dif_pclmul crct10dif_common
drm_panel_orientation_quirks libnvdimm mptbase serio_raw e1000 crc32c_intel dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 17972 Comm: SystemLogFlush Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff9d16167c8000 ti: ffff9d16166ec000 task.ti: ffff9d16166ec000
RIP: 0010:[<ffffffffbbf16562>]  [<ffffffffbbf16562>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9d16166efbe0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff9d16166efbb0 RCX: 000000000000000a
RDX: ffffffffbc614e10 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff9d16166efc30 R08: ffffffffbc614e08 R09: 00003ffffffff000
R10: ffff9d0fb2f3c1b0 R11: ffff9d16166efd88 R12: 0000000000000000
R13: ffffffff00000000 R14: 003fffff000000c0 R15: 0000000000000000
FS:  00007f38d29ed700(0000) GS:ffff9d1618480000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb7e9d0a000 CR3: 000000063981c000 CR4: 0000000000360fe0
Call Trace:
[<ffffffffbbe7e6a0>] ? leave_mm+0x120/0x120
[<ffffffffbbe7e6a0>] ? leave_mm+0x120/0x120
[<ffffffffbbe7e6a0>] ? leave_mm+0x120/0x120
[<ffffffffbbf1667f>] smp_call_function_single+0x5f/0xa0
[<ffffffffbc185de5>] ? cpumask_next_and+0x35/0x50
[<ffffffffbbf16c2b>] smp_call_function_many+0x22b/0x270
[<ffffffffbbe7e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffbbe7e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffbbfedd06>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffffbbfef7cf>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffbbfef8f3>] tlb_finish_mmu+0x23/0x30
[<ffffffffbbfec3a6>] madvise_free_single_vma+0x116/0x180
[<ffffffffbbfed2e1>] SyS_madvise+0x4d1/0xac0
[<ffffffffbc593f92>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 e0 13 b5 bc 48 89 df e8 f7 69 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #816701
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff8e11db12
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff8e081b10
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x130
3
? leave_mm
vmlinux 0xffffffff8e081b10
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x130
4
? leave_mm
vmlinux 0xffffffff8e081b10
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x130
5
smp_call_function_single
vmlinux 0xffffffff8e11dc2f
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff8e39c485
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff8e11e1eb
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff8e081fa8
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8e08201b
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff8e1fa00e
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xae
11
arch_tlb_finish_mmu
vmlinux 0xffffffff8e1fbb8f
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff8e1fbcc3
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffff8e1f86f6
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x116
14
SyS_madvise
vmlinux 0xffffffff8e1f9631
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x4d1
15
? hrtimer_get_res
vmlinux 0xffffffff8e0cf340
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x50
16
? do_nanosleep
vmlinux 0xffffffff8e7b6e1b
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x5b
17
system_call_fastpath
vmlinux 0xffffffff8e7c539a
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [postgres_export:1925]
Modules linked in: tcp_diag inet_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus iosf_mbi snd_seq crc32_pclmul ghash_clmulni_intel snd_seq_device snd_pcm aesni_intel snd_timer lrw gf128mul snd ppdev glue_helper ablk_helper soundcore cryptd vmw_balloon sg joydev pcspkr parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx
drm_kms_helper ata_piix syscopyarea sysfillrect sysimgblt fb_sys_fops ttm libata drm crct10dif_pclmul crct10dif_common crc32c_intel nfit mptspi libnvdimm e1000 scsi_transport_spi mptscsih mptbase serio_raw drm_panel_orientation_quirks fuse
CPU: 2 PID: 1925 Comm: postgres_export Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.92.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff9ff7b5afc200 ti: ffff9ff7ab038000 task.ti: ffff9ff7ab038000
RIP: 0010:[<ffffffff8e11db12>]  [<ffffffff8e11db12>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9ff7ab03bbe0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff9ff7ab03bbb0 RCX: 0000000000000002
RDX: ffffffff8e813bd0 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff9ff7ab03bc30 R08: ffffffff8e813bc8 R09: 00003ffffffff000
R10: ffff9ff078828e58 R11: ffff9ff7ab03bd88 R12: 0000000000000bfd
R13: 0000000000000400 R14: 0000000000000c00 R15: 0000000000000c00
FS:  00007f84e60a1700(0000) GS:ffff9ff7dd680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f992a89eff0 CR3: 00000007f5a0a000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffff8e081b10>] ? leave_mm+0x130/0x130
[<ffffffff8e081b10>] ? leave_mm+0x130/0x130
[<ffffffff8e081b10>] ? leave_mm+0x130/0x130
[<ffffffff8e11dc2f>] smp_call_function_single+0x5f/0xa0
[<ffffffff8e39c485>] ? cpumask_next_and+0x35/0x50
[<ffffffff8e11e1eb>] smp_call_function_many+0x22b/0x270
[<ffffffff8e081fa8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8e08201b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff8e1fa00e>] tlb_flush_mmu_tlbonly+0xae/0xd0
[<ffffffff8e1fbb8f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff8e1fbcc3>] tlb_finish_mmu+0x23/0x40
[<ffffffff8e1f86f6>] madvise_free_single_vma+0x116/0x180
[<ffffffff8e1f9631>] SyS_madvise+0x4d1/0xac0
[<ffffffff8e0cf340>] ? hrtimer_get_res+0x50/0x50
[<ffffffff8e7b6e1b>] ? do_nanosleep+0x5b/0x100
[<ffffffff8e7c539a>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 00 19 d5 8e 48 89 df e8 c7 66 29 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #785618
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa9d1db16
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x106
2
? leave_mm
vmlinux 0xffffffffa9c81b10
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x130
3
? leave_mm
vmlinux 0xffffffffa9c81b10
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x130
4
? leave_mm
vmlinux 0xffffffffa9c81b10
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x130
5
smp_call_function_single
vmlinux 0xffffffffa9d1dc2f
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffa9f9c485
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffa9d1e1eb
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffa9c81fa8
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffa9c8201b
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffa9dfa00e
Build id: 3.10.0-1160.92.1.el7.x86_64 		0xae
11
arch_tlb_finish_mmu
vmlinux 0xffffffffa9dfbb8f
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffa9dfbcc3
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffffa9df86f6
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x116
14
SyS_madvise
vmlinux 0xffffffffa9df9631
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x4d1
15
? lockref_put_or_lock
vmlinux 0xffffffffa9faed48
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x48
16
system_call_fastpath
vmlinux 0xffffffffaa3c539a
Build id: 3.10.0-1160.92.1.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [redis-server:117553]
Modules linked in: tcp_lp tcp_diag inet_diag xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq iosf_mbi snd_seq_device snd_pcm crc32_pclmul ghash_clmulni_intel snd_timer aesni_intel snd lrw gf128mul ppdev soundcore glue_helper vmw_vmci vmw_balloon ablk_helper cryptd pcspkr i2c_piix4 joydev sg parport_pc parport ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi
vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm mptspi scsi_transport_spi nfit libata mptscsih crct10dif_pclmul crct10dif_common crc32c_intel libnvdimm mptbase serio_raw e1000 drm_panel_orientation_quirks fuse
CPU: 1 PID: 117553 Comm: redis-server Kdump: loaded Tainted: G             L ------------   3.10.0-1160.92.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff8f84598e9080 ti: ffff8f81a84b0000 task.ti: ffff8f81a84b0000
RIP: 0010:[<ffffffffa9d1db16>]  [<ffffffffa9d1db16>] generic_exec_single+0x106/0x1c0
RSP: 0018:ffff8f81a84b3be0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff8f81a84b3bb0 RCX: 0000000000000001
RDX: ffffffffaa413950 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff8f81a84b3c30 R08: ffffffffaa413948 R09: 00003ffffffff000
R10: ffff8f8482bf0288 R11: ffff8f81a84b3d88 R12: ffff8f84860d4000
R13: ffff8f84860d3000 R14: ffffffffa9fa7622 R15: ffff8f81a84b3b58
FS:  00007efd59011f80(0000) GS:ffff8f849d640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000ec8068 CR3: 0000000771518000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffffa9c81b10>] ? leave_mm+0x130/0x130
[<ffffffffa9c81b10>] ? leave_mm+0x130/0x130
[<ffffffffa9c81b10>] ? leave_mm+0x130/0x130
[<ffffffffa9d1dc2f>] smp_call_function_single+0x5f/0xa0
[<ffffffffa9f9c485>] ? cpumask_next_and+0x35/0x50
[<ffffffffa9d1e1eb>] smp_call_function_many+0x22b/0x270
[<ffffffffa9c81fa8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa9c8201b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa9dfa00e>] tlb_flush_mmu_tlbonly+0xae/0xd0
[<ffffffffa9dfbb8f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffa9dfbcc3>] tlb_finish_mmu+0x23/0x40
[<ffffffffa9df86f6>] madvise_free_single_vma+0x116/0x180
[<ffffffffa9df9631>] SyS_madvise+0x4d1/0xac0
[<ffffffffa9faed48>] ? lockref_put_or_lock+0x48/0x80
[<ffffffffaa3c539a>] system_call_fastpath+0x25/0x2a
Code: 14 c5 00 19 95 aa 48 89 df e8 c7 66 29 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 f6 43 20 01 <75> f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 00 0f 85 8f
Complete report #727569
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa0b16a32
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffa0a7ddd0
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffffa0a7ddd0
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffffa0a7ddd0
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffffa0b16b4f
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffa0d86a55
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffa0b170fb
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffa0a7e258
Build id: 3.10.0-1160.59.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffa0a7e2cb
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffa0bee676
Build id: 3.10.0-1160.59.1.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffffa0bf013f
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffa0bf0263
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffffa0becd16
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x116
14
SyS_madvise
vmlinux 0xffffffffa0bedc51
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x4d1
15
? pick_next_task_fair
vmlinux 0xffffffffa0ae9d2e
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x61e
16
system_call_fastpath
vmlinux 0xffffffffa1199f92
Build id: 3.10.0-1160.59.1.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 23s! [containerd-shim:2402]
Modules linked in: xt_nat veth xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) vmw_vsock_vmci_transport vsock ext4 mbcache jbd2 nfit libnvdimm coretemp ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif cdrom crct10dif_generic ata_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm pata_acpi mptspi drm scsi_transport_spi ata_piix mptscsih mptbase crct10dif_pclmul libata crct10dif_common crc32c_intel serio_raw vmxnet3 drm_panel_orientation_quirks
floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 7 PID: 2402 Comm: containerd-shim Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-1160.59.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff9054f6978000 ti: ffff9054ec230000 task.ti: ffff9054ec230000
RIP: 0010:[<ffffffffa0b16a32>]  [<ffffffffa0b16a32>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9054ec233be0  EFLAGS: 00000202
RAX: 0000000000000010 RBX: ffff9054ec233bb0 RCX: 0000000000000030
RDX: 000000000000ffff RSI: 0000000000000010 RDI: 0000000000000282
RBP: ffff9054ec233c30 R08: ffffffffa1214440 R09: 00003ffffffff000
R10: ffff9058f54bb368 R11: ffff9054ec233d88 R12: ffff90542f1aefc0
R13: ffff90542f1aefc0 R14: 0000000000000177 R15: ffff90537b1f1e00
FS:  000000c000032410(0000) GS:ffff9054f7d80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8e532ae000 CR3: 0000000436fea000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa0a7ddd0>] ? leave_mm+0x120/0x120
[<ffffffffa0a7ddd0>] ? leave_mm+0x120/0x120
[<ffffffffa0a7ddd0>] ? leave_mm+0x120/0x120
[<ffffffffa0b16b4f>] smp_call_function_single+0x5f/0xa0
[<ffffffffa0d86a55>] ? cpumask_next_and+0x35/0x50
[<ffffffffa0b170fb>] smp_call_function_many+0x22b/0x270
[<ffffffffa0a7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa0a7e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa0bee676>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffffa0bf013f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffa0bf0263>] tlb_finish_mmu+0x23/0x30
[<ffffffffa0becd16>] madvise_free_single_vma+0x116/0x180
[<ffffffffa0bedc51>] SyS_madvise+0x4d1/0xac0
[<ffffffffa0ae9d2e>] ? pick_next_task_fair+0x61e/0x870
[<ffffffffa1199f92>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 60 18 75 a1 48 89 df e8 97 71 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #582129
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa8b16562
Build id: 3.10.0-1160.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffa8a7e6a0
Build id: 3.10.0-1160.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffffa8a7e6a0
Build id: 3.10.0-1160.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffffa8a7e6a0
Build id: 3.10.0-1160.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffffa8b1667f
Build id: 3.10.0-1160.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffa8d85de5
Build id: 3.10.0-1160.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffa8b16c2b
Build id: 3.10.0-1160.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffa8a7e868
Build id: 3.10.0-1160.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffa8a7e8db
Build id: 3.10.0-1160.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffa8bedd06
Build id: 3.10.0-1160.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffffa8bef7cf
Build id: 3.10.0-1160.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffa8bef8f3
Build id: 3.10.0-1160.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffffa8bec3a6
Build id: 3.10.0-1160.el7.x86_64 		0x116
14
? sk_run_filter
vmlinux 0xffffffffa9070b40
Build id: 3.10.0-1160.el7.x86_64 		0x550
15
? sock_aio_read
vmlinux 0xffffffffa9033731
Build id: 3.10.0-1160.el7.x86_64 		0x21
16
? do_sync_read
vmlinux 0xffffffffa8c4cf83
Build id: 3.10.0-1160.el7.x86_64 		0x93
17
SyS_madvise
vmlinux 0xffffffffa8bed2e1
Build id: 3.10.0-1160.el7.x86_64 		0x4d1
18
? __seccomp_filter
vmlinux 0xffffffffa8b56dfb
Build id: 3.10.0-1160.el7.x86_64 		0x5b
19
tracesys
vmlinux 0xffffffffa9194226
Build id: 3.10.0-1160.el7.x86_64 		0xa6 
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [redis-server:43785]
Modules linked in: tcp_lp veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul snd_ens1371 ghash_clmulni_intel snd_rawmidi ppdev snd_ac97_codec ac97_bus aesni_intel
snd_seq lrw gf128mul snd_seq_device glue_helper ablk_helper vmw_balloon snd_pcm cryptd snd_timer joydev pcspkr snd soundcore i2c_piix4 sg vmw_vmci parport_pc parport ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt ata_generic pata_acpi crct10dif_pclmul mptspi fb_sys_fops crct10dif_common ttm scsi_transport_spi drm ata_piix e1000 mptscsih crc32c_intel serio_raw mptbase nfit libnvdimm libata drm_panel_orientation_quirks fuse
CPU: 3 PID: 43785 Comm: redis-server Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff889764629080 ti: ffff88969e9b8000 task.ti: ffff88969e9b8000
RIP: 0010:[<ffffffffa8b16562>]  [<ffffffffa8b16562>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff88969e9bbbe0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff88969e9bbbb0 RCX: 0000000000000001
RDX: ffffffffa9213790 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff88969e9bbc30 R08: ffffffffa9213788 R09: 00003ffffffff000
R10: ffff8895ea011950 R11: ffff88969e9bbd88 R12: ffff88969e9bbcd0
R13: 0000000000004000 R14: ffffffffa9185b52 R15: ffffffffa903dbf4
FS:  00007fad2f831f80(0000) GS:ffff8897af2c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa53ba0cfe8 CR3: 000000011eba6000 CR4: 00000000003607e0
Call Trace:
[<ffffffffa8a7e6a0>] ? leave_mm+0x120/0x120
[<ffffffffa8a7e6a0>] ? leave_mm+0x120/0x120
[<ffffffffa8a7e6a0>] ? leave_mm+0x120/0x120
[<ffffffffa8b1667f>] smp_call_function_single+0x5f/0xa0
[<ffffffffa8d85de5>] ? cpumask_next_and+0x35/0x50
[<ffffffffa8b16c2b>] smp_call_function_many+0x22b/0x270
[<ffffffffa8a7e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa8a7e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa8bedd06>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffffa8bef7cf>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffa8bef8f3>] tlb_finish_mmu+0x23/0x30
[<ffffffffa8bec3a6>] madvise_free_single_vma+0x116/0x180
[<ffffffffa9070b40>] ? sk_run_filter+0x550/0x760
[<ffffffffa9033731>] ? sock_aio_read+0x21/0x30
[<ffffffffa8c4cf83>] ? do_sync_read+0x93/0xe0
[<ffffffffa8bed2e1>] SyS_madvise+0x4d1/0xac0
[<ffffffffa8b56dfb>] ? __seccomp_filter+0x5b/0x300
[<ffffffffa9194226>] tracesys+0xa6/0xcc
Code: 89 de 48 03 14 c5 e0 13 75 a9 48 89 df e8 f7 69 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [CRTC:37:crtc-0] flip_done timed out
Complete report #518408
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff88514a26
Build id: 3.10.0-1062.el7.x86_64 		0x106
2
? leave_mm
vmlinux 0xffffffff8847d1d0
Build id: 3.10.0-1062.el7.x86_64 		0x110
3
? leave_mm
vmlinux 0xffffffff8847d1d0
Build id: 3.10.0-1062.el7.x86_64 		0x110
4
? leave_mm
vmlinux 0xffffffff8847d1d0
Build id: 3.10.0-1062.el7.x86_64 		0x110
5
smp_call_function_single
vmlinux 0xffffffff88514b3f
Build id: 3.10.0-1062.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff8877f475
Build id: 3.10.0-1062.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff885150eb
Build id: 3.10.0-1062.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff8847d398
Build id: 3.10.0-1062.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff8847d40b
Build id: 3.10.0-1062.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff885ea166
Build id: 3.10.0-1062.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffff885ebc2f
Build id: 3.10.0-1062.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff885ebd53
Build id: 3.10.0-1062.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffff885e8866
Build id: 3.10.0-1062.el7.x86_64 		0x116
14
? futex_wake
vmlinux 0xffffffff88510560
Build id: 3.10.0-1062.el7.x86_64 		0x90
15
SyS_madvise
vmlinux 0xffffffff885e97a1
Build id: 3.10.0-1062.el7.x86_64 		0x4d1
16
? pick_next_task_fair
vmlinux 0xffffffff884e166f
Build id: 3.10.0-1062.el7.x86_64 		0x5f
17
system_call_fastpath
vmlinux 0xffffffff88b8bede
Build id: 3.10.0-1062.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [containerd-shim:15303]
Modules linked in: xt_recent veth nf_tables ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 rpcsec_gss_krb5 nfsv4 dns_resolver nfs lockd grace fscache xt_CHECKSUM tun ebtable_filter ebtables ip6table_filter devlink ip6_tables nf_conntrack_netlink xt_statistic xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 ipt_REJECT nf_reject_ipv4 xt_mark xt_addrtype xt_comment xt_conntrack iptable_filter iptable_nat nf_nat_ipv4 nf_nat iptable_mangle ip_set nfnetlink nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nf_conntrack vmw_vsock_vmci_transport vsock dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio sb_edac ppdev iosf_mbi vmw_balloon crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper parport_pc pcspkr joydev sg i2c_piix4 cryptd parport
vmw_vmci br_netfilter auth_rpcgss bridge stp sunrpc llc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper ata_piix syscopyarea sysfillrect sysimgblt fb_sys_fops ttm libata mptspi crct10dif_pclmul crct10dif_common scsi_transport_spi drm serio_raw crc32c_intel mptscsih vmxnet3 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 15303 Comm: containerd-shim Kdump: loaded Tainted: G             L ------------   3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff955d9ca462a0 ti: ffff955e8e12c000 task.ti: ffff955e8e12c000
RIP: 0010:[<ffffffff88514a26>]  [<ffffffff88514a26>] generic_exec_single+0x106/0x1c0
RSP: 0018:ffff955e8e12fbe0  EFLAGS: 00000202
RAX: 0000000000000010 RBX: ffff955e8e12fbb0 RCX: 0000000000000030
RDX: 000000000000ffff RSI: 0000000000000010 RDI: 0000000000000282
RBP: ffff955e8e12fc30 R08: ffffffff88c13500 R09: 00003ffffffff000
R10: ffff956245f00438 R11: ffff955e8e12fd88 R12: ffffffff88b7eb25
R13: ffffffff88b7eb31 R14: ffffffff88b7eb25 R15: ffffffff88b7eb31
FS:  000000c000038410(0000) GS:ffff955e6fd40000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000792ad2000 CR3: 00000004e6dae000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8847d1d0>] ? leave_mm+0x110/0x110
[<ffffffff8847d1d0>] ? leave_mm+0x110/0x110
[<ffffffff8847d1d0>] ? leave_mm+0x110/0x110
[<ffffffff88514b3f>] smp_call_function_single+0x5f/0xa0
[<ffffffff8877f475>] ? cpumask_next_and+0x35/0x50
[<ffffffff885150eb>] smp_call_function_many+0x22b/0x270
[<ffffffff8847d398>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8847d40b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff885ea166>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffff885ebc2f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff885ebd53>] tlb_finish_mmu+0x23/0x30
[<ffffffff885e8866>] madvise_free_single_vma+0x116/0x180
[<ffffffff88510560>] ? futex_wake+0x90/0x180
[<ffffffff885e97a1>] SyS_madvise+0x4d1/0xac0
[<ffffffff884e166f>] ? pick_next_task_fair+0x5f/0x1b0
[<ffffffff88b8bede>] system_call_fastpath+0x25/0x2a
Code: 14 c5 e0 d7 14 89 48 89 df e8 d7 1a 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 f6 43 20 01 <75> f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 00 0f 85 8f
Complete report #374781
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffb6916a32
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffb687ddd0
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffffb687ddd0
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffffb687ddd0
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffffb6916b4f
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffb6b86a45
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffb69170fb
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffb687e258
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffb687e2cb
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffb69ee676
Build id: 3.10.0-1160.49.1.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffffb69f013f
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffb69f0263
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffffb69ecd16
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x116
14
? sock_aio_read
vmlinux 0xffffffffb6e35731
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x21
15
? do_sync_read
vmlinux 0xffffffffb6a4d9c3
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x93
16
SyS_madvise
vmlinux 0xffffffffb69edc51
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x4d1
17
system_call_fastpath
vmlinux 0xffffffffb6f95f92
Build id: 3.10.0-1160.49.1.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [redis-server:17190]
Modules linked in: tun devlink bridge stp llc ip_set vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event crc32_pclmul ppdev snd_ens1371 ghash_clmulni_intel snd_rawmidi snd_ac97_codec ac97_bus snd_seq vmw_balloon snd_seq_device aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_pcm joydev pcspkr snd_timer sg snd soundcore i2c_piix4 vmw_vmci parport_pc parport xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit libnvdimm drm ata_piix crct10dif_pclmul crct10dif_common libata crc32c_intel mptspi scsi_transport_spi serio_raw mptscsih e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: ip_tables]
CPU: 3 PID: 17190 Comm: redis-server Kdump: loaded Tainted: G             L ------------   3.10.0-1160.49.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff9dad3591a100 ti: ffff9dafadb9c000 task.ti: ffff9dafadb9c000
RIP: 0010:[<ffffffffb6916a32>]  [<ffffffffb6916a32>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9dafadb9fbe0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff9dafadb9fbb0 RCX: 0000000000000003
RDX: ffffffffb7013cd0 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff9dafadb9fc30 R08: ffffffffb7013cc8 R09: 00003ffffffff000
R10: ffff9dafdb2131b8 R11: ffff9dafadb9fd88 R12: ffff9dabf5590000
R13: ffff9dabf558f000 R14: ffffffffb6b91672 R15: ffff9dafadb9fb58
FS:  00007fa501c86f80(0000) GS:ffff9dafed6c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5ca19b1000 CR3: 00000003f8bc0000 CR4: 00000000003407e0
Call Trace:
[<ffffffffb687ddd0>] ? leave_mm+0x120/0x120
[<ffffffffb687ddd0>] ? leave_mm+0x120/0x120
[<ffffffffb687ddd0>] ? leave_mm+0x120/0x120
[<ffffffffb6916b4f>] smp_call_function_single+0x5f/0xa0
[<ffffffffb6b86a45>] ? cpumask_next_and+0x35/0x50
[<ffffffffb69170fb>] smp_call_function_many+0x22b/0x270
[<ffffffffb687e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb687e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb69ee676>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffffb69f013f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffb69f0263>] tlb_finish_mmu+0x23/0x30
[<ffffffffb69ecd16>] madvise_free_single_vma+0x116/0x180
[<ffffffffb6e35731>] ? sock_aio_read+0x21/0x30
[<ffffffffb6a4d9c3>] ? do_sync_read+0x93/0xe0
[<ffffffffb69edc51>] SyS_madvise+0x4d1/0xac0
[<ffffffffb6f95f92>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 60 15 55 b7 48 89 df e8 87 71 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #303014
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffb3716a32
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffb367ddd0
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffffb367ddd0
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffffb367ddd0
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffffb3716b4f
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffb3986a45
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffb37170fb
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffb367e258
Build id: 3.10.0-1160.45.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffb367e2cb
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffb37ee676
Build id: 3.10.0-1160.45.1.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffffb37f013f
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffb37f0263
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffffb37ecd16
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x116
14
? wake_up_q
vmlinux 0xffffffffb36dada8
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x58
15
? sk_run_filter
vmlinux 0xffffffffb3c72750
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x550
16
? futex_wake
vmlinux 0xffffffffb3712670
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x90
17
? ep_poll
vmlinux 0xffffffffb389d87e
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x31e
18
SyS_madvise
vmlinux 0xffffffffb37edc51
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x4d1
19
? __seccomp_filter
vmlinux 0xffffffffb375729b
Build id: 3.10.0-1160.45.1.el7.x86_64 		0x5b
20
tracesys
vmlinux 0xffffffffb3d96226
Build id: 3.10.0-1160.45.1.el7.x86_64 		0xa6 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [auditbeat:1576]
Modules linked in: xt_nat veth xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_12803(E) overlay(T) ext4 snd_hda_codec_generic mbcache jbd2 snd_hda_intel iosf_mbi snd_hda_codec crc32_pclmul ppdev ghash_clmulni_intel snd_hda_core snd_hwdep snd_seq aesni_intel snd_seq_device snd_pcm lrw gf128mul glue_helper ablk_helper cryptd snd_timer joydev virtio_balloon snd pcspkr virtio_rng parport_pc i2c_piix4 parport soundcore ip_tables xfs libcrc32c ata_generic pata_acpi virtio_console virtio_blk qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops
ata_piix ttm libata drm e1000 crct10dif_pclmul crct10dif_common virtio_pci crc32c_intel floppy serio_raw virtio_ring virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 1576 Comm: auditbeat Tainted: P            EL ------------ T 3.10.0-1160.45.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 1.13.0-2.module+el8.3.0+7860+a7792d29 04/01/2014
task: ffff88d393413180 ti: ffff88d39344c000 task.ti: ffff88d39344c000
RIP: 0010:[<ffffffffb3716a32>]  [<ffffffffb3716a32>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff88d39344fbe0  EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffff88d39344fbb0 RCX: 000000000000003c
RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000282
RBP: ffff88d39344fc30 R08: ffffffffb3e13a40 R09: 00003ffffffff000
R10: ffff88d4b6e45870 R11: ffff88d39344fd88 R12: ffff88d4b7a106c0
R13: ffff88d4b7a106c0 R14: 0000000000000400 R15: ffff88d3366c0a00
FS:  00007fde0cf68700(0000) GS:ffff88d4bfc00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000555fee5d2016 CR3: 00000001b6e42000 CR4: 00000000001606f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffb367ddd0>] ? leave_mm+0x120/0x120
[<ffffffffb367ddd0>] ? leave_mm+0x120/0x120
[<ffffffffb367ddd0>] ? leave_mm+0x120/0x120
[<ffffffffb3716b4f>] smp_call_function_single+0x5f/0xa0
[<ffffffffb3986a45>] ? cpumask_next_and+0x35/0x50
[<ffffffffb37170fb>] smp_call_function_many+0x22b/0x270
[<ffffffffb367e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb367e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb37ee676>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffffb37f013f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffb37f0263>] tlb_finish_mmu+0x23/0x30
[<ffffffffb37ecd16>] madvise_free_single_vma+0x116/0x180
[<ffffffffb36dada8>] ? wake_up_q+0x58/0x80
[<ffffffffb3c72750>] ? sk_run_filter+0x550/0x760
[<ffffffffb3712670>] ? futex_wake+0x90/0x180
[<ffffffffb389d87e>] ? ep_poll+0x31e/0x360
[<ffffffffb37edc51>] SyS_madvise+0x4d1/0xac0
[<ffffffffb375729b>] ? __seccomp_filter+0x5b/0x300
[<ffffffffb3d96226>] tracesys+0xa6/0xcc
Code: 89 de 48 03 14 c5 60 15 35 b4 48 89 df e8 87 71 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #280504
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff94516f72
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff9447e730
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffff9447e730
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffff9447e730
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffff9451708f
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff94785005
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff9451763b
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff9447e8f8
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9447e96b
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff945ede36
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffff945ef8ff
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff945efa23
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffff945ec4e6
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x116
14
? sk_run_filter
vmlinux 0xffffffff94a6f7a5
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x2c5
15
? do_mmap
vmlinux 0xffffffff945fcb28
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x378
16
SyS_madvise
vmlinux 0xffffffff945ed421
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x4d1
17
? __seccomp_filter
vmlinux 0xffffffff9455770b
Build id: 3.10.0-1127.19.1.el7.x86_64 		0x5b
18
tracesys
vmlinux 0xffffffff94b93166
Build id: 3.10.0-1127.19.1.el7.x86_64 		0xa6 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [armeria-common-:107472]
Modules linked in: xt_nat veth nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) tcp_lp rfcomm fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock bnep sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event squashfs loop iosf_mbi ppdev crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi
snd_ac97_codec vmw_balloon aesni_intel btusb ac97_bus lrw snd_seq gf128mul glue_helper btrtl ablk_helper btbcm snd_seq_device cryptd btintel bluetooth snd_pcm joydev rfkill snd_timer pcspkr snd sg soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit libnvdimm drm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix mptspi scsi_transport_spi libata mptscsih e1000 serio_raw mptbase drm_panel_orientation_quirks
CPU: 1 PID: 107472 Comm: armeria-common- Kdump: loaded Tainted: G             L ------------ T 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff8f0808a63150 ti: ffff8f081c730000 task.ti: ffff8f081c730000
RIP: 0010:[<ffffffff94516f72>]  [<ffffffff94516f72>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff8f081c733be0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff8f081c733bb0 RCX: 0000000000000004
RDX: ffffffff94c13e50 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff8f081c733c30 R08: ffffffff94c13e48 R09: 00003ffffffff000
R10: ffff8f08bbb67950 R11: ffff8f081c733d88 R12: 0000000094b85844
R13: fffffedc0737d3f0 R14: 00007f5aeb733000 R15: 000000018040003f
FS:  00007f5aeb82fb38(0000) GS:ffff8f0986440000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c0006d5000 CR3: 000000027a224000 CR4: 00000000003607e0
Call Trace:
[<ffffffff9447e730>] ? leave_mm+0x120/0x120
[<ffffffff9447e730>] ? leave_mm+0x120/0x120
[<ffffffff9447e730>] ? leave_mm+0x120/0x120
[<ffffffff9451708f>] smp_call_function_single+0x5f/0xa0
[<ffffffff94785005>] ? cpumask_next_and+0x35/0x50
[<ffffffff9451763b>] smp_call_function_many+0x22b/0x270
[<ffffffff9447e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9447e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff945ede36>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffff945ef8ff>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff945efa23>] tlb_finish_mmu+0x23/0x30
[<ffffffff945ec4e6>] madvise_free_single_vma+0x116/0x180
[<ffffffff94a6f7a5>] ? sk_run_filter+0x2c5/0x760
[<ffffffff945fcb28>] ? do_mmap+0x378/0x530
[<ffffffff945ed421>] SyS_madvise+0x4d1/0xab0
[<ffffffff9455770b>] ? __seccomp_filter+0x5b/0x300
[<ffffffff94b93166>] tracesys+0xa6/0xcc
Code: 89 de 48 03 14 c5 a0 10 15 95 48 89 df e8 07 52 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #238872
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff92d16a12
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff92c7ddd0
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffff92c7ddd0
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffff92c7ddd0
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffff92d16b2f
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff92f869f5
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff92d170db
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff92c7e258
Build id: 3.10.0-1160.36.2.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff92c7e2cb
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff92dee656
Build id: 3.10.0-1160.36.2.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffff92df011f
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff92df0243
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffff92deccf6
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x116
14
? sk_run_filter
vmlinux 0xffffffff93272750
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x550
15
? ep_poll
vmlinux 0xffffffff92e9d82e
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x31e
16
SyS_madvise
vmlinux 0xffffffff92dedc31
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x4d1
17
? __seccomp_filter
vmlinux 0xffffffff92d5727b
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x5b
18
? system_call_after_swapgs
vmlinux 0xffffffff93395ed5
Build id: 3.10.0-1160.36.2.el7.x86_64 		0xa2
19
? system_call_after_swapgs
vmlinux 0xffffffff93395ec9
Build id: 3.10.0-1160.36.2.el7.x86_64 		0x96
20
tracesys
vmlinux 0xffffffff93396226
Build id: 3.10.0-1160.36.2.el7.x86_64 		0xa6 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [metricbeat:1648]
Modules linked in: xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables binfmt_misc iptable_filter ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_CHECKSUM iptable_mangle ppdev parport_pc joydev parport i2c_piix4 pcspkr virtio_balloon nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c ata_generic pata_acpi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm virtio_blk drm ata_piix libata e1000 serio_raw virtio_pci virtio_ring virtio drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 1648 Comm: metricbeat Kdump: loaded Tainted: G             L ------------   3.10.0-1160.36.2.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
task: ffff993e0a4a9080 ti: ffff993e0a6ec000 task.ti: ffff993e0a6ec000
RIP: 0010:[<ffffffff92d16a12>]  [<ffffffff92d16a12>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff993e0a6efbe0  EFLAGS: 00000202
RAX: 00000000000400f6 RBX: ffffffff92ce0f3e RCX: 0000000000000000
RDX: 00000000000008fb RSI: 00000000000000fb RDI: 0000000000000286
RBP: ffff993e0a6efc30 R08: 0000000000000001 R09: 00003ffffffff000
R10: ffff993e170ded80 R11: ffff993e0a6efd88 R12: 0000067b392523a3
R13: ffffffff92ce480c R14: ffff993e0a6efb80 R15: ffff993e0a6efbe0
FS:  00007f06bdabf700(0000) GS:ffff993e5fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f06e7b33000 CR3: 00000000d384e000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff92c7ddd0>] ? leave_mm+0x120/0x120
[<ffffffff92c7ddd0>] ? leave_mm+0x120/0x120
[<ffffffff92c7ddd0>] ? leave_mm+0x120/0x120
[<ffffffff92d16b2f>] smp_call_function_single+0x5f/0xa0
[<ffffffff92f869f5>] ? cpumask_next_and+0x35/0x50
[<ffffffff92d170db>] smp_call_function_many+0x22b/0x270
[<ffffffff92c7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff92c7e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff92dee656>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffff92df011f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff92df0243>] tlb_finish_mmu+0x23/0x30
[<ffffffff92deccf6>] madvise_free_single_vma+0x116/0x180
[<ffffffff93272750>] ? sk_run_filter+0x550/0x760
[<ffffffff92e9d82e>] ? ep_poll+0x31e/0x360
[<ffffffff92dedc31>] SyS_madvise+0x4d1/0xac0
[<ffffffff92d5727b>] ? __seccomp_filter+0x5b/0x300
[<ffffffff93395ed5>] ? system_call_after_swapgs+0xa2/0x13a
[<ffffffff93395ec9>] ? system_call_after_swapgs+0x96/0x13a
[<ffffffff93396226>] tracesys+0xa6/0xcc
Code: 89 de 48 03 14 c5 60 15 95 93 48 89 df e8 57 71 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #186116
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffacf167a6
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x106
2
? leave_mm
vmlinux 0xfffffffface7e6a0
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xfffffffface7e6a0
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xfffffffface7e6a0
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffffacf168bf
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffad1862c5
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffacf16e6b
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xfffffffface7e868
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xfffffffface7e8db
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffacfede86
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffffacfef94f
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffacfefa73
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffffacfec526
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x116
14
? wake_up_q
vmlinux 0xffffffffacedb0e8
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x58
15
? sk_run_filter
vmlinux 0xffffffffad4714c5
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x2c5
16
? futex_wake
vmlinux 0xffffffffacf12280
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x90
17
SyS_madvise
vmlinux 0xffffffffacfed461
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x4d1
18
? __seccomp_filter
vmlinux 0xffffffffacf56ffb
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x5b
19
tracesys
vmlinux 0xffffffffad595226
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xa6 
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [metricbeat:1076]
Modules linked in: veth xt_nat xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop overlay nfit libnvdimm snd_hda_codec_generic snd_hda_intel snd_hda_codec iosf_mbi snd_hda_core snd_hwdep snd_seq kvm_intel kvm snd_seq_device snd_pcm snd_timer snd irqbypass soundcore crc32_pclmul ghash_clmulni_intel joydev aesni_intel ppdev virtio_rng i2c_piix4 virtio_balloon parport_pc lrw gf128mul parport glue_helper pcspkr ablk_helper cryptd ip_tables xfs libcrc32c ata_generic pata_acpi virtio_console virtio_blk qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix
drm libata crct10dif_pclmul crct10dif_common e1000 floppy crc32c_intel virtio_pci drm_panel_orientation_quirks virtio_ring serio_raw virtio dm_mirror dm_region_hash dm_log dm_mod
CPU: 4 PID: 1076 Comm: metricbeat Tainted: G             L ------------   3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 1.13.0-2.module+el8.3.0+7860+a7792d29 04/01/2014
task: ffff93d37a7a0000 ti: ffff93d37fe58000 task.ti: ffff93d37fe58000
RIP: 0010:[<ffffffffacf167a6>]  [<ffffffffacf167a6>] generic_exec_single+0x106/0x1c0
RSP: 0018:ffff93d37fe5bbe0  EFLAGS: 00000202
RAX: 0000000000000006 RBX: ffff93d37fe5bbb0 RCX: 0000000000000830
RDX: 0000000000000006 RSI: 0000000000000006 RDI: 0000000000000282
RBP: ffff93d37fe5bc30 R08: ffffffffad614440 R09: 00003ffffffff000
R10: ffff93d2bb483948 R11: ffff93d37fe5bd88 R12: ffffffffacee4546
R13: ffff93d37fe5bb88 R14: ffffffffacee4999 R15: ffff93d37fe5bb60
FS:  00007f24c269f700(0000) GS:ffff93d4bfd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ffdf8f33228 CR3: 0000000266d60000 CR4: 0000000000760ee0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<fffffffface7e6a0>] ? leave_mm+0x120/0x120
[<fffffffface7e6a0>] ? leave_mm+0x120/0x120
[<fffffffface7e6a0>] ? leave_mm+0x120/0x120
[<ffffffffacf168bf>] smp_call_function_single+0x5f/0xa0
[<ffffffffad1862c5>] ? cpumask_next_and+0x35/0x50
[<ffffffffacf16e6b>] smp_call_function_many+0x22b/0x270
[<fffffffface7e868>] native_flush_tlb_others+0xb8/0xc0
[<fffffffface7e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffacfede86>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffffacfef94f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffacfefa73>] tlb_finish_mmu+0x23/0x30
[<ffffffffacfec526>] madvise_free_single_vma+0x116/0x180
[<ffffffffacedb0e8>] ? wake_up_q+0x58/0x80
[<ffffffffad4714c5>] ? sk_run_filter+0x2c5/0x760
[<ffffffffacf12280>] ? futex_wake+0x90/0x180
[<ffffffffacfed461>] SyS_madvise+0x4d1/0xac0
[<ffffffffacf56ffb>] ? __seccomp_filter+0x5b/0x300
[<ffffffffad595226>] tracesys+0xa6/0xcc
Code: 14 c5 e0 13 b5 ad 48 89 df e8 97 6c 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 f6 43 20 01 <75> f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 00 0f 85 8f
Complete report #169312
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa5116842
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffa507e6a0
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffffa507e6a0
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffffa507e6a0
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffffa511695f
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffa5386395
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffa5116f0b
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffa507e868
Build id: 3.10.0-1160.24.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffa507e8db
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffa51edf56
Build id: 3.10.0-1160.24.1.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffffa51efa1f
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffa51efb43
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffffa51ec5f6
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x116
14
? sk_run_filter
vmlinux 0xffffffffa56724c5
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x2c5
15
? do_sync_read
vmlinux 0xffffffffa524d233
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x93
16
SyS_madvise
vmlinux 0xffffffffa51ed531
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x4d1
17
? __seccomp_filter
vmlinux 0xffffffffa51570ab
Build id: 3.10.0-1160.24.1.el7.x86_64 		0x5b
18
tracesys
vmlinux 0xffffffffa5796226
Build id: 3.10.0-1160.24.1.el7.x86_64 		0xa6 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 25s! [1_scheduler:98857]
Modules linked in: tcp_lp nls_utf8 isofs rfcomm xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vxlan ip6_udp_tunnel udp_tunnel xt_nat veth br_netfilter tun devlink overlay(T) bridge stp llc iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack ip_set nfnetlink vmw_vsock_vmci_transport vsock bnep sunrpc snd_seq_midi snd_seq_midi_event btusb btrtl btbcm btintel snd_ens1371 bluetooth snd_rawmidi snd_ac97_codec crc32_pclmul ghash_clmulni_intel ac97_bus
aesni_intel lrw gf128mul glue_helper snd_seq snd_seq_device ablk_helper snd_pcm rfkill cryptd snd_timer snd ppdev pcspkr soundcore vmw_balloon sg joydev parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common nfit crc32c_intel e1000 libata mptspi scsi_transport_spi mptscsih serio_raw libnvdimm mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: iptable_filter]
CPU: 0 PID: 98857 Comm: 1_scheduler Kdump: loaded Tainted: G             L ------------ T 3.10.0-1160.24.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff925ea80b6300 ti: ffff925f0f988000 task.ti: ffff925f0f988000
RIP: 0010:[<ffffffffa5116842>]  [<ffffffffa5116842>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff925f0f98bbe0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff925f0f98bbb0 RCX: 0000000000000002
RDX: ffffffffa5813a50 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffff925f0f98bc30 R08: ffffffffa5813a48 R09: 00003ffffffff000
R10: ffff925eae6206c0 R11: ffff925f0f98bd88 R12: 0000000100000000
R13: 0000000100000000 R14: 0000000000000400 R15: 0000000000000000
FS:  00007fc6d54ff700(0000) GS:ffff925f39600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005626289e4c67 CR3: 000000010f93c000 CR4: 00000000007607f0
PKRU: 55555554
Call Trace:
[<ffffffffa507e6a0>] ? leave_mm+0x120/0x120
[<ffffffffa507e6a0>] ? leave_mm+0x120/0x120
[<ffffffffa507e6a0>] ? leave_mm+0x120/0x120
[<ffffffffa511695f>] smp_call_function_single+0x5f/0xa0
[<ffffffffa5386395>] ? cpumask_next_and+0x35/0x50
[<ffffffffa5116f0b>] smp_call_function_many+0x22b/0x270
[<ffffffffa507e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa507e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa51edf56>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffffa51efa1f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffa51efb43>] tlb_finish_mmu+0x23/0x30
[<ffffffffa51ec5f6>] madvise_free_single_vma+0x116/0x180
[<ffffffffa56724c5>] ? sk_run_filter+0x2c5/0x760
[<ffffffffa524d233>] ? do_sync_read+0x93/0xe0
[<ffffffffa51ed531>] SyS_madvise+0x4d1/0xac0
[<ffffffffa51570ab>] ? __seccomp_filter+0x5b/0x300
[<ffffffffa5796226>] tracesys+0xa6/0xcc
Code: 89 de 48 03 14 c5 a0 15 d5 a5 48 89 df e8 c7 6c 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #79809
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffb2f167a2
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffb2e7e6a0
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffffb2e7e6a0
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffffb2e7e6a0
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffffb2f168bf
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffb31862c5
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffb2f16e6b
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffb2e7e868
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffb2e7e8db
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffb2fede86
Build id: 3.10.0-1160.15.2.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffffb2fef94f
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffb2fefa73
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffffb2fec526
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x116
14
SyS_madvise
vmlinux 0xffffffffb2fed461
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x4d1
15
system_call_fastpath
vmlinux 0xffffffffb3594f92
Build id: 3.10.0-1160.15.2.el7.x86_64 		0x25 
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 21s! [jemalloc_bg_thd:4111]
Modules linked in: tcp_lp nls_utf8 isofs rfcomm nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter overlay(T) bnep vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus crc32_pclmul snd_seq ghash_clmulni_intel snd_seq_device btusb btrtl snd_pcm aesni_intel btbcm lrw btintel snd_timer gf128mul bluetooth ppdev glue_helper snd soundcore ablk_helper sg rfkill cryptd pcspkr joydev vmw_balloon parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c
sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix nfit crct10dif_pclmul crct10dif_common crc32c_intel libata libnvdimm mptspi e1000 scsi_transport_spi serio_raw mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 7 PID: 4111 Comm: jemalloc_bg_thd Kdump: loaded Tainted: G               ------------ T 3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffffa127abeac200 ti: ffffa1266e338000 task.ti: ffffa1266e338000
RIP: 0010:[<ffffffffb2f167a2>]  [<ffffffffb2f167a2>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffffa1266e33bbe0  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffffa1266e33bbb0 RCX: 0000000000000001
RDX: ffffffffb36137d0 RSI: 0000000000000080 RDI: 0000000000000282
RBP: ffffa1266e33bc30 R08: ffffffffb36137c8 R09: 00003ffffffff000
R10: ffffa1268437aa20 R11: ffffa1266e33bd88 R12: ffffa128357dad40
R13: ffffa1283253acc0 R14: ffffa128357dad40 R15: ffffa1283253acc0
FS:  00007f1be09fc700(0000) GS:ffffa128357c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8c76a74000 CR3: 00000001abd60000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffffb2e7e6a0>] ? leave_mm+0x120/0x120
[<ffffffffb2e7e6a0>] ? leave_mm+0x120/0x120
[<ffffffffb2e7e6a0>] ? leave_mm+0x120/0x120
[<ffffffffb2f168bf>] smp_call_function_single+0x5f/0xa0
[<ffffffffb31862c5>] ? cpumask_next_and+0x35/0x50
[<ffffffffb2f16e6b>] smp_call_function_many+0x22b/0x270
[<ffffffffb2e7e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb2e7e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb2fede86>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffffb2fef94f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffb2fefa73>] tlb_finish_mmu+0x23/0x30
[<ffffffffb2fec526>] madvise_free_single_vma+0x116/0x180
[<ffffffffb2fed461>] SyS_madvise+0x4d1/0xac0
[<ffffffffb3594f92>] system_call_fastpath+0x25/0x2a
Code: 89 de 48 03 14 c5 e0 13 b5 b3 48 89 df e8 97 6c 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #55378
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff945165b2
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff9447e6a0
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffff9447e6a0
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffff9447e6a0
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffff945166cf
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff94785e25
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff94516c7b
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff9447e868
Build id: 3.10.0-1160.6.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9447e8db
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff945edd46
Build id: 3.10.0-1160.6.1.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffff945ef80f
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff945ef933
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffff945ec3e6
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x116
14
? sk_run_filter
vmlinux 0xffffffff94a70915
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x2c5
15
SyS_madvise
vmlinux 0xffffffff945ed321
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x4d1
16
? __seccomp_filter
vmlinux 0xffffffff94556e4b
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x5b
17
tracesys
vmlinux 0xffffffff94b95226
Build id: 3.10.0-1160.6.1.el7.x86_64 		0xa6 
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [auditbeat:1040]
Modules linked in: xt_nat veth xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) nfit libnvdimm snd_hda_codec_generic iosf_mbi kvm_intel ext4 kvm snd_hda_intel snd_hda_codec snd_hda_core irqbypass snd_hwdep crc32_pclmul ghash_clmulni_intel snd_seq aesni_intel mbcache jbd2 lrw gf128mul snd_seq_device ppdev joydev snd_pcm glue_helper snd_timer ablk_helper snd cryptd virtio_balloon virtio_rng soundcore parport_pc i2c_piix4 parport pcspkr ip_tables xfs libcrc32c ata_generic pata_acpi virtio_console virtio_blk qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common
libata e1000 crc32c_intel serio_raw floppy virtio_pci drm_panel_orientation_quirks virtio_ring virtio dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 1040 Comm: auditbeat Tainted: G             L ------------ T 3.10.0-1160.6.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 1.13.0-2.module_el8.3.0+555+a55c8938 04/01/2014
task: ffff90a32f414200 ti: ffff90a3b1470000 task.ti: ffff90a3b1470000
RIP: 0010:[<ffffffff945165b2>]  [<ffffffff945165b2>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff90a3b1473be0  EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffff90a3b1473bb0 RCX: 000000000000003c
RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000282
RBP: ffff90a3b1473c30 R08: ffffffff94c137c0 R09: 00003ffffffff000
R10: ffff90a335215438 R11: ffff90a3b1473d88 R12: ffffffff944e4356
R13: ffff90a3b1473b88 R14: ffffffff944e47a9 R15: ffff90a3b1473b60
FS:  00007f5ed9ce1700(0000) GS:ffff90a3bfd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055bfc65d6ff0 CR3: 00000000b8450000 CR4: 0000000000760ee0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffff9447e6a0>] ? leave_mm+0x120/0x120
[<ffffffff9447e6a0>] ? leave_mm+0x120/0x120
[<ffffffff9447e6a0>] ? leave_mm+0x120/0x120
[<ffffffff945166cf>] smp_call_function_single+0x5f/0xa0
[<ffffffff94785e25>] ? cpumask_next_and+0x35/0x50
[<ffffffff94516c7b>] smp_call_function_many+0x22b/0x270
[<ffffffff9447e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9447e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff945edd46>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffff945ef80f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff945ef933>] tlb_finish_mmu+0x23/0x30
[<ffffffff945ec3e6>] madvise_free_single_vma+0x116/0x180
[<ffffffff94a70915>] ? sk_run_filter+0x2c5/0x760
[<ffffffff945ed321>] SyS_madvise+0x4d1/0xac0
[<ffffffff94556e4b>] ? __seccomp_filter+0x5b/0x300
[<ffffffff94b95226>] tracesys+0xa6/0xcc
Code: 89 de 48 03 14 c5 e0 13 15 95 48 89 df e8 e7 69 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #23989
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffbd9165b2
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffffbd87e6a0
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffffbd87e6a0
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffffbd87e6a0
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffffbd9166cf
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffffbdb85e25
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffffbd916c7b
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffbd87e868
Build id: 3.10.0-1160.6.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffbd87e8db
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffbd9edd46
Build id: 3.10.0-1160.6.1.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffffbd9ef80f
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffffbd9ef933
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffffbd9ec3e6
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x116
14
? wake_up_q
vmlinux 0xffffffffbd8daef8
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x58
15
? futex_wake
vmlinux 0xffffffffbd912090
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x90
16
SyS_madvise
vmlinux 0xffffffffbd9ed321
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x4d1
17
ia32_do_call
vmlinux 0xffffffffbdf9966e
Build id: 3.10.0-1160.6.1.el7.x86_64 		0x4c 
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [main:19147]
Modules linked in: tcp_lp nf_conntrack_netlink ip_set_hash_ip xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ts_kmp ts_bm nf_log_ipv4 nf_log_common xt_LOG xt_string xt_set ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip_set_hash_net ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack libcrc32c ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod sb_edac iosf_mbi crc32_pclmul snd_intel8x0 snd_ac97_codec ghash_clmulni_intel ac97_bus snd_seq squashfs snd_seq_device
snd_pcm loop snd_timer aesni_intel lrw gf128mul snd glue_helper ablk_helper cryptd virtio_balloon soundcore pcspkr joydev ip_tables ext4 mbcache jbd2 ata_generic pata_acpi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm virtio_blk ata_piix 8139too libata crct10dif_pclmul crct10dif_common crc32c_intel virtio_pci virtio_ring serio_raw virtio 8139cp mii drm_panel_orientation_quirks fuse
CPU: 1 PID: 19147 Comm: main Kdump: loaded Not tainted 3.10.0-1160.6.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 1.11.0-2.el7 04/01/2014
task: ffff8aaa16650000 ti: ffff8aaa00b94000 task.ti: ffff8aaa00b94000
RIP: 0010:[<ffffffffbd9165b2>]  [<ffffffffbd9165b2>] generic_exec_single+0x102/0x1c0
RSP: 0000:ffff8aaa00b97be0  EFLAGS: 00000202
RAX: 0000000000000002 RBX: ffff8aaa00b97bb0 RCX: 000000000000003e
RDX: 0000000000000003 RSI: 0000000000000002 RDI: 0000000000000282
RBP: ffff8aaa00b97c30 R08: ffffffffbe0137c0 R09: 00003ffffffff000
R10: ffff8aaa0a8e0870 R11: ffff8aaa00b97d88 R12: ffff8aaa5fd1ad40
R13: ffff8aaa16650068 R14: ffffffffbd8e116e R15: ffff8aaa00b97b60
FS:  0000000000000000(0000) GS:ffff8aaa5fd00000(0063) knlGS:000000000a434880
CS:  0010 DS: 002b ES: 002b CR0: 0000000080050033
CR2: 00007efed01cb000 CR3: 000000009a4b8000 CR4: 00000000001607e0
Call Trace:
[<ffffffffbd87e6a0>] ? leave_mm+0x120/0x120
[<ffffffffbd87e6a0>] ? leave_mm+0x120/0x120
[<ffffffffbd87e6a0>] ? leave_mm+0x120/0x120
[<ffffffffbd9166cf>] smp_call_function_single+0x5f/0xa0
[<ffffffffbdb85e25>] ? cpumask_next_and+0x35/0x50
[<ffffffffbd916c7b>] smp_call_function_many+0x22b/0x270
[<ffffffffbd87e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffbd87e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffbd9edd46>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffffbd9ef80f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffffbd9ef933>] tlb_finish_mmu+0x23/0x30
[<ffffffffbd9ec3e6>] madvise_free_single_vma+0x116/0x180
[<ffffffffbd8daef8>] ? wake_up_q+0x58/0x80
[<ffffffffbd912090>] ? futex_wake+0x90/0x180
[<ffffffffbd9ed321>] SyS_madvise+0x4d1/0xac0
[<ffffffffbdf9966e>] ia32_do_call+0x4c/0x4c
Code: 89 de 48 03 14 c5 e0 13 55 be 48 89 df e8 e7 69 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00
Complete report #167211
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff94f16842
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x102
2
? leave_mm
vmlinux 0xffffffff94e7e6a0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x120
3
? leave_mm
vmlinux 0xffffffff94e7e6a0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x120
4
? leave_mm
vmlinux 0xffffffff94e7e6a0
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x120
5
smp_call_function_single
vmlinux 0xffffffff94f1695f
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x5f
6
? cpumask_next_and
vmlinux 0xffffffff95186395
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x35
7
smp_call_function_many
vmlinux 0xffffffff94f16f0b
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff94e7e868
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff94e7e8db
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff94fedf56
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xa6
11
arch_tlb_finish_mmu
vmlinux 0xffffffff94fefa1f
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff94fefb43
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x23
13
madvise_free_single_vma
vmlinux 0xffffffff94fec5f6
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x116
14
? sk_run_filter
vmlinux 0xffffffff954724c5
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x2c5
15
? do_readv_writev
vmlinux 0xffffffff9504f0ae
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x19e
16
SyS_madvise
vmlinux 0xffffffff94fed531
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x4d1
17
? __seccomp_filter
vmlinux 0xffffffff94f570ab
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x5b
18
? sock_ioctl
vmlinux 0xffffffff954346bb
Build id: 3.10.0-1160.25.1.el7.x86_64 		0x1eb
19
tracesys
vmlinux 0xffffffff95596226
Build id: 3.10.0-1160.25.1.el7.x86_64 		0xa6 
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [transmission-da:52719]
Modules linked in: veth nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache overlay nf_conntrack_netbios_ns nf_conntrack_broadcast xt_nat xt_mark ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash
dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul snd_ens1371 glue_helper snd_rawmidi ablk_helper snd_ac97_codec ppdev cryptd ac97_bus snd_seq joydev snd_seq_device snd_pcm vmw_balloon pcspkr snd_timer snd soundcore sg vmw_vmci i2c_piix4 parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sch_fq_codel sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm mptspi nfit ata_piix crct10dif_pclmul crct10dif_common scsi_transport_spi libata mptscsih crc32c_intel libnvdimm serio_raw drm_panel_orientation_quirks e1000 mptbase fuse
CPU: 0 PID: 52719 Comm: transmission-da Kdump: loaded Tainted: G        W    L ------------   3.10.0-1160.25.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff8c1972980000 ti: ffff8c1953268000 task.ti: ffff8c1953268000
RIP: 0010:[<ffffffff94f16842>]  [<ffffffff94f16842>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff8c195326bbe0  EFLAGS: 00000202
RAX: ffff8c17415b8600 RBX: 0000000000000000 RCX: ffff8c17415b8610
RDX: ffff8c197569b840 RSI: ffff8c195326bbe0 RDI: ffff8c195326bbe0
RBP: ffff8c195326bc30 R08: 0000000000000001 R09: 00003ffffffff000
R10: ffff8c17fb2d0360 R11: ffff8c195326bd88 R12: ffffffff9543ba18
R13: ffff8c195326bb78 R14: ffffffff9558b70e R15: ffff8c195326bb48
FS:  00007f4e39713b38(0000) GS:ffff8c1975600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd44b84f000 CR3: 000000020c4d6000 CR4: 00000000003607f0
Call Trace:
[<ffffffff94e7e6a0>] ? leave_mm+0x120/0x120
[<ffffffff94e7e6a0>] ? leave_mm+0x120/0x120
[<ffffffff94e7e6a0>] ? leave_mm+0x120/0x120
[<ffffffff94f1695f>] smp_call_function_single+0x5f/0xa0
[<ffffffff95186395>] ? cpumask_next_and+0x35/0x50
[<ffffffff94f16f0b>] smp_call_function_many+0x22b/0x270
[<ffffffff94e7e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff94e7e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff94fedf56>] tlb_flush_mmu_tlbonly+0xa6/0xc0
[<ffffffff94fefa1f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff94fefb43>] tlb_finish_mmu+0x23/0x30
[<ffffffff94fec5f6>] madvise_free_single_vma+0x116/0x180
[<ffffffff954724c5>] ? sk_run_filter+0x2c5/0x760
[<ffffffff9504f0ae>] ? do_readv_writev+0x19e/0x260
[<ffffffff94fed531>] SyS_madvise+0x4d1/0xac0
[<ffffffff94f570ab>] ? __seccomp_filter+0x5b/0x300
[<ffffffff954346bb>] ? sock_ioctl+0x1eb/0x2d0
[<ffffffff95596226>] tracesys+0xa6/0xcc
Code: 89 de 48 03 14 c5 a0 15 b5 95 48 89 df e8 c7 6c 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00