Info

Permalink
Function
generic_exec_single
First occurrence
2020-09-23
Last occurrence
2020-09-23
State
NEW
Components
kernel
Quality
-51

Statistics

Operating system Count
CentOS 7 29
Architecture Count
x86_64 29
Related packages Count
kernel 29
 0:3.10.0-1160.el7 6
 0:3.10.0-1160.119.1.el7 5
 0:3.10.0-1127.el7 2
 0:3.10.0-1062.el7 2
 0:3.10.0-1160.88.1.el7 2
 0:3.10.0-957.el7 2
 0:3.10.0-1127.13.1.el7 1
 0:3.10.0-1160.6.1.el7 1
 0:3.10.0-1160.62.1.el7 1
 0:3.10.0-1160.90.1.el7 1
 0:3.10.0-1127.19.1.el7 1
 0:3.10.0-1160.99.1.el7 1
 0:3.10.0-1160.31.1.el7 1
 0:3.10.0-1160.49.1.el7 1
 0:3.10.0-957.1.3.el7 1
 0:3.10.0-1160.102.1.el7 1

Packages names with count less than the total count of reports are most probably not the cause of the problem.

History

Daily:

Weekly:

Monthly:

Report backtrace


Complete report #1272847
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff84b1109a
Build id: 3.10.0-957.el7.x86_64
0xfa
2
? leave_mm
vmlinux 0xffffffff84a7a3d0
Build id: 3.10.0-957.el7.x86_64
0x110
3
? leave_mm
vmlinux 0xffffffff84a7a3d0
Build id: 3.10.0-957.el7.x86_64
0x110
4
? leave_mm
vmlinux 0xffffffff84a7a3d0
Build id: 3.10.0-957.el7.x86_64
0x110
5
smp_call_function_single
vmlinux 0xffffffff84b111af
Build id: 3.10.0-957.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff84d75465
Build id: 3.10.0-957.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff84b1175b
Build id: 3.10.0-957.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff84a7a598
Build id: 3.10.0-957.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff84a7a608
Build id: 3.10.0-957.el7.x86_64
0x68
10
tlb_flush_mmu.part.76
vmlinux 0xffffffff84be4103
Build id: 3.10.0-957.el7.x86_64
0xc3
11
tlb_finish_mmu
vmlinux 0xffffffff84be5975
Build id: 3.10.0-957.el7.x86_64
0x55
12
exit_mmap
vmlinux 0xffffffff84bf2bbb
Build id: 3.10.0-957.el7.x86_64
0xdb
13
? __delayacct_add_tsk
vmlinux 0xffffffff84b58242
Build id: 3.10.0-957.el7.x86_64
0x172
14
mmput
vmlinux 0xffffffff84a94047
Build id: 3.10.0-957.el7.x86_64
0x67
15
do_exit
vmlinux 0xffffffff84a9dc15
Build id: 3.10.0-957.el7.x86_64
0x285
16
? ttwu_do_wakeup
vmlinux 0xffffffff84ad2ed9
Build id: 3.10.0-957.el7.x86_64
0x19
17
? ttwu_do_activate
vmlinux 0xffffffff84ad300f
Build id: 3.10.0-957.el7.x86_64
0x6f
18
do_group_exit
vmlinux 0xffffffff84a9e44f
Build id: 3.10.0-957.el7.x86_64
0x3f
19
get_signal_to_deliver
vmlinux 0xffffffff84aaf24e
Build id: 3.10.0-957.el7.x86_64
0x1ce
20
do_signal
vmlinux 0xffffffff84a2b527
Build id: 3.10.0-957.el7.x86_64
0x57
21
do_notify_resume
vmlinux 0xffffffff84a2bc32
Build id: 3.10.0-957.el7.x86_64
0x72
22
int_signal
vmlinux 0xffffffff85175124
Build id: 3.10.0-957.el7.x86_64
0x12
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [gdbus:119446]
Modules linked in: tcp_lp fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ppdev crc32_pclmul ghash_clmulni_intel vmw_balloon aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer
sg snd soundcore parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod crc_t10dif crct10dif_generic cdrom ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel vmwgfx serio_raw drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm e1000 ata_piix libata mptspi scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 119446 Comm: gdbus Kdump: loaded Tainted: G             L ------------   3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff97da08210000 ti: ffff97d9ec108000 task.ti: ffff97d9ec108000
RIP: 0010:[<ffffffff84b1109a>]  [<ffffffff84b1109a>] generic_exec_single+0xfa/0x1b0
RSP: 0018:ffff97d9ec10ba70  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff97d9ec10ba40 RCX: 0000000000000004
RDX: ffffffff85213510 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff97d9ec10bac0 R08: ffffffff85213508 R09: 0000000000000000
R10: ffff97dabfbd7dc0 R11: 0000000000000000 R12: 0000000000000000
R13: 0000000000000133 R14: ffff97dab969f6a0 R15: ffff97dabffd9800
FS:  0000000000000000(0000) GS:ffff97dab9680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000006ec0f8 CR3: 0000000130610000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffff84a7a3d0>] ? leave_mm+0x110/0x110
[<ffffffff84a7a3d0>] ? leave_mm+0x110/0x110
[<ffffffff84a7a3d0>] ? leave_mm+0x110/0x110
[<ffffffff84b111af>] smp_call_function_single+0x5f/0xa0
[<ffffffff84d75465>] ? cpumask_next_and+0x35/0x50
[<ffffffff84b1175b>] smp_call_function_many+0x22b/0x270
[<ffffffff84a7a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff84a7a608>] flush_tlb_mm_range+0x68/0x140
[<ffffffff84be4103>] tlb_flush_mmu.part.76+0xc3/0xe0
[<ffffffff84be5975>] tlb_finish_mmu+0x55/0x60
[<ffffffff84bf2bbb>] exit_mmap+0xdb/0x1a0
[<ffffffff84b58242>] ? __delayacct_add_tsk+0x172/0x1a0
[<ffffffff84a94047>] mmput+0x67/0xf0
[<ffffffff84a9dc15>] do_exit+0x285/0xa40
[<ffffffff84ad2ed9>] ? ttwu_do_wakeup+0x19/0xe0
[<ffffffff84ad300f>] ? ttwu_do_activate+0x6f/0x80
[<ffffffff84a9e44f>] do_group_exit+0x3f/0xa0
[<ffffffff84aaf24e>] get_signal_to_deliver+0x1ce/0x5e0
[<ffffffff84a2b527>] do_signal+0x57/0x6f0
[<ffffffff84a2bc32>] do_notify_resume+0x72/0xc0
[<ffffffff85175124>] int_signal+0x12/0x17
Code: 00 b7 01 00 48 89 de 48 03 14 c5 60 b9 74 85 48 89 df e8 1a b2 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #705128
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff9f51109a
Build id: 3.10.0-957.el7.x86_64
0xfa
2
? leave_mm
vmlinux 0xffffffff9f47a3d0
Build id: 3.10.0-957.el7.x86_64
0x110
3
? leave_mm
vmlinux 0xffffffff9f47a3d0
Build id: 3.10.0-957.el7.x86_64
0x110
4
? leave_mm
vmlinux 0xffffffff9f47a3d0
Build id: 3.10.0-957.el7.x86_64
0x110
5
smp_call_function_single
vmlinux 0xffffffff9f5111af
Build id: 3.10.0-957.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff9f775465
Build id: 3.10.0-957.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff9f51175b
Build id: 3.10.0-957.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff9f47a598
Build id: 3.10.0-957.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9f47a608
Build id: 3.10.0-957.el7.x86_64
0x68
10
tlb_flush_mmu.part.76
vmlinux 0xffffffff9f5e4103
Build id: 3.10.0-957.el7.x86_64
0xc3
11
tlb_finish_mmu
vmlinux 0xffffffff9f5e5975
Build id: 3.10.0-957.el7.x86_64
0x55
12
exit_mmap
vmlinux 0xffffffff9f5f2bbb
Build id: 3.10.0-957.el7.x86_64
0xdb
13
? __delayacct_add_tsk
vmlinux 0xffffffff9f558242
Build id: 3.10.0-957.el7.x86_64
0x172
14
mmput
vmlinux 0xffffffff9f494047
Build id: 3.10.0-957.el7.x86_64
0x67
15
do_exit
vmlinux 0xffffffff9f49dc15
Build id: 3.10.0-957.el7.x86_64
0x285
16
do_group_exit
vmlinux 0xffffffff9f49e44f
Build id: 3.10.0-957.el7.x86_64
0x3f
17
get_signal_to_deliver
vmlinux 0xffffffff9f4af24e
Build id: 3.10.0-957.el7.x86_64
0x1ce
18
? do_filp_open
vmlinux 0xffffffff9f653dfd
Build id: 3.10.0-957.el7.x86_64
0x4d
19
do_signal
vmlinux 0xffffffff9f42b527
Build id: 3.10.0-957.el7.x86_64
0x57
20
? putname
vmlinux 0xffffffff9f652abd
Build id: 3.10.0-957.el7.x86_64
0x3d
21
do_notify_resume
vmlinux 0xffffffff9f42bc32
Build id: 3.10.0-957.el7.x86_64
0x72
22
int_signal
vmlinux 0xffffffff9fb75124
Build id: 3.10.0-957.el7.x86_64
0x12
NMI watchdog: BUG: soft lockup - CPU#15 stuck for 21s! [docker-containe:125784]
Modules linked in: veth xt_nat xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock fuse vmhgfs(OE) overlay(T) sunrpc snd_seq_midi snd_seq_midi_event sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm joydev snd_timer snd pcspkr sg soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic
pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm serio_raw ata_piix mptspi libata scsi_transport_spi e1000 nfit mptscsih libnvdimm mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 15 PID: 125784 Comm: docker-containe Kdump: loaded Tainted: G           OEL ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff8b72f537c100 ti: ffff8b7678324000 task.ti: ffff8b7678324000
RIP: 0010:[<ffffffff9f51109a>]  [<ffffffff9f51109a>] generic_exec_single+0xfa/0x1b0
RSP: 0018:ffff8b7678327a70  EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff8b7678327a40 RCX: 0000000000000001
RDX: ffffffff9fc12d90 RSI: 0000000000000080 RDI: 0000000000000286
RBP: ffff8b7678327ac0 R08: ffffffff9fc12d88 R09: 0000000000000000
R10: ffff8b76ffbd6a40 R11: 0000000000000000 R12: ffff8b7678327a38
R13: ffff8b743fd8e000 R14: 0000000000000000 R15: ffff8b76da6ea000
FS:  0000000000000000(0000) GS:ffff8b76ed9c0000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055c818f54360 CR3: 00000003e0410000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9f47a3d0>] ? leave_mm+0x110/0x110
[<ffffffff9f47a3d0>] ? leave_mm+0x110/0x110
[<ffffffff9f47a3d0>] ? leave_mm+0x110/0x110
[<ffffffff9f5111af>] smp_call_function_single+0x5f/0xa0
[<ffffffff9f775465>] ? cpumask_next_and+0x35/0x50
[<ffffffff9f51175b>] smp_call_function_many+0x22b/0x270
[<ffffffff9f47a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9f47a608>] flush_tlb_mm_range+0x68/0x140
[<ffffffff9f5e4103>] tlb_flush_mmu.part.76+0xc3/0xe0
[<ffffffff9f5e5975>] tlb_finish_mmu+0x55/0x60
[<ffffffff9f5f2bbb>] exit_mmap+0xdb/0x1a0
[<ffffffff9f558242>] ? __delayacct_add_tsk+0x172/0x1a0
[<ffffffff9f494047>] mmput+0x67/0xf0
[<ffffffff9f49dc15>] do_exit+0x285/0xa40
[<ffffffff9f49e44f>] do_group_exit+0x3f/0xa0
[<ffffffff9f4af24e>] get_signal_to_deliver+0x1ce/0x5e0
[<ffffffff9f653dfd>] ? do_filp_open+0x4d/0xb0
[<ffffffff9f42b527>] do_signal+0x57/0x6f0
[<ffffffff9f652abd>] ? putname+0x3d/0x60
[<ffffffff9f42bc32>] do_notify_resume+0x72/0xc0
[<ffffffff9fb75124>] int_signal+0x12/0x17
Code: 00 b7 01 00 48 89 de 48 03 14 c5 60 b9 14 a0 48 89 df e8 1a b2 27 00 84 c0 75 46 45 85 ed 74 11 f6 43 20 01 74 0b 0f 1f 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #1017044
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff9d31db86
Build id: 3.10.0-1160.102.1.el7.x86_64
0x106
2
? leave_mm
vmlinux 0xffffffff9d281b10
Build id: 3.10.0-1160.102.1.el7.x86_64
0x130
3
? leave_mm
vmlinux 0xffffffff9d281b10
Build id: 3.10.0-1160.102.1.el7.x86_64
0x130
4
? leave_mm
vmlinux 0xffffffff9d281b10
Build id: 3.10.0-1160.102.1.el7.x86_64
0x130
5
smp_call_function_single
vmlinux 0xffffffff9d31dc9f
Build id: 3.10.0-1160.102.1.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff9d59c5d5
Build id: 3.10.0-1160.102.1.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff9d31e25b
Build id: 3.10.0-1160.102.1.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff9d281fa8
Build id: 3.10.0-1160.102.1.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9d28201b
Build id: 3.10.0-1160.102.1.el7.x86_64
0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff9d3fa003
Build id: 3.10.0-1160.102.1.el7.x86_64
0x33
11
arch_tlb_finish_mmu
vmlinux 0xffffffff9d3fbbff
Build id: 3.10.0-1160.102.1.el7.x86_64
0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff9d3fbd33
Build id: 3.10.0-1160.102.1.el7.x86_64
0x23
13
exit_mmap
vmlinux 0xffffffff9d40956b
Build id: 3.10.0-1160.102.1.el7.x86_64
0xdb
14
? __delayacct_add_tsk
vmlinux 0xffffffff9d366c45
Build id: 3.10.0-1160.102.1.el7.x86_64
0x175
15
mmput
vmlinux 0xffffffff9d29c07f
Build id: 3.10.0-1160.102.1.el7.x86_64
0x6f
16
do_exit
vmlinux 0xffffffff9d2a6128
Build id: 3.10.0-1160.102.1.el7.x86_64
0x288
17
? futex_wait
vmlinux 0xffffffff9d31a5ff
Build id: 3.10.0-1160.102.1.el7.x86_64
0x11f
18
? ttwu_do_wakeup
vmlinux 0xffffffff9d2dd239
Build id: 3.10.0-1160.102.1.el7.x86_64
0x19
19
do_group_exit
vmlinux 0xffffffff9d2a694f
Build id: 3.10.0-1160.102.1.el7.x86_64
0x3f
20
get_signal_to_deliver
vmlinux 0xffffffff9d2b825e
Build id: 3.10.0-1160.102.1.el7.x86_64
0x1ce
21
do_signal
vmlinux 0xffffffff9d22d5b7
Build id: 3.10.0-1160.102.1.el7.x86_64
0x57
22
? do_futex
vmlinux 0xffffffff9d31c356
Build id: 3.10.0-1160.102.1.el7.x86_64
0x106
23
do_notify_resume
vmlinux 0xffffffff9d22dcca
Build id: 3.10.0-1160.102.1.el7.x86_64
0x7a
24
int_signal
vmlinux 0xffffffff9d9c56f7
Build id: 3.10.0-1160.102.1.el7.x86_64
0x12
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [kubelet:15741]
Modules linked in: resguard_linux(OE) secmodel_linux(OE) syshook_linux(OE) nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event coretemp snd_ens1371 snd_rawmidi snd_ac97_codec iosf_mbi ac97_bus crc32_pclmul ghash_clmulni_intel aesni_intel
snd_seq snd_seq_device lrw gf128mul glue_helper snd_pcm ablk_helper cryptd snd_timer snd ppdev sg soundcore pcspkr joydev vmw_balloon parport_pc parport vmw_vmci i2c_piix4 sch_fq_codel binfmt_misc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm ata_piix libahci nfit crct10dif_pclmul crct10dif_common libata crc32c_intel mptspi libnvdimm scsi_transport_spi mptscsih serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: resguard_linux]
CPU: 2 PID: 15741 Comm: kubelet Tainted: G        W  OEL ------------ T 3.10.0-1160.102.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff8aedbdb23180 ti: ffff8afb06788000 task.ti: ffff8afb06788000
RIP: 0010:[<ffffffff9d31db86>]  [<ffffffff9d31db86>] generic_exec_single+0x106/0x1c0
RSP: 0018:ffff8afb0678ba70  EFLAGS: 00000202
RAX: 0000000000000040 RBX: 0000014100000000 RCX: 0000000000000005
RDX: 0000000000000040 RSI: 0000000000000000 RDI: 0000000000000282
RBP: ffff8afb0678bab8 R08: ffffffff9da14348 R09: 000000000001fd08
R10: ffff8afb7ffda000 R11: 0000000000000000 R12: ffff8aedbdb23180
R13: ffff8aedbdb23180 R14: 0000000000000001 R15: ffff8aedbdb23180
FS:  00007fe073fff700(0000) GS:ffff8afb1e680000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f043cee1000 CR3: 00000017c8bee000 CR4: 00000000001607e0
Call Trace:
[<ffffffff9d281b10>] ? leave_mm+0x130/0x130
[<ffffffff9d281b10>] ? leave_mm+0x130/0x130
[<ffffffff9d281b10>] ? leave_mm+0x130/0x130
[<ffffffff9d31dc9f>] smp_call_function_single+0x5f/0xa0
[<ffffffff9d59c5d5>] ? cpumask_next_and+0x35/0x50
[<ffffffff9d31e25b>] smp_call_function_many+0x22b/0x270
[<ffffffff9d281fa8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9d28201b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9d3fa003>] tlb_flush_mmu_tlbonly+0x33/0xd0
[<ffffffff9d3fbbff>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff9d3fbd33>] tlb_finish_mmu+0x23/0x40
[<ffffffff9d40956b>] exit_mmap+0xdb/0x1a0
[<ffffffff9d366c45>] ? __delayacct_add_tsk+0x175/0x1a0
[<ffffffff9d29c07f>] mmput+0x6f/0x100
[<ffffffff9d2a6128>] do_exit+0x288/0xa30
[<ffffffff9d31a5ff>] ? futex_wait+0x11f/0x290
[<ffffffff9d2dd239>] ? ttwu_do_wakeup+0x19/0xf0
[<ffffffff9d2a694f>] do_group_exit+0x3f/0xa0
[<ffffffff9d2b825e>] get_signal_to_deliver+0x1ce/0x5e0
[<ffffffff9d22d5b7>] do_signal+0x57/0x6f0
[<ffffffff9d31c356>] ? do_futex+0x106/0x4d0
[<ffffffff9d22dcca>] do_notify_resume+0x7a/0xd0
[<ffffffff9d9c56f7>] int_signal+0x12/0x17
Code: 14 c5 40 19 f5 9d 48 89 df e8 97 67 29 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 f6 43 20 01 <75> f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 00 0f 85 8f 
Complete report #498887
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff9a116a32
Build id: 3.10.0-1160.49.1.el7.x86_64
0x102
2
? leave_mm
vmlinux 0xffffffff9a07ddd0
Build id: 3.10.0-1160.49.1.el7.x86_64
0x120
3
? leave_mm
vmlinux 0xffffffff9a07ddd0
Build id: 3.10.0-1160.49.1.el7.x86_64
0x120
4
? leave_mm
vmlinux 0xffffffff9a07ddd0
Build id: 3.10.0-1160.49.1.el7.x86_64
0x120
5
smp_call_function_single
vmlinux 0xffffffff9a116b4f
Build id: 3.10.0-1160.49.1.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff9a386a45
Build id: 3.10.0-1160.49.1.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff9a1170fb
Build id: 3.10.0-1160.49.1.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff9a07e258
Build id: 3.10.0-1160.49.1.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9a07e2cb
Build id: 3.10.0-1160.49.1.el7.x86_64
0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff9a1ee5ff
Build id: 3.10.0-1160.49.1.el7.x86_64
0x2f
11
unmap_page_range
vmlinux 0xffffffff9a1f1839
Build id: 3.10.0-1160.49.1.el7.x86_64
0x979
12
unmap_single_vma
vmlinux 0xffffffff9a1f1bc1
Build id: 3.10.0-1160.49.1.el7.x86_64
0x81
13
unmap_vmas
vmlinux 0xffffffff9a1f35f9
Build id: 3.10.0-1160.49.1.el7.x86_64
0x49
14
exit_mmap
vmlinux 0xffffffff9a1fd63c
Build id: 3.10.0-1160.49.1.el7.x86_64
0xac
15
mmput
vmlinux 0xffffffff9a097b87
Build id: 3.10.0-1160.49.1.el7.x86_64
0x67
16
do_exit
vmlinux 0xffffffff9a0a1908
Build id: 3.10.0-1160.49.1.el7.x86_64
0x288
17
? wake_up_atomic_t
vmlinux 0xffffffff9a0c6f50
Build id: 3.10.0-1160.49.1.el7.x86_64
0x30
18
do_group_exit
vmlinux 0xffffffff9a0a212f
Build id: 3.10.0-1160.49.1.el7.x86_64
0x3f
19
get_signal_to_deliver
vmlinux 0xffffffff9a0b328e
Build id: 3.10.0-1160.49.1.el7.x86_64
0x1ce
20
do_signal
vmlinux 0xffffffff9a02c527
Build id: 3.10.0-1160.49.1.el7.x86_64
0x57
21
? ep_poll
vmlinux 0xffffffff9a29d683
Build id: 3.10.0-1160.49.1.el7.x86_64
0x123
22
? wake_up_state
vmlinux 0xffffffff9a0dadf0
Build id: 3.10.0-1160.49.1.el7.x86_64
0x20
23
do_notify_resume
vmlinux 0xffffffff9a02cc32
Build id: 3.10.0-1160.49.1.el7.x86_64
0x72
24
int_signal
vmlinux 0xffffffff9a7962ef
Build id: 3.10.0-1160.49.1.el7.x86_64
0x12
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 45s! [systemd-journal:26939]
Modules linked in: xt_multiport xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink nf_nat_ftp nf_conntrack_ftp ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack libcrc32c ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod squashfs loop sb_edac bochs_drm iosf_mbi ttm crc32_pclmul ghash_clmulni_intel drm_kms_helper syscopyarea sysfillrect ppdev sysimgblt fb_sys_fops drm aesni_intel lrw gf128mul glue_helper sg ablk_helper
cryptd pcspkr joydev parport_pc virtio_balloon drm_panel_orientation_quirks parport i2c_piix4 ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi virtio_net net_failover virtio_scsi failover ata_piix crct10dif_pclmul crct10dif_common crc32c_intel libata serio_raw virtio_pci virtio_ring virtio floppy fuse
CPU: 1 PID: 26939 Comm: systemd-journal Kdump: loaded Tainted: G             L ------------   3.10.0-1160.49.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.12.1-0-ga5cab58e9a3f-prebuilt.qemu.org 04/01/2014
task: ffff99e03af81080 ti: ffff99e0f5f98000 task.ti: ffff99e0f5f98000
RIP: 0010:[<ffffffff9a116a32>]  [<ffffffff9a116a32>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff99e0f5f9b950  EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffff99e0f5f9b920 RCX: 000000000000003c
RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000282
RBP: ffff99e0f5f9b9a0 R08: ffffffff9a8137c0 R09: 00003ffffffff000
R10: ffff99df782bd360 R11: ffff99def565e780 R12: 0000000100020200
R13: ffff99e03a923000 R14: 0000000000000286 R15: ffffffffffffffff
FS:  0000000000000000(0000) GS:ffff99e0ffc80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f963502b000 CR3: 0000000076010000 CR4: 0000000000360fe0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9a07ddd0>] ? leave_mm+0x120/0x120
[<ffffffff9a07ddd0>] ? leave_mm+0x120/0x120
[<ffffffff9a07ddd0>] ? leave_mm+0x120/0x120
[<ffffffff9a116b4f>] smp_call_function_single+0x5f/0xa0
[<ffffffff9a386a45>] ? cpumask_next_and+0x35/0x50
[<ffffffff9a1170fb>] smp_call_function_many+0x22b/0x270
[<ffffffff9a07e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9a07e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9a1ee5ff>] tlb_flush_mmu_tlbonly+0x2f/0xc0
[<ffffffff9a1f1839>] unmap_page_range+0x979/0xc80
[<ffffffff9a1f1bc1>] unmap_single_vma+0x81/0xf0
[<ffffffff9a1f35f9>] unmap_vmas+0x49/0x90
[<ffffffff9a1fd63c>] exit_mmap+0xac/0x1a0
[<ffffffff9a097b87>] mmput+0x67/0xf0
[<ffffffff9a0a1908>] do_exit+0x288/0xa30
[<ffffffff9a0c6f50>] ? wake_up_atomic_t+0x30/0x30
[<ffffffff9a0a212f>] do_group_exit+0x3f/0xa0
[<ffffffff9a0b328e>] get_signal_to_deliver+0x1ce/0x5e0
[<ffffffff9a02c527>] do_signal+0x57/0x6f0
[<ffffffff9a29d683>] ? ep_poll+0x123/0x360
[<ffffffff9a0dadf0>] ? wake_up_state+0x20/0x20
[<ffffffff9a02cc32>] do_notify_resume+0x72/0xc0
[<ffffffff9a7962ef>] int_signal+0x12/0x17
Code: 89 de 48 03 14 c5 60 15 d5 9a 48 89 df e8 87 71 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #496085
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa2f16532
Build id: 3.10.0-1160.31.1.el7.x86_64
0x102
2
? leave_mm
vmlinux 0xffffffffa2e7ddd0
Build id: 3.10.0-1160.31.1.el7.x86_64
0x120
3
? leave_mm
vmlinux 0xffffffffa2e7ddd0
Build id: 3.10.0-1160.31.1.el7.x86_64
0x120
4
? leave_mm
vmlinux 0xffffffffa2e7ddd0
Build id: 3.10.0-1160.31.1.el7.x86_64
0x120
5
smp_call_function_single
vmlinux 0xffffffffa2f1664f
Build id: 3.10.0-1160.31.1.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffffa31864f5
Build id: 3.10.0-1160.31.1.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffffa2f16bfb
Build id: 3.10.0-1160.31.1.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffa2e7e258
Build id: 3.10.0-1160.31.1.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffa2e7e2cb
Build id: 3.10.0-1160.31.1.el7.x86_64
0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffa2fee0ff
Build id: 3.10.0-1160.31.1.el7.x86_64
0x2f
11
unmap_page_range
vmlinux 0xffffffffa2ff1339
Build id: 3.10.0-1160.31.1.el7.x86_64
0x979
12
unmap_single_vma
vmlinux 0xffffffffa2ff16c1
Build id: 3.10.0-1160.31.1.el7.x86_64
0x81
13
unmap_vmas
vmlinux 0xffffffffa2ff30f9
Build id: 3.10.0-1160.31.1.el7.x86_64
0x49
14
exit_mmap
vmlinux 0xffffffffa2ffd13c
Build id: 3.10.0-1160.31.1.el7.x86_64
0xac
15
? __delayacct_add_tsk
vmlinux 0xffffffffa2f5dde5
Build id: 3.10.0-1160.31.1.el7.x86_64
0x175
16
mmput
vmlinux 0xffffffffa2e97b57
Build id: 3.10.0-1160.31.1.el7.x86_64
0x67
17
do_exit
vmlinux 0xffffffffa2ea18d8
Build id: 3.10.0-1160.31.1.el7.x86_64
0x288
18
? futex_wait
vmlinux 0xffffffffa2f1308f
Build id: 3.10.0-1160.31.1.el7.x86_64
0x11f
19
? ttwu_do_wakeup
vmlinux 0xffffffffa2ed7419
Build id: 3.10.0-1160.31.1.el7.x86_64
0x19
20
do_group_exit
vmlinux 0xffffffffa2ea20ff
Build id: 3.10.0-1160.31.1.el7.x86_64
0x3f
21
get_signal_to_deliver
vmlinux 0xffffffffa2eb325e
Build id: 3.10.0-1160.31.1.el7.x86_64
0x1ce
22
do_signal
vmlinux 0xffffffffa2e2c527
Build id: 3.10.0-1160.31.1.el7.x86_64
0x57
23
? do_futex
vmlinux 0xffffffffa2f14da6
Build id: 3.10.0-1160.31.1.el7.x86_64
0x106
24
? SyS_futex
vmlinux 0xffffffffa2f151f0
Build id: 3.10.0-1160.31.1.el7.x86_64
0x80
25
do_notify_resume
vmlinux 0xffffffffa2e2cc32
Build id: 3.10.0-1160.31.1.el7.x86_64
0x72
26
int_signal
vmlinux 0xffffffffa35962ef
Build id: 3.10.0-1160.31.1.el7.x86_64
0x12
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [kube-controller:66811]
Modules linked in: binfmt_misc squashfs loop xt_multiport veth ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables ipt_rpfilter xt_set iptable_raw ip_set_hash_ip ip_set_hash_net ip_set ipip tunnel4 ip_tunnel xt_nat xt_statistic ipt_REJECT nf_reject_ipv4 iptable_mangle xt_comment xt_mark xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype iptable_filter iptable_nat nf_nat_ipv4 nf_nat rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache overlay(T) vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev joydev sg pcspkr vmw_balloon parport_pc parport vmw_vmci i2c_piix4 nfsd auth_rpcgss nf_conntrack_ipv4 nfs_acl nf_defrag_ipv4
ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs lockd grace sunrpc nf_conntrack libcrc32c ip_tables ext4 mbcache jbd2 sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod crc_t10dif crct10dif_generic syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ahci ata_piix libahci libata serio_raw nfit libnvdimm vmxnet3 vmw_pvscsi drm_panel_orientation_quirks fuse br_netfilter bridge stp llc
CPU: 1 PID: 66811 Comm: kube-controller Kdump: loaded Tainted: G        W    L ------------ T 3.10.0-1160.31.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/28/2020
task: ffffa07c03128000 ti: ffffa0841115c000 task.ti: ffffa0841115c000
RIP: 0010:[<ffffffffa2f16532>]  [<ffffffffa2f16532>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffffa0841115f950  EFLAGS: 00000202
RAX: ffffa08410750a00 RBX: 0000000000000246 RCX: ffffa08410750a90
RDX: ffffa0841d61b840 RSI: ffffa0841115f950 RDI: ffffa0841115f950
RBP: ffffa0841115f9a0 R08: 0000000000000001 R09: 00003ffffffff000
R10: ffffa082a16690e0 R11: 0000000000000202 R12: 0000000100020200
R13: 0000000000000246 R14: ffffa084fd010018 R15: ffffffffffffffff
FS:  000000c000680090(0000) GS:ffffa0841d640000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000002b8203a CR3: 0000000113e10000 CR4: 00000000001607e0
Call Trace:
[<ffffffffa2e7ddd0>] ? leave_mm+0x120/0x120
[<ffffffffa2e7ddd0>] ? leave_mm+0x120/0x120
[<ffffffffa2e7ddd0>] ? leave_mm+0x120/0x120
[<ffffffffa2f1664f>] smp_call_function_single+0x5f/0xa0
[<ffffffffa31864f5>] ? cpumask_next_and+0x35/0x50
[<ffffffffa2f16bfb>] smp_call_function_many+0x22b/0x270
[<ffffffffa2e7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa2e7e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa2fee0ff>] tlb_flush_mmu_tlbonly+0x2f/0xc0
[<ffffffffa2ff1339>] unmap_page_range+0x979/0xc80
[<ffffffffa2ff16c1>] unmap_single_vma+0x81/0xf0
[<ffffffffa2ff30f9>] unmap_vmas+0x49/0x90
[<ffffffffa2ffd13c>] exit_mmap+0xac/0x1a0
[<ffffffffa2f5dde5>] ? __delayacct_add_tsk+0x175/0x1a0
[<ffffffffa2e97b57>] mmput+0x67/0xf0
[<ffffffffa2ea18d8>] do_exit+0x288/0xa30
[<ffffffffa2f1308f>] ? futex_wait+0x11f/0x280
[<ffffffffa2ed7419>] ? ttwu_do_wakeup+0x19/0xe0
[<ffffffffa2ea20ff>] do_group_exit+0x3f/0xa0
[<ffffffffa2eb325e>] get_signal_to_deliver+0x1ce/0x5e0
[<ffffffffa2e2c527>] do_signal+0x57/0x6f0
[<ffffffffa2f14da6>] ? do_futex+0x106/0x4d0
[<ffffffffa2f151f0>] ? SyS_futex+0x80/0x190
[<ffffffffa2e2cc32>] do_notify_resume+0x72/0xc0
[<ffffffffa35962ef>] int_signal+0x12/0x17
Code: 89 de 48 03 14 c5 60 15 b5 a3 48 89 df e8 37 71 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #374554
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffff9bb14a22
Build id: 3.10.0-1062.el7.x86_64
0x102
2
? leave_mm
vmlinux 0xffffffff9ba7d1d0
Build id: 3.10.0-1062.el7.x86_64
0x110
3
? leave_mm
vmlinux 0xffffffff9ba7d1d0
Build id: 3.10.0-1062.el7.x86_64
0x110
4
? leave_mm
vmlinux 0xffffffff9ba7d1d0
Build id: 3.10.0-1062.el7.x86_64
0x110
5
smp_call_function_single
vmlinux 0xffffffff9bb14b3f
Build id: 3.10.0-1062.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffff9bd7f475
Build id: 3.10.0-1062.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffff9bb150eb
Build id: 3.10.0-1062.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffff9ba7d398
Build id: 3.10.0-1062.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffff9ba7d40b
Build id: 3.10.0-1062.el7.x86_64
0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffff9bbea0ef
Build id: 3.10.0-1062.el7.x86_64
0x2f
11
arch_tlb_finish_mmu
vmlinux 0xffffffff9bbebc2f
Build id: 3.10.0-1062.el7.x86_64
0x3f
12
tlb_finish_mmu
vmlinux 0xffffffff9bbebd53
Build id: 3.10.0-1062.el7.x86_64
0x23
13
exit_mmap
vmlinux 0xffffffff9bbf910b
Build id: 3.10.0-1062.el7.x86_64
0xdb
14
? __delayacct_add_tsk
vmlinux 0xffffffff9bb5c225
Build id: 3.10.0-1062.el7.x86_64
0x175
15
mmput
vmlinux 0xffffffff9ba971f7
Build id: 3.10.0-1062.el7.x86_64
0x67
16
do_exit
vmlinux 0xffffffff9baa0ed8
Build id: 3.10.0-1062.el7.x86_64
0x288
17
? futex_wait
vmlinux 0xffffffff9bb1145f
Build id: 3.10.0-1062.el7.x86_64
0x11f
18
? sched_clock_cpu
vmlinux 0xffffffff9badd425
Build id: 3.10.0-1062.el7.x86_64
0x85
19
do_group_exit
vmlinux 0xffffffff9baa171f
Build id: 3.10.0-1062.el7.x86_64
0x3f
20
get_signal_to_deliver
vmlinux 0xffffffff9bab252e
Build id: 3.10.0-1062.el7.x86_64
0x1ce
21
do_signal
vmlinux 0xffffffff9ba2c527
Build id: 3.10.0-1062.el7.x86_64
0x57
22
? do_futex
vmlinux 0xffffffff9bb13206
Build id: 3.10.0-1062.el7.x86_64
0x106
23
do_notify_resume
vmlinux 0xffffffff9ba2cc32
Build id: 3.10.0-1062.el7.x86_64
0x72
24
int_signal
vmlinux 0xffffffff9c18c23b
Build id: 3.10.0-1062.el7.x86_64
0x12
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [docker-containe:17180]
Modules linked in: veth xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd soundcore coretemp btusb ppdev btrtl btbcm btintel bluetooth vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel sg aesni_intel rfkill lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr parport_pc parport pcc_cpufreq i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm drm ata_piix mptspi crct10dif_pclmul crct10dif_common libata scsi_transport_spi e1000 mptscsih crc32c_intel mptbase serio_raw drm_panel_orientation_quirks floppy
CPU: 4 PID: 17180 Comm: docker-containe Kdump: loaded Tainted: G             L ------------ T 3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 06/02/2011
task: ffff9738f73720e0 ti: ffff9738dbdfc000 task.ti: ffff9738dbdfc000
RIP: 0010:[<ffffffff9bb14a22>]  [<ffffffff9bb14a22>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9738dbdffa70  EFLAGS: 00000202
RAX: 0000000000000020 RBX: ffff9738f73720e0 RCX: 0000000000000020
RDX: 0000000000000020 RSI: 0000000000000020 RDI: 0000000000000282
RBP: ffff9738dbdffab8 R08: ffffffff9c213c80 R09: 000000000001fca0
R10: ffff9738fffd6800 R11: 0000000000000000 R12: ffff9738f73720e0
R13: ffff9738f73720e0 R14: ffff9738f73720e0 R15: ffff973800000000
FS:  0000000000000000(0000) GS:ffff9738faf00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c420ada200 CR3: 0000000049c10000 CR4: 00000000000407e0
Call Trace:
[<ffffffff9ba7d1d0>] ? leave_mm+0x110/0x110
[<ffffffff9ba7d1d0>] ? leave_mm+0x110/0x110
[<ffffffff9ba7d1d0>] ? leave_mm+0x110/0x110
[<ffffffff9bb14b3f>] smp_call_function_single+0x5f/0xa0
[<ffffffff9bd7f475>] ? cpumask_next_and+0x35/0x50
[<ffffffff9bb150eb>] smp_call_function_many+0x22b/0x270
[<ffffffff9ba7d398>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9ba7d40b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9bbea0ef>] tlb_flush_mmu_tlbonly+0x2f/0xc0
[<ffffffff9bbebc2f>] arch_tlb_finish_mmu+0x3f/0x80
[<ffffffff9bbebd53>] tlb_finish_mmu+0x23/0x30
[<ffffffff9bbf910b>] exit_mmap+0xdb/0x1a0
[<ffffffff9bb5c225>] ? __delayacct_add_tsk+0x175/0x1a0
[<ffffffff9ba971f7>] mmput+0x67/0xf0
[<ffffffff9baa0ed8>] do_exit+0x288/0xa50
[<ffffffff9bb1145f>] ? futex_wait+0x11f/0x280
[<ffffffff9badd425>] ? sched_clock_cpu+0x85/0xc0
[<ffffffff9baa171f>] do_group_exit+0x3f/0xa0
[<ffffffff9bab252e>] get_signal_to_deliver+0x1ce/0x5e0
[<ffffffff9ba2c527>] do_signal+0x57/0x6f0
[<ffffffff9bb13206>] ? do_futex+0x106/0x5a0
[<ffffffff9ba2cc32>] do_notify_resume+0x72/0xc0
[<ffffffff9c18c23b>] int_signal+0x12/0x17
Code: 89 de 48 03 14 c5 e0 d7 74 9c 48 89 df e8 d7 1a 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #513
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffa3f16f22
Build id: 3.10.0-1127.13.1.el7.x86_64
0x102
2
? leave_mm
vmlinux 0xffffffffa3e7e730
Build id: 3.10.0-1127.13.1.el7.x86_64
0x120
3
? leave_mm
vmlinux 0xffffffffa3e7e730
Build id: 3.10.0-1127.13.1.el7.x86_64
0x120
4
? leave_mm
vmlinux 0xffffffffa3e7e730
Build id: 3.10.0-1127.13.1.el7.x86_64
0x120
5
smp_call_function_single
vmlinux 0xffffffffa3f1703f
Build id: 3.10.0-1127.13.1.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffffa4184fc5
Build id: 3.10.0-1127.13.1.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffffa3f175eb
Build id: 3.10.0-1127.13.1.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffa3e7e8f8
Build id: 3.10.0-1127.13.1.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffa3e7e96b
Build id: 3.10.0-1127.13.1.el7.x86_64
0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffa3fedd9f
Build id: 3.10.0-1127.13.1.el7.x86_64
0x2f
11
unmap_page_range
vmlinux 0xffffffffa3ff0fd9
Build id: 3.10.0-1127.13.1.el7.x86_64
0x979
12
unmap_single_vma
vmlinux 0xffffffffa3ff1361
Build id: 3.10.0-1127.13.1.el7.x86_64
0x81
13
unmap_vmas
vmlinux 0xffffffffa3ff2d99
Build id: 3.10.0-1127.13.1.el7.x86_64
0x49
14
exit_mmap
vmlinux 0xffffffffa3ffcd9c
Build id: 3.10.0-1127.13.1.el7.x86_64
0xac
15
? __delayacct_add_tsk
vmlinux 0xffffffffa3f5e705
Build id: 3.10.0-1127.13.1.el7.x86_64
0x175
16
mmput
vmlinux 0xffffffffa3e98667
Build id: 3.10.0-1127.13.1.el7.x86_64
0x67
17
do_exit
vmlinux 0xffffffffa3ea23b8
Build id: 3.10.0-1127.13.1.el7.x86_64
0x288
18
? futex_wait
vmlinux 0xffffffffa3f1391f
Build id: 3.10.0-1127.13.1.el7.x86_64
0x11f
19
do_group_exit
vmlinux 0xffffffffa3ea2bcf
Build id: 3.10.0-1127.13.1.el7.x86_64
0x3f
20
get_signal_to_deliver
vmlinux 0xffffffffa3eb3aee
Build id: 3.10.0-1127.13.1.el7.x86_64
0x1ce
21
do_signal
vmlinux 0xffffffffa3e2c527
Build id: 3.10.0-1127.13.1.el7.x86_64
0x57
22
? do_futex
vmlinux 0xffffffffa3f156c6
Build id: 3.10.0-1127.13.1.el7.x86_64
0x106
23
do_notify_resume
vmlinux 0xffffffffa3e2cc32
Build id: 3.10.0-1127.13.1.el7.x86_64
0x72
24
int_signal
vmlinux 0xffffffffa459322f
Build id: 3.10.0-1127.13.1.el7.x86_64
0x12
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [Finalizer:11661]
Modules linked in: nf_conntrack_netlink nfnetlink binfmt_misc vboxnetadp(OE) vboxnetflt(OE) xt_conntrack iptable_filter xt_REDIRECT nf_nat_redirect vboxdrv(OE) iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack sg ppdev joydev pcspkr parport_pc virtio_balloon parport i2c_piix4 auth_rpcgss sunrpc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_common ata_generic pata_acpi virtio_net virtio_console net_failover virtio_scsi failover bochs_drm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata serio_raw virtio_pci virtio_ring virtio drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 11661 Comm: Finalizer Kdump: loaded Tainted: G           OEL ------------   3.10.0-1127.13.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.2-0-gf9626ccb91-prebuilt.qemu-project.org 04/01/2014
task: ffff8f9bc5ecd230 ti: ffff8f9c260c8000 task.ti: ffff8f9c260c8000
RIP: 0010:[<ffffffffa3f16f22>]  [<ffffffffa3f16f22>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff8f9c260cb950  EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffff8f9c260cb920 RCX: 000000000000003c
RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000282
RBP: ffff8f9c260cb9a0 R08: ffffffffa46136c0 R09: ffff8f9baea68bc8
R10: ffff8f9c4d53a510 R11: 0000000000000000 R12: 00000000000280da
R13: 0000000000000002 R14: 0000000000000002 R15: ffff8f9d3ffd5008
FS:  0000000000000000(0000) GS:ffff8f9d3fd80000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd3a18ad000 CR3: 000000015aa10000 CR4: 00000000000006e0
Call Trace:
[<ffffffffa3e7e730>] ? leave_mm+0x120/0x120
[<ffffffffa3e7e730>] ? leave_mm+0x120/0x120
[<ffffffffa3e7e730>] ? leave_mm+0x120/0x120
[<ffffffffa3f1703f>] smp_call_function_single+0x5f/0xa0
[<ffffffffa4184fc5>] ? cpumask_next_and+0x35/0x50
[<ffffffffa3f175eb>] smp_call_function_many+0x22b/0x270
[<ffffffffa3e7e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa3e7e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa3fedd9f>] tlb_flush_mmu_tlbonly+0x2f/0xc0
[<ffffffffa3ff0fd9>] unmap_page_range+0x979/0xc80
[<ffffffffa3ff1361>] unmap_single_vma+0x81/0xf0
[<ffffffffa3ff2d99>] unmap_vmas+0x49/0x90
[<ffffffffa3ffcd9c>] exit_mmap+0xac/0x1a0
[<ffffffffa3f5e705>] ? __delayacct_add_tsk+0x175/0x1a0
[<ffffffffa3e98667>] mmput+0x67/0xf0
[<ffffffffa3ea23b8>] do_exit+0x288/0xa20
[<ffffffffa3f1391f>] ? futex_wait+0x11f/0x280
[<ffffffffa3ea2bcf>] do_group_exit+0x3f/0xa0
[<ffffffffa3eb3aee>] get_signal_to_deliver+0x1ce/0x5e0
[<ffffffffa3e2c527>] do_signal+0x57/0x6f0
[<ffffffffa3f156c6>] ? do_futex+0x106/0x5a0
[<ffffffffa3e2cc32>] do_notify_resume+0x72/0xc0
[<ffffffffa459322f>] int_signal+0x12/0x17
Code: 89 de 48 03 14 c5 60 10 b5 a4 48 89 df e8 17 52 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00 
Complete report #5769
Frame # Function Binary Source or offset Line
1
generic_exec_single
vmlinux 0xffffffffb0d16f62
Build id: 3.10.0-1127.el7.x86_64
0x102
2
? leave_mm
vmlinux 0xffffffffb0c7e730
Build id: 3.10.0-1127.el7.x86_64
0x120
3
? leave_mm
vmlinux 0xffffffffb0c7e730
Build id: 3.10.0-1127.el7.x86_64
0x120
4
? leave_mm
vmlinux 0xffffffffb0c7e730
Build id: 3.10.0-1127.el7.x86_64
0x120
5
smp_call_function_single
vmlinux 0xffffffffb0d1707f
Build id: 3.10.0-1127.el7.x86_64
0x5f
6
? cpumask_next_and
vmlinux 0xffffffffb0f84ee5
Build id: 3.10.0-1127.el7.x86_64
0x35
7
smp_call_function_many
vmlinux 0xffffffffb0d1762b
Build id: 3.10.0-1127.el7.x86_64
0x22b
8
native_flush_tlb_others
vmlinux 0xffffffffb0c7e8f8
Build id: 3.10.0-1127.el7.x86_64
0xb8
9
flush_tlb_mm_range
vmlinux 0xffffffffb0c7e96b
Build id: 3.10.0-1127.el7.x86_64
0x6b
10
tlb_flush_mmu_tlbonly
vmlinux 0xffffffffb0dedd3f
Build id: 3.10.0-1127.el7.x86_64
0x2f
11
unmap_page_range
vmlinux 0xffffffffb0df0f79
Build id: 3.10.0-1127.el7.x86_64
0x979
12
unmap_single_vma
vmlinux 0xffffffffb0df1301
Build id: 3.10.0-1127.el7.x86_64
0x81
13
unmap_vmas
vmlinux 0xffffffffb0df2d39
Build id: 3.10.0-1127.el7.x86_64
0x49
14
exit_mmap
vmlinux 0xffffffffb0dfcd3c
Build id: 3.10.0-1127.el7.x86_64
0xac
15
? __delayacct_add_tsk
vmlinux 0xffffffffb0d5e7b5
Build id: 3.10.0-1127.el7.x86_64
0x175
16
mmput
vmlinux 0xffffffffb0c98667
Build id: 3.10.0-1127.el7.x86_64
0x67
17
do_exit
vmlinux 0xffffffffb0ca23b8
Build id: 3.10.0-1127.el7.x86_64
0x288
18
? futex_wait
vmlinux 0xffffffffb0d139e5
Build id: 3.10.0-1127.el7.x86_64
0x1a5
19
do_group_exit
vmlinux 0xffffffffb0ca2bcf
Build id: 3.10.0-1127.el7.x86_64
0x3f
20
get_signal_to_deliver
vmlinux 0xffffffffb0cb3aee
Build id: 3.10.0-1127.el7.x86_64
0x1ce
21
do_signal
vmlinux 0xffffffffb0c2c527
Build id: 3.10.0-1127.el7.x86_64
0x57
22
? do_futex
vmlinux 0xffffffffb0d15706
Build id: 3.10.0-1127.el7.x86_64
0x106
23
? si_swapinfo
vmlinux 0xffffffffb0e0f41c
Build id: 3.10.0-1127.el7.x86_64
0x8c
24
do_notify_resume
vmlinux 0xffffffffb0c2cc32
Build id: 3.10.0-1127.el7.x86_64
0x72
25
int_signal
vmlinux 0xffffffffb139322f
Build id: 3.10.0-1127.el7.x86_64
0x12
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [C2 CompilerThre:2944]
Modules linked in: nf_conntrack_netbios_ns nf_conntrack_broadcast ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack libcrc32c ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter dm_mirror dm_region_hash dm_log dm_mod ppdev aesni_intel lrw gf128mul glue_helper sg ablk_helper cryptd joydev pcspkr virtio_balloon i2c_piix4 parport_pc parport ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic crct10dif_common sr_mod cdrom virtio_net net_failover failover
virtio_console virtio_scsi ata_generic pata_acpi bochs_drm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci ata_piix libata drm_panel_orientation_quirks virtio_pci virtio_ring serio_raw virtio floppy
CPU: 3 PID: 2944 Comm: C2 CompilerThre Tainted: G             L ------------   3.10.0-1127.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.12.1-0-ga5cab58e9a3f-prebuilt.qemu.org 04/01/2014
task: ffff9b149e4441c0 ti: ffff9b14d16ec000 task.ti: ffff9b14d16ec000
RIP: 0010:[<ffffffffb0d16f62>]  [<ffffffffb0d16f62>] generic_exec_single+0x102/0x1c0
RSP: 0018:ffff9b14d16ef950  EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffff9b14d16ef920 RCX: 000000000000003c
RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000282
RBP: ffff9b14d16ef9a0 R08: ffffffffb1413b00 R09: 00003ffffffff000
R10: ffff9b15ad92c6c0 R11: 0000000000000000 R12: ffffffffc0393cbb
R13: ffff9b14d16ef918 R14: 0000000000000002 R15: ffff9b137ffb6008
FS:  0000000000000000(0000) GS:ffff9b137fd00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd156846000 CR3: 0000000029610000 CR4: 00000000000006e0
Call Trace:
[<ffffffffb0c7e730>] ? leave_mm+0x120/0x120
[<ffffffffb0c7e730>] ? leave_mm+0x120/0x120
[<ffffffffb0c7e730>] ? leave_mm+0x120/0x120
[<ffffffffb0d1707f>] smp_call_function_single+0x5f/0xa0
[<ffffffffb0f84ee5>] ? cpumask_next_and+0x35/0x50
[<ffffffffb0d1762b>] smp_call_function_many+0x22b/0x270
[<ffffffffb0c7e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb0c7e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb0dedd3f>] tlb_flush_mmu_tlbonly+0x2f/0xc0
[<ffffffffb0df0f79>] unmap_page_range+0x979/0xc80
[<ffffffffb0df1301>] unmap_single_vma+0x81/0xf0
[<ffffffffb0df2d39>] unmap_vmas+0x49/0x90
[<ffffffffb0dfcd3c>] exit_mmap+0xac/0x1a0
[<ffffffffb0d5e7b5>] ? __delayacct_add_tsk+0x175/0x1a0
[<ffffffffb0c98667>] mmput+0x67/0xf0
[<ffffffffb0ca23b8>] do_exit+0x288/0xa20
[<ffffffffb0d139e5>] ? futex_wait+0x1a5/0x280
[<ffffffffb0ca2bcf>] do_group_exit+0x3f/0xa0
[<ffffffffb0cb3aee>] get_signal_to_deliver+0x1ce/0x5e0
[<ffffffffb0c2c527>] do_signal+0x57/0x6f0
[<ffffffffb0d15706>] ? do_futex+0x106/0x5a0
[<ffffffffb0e0f41c>] ? si_swapinfo+0x8c/0xa0
[<ffffffffb0c2cc32>] do_notify_resume+0x72/0xc0
[<ffffffffb139322f>] int_signal+0x12/0x17
Code: 89 de 48 03 14 c5 e0 0f 95 b1 48 89 df e8 17 51 28 00 84 c0 75 53 45 85 ed 74 16 f6 43 20 01 74 10 0f 1f 84 00 00 00 00 00 f3 90 <f6> 43 20 01 75 f8 31 c0 48 8b 7c 24 28 65 48 33 3c 25 28 00 00