Complete report #1258134
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff8e91e07a
Build id: 3.10.0-1160.81.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff8e881f48
Build id: 3.10.0-1160.81.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff8e881fbb
Build id: 3.10.0-1160.81.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff8ea0a66d
Build id: 3.10.0-1160.81.1.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffff8e8cf1f0
Build id: 3.10.0-1160.81.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff8ea0a873
Build id: 3.10.0-1160.81.1.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffff8efbf7f8
Build id: 3.10.0-1160.81.1.el7.x86_64
|
0x238
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffff8ea0acfe
Build id: 3.10.0-1160.81.1.el7.x86_64
|
0x23e
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffff8ea0ae53
Build id: 3.10.0-1160.81.1.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffff8efc539a
Build id: 3.10.0-1160.81.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#9 stuck for 23s! [java:2627]
Modules linked in: ceph libceph dns_resolver xt_nat veth ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) nfit libnvdimm iosf_mbi kvm_intel bochs_drm ttm kvm drm_kms_helper syscopyarea sysfillrect irqbypass sysimgblt fb_sys_fops crc32_pclmul ghash_clmulni_intel drm e1000e aesni_intel lrw gf128mul glue_helper ablk_helper sg cryptd joydev i2c_piix4 pcspkr virtio_balloon floppy ptp drm_panel_orientation_quirks pps_core ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi ata_piix virtio_console virtio_scsi libata crct10dif_pclmul virtio_pci crct10dif_common crc32c_intel virtio_ring serio_raw virtio dm_mirror
dm_region_hash dm_log dm_mod
CPU: 9 PID: 2627 Comm: java Kdump: loaded Tainted: G W ------------ T 3.10.0-1160.81.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.3-0-ga6ed6b701f0a-prebuilt.qemu.org 04/01/2014
task: ffff8ad75950a100 ti: ffff8ad631858000 task.ti: ffff8ad631858000
RIP: 0010:[<ffffffff8e91e07a>] [<ffffffff8e91e07a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8ad63185bc70 EFLAGS: 00000202
RAX: 0000000000000005 RBX: 000800008e881ab0 RCX: ffff8ad75f360740
RDX: 0000000000000005 RSI: 0000000000000010 RDI: 0000000000000000
RBP: ffff8ad63185bca8 R08: ffff8ac0c3148800 R09: ffffffff8eb9c139
R10: ffff8ad75f45f160 R11: ffffed79cd3eda00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8ad63185bc20 R15: 0000000000000001
FS: 00007f71fc442700(0000) GS:ffff8ad75f440000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055f1689f42a8 CR3: 00000016b0b80000 CR4: 0000000000760fe0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffff8e881f48>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8e881fbb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff8ea0a66d>] change_protection+0x5dd/0x680
[<ffffffff8e8cf1f0>] ? hrtimer_get_res+0x50/0x50
[<ffffffff8ea0a873>] mprotect_fixup+0x163/0x3b0
[<ffffffff8efbf7f8>] ? __do_page_fault+0x238/0x510
[<ffffffff8ea0acfe>] do_mprotect_pkey+0x23e/0x380
[<ffffffff8ea0ae53>] SyS_mprotect+0x13/0x20
[<ffffffff8efc539a>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 ce 19 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 00 19 55 8f f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 19 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #1201720
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff903150ca
Build id: 3.10.0-1062.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9027d398
Build id: 3.10.0-1062.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9027d40b
Build id: 3.10.0-1062.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff903fa5ad
Build id: 3.10.0-1062.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff903fa7b3
Build id: 3.10.0-1062.el7.x86_64
|
0x163
|
|
6
|
do_mprotect_pkey
|
vmlinux |
0xffffffff903fac42
Build id: 3.10.0-1062.el7.x86_64
|
0x252
|
|
7
|
SyS_mprotect
|
vmlinux |
0xffffffff903fad63
Build id: 3.10.0-1062.el7.x86_64
|
0x13
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 23s! [VM Thread:126752]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun bridge stp llc devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi sb_edac snd_ac97_codec coretemp ac97_bus snd_seq snd_seq_device snd_pcm ppdev iosf_mbi vmw_balloon snd_timer crc32_pclmul snd ghash_clmulni_intel aesni_intel soundcore
lrw gf128mul glue_helper joydev ablk_helper pcspkr sg cryptd i2c_piix4 vmw_vmci parport_pc parport binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul ata_piix crct10dif_common nfit crc32c_intel mptspi e1000 libata libnvdimm scsi_transport_spi mptscsih serio_raw mptbase drm_panel_orientation_quirks
CPU: 5 PID: 126752 Comm: VM Thread Kdump: loaded Tainted: G L ------------ 3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff8c4828088000 ti: ffff8c45042ac000 task.ti: ffff8c45042ac000
RIP: 0010:[<ffffffff903150ca>] [<ffffffff903150ca>] smp_call_function_many+0x20a/0x270
ata2: lost interrupt (Status 0x18)
RSP: 0018:ffff8c45042afc70 EFLAGS: 00000202
RAX: 0000000000000003 RBX: 000800009027d1d0 RCX: ffff8c482d6e0650
RDX: 0000000000000003 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff8c45042afca8 R08: ffff8c4579ca4400 R09: ffffffff9057f629
R10: ffff8c482d75f160 R11: ffffd6a0400b4600 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8c45042afc20 R15: ffffffff9022b621
FS: 00007f2998b46700(0000) GS:ffff8c482d740000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8e2b323c70 CR3: 0000000108a3e000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9027d398>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9027d40b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff903fa5ad>] change_protection+0x5cd/0x670
[<ffffffff903fa7b3>] mprotect_fixup+0x163/0x3a0
[<ffffffff903fac42>] do_mprotect_pkey+0x252/0x360
[<ffffffff903fad63>] SyS_mprotect+0x13/0x20
Complete report #1118293
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff82f1173a
Build id: 3.10.0-957.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff82e7a598
Build id: 3.10.0-957.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff82e7a608
Build id: 3.10.0-957.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffff82ff404d
Build id: 3.10.0-957.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff82ff4262
Build id: 3.10.0-957.el7.x86_64
|
0x162
|
|
6
|
|
vmlinux |
0xffffffff82ff1687
Build id: 3.10.0-957.el7.x86_64
|
0x327
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff82ff46b2
Build id: 3.10.0-957.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff82ff47d3
Build id: 3.10.0-957.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff83574ddb
Build id: 3.10.0-957.el7.x86_64
|
0x22
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 37s! [cloudwalker-eng:13753]
Modules linked in: udp_diag unix_diag sch_htb ip_vs binfmt_misc tcp_diag inet_diag xt_nat veth ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr sg joydev parport_pc i2c_piix4 parport vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 ahci vmw_pvscsi libahci vmwgfx drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ttm nfit libnvdimm ata_piix drm libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 13753 Comm: cloudwalker-eng Kdump: loaded Tainted: G ------------ T 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/28/2017
task: ffff8e4eaf3ec100 ti: ffff8e4deb640000 task.ti: ffff8e4deb640000
RIP: 0010:[<ffffffff82f1173a>] [<ffffffff82f1173a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8e4deb643c70 EFLAGS: 00000202
RAX: 0000000000000003 RBX: 0008000082e7a3d0 RCX: ffff8e4effce04b8
RDX: 0000000000000003 RSI: 0000000000000008 RDI: 0000000000000000
RBP: ffff8e4deb643ca8 R08: ffff8e402950f000 R09: ffffffff831755c9
R10: ffff8e4effc9f160 R11: fffffa233fd1cc00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8e4deb643c20 R15: ffffffff82e2a621
FS: 00007f6caf2abb20(0000) GS:ffff8e4effc80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c0005db000 CR3: 000000052618e000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffff82e7a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff82e7a608>] flush_tlb_mm_range+0x68/0x140
[<ffffffff82ff404d>] change_protection+0x5cd/0x680
[<ffffffff82ff4262>] mprotect_fixup+0x162/0x360
[<ffffffff82ff1687>] ? do_munmap+0x327/0x480
[<ffffffff82ff46b2>] do_mprotect_pkey+0x252/0x360
[<ffffffff82ff47d3>] SyS_mprotect+0x13/0x20
[<ffffffff83574ddb>] system_call_fastpath+0x22/0x27
Code: 48 63 35 4e 83 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 b9 b4 83 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 1d 83 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #983978
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff9cd16c0a
Build id: 3.10.0-1160.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9cc7e868
Build id: 3.10.0-1160.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9cc7e8db
Build id: 3.10.0-1160.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff9cdfe11d
Build id: 3.10.0-1160.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffff9ccc9860
Build id: 3.10.0-1160.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff9cdfe323
Build id: 3.10.0-1160.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffff9ccde185
Build id: 3.10.0-1160.el7.x86_64
|
0x85
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffff9cdfe79e
Build id: 3.10.0-1160.el7.x86_64
|
0x23e
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffff9cdfe8f3
Build id: 3.10.0-1160.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffff9d393f92
Build id: 3.10.0-1160.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [java:14936]
Modules linked in: tcp_lp rfcomm xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter bnep vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event crc32_pclmul ghash_clmulni_intel ppdev vmw_balloon snd_ens1371 snd_rawmidi aesni_intel snd_ac97_codec lrw btusb gf128mul btrtl ac97_bus glue_helper btbcm ablk_helper btintel cryptd snd_seq bluetooth snd_seq_device snd_pcm joydev sg rfkill pcspkr snd_timer snd soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic
ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common nfit libata crc32c_intel libnvdimm mptspi scsi_transport_spi e1000 serio_raw mptscsih mptbase drm_panel_orientation_quirks fuse
CPU: 6 PID: 14936 Comm: java Kdump: loaded Not tainted 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff9169558bb180 ti: ffff916b852cc000 task.ti: ffff916b852cc000
RIP: 0010:[<ffffffff9cd16c0a>] [<ffffffff9cd16c0a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff916b852cfc70 EFLAGS: 00000202
RAX: 0000000000000002 RBX: 000800009cc7e6a0 RCX: ffff916c068a06c8
RDX: 0000000000000002 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff916b852cfca8 R08: ffff916a27f8c400 R09: ffffffff9cf85f99
R10: ffff916c0699f160 R11: ffffe7a54c503e00 R12: 0000000000000282
R13: 0000000000000018 R14: ffff916b852cfbe0 R15: 0000000000000282
FS: 00007fb20cded700(0000) GS:ffff916c06980000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0b87d9c730 CR3: 000000028e5c8000 CR4: 0000000000740fe0
PKRU: 55555554
Call Trace:
[<ffffffff9cc7e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9cc7e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9cdfe11d>] change_protection+0x5dd/0x680
[<ffffffff9ccc9860>] ? hrtimer_get_res+0x50/0x50
[<ffffffff9cdfe323>] mprotect_fixup+0x163/0x3a0
[<ffffffff9ccde185>] ? sched_clock_cpu+0x85/0xc0
[<ffffffff9cdfe79e>] do_mprotect_pkey+0x23e/0x380
[<ffffffff9cdfe8f3>] SyS_mprotect+0x13/0x20
[<ffffffff9d393f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 1e 89 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 95 9d f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ed 88 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #877378
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffb8d16c0a
Build id: 3.10.0-1160.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffb8c7e868
Build id: 3.10.0-1160.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffb8c7e8db
Build id: 3.10.0-1160.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffb8dfe11d
Build id: 3.10.0-1160.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffffb8cc9860
Build id: 3.10.0-1160.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffb8dfe323
Build id: 3.10.0-1160.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffffb8d56dfb
Build id: 3.10.0-1160.el7.x86_64
|
0x5b
|
|
8
|
|
vmlinux |
0xffffffffb8c2b981
Build id: 3.10.0-1160.el7.x86_64
|
0x4b1
|
|
9
|
do_mprotect_pkey
|
vmlinux |
0xffffffffb8dfe79e
Build id: 3.10.0-1160.el7.x86_64
|
0x23e
|
|
10
|
SyS_mprotect
|
vmlinux |
0xffffffffb8dfe8f3
Build id: 3.10.0-1160.el7.x86_64
|
0x13
|
|
11
|
tracesys
|
vmlinux |
0xffffffffb9394226
Build id: 3.10.0-1160.el7.x86_64
|
0xa6
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 26s! [VM Thread:38308]
Modules linked in: veth xt_nat xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc tcp_diag inet_diag ext4 mbcache jbd2 overlay(T) vmw_vsock_vmci_transport vsock sunrpc kvm_intel kvm irqbypass crc32_pclmul ppdev ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon pcspkr sg joydev parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx nfit drm_kms_helper libnvdimm syscopyarea ata_piix sysfillrect sysimgblt fb_sys_fops ttm libata drm crct10dif_pclmul crct10dif_common crc32c_intel e1000 mptspi scsi_transport_spi
mptscsih serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 38308 Comm: VM Thread Kdump: loaded Tainted: G L ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff9d25fdb7b180 ti: ffff9d25be7d8000 task.ti: ffff9d25be7d8000
RIP: 0010:[<ffffffffb8d16c0a>] [<ffffffffb8d16c0a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9d25be7dbc70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00080000b8c7e6a0 RCX: ffff9d2675620650
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff9d25be7dbca8 R08: ffff9d25be34cc00 R09: ffffffffb8f85f99
R10: ffff9d26756df160 R11: ffffe92f054e0400 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9d25be7dbc20 R15: ffffffffb8c2b981
FS: 00007f76ee8f0700(0000) GS:ffff9d26756c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f76b4551978 CR3: 000000017dbee000 CR4: 00000000003607e0
Call Trace:
[<ffffffffb8c7e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb8c7e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb8dfe11d>] change_protection+0x5dd/0x680
[<ffffffffb8cc9860>] ? hrtimer_get_res+0x50/0x50
[<ffffffffb8dfe323>] mprotect_fixup+0x163/0x3a0
[<ffffffffb8d56dfb>] ? __seccomp_filter+0x5b/0x300
[<ffffffffb8c2b981>] ? __switch_to+0x4b1/0x580
[<ffffffffb8dfe79e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffb8dfe8f3>] SyS_mprotect+0x13/0x20
[<ffffffffb9394226>] tracesys+0xa6/0xcc
Code: 48 63 35 1e 89 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 95 b9 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ed 88 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #876890
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffa2916c0a
Build id: 3.10.0-1160.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffa287e868
Build id: 3.10.0-1160.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffa287e8db
Build id: 3.10.0-1160.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffa29fe11d
Build id: 3.10.0-1160.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffffa28c9860
Build id: 3.10.0-1160.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffa29fe323
Build id: 3.10.0-1160.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffffa2956dfb
Build id: 3.10.0-1160.el7.x86_64
|
0x5b
|
|
8
|
|
vmlinux |
0xffffffffa28de185
Build id: 3.10.0-1160.el7.x86_64
|
0x85
|
|
9
|
do_mprotect_pkey
|
vmlinux |
0xffffffffa29fe79e
Build id: 3.10.0-1160.el7.x86_64
|
0x23e
|
|
10
|
SyS_mprotect
|
vmlinux |
0xffffffffa29fe8f3
Build id: 3.10.0-1160.el7.x86_64
|
0x13
|
|
11
|
tracesys
|
vmlinux |
0xffffffffa2f94226
Build id: 3.10.0-1160.el7.x86_64
|
0xa6
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [java:2961]
Modules linked in: veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 crc32_pclmul snd_rawmidi snd_ac97_codec ghash_clmulni_intel ac97_bus snd_seq snd_seq_device ppdev aesni_intel snd_pcm lrw gf128mul glue_helper vmw_balloon ablk_helper cryptd snd_timer joydev pcspkr snd sg vmw_vmci soundcore i2c_piix4 parport_pc parport nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs nf_conntrack ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif
crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix mptspi crct10dif_pclmul scsi_transport_spi nfit crct10dif_common crc32c_intel drm mptscsih libnvdimm libata serio_raw e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 2961 Comm: java Tainted: G ------------ T 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff9f54e64fe300 ti: ffff9f5670a68000 task.ti: ffff9f5670a68000
RIP: 0010:[<ffffffffa2916c0a>] [<ffffffffa2916c0a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9f5670a6bc70 EFLAGS: 00000202
RAX: 0000000000000003 RBX: 00080000a287e6a0 RCX: ffff9f56756e0628
RDX: 0000000000000003 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff9f5670a6bca8 R08: ffff9f55be34b400 R09: ffffffffa2b85f99
R10: ffff9f567569f160 R11: fffff5ddc82d4a00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9f5670a6bc20 R15: ffffffffa282b981
FS: 00007f5901833700(0000) GS:ffff9f5675680000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055eaec96af50 CR3: 00000000ad154000 CR4: 0000000000360fe0
Call Trace:
[<ffffffffa287e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa287e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa29fe11d>] change_protection+0x5dd/0x680
[<ffffffffa28c9860>] ? hrtimer_get_res+0x50/0x50
[<ffffffffa29fe323>] mprotect_fixup+0x163/0x3a0
[<ffffffffa2956dfb>] ? __seccomp_filter+0x5b/0x300
[<ffffffffa28de185>] ? sched_clock_cpu+0x85/0xc0
[<ffffffffa29fe79e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffa29fe8f3>] SyS_mprotect+0x13/0x20
[<ffffffffa2f94226>] tracesys+0xa6/0xcc
Code: 48 63 35 1e 89 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 55 a3 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ed 88 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #809849
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffa73175ca
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffa727e8f8
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffa727e96b
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffa73fe23d
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffffa72ca2d0
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffa73fe443
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffffa7362584
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0xf4
|
|
8
|
|
vmlinux |
0xffffffffa7996b14
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x5
|
|
9
|
do_mprotect_pkey
|
vmlinux |
0xffffffffa73fe8be
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x23e
|
|
10
|
SyS_mprotect
|
vmlinux |
0xffffffffa73fea13
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0x13
|
|
11
|
tracesys
|
vmlinux |
0xffffffffa7993166
Build id: 3.10.0-1127.10.1.el7.x86_64
|
0xa6
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [java:7578]
Modules linked in: xt_owner ip6table_filter ip6_tables vsock_diag tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack libcrc32c br_netfilter bridge stp llc overlay(T) vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper ppdev cryptd vmw_balloon joydev pcspkr parport_pc parport vmw_vmci sg i2c_piix4 nfsd nfs_acl lockd grace auth_rpcgss binfmt_misc sunrpc ip_tables ext4 mbcache jbd2 sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect
sysimgblt fb_sys_fops ttm drm mptspi scsi_transport_spi ata_piix mptscsih nfit libata crct10dif_pclmul mptbase crct10dif_common crc32c_intel libnvdimm serio_raw vmxnet3 drm_panel_orientation_quirks floppy
CPU: 3 PID: 7578 Comm: java Tainted: G W L ------------ T 3.10.0-1127.10.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff9f94f46e41c0 ti: ffff9f9ad98f4000 task.ti: ffff9f9ad98f4000
RIP: 0010:[<ffffffffa73175ca>] [<ffffffffa73175ca>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9f9ad98f7c70 EFLAGS: 00000202
RAX: 0000000000000001 RBX: ffffffffa727e730 RCX: ffff9f9bbfc60628
RDX: 0000000000000001 RSI: 0000000000000008 RDI: 0000000000000000
RBP: ffff9f9ad98f7ca8 R08: ffff9f94f4409800 R09: ffffffffa7585179
R10: ffff9f9bbfcdf160 R11: ffffd92560709400 R12: ffff9f9ad98f7c40
R13: ffffffffa75850cf R14: ffff9f9bbfcc0000 R15: ffffffffa722b621
FS: 00007f0e7b7f7700(0000) GS:ffff9f9bbfcc0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0e9ea10400 CR3: 00000002a76b4000 CR4: 00000000000007e0
Call Trace:
[<ffffffffa727e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa727e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa73fe23d>] change_protection+0x5cd/0x670
[<ffffffffa72ca2d0>] ? hrtimer_get_res+0x50/0x50
[<ffffffffa73fe443>] mprotect_fixup+0x163/0x3a0
[<ffffffffa7362584>] ? ftrace_ops_list_func+0xf4/0x120
[<ffffffffa7996b14>] ? ftrace_regs_call+0x5/0x81
[<ffffffffa73fe8be>] do_mprotect_pkey+0x23e/0x380
[<ffffffffa73fea13>] SyS_mprotect+0x13/0x20
[<ffffffffa7993166>] tracesys+0xa6/0xcc
Code: 48 63 35 9e 7b c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 20 10 f5 a7 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 6d 7b c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #771142
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff8b9150ca
Build id: 3.10.0-1062.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff8b87d398
Build id: 3.10.0-1062.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff8b87d40b
Build id: 3.10.0-1062.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff8b9fa5ad
Build id: 3.10.0-1062.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff8b9fa7b3
Build id: 3.10.0-1062.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffff8b82b621
Build id: 3.10.0-1062.el7.x86_64
|
0x151
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff8b9fac42
Build id: 3.10.0-1062.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff8b9fad63
Build id: 3.10.0-1062.el7.x86_64
|
0x13
|
NMI watchdog: BUG: soft lockup - CPU#14 stuck for 23s! [gnome-shell:2812]
Modules linked in: binfmt_misc nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq ppdev snd_seq_device snd_pcm vmw_balloon snd_timer snd iosf_mbi crc32_pclmul ghash_clmulni_intel sg soundcore aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic
ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nfit libnvdimm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel mptspi libata scsi_transport_spi e1000 mptscsih serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 14 PID: 2812 Comm: gnome-shell Kdump: loaded Tainted: G L ------------ T 3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff93dc332ae2a0 ti: ffff93dbd8eb0000 task.ti: ffff93dbd8eb0000
RIP: 0010:[<ffffffff8b9150ca>] [<ffffffff8b9150ca>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff93dbd8eb3c70 EFLAGS: 00000202
RAX: 0000000000000009 RBX: 000800008b87d1d0 RCX: ffff93dc3d8607b8
RDX: 0000000000000009 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff93dbd8eb3ca8 R08: ffff93cda9666800 R09: ffffffff8bb7f629
R10: ffff93dc3d99f160 R11: fffffd1076edfe00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff93dbd8eb3c20 R15: ffff93dc3665b500
FS: 00007f579b189a80(0000) GS:ffff93dc3d980000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9fa4e34000 CR3: 0000000f99602000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffff8b87d398>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8b87d40b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff8b9fa5ad>] change_protection+0x5cd/0x670
[<ffffffff8b9fa7b3>] mprotect_fixup+0x163/0x3a0
[<ffffffff8b82b621>] ? __switch_to+0x151/0x580
[<ffffffff8b9fac42>] do_mprotect_pkey+0x252/0x360
[<ffffffff8b9fad63>] SyS_mprotect+0x13/0x20
Complete report #714678
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff83b16c0a
Build id: 3.10.0-1160.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff83a7e868
Build id: 3.10.0-1160.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff83a7e8db
Build id: 3.10.0-1160.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff83bfe11d
Build id: 3.10.0-1160.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff83bfe323
Build id: 3.10.0-1160.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffff83ad49d7
Build id: 3.10.0-1160.el7.x86_64
|
0x57
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff83bfe79e
Build id: 3.10.0-1160.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff83bfe8f3
Build id: 3.10.0-1160.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff84193f92
Build id: 3.10.0-1160.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 67s! [gnome-shell:65000]
Modules linked in: cmac arc4 md4 nls_utf8 cifs ccm dns_resolver ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc nfit kvm_intel libnvdimm kvm irqbypass pcspkr joydev crc32_pclmul ghash_clmulni_intel sg aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic
ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ata_piix libata mptspi serio_raw scsi_transport_spi e1000 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 6 PID: 65000 Comm: gnome-shell Kdump: loaded Tainted: G W L ------------ 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff909b42d29080 ti: ffff909a51010000 task.ti: ffff909a51010000
RIP: 0010:[<ffffffff83b16c0a>] [<ffffffff83b16c0a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff909a51013c70 EFLAGS: 00000202
RAX: 0000000000000007 RBX: 0008000083a7e6a0 RCX: ffff90a041fe06c8
RDX: 0000000000000007 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff909a51013ca8 R08: ffff909b92bfe000 R09: ffffffff83d85f99
R10: ffff90a041f9f160 R11: ffffdfb0406b1200 R12: 0000000000000282
R13: 0000000000000282 R14: ffff909a51013c20 R15: ffffffff83a2b621
FS: 00007fcada67fa80(0000) GS:ffff90a041f80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb946295250 CR3: 00000000158f4000 CR4: 00000000003607e0
Call Trace:
[<ffffffff83a7e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff83a7e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff83bfe11d>] change_protection+0x5dd/0x680
[<ffffffff83bfe323>] mprotect_fixup+0x163/0x3a0
[<ffffffff83ad49d7>] ? finish_task_switch+0x57/0x1c0
[<ffffffff83bfe79e>] do_mprotect_pkey+0x23e/0x380
[<ffffffff83bfe8f3>] SyS_mprotect+0x13/0x20
[<ffffffff84193f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 1e 89 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 75 84 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ed 88 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #655342
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff92f170da
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff92e7e258
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff92e7e2cb
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff92ffeaed
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff92ffecf3
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffff93064640
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0xf0
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff92fff16e
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff92fff2c3
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff93599f92
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [gnome-shell:7368]
Modules linked in: tcp_lp rfcomm xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock bnep sunrpc crc32_pclmul ghash_clmulni_intel ppdev aesni_intel btusb lrw btrtl gf128mul btbcm glue_helper btintel ablk_helper cryptd vmw_balloon bluetooth pcspkr joydev rfkill sg vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod
sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ata_piix nfit crc32c_intel libata mptspi libnvdimm scsi_transport_spi e1000 mptscsih serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 7368 Comm: gnome-shell Kdump: loaded Tainted: G L ------------ 3.10.0-1160.59.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff92d68c231080 ti: ffff92d5e759c000 task.ti: ffff92d5e759c000
RIP: 0010:[<ffffffff92f170da>] [<ffffffff92f170da>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff92d5e759fc70 EFLAGS: 00000202
RAX: 0000000000000007 RBX: 0008000092e7ddd0 RCX: ffff92d6b57e0370
RDX: 0000000000000007 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff92d5e759fca8 R08: ffff92d5fa88b800 R09: ffffffff93186c09
R10: ffff92d6b56df160 R11: ffffe66c48bed000 R12: 0000000000000282
R13: 0000000000000018 R14: ffff92d5e759fbe0 R15: 0000000000000282
FS: 00007f3241870a80(0000) GS:ffff92d6b56c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0a275b2bc4 CR3: 000000020c384000 CR4: 00000000003406e0
Call Trace:
[<ffffffff92e7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff92e7e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff92ffeaed>] change_protection+0x5dd/0x680
[<ffffffff92ffecf3>] mprotect_fixup+0x163/0x3a0
[<ffffffff93064640>] ? __pollwait+0xf0/0xf0
[<ffffffff92fff16e>] do_mprotect_pkey+0x23e/0x380
[<ffffffff92fff2c3>] SyS_mprotect+0x13/0x20
[<ffffffff93599f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 ce 88 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 18 b5 93 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 88 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #619254
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff943170da
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9427e258
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9427e2cb
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff943feaed
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff943fecf3
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x163
|
|
6
|
do_mprotect_pkey
|
vmlinux |
0xffffffff943ff16e
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x23e
|
|
7
|
SyS_mprotect
|
vmlinux |
0xffffffff943ff2c3
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x13
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffff94995f92
Build id: 3.10.0-1160.42.2.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#13 stuck for 22s! [node:111556]
Modules linked in: binfmt_misc ip_vs_rr xt_ipvs ip_vs xt_REDIRECT nf_nat_redirect vxlan ip6_udp_tunnel udp_tunnel xt_mark xt_nat veth ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel vmw_balloon lrw gf128mul glue_helper ablk_helper
cryptd joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 CyProtectDrv(POE) CyProtectDrvOpen(OE) ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper sd_mod syscopyarea sysfillrect sysimgblt fb_sys_fops crc_t10dif ahci ttm crct10dif_generic ata_piix libahci drm crct10dif_pclmul nfit crct10dif_common crc32c_intel libata libnvdimm vmxnet3 serio_raw vmw_pvscsi drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 13 PID: 111556 Comm: node Kdump: loaded Tainted: P W OEL ------------ T 3.10.0-1160.42.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff998cb58d4200 ti: ffff99909abd4000 task.ti: ffff99909abd4000
RIP: 0010:[<ffffffff943170da>] [<ffffffff943170da>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff99909abd7c70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 000800009427ddd0 RCX: ffff9990ad6207e0
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff99909abd7ca8 R08: ffff998df5c6e000 R09: ffffffff94586bd9
R10: ffff9990ad95f160 R11: ffffe55dc637ce00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff99909abd7c20 R15: ffff998cb58d6300
FS: 00007f84d37fe700(0000) GS:ffff9990ad940000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00003eff443e50b0 CR3: 00000003c13f8000 CR4: 00000000003607e0
Call Trace:
[<ffffffff9427e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9427e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff943feaed>] change_protection+0x5dd/0x680
[<ffffffff943fecf3>] mprotect_fixup+0x163/0x3a0
[<ffffffff943ff16e>] do_mprotect_pkey+0x23e/0x380
[<ffffffff943ff2c3>] SyS_mprotect+0x13/0x20
[<ffffffff94995f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 ce 85 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 15 f5 94 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 85 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #569999
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff87d150ca
Build id: 3.10.0-1062.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff87c7d398
Build id: 3.10.0-1062.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff87c7d40b
Build id: 3.10.0-1062.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff87dfa5ad
Build id: 3.10.0-1062.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffff87cc8d10
Build id: 3.10.0-1062.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff87dfa7b3
Build id: 3.10.0-1062.el7.x86_64
|
0x163
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff87dfac42
Build id: 3.10.0-1062.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff87dfad63
Build id: 3.10.0-1062.el7.x86_64
|
0x13
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [VM Thread:3239]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper pcspkr vmw_balloon sg cryptd joydev vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod vmwgfx cdrom sd_mod ata_generic crc_t10dif crct10dif_generic pata_acpi drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nfit libnvdimm ata_piix mptspi libata scsi_transport_spi mptscsih e1000 crct10dif_pclmul crct10dif_common
mptbase crc32c_intel serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 3239 Comm: VM Thread Kdump: loaded Tainted: G L ------------ 3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff9d20b673c1c0 ti: ffff9d20b6314000 task.ti: ffff9d20b6314000
RIP: 0010:[<ffffffff87d150ca>] [<ffffffff87d150ca>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9d20b6317c70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 0008000087c7d1d0 RCX: ffff9d20dd620650
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff9d20b6317ca8 R08: ffff9d1a3453cc00 R09: ffffffff87f7f629
R10: ffff9d20dd75f160 R11: ffffe779204dba00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9d20b6317c20 R15: ffffffff87c2b621
FS: 00007f3e6c4c6700(0000) GS:ffff9d20dd740000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3e9d49a0a0 CR3: 0000000814a22000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff87c7d398>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff87c7d40b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff87dfa5ad>] change_protection+0x5cd/0x670
[<ffffffff87cc8d10>] ? hrtimer_get_res+0x50/0x50
[<ffffffff87dfa7b3>] mprotect_fixup+0x163/0x3a0
[<ffffffff87dfac42>] do_mprotect_pkey+0x252/0x360
[<ffffffff87dfad63>] SyS_mprotect+0x13/0x20
Complete report #546080
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff9771718e
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x20e
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9767e258
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9767e2cb
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff977feacd
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffff976c9bd0
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff977fecd3
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffff9775737b
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x5b
|
|
8
|
|
vmlinux |
0xffffffff97d94678
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x238
|
|
9
|
do_mprotect_pkey
|
vmlinux |
0xffffffff977ff14e
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x23e
|
|
10
|
SyS_mprotect
|
vmlinux |
0xffffffff977ff2a3
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x13
|
|
11
|
tracesys
|
vmlinux |
0xffffffff97d9a226
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0xa6
|
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 23s! [java:16270]
Modules linked in: veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter overlay(T) sunrpc ppdev sg i2c_piix4 parport_pc virtio_balloon parport joydev pcspkr ip_tables xfs libcrc32c sr_mod cdrom virtio_net ata_generic pata_acpi net_failover virtio_console virtio_scsi virtio_blk failover cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata serio_raw virtio_pci drm_panel_orientation_quirks virtio_ring floppy virtio dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 7 PID: 16270 Comm: java Kdump: loaded Tainted: G L ------------ T 3.10.0-1160.76.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff9045a8311080 ti: ffff90436eba0000 task.ti: ffff90436eba0000
RIP: 0010:[<ffffffff9771718e>] [<ffffffff9771718e>] smp_call_function_many+0x20e/0x270
RSP: 0018:ffff90436eba3c70 EFLAGS: 00000202
RAX: 0000000000000001 RBX: 000800009767ddd0 RCX: ffff90472de604f0
RDX: 0000000000000001 RSI: 0000000000000060 RDI: 0000000000000000
RBP: ffff90436eba3ca8 R08: ffff9044763bc800 R09: ffffffff979869f9
R10: ffff90472dfdf160 R11: fffff3fc41840400 R12: 0000000000000282
R13: 0000000000000282 R14: ffff90436eba3c20 R15: 0000000000001000
FS: 00007fb651d5e700(0000) GS:ffff90472dfc0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb6554c9600 CR3: 00000002a7756000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9767e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9767e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff977feacd>] change_protection+0x5dd/0x680
[<ffffffff976c9bd0>] ? hrtimer_get_res+0x50/0x50
[<ffffffff977fecd3>] mprotect_fixup+0x163/0x3a0
[<ffffffff9775737b>] ? __seccomp_filter+0x5b/0x300
[<ffffffff97d94678>] ? __do_page_fault+0x238/0x500
[<ffffffff977ff14e>] do_mprotect_pkey+0x23e/0x380
[<ffffffff977ff2a3>] SyS_mprotect+0x13/0x20
[<ffffffff97d9a226>] tracesys+0xa6/0xcc
Code: 88 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 00 19 35 98 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 f6 41 20 01 <75> f8 48 63 35 8d 88 c4 00 eb b7 0f b6 4d cc 4c 89 f2 4c 89 ee
Complete report #542183
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff9fd1718a
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9fc7e258
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9fc7e2cb
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff9fdfeacd
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff9fdfecd3
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffff9fd5737b
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x5b
|
|
7
|
|
vmlinux |
0xffffffffa0394678
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x238
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffff9fdff14e
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x23e
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffff9fdff2a3
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0x13
|
|
10
|
tracesys
|
vmlinux |
0xffffffffa039a226
Build id: 3.10.0-1160.76.1.el7.x86_64
|
0xa6
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 21s! [java:4408]
Modules linked in: veth xt_nat nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter overlay(T) sunrpc ppdev sg i2c_piix4 parport_pc parport virtio_balloon pcspkr joydev ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_console virtio_net virtio_blk net_failover virtio_scsi failover cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix libata drm virtio_pci serio_raw virtio_ring virtio drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 4408 Comm: java Kdump: loaded Tainted: G L ------------ T 3.10.0-1160.76.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff8e8f9c08c200 ti: ffff8e8fae6e0000 task.ti: ffff8e8fae6e0000
RIP: 0010:[<ffffffff9fd1718a>] [<ffffffff9fd1718a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8e8fae6e3c70 EFLAGS: 00000202
RAX: 0000000000000005 RBX: 000800009fc7ddd0 RCX: ffff8e8fedf60450
RDX: 0000000000000005 RSI: 0000000000000060 RDI: 0000000000000000
RBP: ffff8e8fae6e3ca8 R08: ffff8e8d363bb800 R09: ffffffff9ff869f9
R10: ffff8e8fededf160 R11: fffffae041f7ea00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8e8fae6e3c20 R15: 0000000000001000
FS: 00007f086c36f700(0000) GS:ffff8e8fedec0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f08840be600 CR3: 00000003f7e5c000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9fc7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9fc7e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9fdfeacd>] change_protection+0x5dd/0x680
[<ffffffff9fdfecd3>] mprotect_fixup+0x163/0x3a0
[<ffffffff9fd5737b>] ? __seccomp_filter+0x5b/0x300
[<ffffffffa0394678>] ? __do_page_fault+0x238/0x500
[<ffffffff9fdff14e>] do_mprotect_pkey+0x23e/0x380
[<ffffffff9fdff2a3>] SyS_mprotect+0x13/0x20
[<ffffffffa039a226>] tracesys+0xa6/0xcc
Code: 48 63 35 be 88 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 00 19 95 a0 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 8d 88 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #534938
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff98b1720a
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff98a7e258
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff98a7e2cb
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff98bfeaed
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffff98ac9bd0
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff98bfecf3
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffff98a2b621
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x151
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffff98bff16e
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x23e
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffff98bff2c3
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffff99199f92
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [java:22799]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event coretemp snd_ens1371 snd_rawmidi snd_ac97_codec iosf_mbi ac97_bus crc32_pclmul ghash_clmulni_intel snd_seq snd_seq_device snd_pcm aesni_intel snd_timer ppdev snd lrw gf128mul glue_helper ablk_helper cryptd vmw_balloon soundcore joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect
sysimgblt fb_sys_fops mptspi scsi_transport_spi nfit ttm ata_piix mptscsih drm mptbase libnvdimm crct10dif_pclmul crct10dif_common libata e1000 crc32c_intel serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 22799 Comm: java Kdump: loaded Tainted: G W L ------------ 3.10.0-1160.71.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff9b17af0be300 ti: ffff9b164da28000 task.ti: ffff9b164da28000
RIP: 0010:[<ffffffff98b1720a>] [<ffffffff98b1720a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9b164da2bc70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 0008000098a7ddd0 RCX: ffff9b17b8620628
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff9b164da2bca8 R08: ffff9b17b448b400 R09: ffffffff98d86a19
R10: ffff9b17b869f160 R11: fffff6aa05c2e800 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9b164da2bc20 R15: ffff9b1741f331e8
FS: 00007f398cb7e700(0000) GS:ffff9b17b8680000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9f2b5f7d00 CR3: 000000015604c000 CR4: 00000000003607e0
Call Trace:
[<ffffffff98a7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff98a7e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff98bfeaed>] change_protection+0x5dd/0x680
[<ffffffff98ac9bd0>] ? hrtimer_get_res+0x50/0x50
[<ffffffff98bfecf3>] mprotect_fixup+0x163/0x3a0
[<ffffffff98a2b621>] ? __switch_to+0x151/0x580
[<ffffffff98bff16e>] do_mprotect_pkey+0x23e/0x380
[<ffffffff98bff2c3>] SyS_mprotect+0x13/0x20
[<ffffffff99199f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 9e 87 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 18 75 99 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 6d 87 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #493741
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffad11720a
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffad07e258
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffad07e2cb
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffad1feaed
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffad1fecf3
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffffad24b18a
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x1ca
|
|
7
|
|
vmlinux |
0xffffffffad02b621
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x151
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffffad1ff16e
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x23e
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffffad1ff2c3
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffffad799f92
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0x25
|
|
11
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffffad799ed5
Build id: 3.10.0-1160.71.1.el7.x86_64
|
0xa2
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [gnome-shell:3895]
Modules linked in: ip6t_REJECT nf_reject_ipv6 nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables ipt_REJECT nf_reject_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c iptable_filter sunrpc dm_mirror dm_region_hash dm_log dm_mod squashfs loop joydev i2c_piix4 edac_mce_amd sg pcspkr virtio_balloon ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_common ata_generic pata_acpi virtio_net virtio_console net_failover virtio_scsi failover bochs_drm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata serio_raw virtio_pci virtio_ring virtio drm_panel_orientation_quirks floppy fuse
CPU: 3 PID: 3895 Comm: gnome-shell Kdump: loaded Tainted: G L ------------ 3.10.0-1160.71.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.15.0-0-g2dd4b9b3f840-prebuilt.qemu.org 04/01/2014
task: ffff9364f5426300 ti: ffff93646fdc0000 task.ti: ffff93646fdc0000
RIP: 0010:[<ffffffffad11720a>] [<ffffffffad11720a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff93646fdc3c70 EFLAGS: 00000202
RAX: 0000000000000001 RBX: 000c0000ad07ddd0 RCX: ffff9364ffca0628
RDX: 0000000000000001 RSI: 0000000000000004 RDI: 0000000000000000
RBP: ffff93646fdc3ca8 R08: ffff9364f8492000 R09: ffffffffad386a19
R10: ffff9364ffd9f160 R11: fffffc81c422aa00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff93646fdc3c20 R15: ffff9364f543b1e8
FS: 00007f86b3b5ea80(0000) GS:ffff9364ffd80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff0db582000 CR3: 00000000afd2a000 CR4: 00000000000007e0
Call Trace:
[<ffffffffad07e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffad07e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffad1feaed>] change_protection+0x5dd/0x680
[<ffffffffad1fecf3>] mprotect_fixup+0x163/0x3a0
[<ffffffffad24b18a>] ? __check_object_size+0x1ca/0x250
[<ffffffffad02b621>] ? __switch_to+0x151/0x580
[<ffffffffad1ff16e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffad1ff2c3>] SyS_mprotect+0x13/0x20
[<ffffffffad799f92>] system_call_fastpath+0x25/0x2a
[<ffffffffad799ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: 48 63 35 9e 87 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 18 d5 ad f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 6d 87 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #485754
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffabf1722a
Build id: 3.10.0-1160.62.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffabe7e258
Build id: 3.10.0-1160.62.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffabe7e2cb
Build id: 3.10.0-1160.62.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffabffeadd
Build id: 3.10.0-1160.62.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffabffece3
Build id: 3.10.0-1160.62.1.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffffac0643f0
Build id: 3.10.0-1160.62.1.el7.x86_64
|
0xf0
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffffabfff15e
Build id: 3.10.0-1160.62.1.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffffabfff2b3
Build id: 3.10.0-1160.62.1.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffffac599f92
Build id: 3.10.0-1160.62.1.el7.x86_64
|
0x25
|
|
10
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffffac599ed5
Build id: 3.10.0-1160.62.1.el7.x86_64
|
0xa2
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [gnome-shell:2724]
Modules linked in: tcp_diag udp_diag inet_diag tcp_lp xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat ipt_REJECT nf_reject_ipv4 tun nf_conntrack_ipv4 nf_defrag_ipv4 bridge stp xt_conntrack llc nf_conntrack ebtable_filter ebtables devlink ip6table_filter ip6_tables nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache xt_set ip_set iptable_filter sunrpc snd_hda_codec_generic snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd soundcore ppdev sg i2c_piix4 parport_pc virtio_balloon pcspkr joydev parport ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom crct10dif_common ata_generic pata_acpi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops ttm drm virtio_net net_failover virtio_blk ata_piix failover libata floppy virtio_pci virtio_ring serio_raw virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 2724 Comm: gnome-shell Kdump: loaded Tainted: G L ------------ 3.10.0-1160.62.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
task: ffff9cd6f9575280 ti: ffff9cc69aa10000 task.ti: ffff9cc69aa10000
RIP: 0010:[<ffffffffabf1722a>] [<ffffffffabf1722a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9cc69aa13c70 EFLAGS: 00000202
RAX: 0000000000000004 RBX: ffffffffabe7ddd0 RCX: ffff9cd78b920428
RDX: 0000000000000004 RSI: 0000000000000008 RDI: 0000000000000000
RBP: ffff9cc69aa13ca8 R08: ffff9cc70fd48c00 R09: ffffffffac1869d9
R10: ffff9cd78b89f160 R11: fffff77144abee00 R12: ffff9cc69aa13c40
R13: ffffffffac18692f R14: 00000000a7adcfa7 R15: 0000000000000040
FS: 00007f5fa2b22a80(0000) GS:ffff9cd78b880000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000012dd64bafc08 CR3: 000000112fde0000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffabe7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffabe7e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffabffeadd>] change_protection+0x5dd/0x680
[<ffffffffabffece3>] mprotect_fixup+0x163/0x3a0
[<ffffffffac0643f0>] ? __pollwait+0xf0/0xf0
[<ffffffffabfff15e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffabfff2b3>] SyS_mprotect+0x13/0x20
[<ffffffffac599f92>] system_call_fastpath+0x25/0x2a
[<ffffffffac599ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: 48 63 35 7e 87 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 18 b5 ac f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 4d 87 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #473343
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffa8b1173a
Build id: 3.10.0-957.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffa8a7a598
Build id: 3.10.0-957.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffa8a7a608
Build id: 3.10.0-957.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffffa8bf404d
Build id: 3.10.0-957.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffffa8ac57e0
Build id: 3.10.0-957.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffa8bf4262
Build id: 3.10.0-957.el7.x86_64
|
0x162
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffffa8bf46b2
Build id: 3.10.0-957.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffffa8bf47d3
Build id: 3.10.0-957.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffffa9174ddb
Build id: 3.10.0-957.el7.x86_64
|
0x22
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 28s! [java:10791]
Modules linked in: vmw_vsock_vmci_transport vsock vfat fat crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper pcspkr cryptd ppdev vmw_balloon joydev sg vmw_vmci parport_pc parport i2c_piix4 tpm_crb ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel vmwgfx e1000e serio_raw ptp drm_kms_helper pps_core syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptsas scsi_transport_sas ahci mptscsih drm mptbase nfit libahci ata_piix libnvdimm libata drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 10791 Comm: java Kdump: loaded Tainted: G W L ------------ 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.17369862.B64.2012240522 12/24/2020
task: ffff91f564ea9040 ti: ffff91f353cb4000 task.ti: ffff91f353cb4000
RIP: 0010:[<ffffffffa8b1173a>] [<ffffffffa8b1173a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff91f353cb7c70 EFLAGS: 00000202
RAX: 000000000000000e RBX: 00080000a8a7a3d0 RCX: ffff91fadf59f610
RDX: 000000000000000e RSI: 0000000000000010 RDI: 0000000000000000
RBP: ffff91f353cb7ca8 R08: ffff91f43fd49000 R09: ffffffffa8d755c9
R10: ffff91fadf21f160 R11: ffffdbee823cfc00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff91f353cb7c20 R15: ffffffffa8a2a621
FS: 00007f7f6fefe700(0000) GS:ffff91fadf200000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f96c5e77d80 CR3: 00000001021ae000 CR4: 0000000000760ff0
PKRU: 55555554
Call Trace:
[<ffffffffa8a7a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa8a7a608>] flush_tlb_mm_range+0x68/0x140
[<ffffffffa8bf404d>] change_protection+0x5cd/0x680
[<ffffffffa8ac57e0>] ? hrtimer_get_res+0x50/0x50
[<ffffffffa8bf4262>] mprotect_fixup+0x162/0x360
[<ffffffffa8bf46b2>] do_mprotect_pkey+0x252/0x360
[<ffffffffa8bf47d3>] SyS_mprotect+0x13/0x20
[<ffffffffa9174ddb>] system_call_fastpath+0x22/0x27
Code: 48 63 35 4e 83 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 b9 74 a9 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 1d 83 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #446684
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff99d1761a
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff99c7e8f8
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff99c7e96b
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff99dfe26d
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff99dfe473
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x163
|
|
6
|
do_mprotect_pkey
|
vmlinux |
0xffffffff99dfe8ee
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x23e
|
|
7
|
SyS_mprotect
|
vmlinux |
0xffffffff99dfea43
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x13
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffff9a392ed2
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x25
|
|
9
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffff9a392e15
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xa2
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [java:4285]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel lrw vmw_balloon gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg vmw_vmci parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic
ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ata_piix ttm drm crct10dif_pclmul crct10dif_common mptspi scsi_transport_spi crc32c_intel mptscsih libata serio_raw mptbase e1000 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 4285 Comm: java Kdump: loaded Tainted: G W L ------------ 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 06/22/2012
task: ffff963e93a2e2a0 ti: ffff963e93a68000 task.ti: ffff963e93a68000
RIP: 0010:[<ffffffff99d1761a>] [<ffffffff99d1761a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff963e93a6bc70 EFLAGS: 00000202
RAX: 0000000000000001 RBX: ffffffff99c7e730 RCX: ffff963effca0650
RDX: 0000000000000001 RSI: 0000000000000004 RDI: 0000000000000000
RBP: ffff963e93a6bca8 R08: ffff963d3b357000 R09: ffffffff99f851b9
R10: ffff963effd9f160 R11: ffffd0fe447b0400 R12: ffff963e93a6bc40
R13: ffffffff99f8510f R14: ffff963effd80000 R15: ffffffff99c2b621
FS: 00007fee0c386700(0000) GS:ffff963effd80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f83afa4f000 CR3: 000000032412c000 CR4: 00000000000407e0
Call Trace:
[<ffffffff99c7e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff99c7e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff99dfe26d>] change_protection+0x5dd/0x680
[<ffffffff99dfe473>] mprotect_fixup+0x163/0x3a0
[<ffffffff99dfe8ee>] do_mprotect_pkey+0x23e/0x380
[<ffffffff99dfea43>] SyS_mprotect+0x13/0x20
[<ffffffff9a392ed2>] system_call_fastpath+0x25/0x2a
[<ffffffff9a392e15>] ? system_call_after_swapgs+0xa2/0x13a
Code: 48 63 35 ce 7b c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 10 95 9a f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 7b c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #443084
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff8c316e4a
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff8c27e868
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff8c27e8db
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff8c3fe2fd
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffff8c2c9a50
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff8c3fe503
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x163
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff8c3fe97e
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff8c3fead3
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff8c994f92
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [java:4442]
Modules linked in: vmsecmod(OE) tcp_lp tcp_diag udp_diag inet_diag binfmt_misc xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc nfit libnvdimm iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul glue_helper ablk_helper vmw_balloon cryptd pcspkr joydev sg parport_pc parport vmw_vmci i2c_piix4
ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix sd_mod crc_t10dif crct10dif_generic libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 vmw_pvscsi drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: vmsecmod]
CPU: 1 PID: 4442 Comm: java Tainted: G W OEL ------------ 3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff966989482100 ti: ffff966996fb0000 task.ti: ffff966996fb0000
RIP: 0010:[<ffffffff8c316e4a>] [<ffffffff8c316e4a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff966996fb3c70 EFLAGS: 00000202
RAX: 0000000000000002 RBX: 000800008c27e6a0 RCX: ffff9669bfca0600
RDX: 0000000000000002 RSI: 0000000000000008 RDI: 0000000000000000
RBP: ffff966996fb3ca8 R08: ffff9666f9f40800 R09: ffffffff8c586479
R10: ffff9669bfc5f160 R11: ffffe5e402c80600 R12: 0000000000000282
R13: 0000000000000282 R14: ffff966996fb3c20 R15: ffffffff8c22b621
FS: 00007fe0effff700(0000) GS:ffff9669bfc40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3207743280 CR3: 0000000409542000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8c27e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8c27e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff8c3fe2fd>] change_protection+0x5dd/0x680
[<ffffffff8c2c9a50>] ? hrtimer_get_res+0x50/0x50
[<ffffffff8c3fe503>] mprotect_fixup+0x163/0x3a0
[<ffffffff8c3fe97e>] do_mprotect_pkey+0x23e/0x380
[<ffffffff8c3fead3>] SyS_mprotect+0x13/0x20
[<ffffffff8c994f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 de 86 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 f5 8c f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ad 86 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #432973
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff9791173a
Build id: 3.10.0-957.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9787a598
Build id: 3.10.0-957.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9787a608
Build id: 3.10.0-957.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffff979f404d
Build id: 3.10.0-957.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffff978c57e0
Build id: 3.10.0-957.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff979f4262
Build id: 3.10.0-957.el7.x86_64
|
0x162
|
|
7
|
|
vmlinux |
0xffffffff97a3e008
Build id: 3.10.0-957.el7.x86_64
|
0x198
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffff979f46b2
Build id: 3.10.0-957.el7.x86_64
|
0x252
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffff979f47d3
Build id: 3.10.0-957.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffff97f74ddb
Build id: 3.10.0-957.el7.x86_64
|
0x22
|
|
11
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffff97f74d21
Build id: 3.10.0-957.el7.x86_64
|
0xae
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 44s! [java:7346]
Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ip_set bridge stp llc udp_diag unix_diag af_packet_diag netlink_diag tcp_diag inet_diag binfmt_misc nfnetlink_queue nfnetlink_log nfnetlink bluetooth rfkill ext4 mbcache jbd2 ppdev sg joydev virtio_balloon parport_pc parport i2c_piix4 pcspkr xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_console virtio_scsi virtio_blk cirrus drm_kms_helper floppy serio_raw syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata virtio_pci virtio_ring drm_panel_orientation_quirks virtio dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
CPU: 2 PID: 7346 Comm: java Kdump: loaded Tainted: G L ------------ 3.10.0-957.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff97bf59c09040 ti: ffff97b867410000 task.ti: ffff97b867410000
RIP: 0010:[<ffffffff9791173a>] [<ffffffff9791173a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff97b867413c70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 000800009787a3d0 RCX: ffff97bf5ce1fba8
RDX: 0000000000000000 RSI: 00000000000000a0 RDI: 0000000000000000
RBP: ffff97b867413ca8 R08: ffff97b8b44abc00 R09: ffffffff97b755c9
R10: ffff97bf5ce9f160 R11: fffff753041e6600 R12: 0000000000000282
R13: 0000000000000282 R14: ffff97b867413c20 R15: ffffffff9782a621
FS: 00007ff6c35f5700(0000) GS:ffff97bf5ce80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4c5e079000 CR3: 0000000036728000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9787a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9787a608>] flush_tlb_mm_range+0x68/0x140
[<ffffffff979f404d>] change_protection+0x5cd/0x680
[<ffffffff978c57e0>] ? hrtimer_get_res+0x50/0x50
[<ffffffff979f4262>] mprotect_fixup+0x162/0x360
[<ffffffff97a3e008>] ? __check_object_size+0x198/0x250
[<ffffffff979f46b2>] do_mprotect_pkey+0x252/0x360
[<ffffffff979f47d3>] SyS_mprotect+0x13/0x20
[<ffffffff97f74ddb>] system_call_fastpath+0x22/0x27
[<ffffffff97f74d21>] ? system_call_after_swapgs+0xae/0x146
Code: 48 63 35 4e 83 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 b9 54 98 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 1d 83 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #391935
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffa27170da
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffa267e258
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffa267e2cb
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffa27feaed
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffffa26c9aa0
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffa27fecf3
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffffa27dedab
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0xeb
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffffa27ff16e
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x23e
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffffa27ff2c3
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffffa2d99f92
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [VM Thread:71001]
Modules linked in: nfnetlink_queue nfnetlink_log bluetooth rfkill veth vxlan ip6_udp_tunnel udp_tunnel xt_statistic xt_nat ipt_REJECT nf_reject_ipv4 nf_tables ip_set ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs ip6table_mangle ip6t_MASQUERADE nf_nat_masquerade_ipv6 ip6table_filter iptable_mangle ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables xt_comment xt_mark xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc ipmi_devintf ipmi_msghandler nfs fscache overlay(T) vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event snd_ens1371 iosf_mbi snd_rawmidi crc32_pclmul snd_ac97_codec ghash_clmulni_intel ac97_bus aesni_intel
lrw gf128mul snd_seq glue_helper ablk_helper cryptd snd_seq_device snd_pcm ppdev snd_timer snd soundcore sg joydev pcspkr vmw_balloon parport_pc parport i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix crct10dif_pclmul crct10dif_common drm libata crc32c_intel serio_raw e1000 nfit mptspi scsi_transport_spi libnvdimm mptscsih drm_panel_orientation_quirks mptbase dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 3 PID: 71001 Comm: VM Thread Kdump: loaded Tainted: G ------------ T 3.10.0-1160.59.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff93f26ab88000 ti: ffff93f2a04a4000 task.ti: ffff93f2a04a4000
RIP: 0010:[<ffffffffa27170da>] [<ffffffffa27170da>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff93f2a04a7c70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00080000a267ddd0 RCX: ffff93f2f9420650
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff93f2a04a7ca8 R08: ffff93f2bb98b800 R09: ffffffffa2986c09
R10: ffff93f2f94df160 R11: fffffb5f46dcca00 R12: 0000000000000282
R13: 0000000000000018 R14: ffff93f2a04a7be0 R15: 0000000000000282
FS: 00007febb91db700(0000) GS:ffff93f2f94c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000001005ea118 CR3: 0000000161bee000 CR4: 00000000003607e0
Call Trace:
[<ffffffffa267e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa267e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa27feaed>] change_protection+0x5dd/0x680
[<ffffffffa26c9aa0>] ? hrtimer_get_res+0x50/0x50
[<ffffffffa27fecf3>] mprotect_fixup+0x163/0x3a0
[<ffffffffa27dedab>] ? vm_mmap_pgoff+0xeb/0x120
[<ffffffffa27ff16e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffa27ff2c3>] SyS_mprotect+0x13/0x20
[<ffffffffa2d99f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 ce 88 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 18 35 a3 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 88 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #387001
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffa5511a0a
Build id: 3.10.0-957.12.2.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffa547a628
Build id: 3.10.0-957.12.2.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffa547a698
Build id: 3.10.0-957.12.2.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffffa55f45dd
Build id: 3.10.0-957.12.2.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffa55f47f2
Build id: 3.10.0-957.12.2.el7.x86_64
|
0x162
|
|
6
|
do_mprotect_pkey
|
vmlinux |
0xffffffffa55f4c42
Build id: 3.10.0-957.12.2.el7.x86_64
|
0x252
|
|
7
|
SyS_mprotect
|
vmlinux |
0xffffffffa55f4d63
Build id: 3.10.0-957.12.2.el7.x86_64
|
0x13
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffffa5b75ddb
Build id: 3.10.0-957.12.2.el7.x86_64
|
0x22
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [node:20604]
Modules linked in: cdc_acm tcp_lp fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmhgfs(OE) vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ppdev snd_ens1371 iosf_mbi crc32_pclmul snd_rawmidi ghash_clmulni_intel snd_ac97_codec aesni_intel ac97_bus lrw gf128mul snd_seq glue_helper ablk_helper cryptd snd_seq_device snd_pcm
snd_timer vmw_balloon snd soundcore pcspkr joydev sg parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel ata_generic pata_acpi serio_raw vmwgfx drm_kms_helper syscopyarea e1000 sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata mptspi scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 20604 Comm: node Kdump: loaded Tainted: G OE ------------ 3.10.0-957.12.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff980c85aa6180 ti: ffff980c692f0000 task.ti: ffff980c692f0000
RIP: 0010:[<ffffffffa5511a0a>] [<ffffffffa5511a0a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff980c692f3c70 EFLAGS: 00000202
RAX: 0000000000000002 RBX: 00080000a547a460 RCX: ffff980cb56a0490
RDX: 0000000000000002 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff980c692f3ca8 R08: ffff980bfc85b400 R09: ffffffffa5775d69
R10: ffff980cb565f160 R11: fffff3ba8835de00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff980c692f3c20 R15: 00000000a542a621
FS: 00007fc62c71d780(0000) GS:ffff980cb5640000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00002b677b872000 CR3: 0000000209a2c000 CR4: 00000000003607e0
Call Trace:
[<ffffffffa547a628>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa547a698>] flush_tlb_mm_range+0x68/0x140
[<ffffffffa55f45dd>] change_protection+0x5cd/0x680
[<ffffffffa55f47f2>] mprotect_fixup+0x162/0x360
[<ffffffffa55f4c42>] do_mprotect_pkey+0x252/0x360
[<ffffffffa55f4d63>] SyS_mprotect+0x13/0x20
[<ffffffffa5b75ddb>] system_call_fastpath+0x22/0x27
Code: 48 63 35 7e 83 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 bc 14 a6 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 4d 83 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #381711
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff8311173a
Build id: 3.10.0-957.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff8307a598
Build id: 3.10.0-957.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff8307a608
Build id: 3.10.0-957.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffff831f404d
Build id: 3.10.0-957.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffff830c57e0
Build id: 3.10.0-957.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff831f4262
Build id: 3.10.0-957.el7.x86_64
|
0x162
|
|
7
|
|
vmlinux |
0xffffffff830e00bc
Build id: 3.10.0-957.el7.x86_64
|
0x14c
|
|
8
|
|
vmlinux |
0xffffffff8302a621
Build id: 3.10.0-957.el7.x86_64
|
0x151
|
|
9
|
do_mprotect_pkey
|
vmlinux |
0xffffffff831f46b2
Build id: 3.10.0-957.el7.x86_64
|
0x252
|
|
10
|
SyS_mprotect
|
vmlinux |
0xffffffff831f47d3
Build id: 3.10.0-957.el7.x86_64
|
0x13
|
|
11
|
system_call_fastpath
|
vmlinux |
0xffffffff83774ddb
Build id: 3.10.0-957.el7.x86_64
|
0x22
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [java:5611]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc sb_edac coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops floppy ttm libata mptspi drm vmxnet3 scsi_transport_spi
mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 5611 Comm: java Not tainted 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff8ccc24541040 ti: ffff8ccc245ec000 task.ti: ffff8ccc245ec000
RIP: 0010:[<ffffffff8311173a>] [<ffffffff8311173a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8ccc245efc70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 000c00008307a3d0 RCX: ffff8ccc3fc1fd98
RDX: 0000000000000000 RSI: 0000000000000004 RDI: 0000000000000000
RBP: ffff8ccc245efca8 R08: ffff8ccc3e9dd400 R09: ffffffff833755c9
R10: ffff8ccc3fc9f160 R11: ffffd90b81dd3100 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8ccc245efc20 R15: ffffffff8302a621
FS: 00007fcf2f7f7700(0000) GS:ffff8ccc3fc80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f51fc034098 CR3: 00000000786d6000 CR4: 00000000001607e0
Call Trace:
[<ffffffff8307a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8307a608>] flush_tlb_mm_range+0x68/0x140
[<ffffffff831f404d>] change_protection+0x5cd/0x680
[<ffffffff830c57e0>] ? hrtimer_get_res+0x50/0x50
[<ffffffff831f4262>] mprotect_fixup+0x162/0x360
[<ffffffff830e00bc>] ? update_curr+0x14c/0x1e0
[<ffffffff8302a621>] ? __switch_to+0x151/0x580
[<ffffffff831f46b2>] do_mprotect_pkey+0x252/0x360
[<ffffffff831f47d3>] SyS_mprotect+0x13/0x20
[<ffffffff83774ddb>] system_call_fastpath+0x22/0x27
Code: 48 63 35 4e 83 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 b9 d4 83 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 1d 83 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #377409
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffba5170da
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffba47e258
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffba47e2cb
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffba5feaed
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffffba4c9aa0
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffba5fecf3
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffffbab94678
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x238
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffffba5ff16e
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x23e
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffffba5ff2c3
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffffbab99f92
Build id: 3.10.0-1160.59.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [VM Thread:1759]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13109(E) falcon_lsm_pinned_13005(E) binfmt_misc xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack xt_CHECKSUM iptable_mangle ext4 mbcache jbd2 snd_hda_codec_generic snd_hda_intel iosf_mbi crc32_pclmul ghash_clmulni_intel snd_hda_codec joydev aesni_intel lrw gf128mul snd_hda_core snd_hwdep snd_seq glue_helper iTCO_wdt snd_seq_device ablk_helper cryptd ppdev iTCO_vendor_support snd_pcm snd_timer snd pcspkr soundcore virtio_rng parport_pc lpc_ich i2c_i801 parport virtio_balloon nfsd auth_rpcgss
nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c virtio_console virtio_blk qxl ahci virtio_net net_failover failover drm_kms_helper libahci syscopyarea sysfillrect sysimgblt libata fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm crc32c_intel serio_raw virtio_pci virtio_ring virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: falcon_kal]
CPU: 1 PID: 1759 Comm: VM Thread Kdump: loaded Tainted: P EL ------------ 3.10.0-1160.59.1.el7.x86_64 #1
Hardware name: Red Hat KVM/RHEL-AV, BIOS 1.13.0-2.module+el8.3.0+7860+a7792d29 04/01/2014
task: ffffa08f739ad280 ti: ffffa08f74be8000 task.ti: ffffa08f74be8000
RIP: 0010:[<ffffffffba5170da>] [<ffffffffba5170da>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffffa08f74bebc70 EFLAGS: 00000202
RAX: 0000000000000002 RBX: 00080000ba47ddd0 RCX: ffffa08f7fd20320
RDX: 0000000000000002 RSI: 0000000000000004 RDI: 0000000000000000
RBP: ffffa08f74bebca8 R08: ffffa08e7aec1800 R09: ffffffffba786c09
R10: ffffa08f7fc9f160 R11: fffffcc907865f00 R12: 0000000000000282
R13: 0000000000000282 R14: ffffa08f74bebc20 R15: 0000000000000001
FS: 00007fb40cdfd700(0000) GS:ffffa08f7fc80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c001845000 CR3: 0000000275282000 CR4: 00000000001606e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffba47e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffba47e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffba5feaed>] change_protection+0x5dd/0x680
[<ffffffffba4c9aa0>] ? hrtimer_get_res+0x50/0x50
[<ffffffffba5fecf3>] mprotect_fixup+0x163/0x3a0
[<ffffffffbab94678>] ? __do_page_fault+0x238/0x500
[<ffffffffba5ff16e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffba5ff2c3>] SyS_mprotect+0x13/0x20
[<ffffffffbab99f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 ce 88 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 18 15 bb f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 88 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #372883
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffae116dda
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffae07e868
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffae07e8db
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffae1fe29d
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffae1fe4a3
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffffae156f9b
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x5b
|
|
7
|
|
vmlinux |
0xffffffffae02b981
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x4b1
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffffae1fe91e
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x23e
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffffae1fea73
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x13
|
|
10
|
tracesys
|
vmlinux |
0xffffffffae796226
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0xa6
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [java:3595]
Modules linked in: veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter overlay(T) vmw_vsock_vmci_transport vsock bnep sunrpc snd_seq_midi snd_seq_midi_event ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel btusb snd_ens1371 btrtl vmw_balloon btbcm btintel lrw gf128mul glue_helper ablk_helper bluetooth snd_rawmidi cryptd snd_ac97_codec ac97_bus snd_seq snd_seq_device joydev pcspkr snd_pcm rfkill snd_timer sg snd soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod
cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm nfit ata_piix serio_raw libnvdimm libata mptspi e1000 scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 4 PID: 3595 Comm: java Kdump: loaded Tainted: G ------------ T 3.10.0-1160.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff8ed040434200 ti: ffff8ed021d94000 task.ti: ffff8ed021d94000
RIP: 0010:[<ffffffffae116dda>] [<ffffffffae116dda>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8ed021d97c70 EFLAGS: 00000202
RAX: 0000000000000001 RBX: 00080000ae07e6a0 RCX: ffff8ed07b660600
RDX: 0000000000000001 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff8ed021d97ca8 R08: ffff8ed0777dbc00 R09: ffffffffae386419
R10: ffff8ed07b71f160 R11: ffffdcd94045a600 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8ed021d97c20 R15: ffffffffae0593e2
FS: 00007fe13fefe700(0000) GS:ffff8ed07b700000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f42baed9ea0 CR3: 0000000017032000 CR4: 00000000003607e0
Call Trace:
[<ffffffffae07e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffae07e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffae1fe29d>] change_protection+0x5dd/0x680
[<ffffffffae1fe4a3>] mprotect_fixup+0x163/0x3a0
[<ffffffffae156f9b>] ? __seccomp_filter+0x5b/0x300
[<ffffffffae02b981>] ? __switch_to+0x4b1/0x580
[<ffffffffae1fe91e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffae1fea73>] SyS_mprotect+0x13/0x20
[<ffffffffae796226>] tracesys+0xa6/0xcc
Code: 48 63 35 0e 89 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 15 d5 ae f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 dd 88 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #372641
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff87b07e3a
Build id: 3.10.0-862.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff87a77018
Build id: 3.10.0-862.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff87a77088
Build id: 3.10.0-862.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffff87bcf45d
Build id: 3.10.0-862.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff87bcf61c
Build id: 3.10.0-862.el7.x86_64
|
0x10c
|
|
6
|
do_mprotect_pkey
|
vmlinux |
0xffffffff87bcf9a2
Build id: 3.10.0-862.el7.x86_64
|
0x252
|
|
7
|
SyS_mprotect
|
vmlinux |
0xffffffff87bcfac3
Build id: 3.10.0-862.el7.x86_64
|
0x13
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffff8811f7d5
Build id: 3.10.0-862.el7.x86_64
|
0x1c
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [java:3912]
Modules linked in: tcp_lp fuse vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper snd_seq ablk_helper cryptd snd_seq_device snd_pcm snd_timer snd vmw_balloon soundcore nfit ppdev joydev pcspkr sg libnvdimm parport_pc parport shpchp i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm ata_piix mptspi crc32c_intel libata scsi_transport_spi e1000 mptscsih serio_raw mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 3912 Comm: java Kdump: loaded Tainted: G W L ------------ 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff9917b8b36eb0 ti: ffff99178fa38000 task.ti: ffff99178fa38000
RIP: 0010:[<ffffffff87b07e3a>] [<ffffffff87b07e3a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff99178fa3bcd0 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 0008000087a76e50 RCX: ffff9917fb61cd70
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff99178fa3bd08 R08: ffff9917fa6c3c00 R09: ffffffff87d4a3d9
R10: ffff9917fb6dbb00 R11: ffffd5f4403d1e00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff99178fa3bc80 R15: ffff99178fa3bca8
FS: 00007fc554924700(0000) GS:ffff9917fb6c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f6295a9fff0 CR3: 0000000077a04000 CR4: 00000000007607e0
PKRU: 55555554
Call Trace:
[<ffffffff87a77018>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff87a77088>] flush_tlb_mm_range+0x68/0x140
[<ffffffff87bcf45d>] change_protection+0x5cd/0x680
[<ffffffff87bcf61c>] mprotect_fixup+0x10c/0x240
[<ffffffff87bcf9a2>] do_mprotect_pkey+0x252/0x360
[<ffffffff87bcfac3>] SyS_mprotect+0x13/0x20
[<ffffffff8811f7d5>] system_call_fastpath+0x1c/0x21
Code: 48 63 35 8e b6 c3 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 53 73 88 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 5d b6 c3 00 eb b7 0f b6 4d cc 4c 89
Complete report #362375
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff81116a7e
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x20e
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff8107e478
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff8107e4eb
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff811fc4dd
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffff810c9e30
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff811fc6e3
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffff8102b621
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x151
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffff811fcb72
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x252
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffff811fcc93
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffff8178dede
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 24s! [VM Thread:24688]
Modules linked in: veth nf_tables vxlan ip6_udp_tunnel udp_tunnel xt_statistic xt_nat ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs xt_comment xt_mark nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink overlay sunrpc sb_edac coretemp ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr vmw_vmci sg parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic
ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul mptspi crct10dif_common crc32c_intel scsi_transport_spi serio_raw mptscsih libata mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 7 PID: 24688 Comm: VM Thread Kdump: loaded Tainted: G L ------------ 3.10.0-1062.12.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff9230ef3b9070 ti: ffff9230d27ec000 task.ti: ffff9230d27ec000
RIP: 0010:[<ffffffff81116a7e>] [<ffffffff81116a7e>] smp_call_function_many+0x20e/0x270
RSP: 0018:ffff9230d27efc70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 000800008107e2b0 RCX: ffff9231bfc206f0
RDX: 0000000000000000 RSI: 0000000000000008 RDI: 0000000000000000
RBP: ffff9230d27efca8 R08: ffff9222e96b0400 R09: ffffffff81381839
R10: ffff9231bfddf160 R11: ffffdb20c6d8f400 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9230d27efc20 R15: ffffffff8102b621
FS: 00007ff491e9b700(0000) GS:ffff9231bfdc0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fcfe72a5000 CR3: 0000000ff36ae000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8107e478>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8107e4eb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff811fc4dd>] change_protection+0x5cd/0x670
[<ffffffff810c9e30>] ? hrtimer_get_res+0x50/0x50
[<ffffffff811fc6e3>] mprotect_fixup+0x163/0x3a0
[<ffffffff8102b621>] ? __switch_to+0x151/0x580
[<ffffffff811fcb72>] do_mprotect_pkey+0x252/0x360
[<ffffffff811fcc93>] SyS_mprotect+0x13/0x20
[<ffffffff8178dede>] system_call_fastpath+0x25/0x2a
Code: 5e c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 20 e8 d4 81 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 f6 41 20 01 <75> f8 48 63 35 bd 5e c4 00 eb b7 0f b6 4d cc 4c 89 f2 4c 89 ee
Complete report #361783
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffa6d170da
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffa6c7e258
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffa6c7e2cb
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffa6dfeaed
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffa6dfecf3
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffffa7390678
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x238
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffffa6dff16e
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffffa6dff2c3
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffffa7395f92
Build id: 3.10.0-1160.53.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [VM Thread:1475]
Modules linked in: xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop overlay falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_13005(E) iptable_filter snd_hda_codec_generic snd_hda_intel snd_hda_codec snd_hda_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw snd_hwdep snd_seq gf128mul snd_seq_device snd_pcm glue_helper ablk_helper snd_timer cryptd ppdev snd pcspkr soundcore joydev i2c_piix4 parport_pc virtio_balloon parport ip_tables xfs libcrc32c ata_generic pata_acpi virtio_console virtio_blk qxl drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops ttm drm ata_piix libata e1000 virtio_pci crct10dif_pclmul crct10dif_common crc32c_intel virtio_ring floppy serio_raw virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 1475 Comm: VM Thread Kdump: loaded Tainted: P EL ------------ 3.10.0-1160.53.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
task: ffff9d8ab3e03180 ti: ffff9d8ab5eb0000 task.ti: ffff9d8ab5eb0000
RIP: 0010:[<ffffffffa6d170da>] [<ffffffffa6d170da>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9d8ab5eb3c70 EFLAGS: 00000202
RAX: 0000000000000001 RBX: 00080000a6c7ddd0 RCX: ffff9d8abfc60370
RDX: 0000000000000001 RSI: 0000000000000006 RDI: 0000000000000000
RBP: ffff9d8ab5eb3ca8 R08: ffff9d89faed9800 R09: ffffffffa6f86bf9
R10: ffff9d8abfcdf160 R11: ffffd47641b0f600 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9d8ab5eb3c20 R15: 0000000000000001
FS: 00007f27e0a1e700(0000) GS:ffff9d8abfcc0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5b5645f000 CR3: 00000000b89e6000 CR4: 00000000001606e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa6c7e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa6c7e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa6dfeaed>] change_protection+0x5dd/0x680
[<ffffffffa6dfecf3>] mprotect_fixup+0x163/0x3a0
[<ffffffffa7390678>] ? __do_page_fault+0x238/0x500
[<ffffffffa6dff16e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffa6dff2c3>] SyS_mprotect+0x13/0x20
[<ffffffffa7395f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 ce 85 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 15 95 a7 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 85 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #341595
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffadd16a7a
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffadc7e478
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffadc7e4eb
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffaddfc4dd
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffffadcc9e30
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffaddfc6e3
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffffae388678
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x238
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffffaddfcb72
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x252
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffffaddfcc93
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffffae38dede
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x25
|
|
11
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffffae38de21
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0xae
|
NMI watchdog: BUG: soft lockup - CPU#8 stuck for 22s! [java:107972]
Modules linked in: tcp_lp fuse kbase(OE) xt_NFQUEUE nfnetlink_log nfnetlink nfring(OE) vmsecmod(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat xt_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter nf_conntrack_ipv6 nf_defrag_ipv6 nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache sunrpc ppdev joydev virtio_balloon sg i2c_piix4 pcspkr parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_console virtio_net virtio_blk virtio_scsi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata virtio_pci virtio_ring serio_raw floppy virtio
drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod [last unloaded: vmsec_nfq]
CPU: 8 PID: 107972 Comm: java Kdump: loaded Tainted: GF OE ------------ 3.10.0-1062.12.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff9c2ab9b620e0 ti: ffff9c2cccb38000 task.ti: ffff9c2cccb38000
RIP: 0010:[<ffffffffadd16a7a>] [<ffffffffadd16a7a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9c2cccb3bc70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00080000adc7e2b0 RCX: ffff9c2cfce20518
RDX: 0000000000000000 RSI: 00000000000000a0 RDI: 0000000000000000
RBP: ffff9c2cccb3bca8 R08: ffff9c1e695dc800 R09: ffffffffadf81839
R10: ffff9c2cfd01f160 R11: fffff05487448600 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9c2cccb3bc20 R15: ffffffffadc2b621
FS: 00007fc73d77c700(0000) GS:ffff9c2cfd000000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f1c34001000 CR3: 0000000e6f212000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffadc7e478>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffadc7e4eb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffaddfc4dd>] change_protection+0x5cd/0x670
[<ffffffffadcc9e30>] ? hrtimer_get_res+0x50/0x50
[<ffffffffaddfc6e3>] mprotect_fixup+0x163/0x3a0
[<ffffffffae388678>] ? __do_page_fault+0x238/0x500
[<ffffffffaddfcb72>] do_mprotect_pkey+0x252/0x360
[<ffffffffaddfcc93>] SyS_mprotect+0x13/0x20
[<ffffffffae38dede>] system_call_fastpath+0x25/0x2a
[<ffffffffae38de21>] ? system_call_after_swapgs+0xae/0x146
Code: 48 63 35 ee 5e c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 20 e8 94 ae f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 bd 5e c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #302402
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffa6f1760a
Build id: 3.10.0-1127.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffa6e7e8f8
Build id: 3.10.0-1127.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffa6e7e96b
Build id: 3.10.0-1127.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffa6ffe1dd
Build id: 3.10.0-1127.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffa6ffe3e3
Build id: 3.10.0-1127.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffffa6e2b621
Build id: 3.10.0-1127.el7.x86_64
|
0x151
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffffa6ffe85e
Build id: 3.10.0-1127.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffffa6ffe9b3
Build id: 3.10.0-1127.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffffa7592ed2
Build id: 3.10.0-1127.el7.x86_64
|
0x25
|
|
10
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffffa7592e15
Build id: 3.10.0-1127.el7.x86_64
|
0xa2
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [gnome-shell:2142]
Modules linked in: xt_comment xt_mark xt_addrtype xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink sunrpc ppdev snd_intel8x0 snd_ac97_codec sb_edac ac97_bus snd_seq snd_seq_device snd_pcm snd_timer iosf_mbi crc32_pclmul snd ghash_clmulni_intel aesni_intel sg video soundcore lrw gf128mul parport_pc pcspkr parport i2c_piix4 glue_helper ablk_helper cryptd br_netfilter bridge stp llc overlay(T) ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci drm ata_piix libahci
libata e1000 crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 2142 Comm: gnome-shell Kdump: loaded Tainted: G ------------ T 3.10.0-1127.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff9389da8a5230 ti: ffff938b533a4000 task.ti: ffff938b533a4000
RIP: 0010:[<ffffffffa6f1760a>] [<ffffffffa6f1760a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff938b533a7c70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00080000a6e7e730 RCX: ffff938b5e420320
RDX: 0000000000000000 RSI: 0000000000000006 RDI: 0000000000000000
RBP: ffff938b533a7ca8 R08: ffff938a7bf11000 R09: ffffffffa7185099
R10: ffff938b5e45f160 R11: ffffc6bec2c02100 R12: 0000000000000282
R13: 0000000000000282 R14: ffff938b533a7c20 R15: ffff938b533a7bf0
FS: 00007f65e5498a80(0000) GS:ffff938b5e440000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ff143db1e40 CR3: 00000000d6046000 CR4: 00000000000606e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa6e7e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa6e7e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa6ffe1dd>] change_protection+0x5cd/0x670
[<ffffffffa6ffe3e3>] mprotect_fixup+0x163/0x3a0
[<ffffffffa6e2b621>] ? __switch_to+0x151/0x580
[<ffffffffa6ffe85e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffa6ffe9b3>] SyS_mprotect+0x13/0x20
[<ffffffffa7592ed2>] system_call_fastpath+0x25/0x2a
[<ffffffffa7592e15>] ? system_call_after_swapgs+0xa2/0x13a
Code: 48 63 35 1e 7b c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 0f b5 a7 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ed 7a c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #268920
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff86f16e4a
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff86e7e868
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff86e7e8db
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff86ffe2fd
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffff86ec9a50
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff86ffe503
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x163
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff86ffe97e
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff86ffead3
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff87594f92
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [VM Thread:6544]
Modules linked in: bmhook(OE) tcp_lp dsa_filter(POE) dsa_filter_hook(OE) gsch(OE) redirfs(OE) tmhook(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 ppdev sb_edac vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr
sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul nfit crct10dif_common crc32c_intel mptspi libata scsi_transport_spi libnvdimm mptscsih serio_raw mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse [last unloaded: bmhook]
CPU: 5 PID: 6544 Comm: VM Thread Kdump: loaded Tainted: P OEL ------------ 3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff89c4afbf8000 ti: ffff89c43dd20000 task.ti: ffff89c43dd20000
RIP: 0010:[<ffffffff86f16e4a>] [<ffffffff86f16e4a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff89c43dd23c70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 0008000086e7e6a0 RCX: ffff89c50d6206a0
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff89c43dd23ca8 R08: ffff89ba21bac000 R09: ffffffff87186479
R10: ffff89c50d75f160 R11: fffffd2767e51c00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff89c43dd23c20 R15: ffffffff86e2b621
FS: 00007f1d50466700(0000) GS:ffff89c50d740000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f561bf0e000 CR3: 00000001783fa000 CR4: 00000000003607e0
Call Trace:
[<ffffffff86e7e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff86e7e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff86ffe2fd>] change_protection+0x5dd/0x680
[<ffffffff86ec9a50>] ? hrtimer_get_res+0x50/0x50
[<ffffffff86ffe503>] mprotect_fixup+0x163/0x3a0
[<ffffffff86ffe97e>] do_mprotect_pkey+0x23e/0x380
[<ffffffff86ffead3>] SyS_mprotect+0x13/0x20
[<ffffffff87594f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 de 86 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 b5 87 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ad 86 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #259762
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff96516e4a
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9647e868
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9647e8db
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff965fe2fd
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff965fe503
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffff96b8f678
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x238
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff965fe97e
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff965fead3
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff96b94f92
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 45s! [VM Thread:6573]
Modules linked in: ip6table_mangle ip6table_raw ip6table_nat nf_nat_ipv6 nf_conntrack_ipv6 nf_defrag_ipv6 nf_log_ipv6 nf_log_ipv4 nf_log_common xt_CHECKSUM nf_nat_ftp ipt_MASQUERADE xt_REDIRECT nf_nat_masquerade_ipv4 nf_nat_redirect iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ftp nf_conntrack_ipv4 xt_LOG nf_defrag_ipv4 xt_conntrack xt_limit nf_conntrack xt_multiport libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_mangle iptable_raw iptable_filter ipmi_devintf ipmi_msghandler sunrpc dm_mirror dm_region_hash dm_log dm_mod sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev aesni_intel sg lrw gf128mul glue_helper ablk_helper pcspkr joydev cryptd virtio_balloon parport_pc parport i2c_piix4 ip_tables ext4 mbcache
jbd2 sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi virtio_net net_failover virtio_scsi failover vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata crct10dif_pclmul crct10dif_common virtio_pci crc32c_intel virtio_ring serio_raw virtio drm_panel_orientation_quirks floppy fuse
CPU: 0 PID: 6573 Comm: VM Thread Kdump: loaded Tainted: G L ------------ 3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.12.1-0-ga5cab58e9a3f-prebuilt.qemu.org 04/01/2014
task: ffff9cce65fd9080 ti: ffff9cd05ada8000 task.ti: ffff9cd05ada8000
RIP: 0010:[<ffffffff96516e4a>] [<ffffffff96516e4a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9cd05adabc70 EFLAGS: 00000202
RAX: 0000000000000004 RBX: 000800009647e6a0 RCX: ffff9cd13fd1fc10
RDX: 0000000000000004 RSI: 0000000000000006 RDI: 0000000000000000
RBP: ffff9cd05adabca8 R08: ffff9cce7fd4f800 R09: ffffffff96786479
R10: ffff9cd13fc1f160 R11: fffff0b60a0f1800 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9cd05adabc20 R15: ffffffff9642b621
FS: 00007fccb81fd700(0000) GS:ffff9cd13fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fcc19fa8a28 CR3: 00000001617da000 CR4: 0000000000360ff0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff9647e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9647e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff965fe2fd>] change_protection+0x5dd/0x680
[<ffffffff965fe503>] mprotect_fixup+0x163/0x3a0
[<ffffffff96b8f678>] ? __do_page_fault+0x238/0x500
[<ffffffff965fe97e>] do_mprotect_pkey+0x23e/0x380
[<ffffffff965fead3>] SyS_mprotect+0x13/0x20
[<ffffffff96b94f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 de 86 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 15 97 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ad 86 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #258538
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff9bb1761a
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9ba7e8f8
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9ba7e96b
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff9bbfe26d
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffff9baca2d0
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff9bbfe473
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffff9bbde63b
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xeb
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffff9bbfe8ee
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x23e
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffff9bbfea43
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffff9c192ed2
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x25
|
|
11
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffff9c192e15
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xa2
|
NMI watchdog: BUG: soft lockup - CPU#17 stuck for 22s! [VM Thread:2918]
Modules linked in: dcdbas xt_nat veth nf_conntrack_netlink nfnetlink br_netfilter bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop overlay vmw_vsock_vmci_transport vsock xt_comment xt_conntrack iptable_filter ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_addrtype iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack ext4 mbcache jbd2 sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel ppdev lrw gf128mul vmw_balloon glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc vmw_vmci i2c_piix4 parport binfmt_misc auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul ata_piix crct10dif_common
drm crc32c_intel libata mptspi nfit scsi_transport_spi serio_raw mptscsih e1000 libnvdimm mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 17 PID: 2918 Comm: VM Thread Kdump: loaded Tainted: G L ------------ 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8c63fad7a0e0 ti: ffff8c63c6cd8000 task.ti: ffff8c63c6cd8000
RIP: 0010:[<ffffffff9bb1761a>] [<ffffffff9bb1761a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8c63c6cdbc70 EFLAGS: 00000202
RAX: 0000000000000012 RBX: ffffffff9ba7e730 RCX: ffff8c63ff4a0880
RDX: 0000000000000012 RSI: 0000000000000014 RDI: 0000000000000000
RBP: ffff8c63c6cdbca8 R08: ffff8c55697b9c00 R09: ffffffff9bd851b9
R10: ffff8c63ff45f160 R11: fffff114bb038c00 R12: 0000000000000286
R13: ffff8c63c6cdbc20 R14: ffff8c63ff440000 R15: ffffffff9ba2b621
FS: 00007fbf6dfdf700(0000) GS:ffff8c63ff440000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb6576f21b8 CR3: 0000000fc6cdc000 CR4: 00000000000407e0
Call Trace:
[<ffffffff9ba7e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9ba7e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9bbfe26d>] change_protection+0x5dd/0x680
[<ffffffff9baca2d0>] ? hrtimer_get_res+0x50/0x50
[<ffffffff9bbfe473>] mprotect_fixup+0x163/0x3a0
[<ffffffff9bbde63b>] ? vm_mmap_pgoff+0xeb/0x120
[<ffffffff9bbfe8ee>] do_mprotect_pkey+0x23e/0x380
[<ffffffff9bbfea43>] SyS_mprotect+0x13/0x20
[<ffffffff9c192ed2>] system_call_fastpath+0x25/0x2a
[<ffffffff9c192e15>] ? system_call_after_swapgs+0xa2/0x13a
Code: 48 63 35 ce 7b c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 10 75 9c f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 7b c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #247117
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff86107e3a
Build id: 3.10.0-862.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff86077018
Build id: 3.10.0-862.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff86077088
Build id: 3.10.0-862.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffff861cf45d
Build id: 3.10.0-862.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff861cf61c
Build id: 3.10.0-862.el7.x86_64
|
0x10c
|
|
6
|
do_mprotect_pkey
|
vmlinux |
0xffffffff861cf9a2
Build id: 3.10.0-862.el7.x86_64
|
0x252
|
|
7
|
SyS_mprotect
|
vmlinux |
0xffffffff861cfac3
Build id: 3.10.0-862.el7.x86_64
|
0x13
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffff8671f7d5
Build id: 3.10.0-862.el7.x86_64
|
0x1c
|
|
9
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffff8671f721
Build id: 3.10.0-862.el7.x86_64
|
0xae
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [java:6730]
Modules linked in: gsch(OE) redirfs(OE) dsa_filter(POE) binfmt_misc sunrpc ext4 mbcache jbd2 ppdev sg joydev pcspkr virtio_balloon parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_console virtio_net virtio_scsi virtio_blk cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata serio_raw virtio_pci i2c_core floppy virtio_ring virtio dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 6730 Comm: java Kdump: loaded Tainted: P OEL ------------ 3.10.0-862.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff9f0741f00000 ti: ffff9f07b44dc000 task.ti: ffff9f07b44dc000
RIP: 0010:[<ffffffff86107e3a>] [<ffffffff86107e3a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9f07b44dfcd0 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 0008000086076e50 RCX: ffff9f0aa0c1cc20
RDX: 0000000000000000 RSI: 0000000000000028 RDI: 0000000000000000
RBP: ffff9f07b44dfd08 R08: ffff9f0474d70400 R09: ffffffff8634a3d9
R10: ffff9f0aa0cdbb00 R11: ffffe4c2416ad200 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9f07b44dfc80 R15: ffff9f07b44dfca8
FS: 00007f81976f6700(0000) GS:ffff9f0aa0cc0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5bd8e92fe8 CR3: 000000016221e000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff86077018>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff86077088>] flush_tlb_mm_range+0x68/0x140
[<ffffffff861cf45d>] change_protection+0x5cd/0x680
[<ffffffff861cf61c>] mprotect_fixup+0x10c/0x240
[<ffffffff861cf9a2>] do_mprotect_pkey+0x252/0x360
[<ffffffff861cfac3>] SyS_mprotect+0x13/0x20
[<ffffffff8671f7d5>] system_call_fastpath+0x1c/0x21
[<ffffffff8671f721>] ? system_call_after_swapgs+0xae/0x146
Code: 48 63 35 8e b6 c3 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 53 d3 86 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 5d b6 c3 00 eb b7 0f b6 4d cc 4c 89
Complete report #224042
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffb1116c5a
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffb107e868
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffb107e8db
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffb11fe15d
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffb11fe363
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffffb124a73a
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x1ca
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffffb11fe7de
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffffb11fe933
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffffb1794f92
Build id: 3.10.0-1160.6.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [gnome-shell:92474]
Modules linked in: tcp_lp xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd pcspkr sg joydev vmw_balloon parport_pc parport snd_seq_midi snd_seq_midi_event snd_ens1371
snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd soundcore vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel drm ata_piix serio_raw nfit libata libnvdimm e1000 mptspi scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks fuse
CPU: 1 PID: 92474 Comm: gnome-shell Kdump: loaded Tainted: G W L ------------ 3.10.0-1160.6.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffffa0dc3dd21080 ti: ffffa0dbeb1dc000 task.ti: ffffa0dbeb1dc000
RIP: 0010:[<ffffffffb1116c5a>] [<ffffffffb1116c5a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffffa0dbeb1dfc70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00080000b107e6a0 RCX: ffffa0dc6d620600
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffffa0dbeb1dfca8 R08: ffffa0d9ba74b000 R09: ffffffffb1385fd9
R10: ffffa0dc6d65f160 R11: ffffea92d0025e00 R12: 0000000000000282
R13: 0000000000000282 R14: ffffa0dbeb1dfc20 R15: ffffffffb102b621
FS: 00007f66f8689a80(0000) GS:ffffa0dc6d640000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000056198bb60948 CR3: 00000000ae24a000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffb107e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb107e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb11fe15d>] change_protection+0x5dd/0x680
[<ffffffffb11fe363>] mprotect_fixup+0x163/0x3a0
[<ffffffffb124a73a>] ? __check_object_size+0x1ca/0x250
[<ffffffffb11fe7de>] do_mprotect_pkey+0x23e/0x380
[<ffffffffb11fe933>] SyS_mprotect+0x13/0x20
[<ffffffffb1794f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 ce 88 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 d5 b1 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 88 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #220425
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffa29170ba
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffa287e258
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffa287e2cb
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffa29feacd
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffa29fecd3
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffffa295727b
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x5b
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffffa29ff14e
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffffa29ff2a3
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0x13
|
|
9
|
tracesys
|
vmlinux |
0xffffffffa2f96226
Build id: 3.10.0-1160.36.2.el7.x86_64
|
0xa6
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [Web Content:36841]
Modules linked in: tun xt_hl ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event ppdev crc32_pclmul vmw_balloon ghash_clmulni_intel snd_ens1371 snd_rawmidi snd_ac97_codec aesni_intel ac97_bus lrw gf128mul glue_helper ablk_helper snd_seq cryptd snd_seq_device snd_pcm joydev pcspkr snd_timer snd sg soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables
xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops crct10dif_pclmul ttm crct10dif_common crc32c_intel ata_piix drm libata nfit mptspi e1000 serio_raw scsi_transport_spi libnvdimm mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 36841 Comm: Web Content Tainted: G W L ------------ 3.10.0-1160.36.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff91e4486f0000 ti: ffff91e3db8c8000 task.ti: ffff91e3db8c8000
RIP: 0010:[<ffffffffa29170ba>] [<ffffffffa29170ba>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff91e3db8cbc70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00080000a287ddd0 RCX: ffff91e45d6204d0
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff91e3db8cbca8 R08: ffff91ddac553800 R09: ffffffffa2b86ba9
R10: ffff91e45d65f160 R11: fffffa105065be00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff91e3db8cbc20 R15: 0000000000000040
FS: 00007f5ff8ef0780(0000) GS:ffff91e45d640000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5fd17b1000 CR3: 00000004196f6000 CR4: 00000000000007e0
Call Trace:
[<ffffffffa287e258>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa287e2cb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa29feacd>] change_protection+0x5dd/0x680
[<ffffffffa29fecd3>] mprotect_fixup+0x163/0x3a0
[<ffffffffa295727b>] ? __seccomp_filter+0x5b/0x300
[<ffffffffa29ff14e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffa29ff2a3>] SyS_mprotect+0x13/0x20
[<ffffffffa2f96226>] tracesys+0xa6/0xcc
Code: 48 63 35 ee 85 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 15 55 a3 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 bd 85 c4 00 eb b7 0f b6 4d cc 4c 89
[drm:drm_atomic_helper_wait_for_dependencies [drm_kms_helper]] *ERROR* [CRTC:37:crtc-0] flip_done timed out
Complete report #211181
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffab11760a
Build id: 3.10.0-1127.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffab07e8f8
Build id: 3.10.0-1127.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffab07e96b
Build id: 3.10.0-1127.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffab1fe1dd
Build id: 3.10.0-1127.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffffab0ca2d0
Build id: 3.10.0-1127.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffab1fe3e3
Build id: 3.10.0-1127.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffffab0d53fe
Build id: 3.10.0-1127.el7.x86_64
|
0x4e
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffffab1fe85e
Build id: 3.10.0-1127.el7.x86_64
|
0x23e
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffffab1fe9b3
Build id: 3.10.0-1127.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffffab792ed2
Build id: 3.10.0-1127.el7.x86_64
|
0x25
|
|
11
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffffab792e15
Build id: 3.10.0-1127.el7.x86_64
|
0xa2
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [VM Thread:1736]
Modules linked in: xt_comment xt_mark xt_addrtype xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter sunrpc snd_intel8x0 snd_ac97_codec ac97_bus sb_edac ppdev snd_seq sg snd_seq_device snd_pcm iosf_mbi snd_timer crc32_pclmul parport_pc snd ghash_clmulni_intel parport video soundcore i2c_piix4 aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr br_netfilter bridge stp llc overlay(T) ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci ata_piix
e1000 libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 1736 Comm: VM Thread Kdump: loaded Tainted: G L ------------ T 3.10.0-1127.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff8a380eb9a0e0 ti: ffff8a380c748000 task.ti: ffff8a380c748000
RIP: 0010:[<ffffffffab11760a>] [<ffffffffab11760a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8a380c74bc70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00080000ab07e730 RCX: ffff8a380f0203c0
RDX: 0000000000000000 RSI: 000000000000000a RDI: 0000000000000000
RBP: ffff8a380c74bca8 R08: ffff8a357a2fd000 R09: ffffffffab385099
R10: ffff8a380f29f160 R11: ffffe8e700a14e00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8a380c74bc20 R15: ffffffffab02b621
FS: 00007f2e4cf75700(0000) GS:ffff8a380f280000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c421825000 CR3: 0000000034d16000 CR4: 00000000000606e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffab07e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffab07e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffab1fe1dd>] change_protection+0x5cd/0x670
[<ffffffffab0ca2d0>] ? hrtimer_get_res+0x50/0x50
[<ffffffffab1fe3e3>] mprotect_fixup+0x163/0x3a0
[<ffffffffab0d53fe>] ? finish_task_switch+0x4e/0x1c0
[<ffffffffab1fe85e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffab1fe9b3>] SyS_mprotect+0x13/0x20
[<ffffffffab792ed2>] system_call_fastpath+0x25/0x2a
[<ffffffffab792e15>] ? system_call_after_swapgs+0xa2/0x13a
Code: 48 63 35 1e 7b c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 0f d5 ab f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ed 7a c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #210147
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffa591185a
Build id: 3.10.0-957.10.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffa587a5c8
Build id: 3.10.0-957.10.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffa587a638
Build id: 3.10.0-957.10.1.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffffa59f44dd
Build id: 3.10.0-957.10.1.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffa59f46f2
Build id: 3.10.0-957.10.1.el7.x86_64
|
0x162
|
|
6
|
|
vmlinux |
0xffffffffa5f70608
Build id: 3.10.0-957.10.1.el7.x86_64
|
0x228
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffffa59f4b42
Build id: 3.10.0-957.10.1.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffffa59f4c63
Build id: 3.10.0-957.10.1.el7.x86_64
|
0x13
|
|
9
|
tracesys
|
vmlinux |
0xffffffffa5f7605b
Build id: 3.10.0-957.10.1.el7.x86_64
|
0xa3
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [java:24344]
Modules linked in: tcp_diag inet_diag binfmt_misc rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace sunrpc fscache xt_nat veth ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntrack nf_nat nf_conntrack br_netfilter bridge stp llc overlay(T) ppdev ext4 mbcache jbd2 joydev pcspkr sg virtio_balloon parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic crct10dif_common sr_mod cdrom virtio_net virtio_scsi ata_generic pata_acpi bochs_drm drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm floppy serio_raw ata_piix libata virtio_pci virtio_ring virtio drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 24344 Comm: java Kdump: loaded Tainted: G ------------ T 3.10.0-957.10.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.13.0-0-gf21b5a4aeb02-prebuilt.qemu.org 04/01/2014
task: ffff881a51bcc100 ti: ffff8815dbd20000 task.ti: ffff8815dbd20000
RIP: 0010:[<ffffffffa591185a>] [<ffffffffa591185a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8815dbd23c70 EFLAGS: 00000202
RAX: 0000000000000002 RBX: 00080000a587a400 RCX: ffff881cffca0348
RDX: 0000000000000002 RSI: 0000000000000008 RDI: 0000000000000000
RBP: ffff8815dbd23ca8 R08: ffff8816344a0800 R09: ffffffffa5b75c99
R10: ffff881cffd5f160 R11: ffffd3aedf758200 R12: 0000000000000282
R13: 0000000000000018 R14: ffff8815dbd23be0 R15: 0000000000000282
FS: 00007f8c37fff700(0000) GS:ffff881cffd40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8b2b32a300 CR3: 00000004e6ff4000 CR4: 00000000000006e0
Call Trace:
[<ffffffffa587a5c8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa587a638>] flush_tlb_mm_range+0x68/0x140
[<ffffffffa59f44dd>] change_protection+0x5cd/0x680
[<ffffffffa59f46f2>] mprotect_fixup+0x162/0x360
[<ffffffffa5f70608>] ? __do_page_fault+0x228/0x500
[<ffffffffa59f4b42>] do_mprotect_pkey+0x252/0x360
[<ffffffffa59f4c63>] SyS_mprotect+0x13/0x20
[<ffffffffa5f7605b>] tracesys+0xa3/0xc9
Code: 48 63 35 6e 82 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 b9 54 a6 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 3d 82 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #197982
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff97f07e3a
Build id: 3.10.0-862.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff97e77018
Build id: 3.10.0-862.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff97e77088
Build id: 3.10.0-862.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffff97fcf45d
Build id: 3.10.0-862.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff97fcf61c
Build id: 3.10.0-862.el7.x86_64
|
0x10c
|
|
6
|
do_mprotect_pkey
|
vmlinux |
0xffffffff97fcf9a2
Build id: 3.10.0-862.el7.x86_64
|
0x252
|
|
7
|
SyS_mprotect
|
vmlinux |
0xffffffff97fcfac3
Build id: 3.10.0-862.el7.x86_64
|
0x13
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffff9851f7d5
Build id: 3.10.0-862.el7.x86_64
|
0x1c
|
|
9
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffff9851f721
Build id: 3.10.0-862.el7.x86_64
|
0xae
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 84s! [java:331]
Modules linked in: falcon_lsm_serviceable(PE) falcon_nf_netcontain(PE) falcon_kal(E) falcon_lsm_pinned_11711(E) falcon_lsm_pinned_11312(E) binfmt_misc arc4 md4 nls_utf8 cifs ccm dns_resolver vmw_vsock_vmci_transport vsock sb_edac iosf_mbi crc32_pclmul ext4 ghash_clmulni_intel aesni_intel lrw gf128mul mbcache glue_helper jbd2 ablk_helper cryptd ppdev vmw_balloon pcspkr joydev sg nfit parport_pc libnvdimm parport shpchp vmw_vmci i2c_piix4 auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata crct10dif_pclmul crct10dif_common mptspi scsi_transport_spi crc32c_intel mptscsih serio_raw mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash
dm_log dm_mod [last unloaded: falcon_kal]
CPU: 3 PID: 331 Comm: java Kdump: loaded Tainted: P EL ------------ 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff9b2b4a608000 ti: ffff9b39f93c0000 task.ti: ffff9b39f93c0000
RIP: 0010:[<ffffffff97f07e3a>] [<ffffffff97f07e3a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9b39f93c3cd0 EFLAGS: 00000202
RAX: 0000000000000001 RBX: 0008000097e76e50 RCX: ffff9b30cfa5ce48
RDX: 0000000000000001 RSI: 0000000000000018 RDI: 0000000000000000
RBP: ffff9b39f93c3d08 R08: ffff9b262d531400 R09: ffffffff9814a3d9
R10: ffff9b30cfadbb00 R11: ffffe836b521a800 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9b39f93c3c80 R15: ffff9b39f93c3ca8
FS: 00007f2f49018700(0000) GS:ffff9b30cfac0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb86d8cfb88 CR3: 0000001801378000 CR4: 00000000000607e0
Call Trace:
[<ffffffff97e77018>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff97e77088>] flush_tlb_mm_range+0x68/0x140
[<ffffffff97fcf45d>] change_protection+0x5cd/0x680
[<ffffffff97fcf61c>] mprotect_fixup+0x10c/0x240
[<ffffffff97fcf9a2>] do_mprotect_pkey+0x252/0x360
[<ffffffff97fcfac3>] SyS_mprotect+0x13/0x20
[<ffffffff9851f7d5>] system_call_fastpath+0x1c/0x21
[<ffffffff9851f721>] ? system_call_after_swapgs+0xae/0x146
Code: 48 63 35 8e b6 c3 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 53 b3 98 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 5d b6 c3 00 eb b7 0f b6 4d cc 4c 89
Complete report #195332
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff9b5150ca
Build id: 3.10.0-1062.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9b47d398
Build id: 3.10.0-1062.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9b47d40b
Build id: 3.10.0-1062.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff9b5fa5ad
Build id: 3.10.0-1062.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff9b5fa7b3
Build id: 3.10.0-1062.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffff9b64521a
Build id: 3.10.0-1062.el7.x86_64
|
0x1ca
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff9b5fac42
Build id: 3.10.0-1062.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff9b5fad63
Build id: 3.10.0-1062.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff9bb8bede
Build id: 3.10.0-1062.el7.x86_64
|
0x25
|
|
10
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffff9bb8be21
Build id: 3.10.0-1062.el7.x86_64
|
0xae
|
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 23s! [gnome-shell:9075]
Modules linked in: tcp_lp nls_utf8 isofs fuse tun bridge stp llc devlink ip_set nfnetlink vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log snd_seq_midi snd_seq_midi_event dm_mod sb_edac coretemp ppdev snd_ens1371 snd_rawmidi snd_ac97_codec vmw_balloon iosf_mbi ac97_bus crc32_pclmul snd_seq ghash_clmulni_intel snd_seq_device snd_pcm aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_timer snd sg pcspkr soundcore joydev i2c_piix4 vmw_vmci parport_pc parport xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul nfit crct10dif_common crc32c_intel libata libnvdimm e1000 mptspi scsi_transport_spi serio_raw mptscsih mptbase drm_panel_orientation_quirks
[last unloaded: ip_tables]
CPU: 7 PID: 9075 Comm: gnome-shell Kdump: loaded Tainted: G L ------------ 3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff8d16b7649070 ti: ffff8d1374dd4000 task.ti: ffff8d1374dd4000
RIP: 0010:[<ffffffff9b5150ca>] [<ffffffff9b5150ca>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8d1374dd7c70 EFLAGS: 00000202
RAX: 0000000000000008 RBX: 000800009b47d1d0 RCX: ffff8d16ed8206a0
RDX: 0000000000000008 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff8d1374dd7ca8 R08: ffff8d1439ca6c00 R09: ffffffff9b77f629
R10: ffff8d16ed7df160 R11: fffff9cd4fbcb000 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8d1374dd7c20 R15: ffffffff9b42b621
FS: 00007f03b7545a80(0000) GS:ffff8d16ed7c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fcfc805c000 CR3: 00000000ba4ac000 CR4: 00000000000607e0
Call Trace:
[<ffffffff9b47d398>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9b47d40b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9b5fa5ad>] change_protection+0x5cd/0x670
[<ffffffff9b5fa7b3>] mprotect_fixup+0x163/0x3a0
[<ffffffff9b64521a>] ? __check_object_size+0x1ca/0x250
[<ffffffff9b5fac42>] do_mprotect_pkey+0x252/0x360
[<ffffffff9b5fad63>] SyS_mprotect+0x13/0x20
[<ffffffff9bb8bede>] system_call_fastpath+0x25/0x2a
[<ffffffff9bb8be21>] ? system_call_after_swapgs+0xae/0x146
Code: 48 63 35 3e 68 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 d7 14 9c f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 0d 68 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #187016
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffb9707e3a
Build id: 3.10.0-862.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffb9677018
Build id: 3.10.0-862.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffb9677088
Build id: 3.10.0-862.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffffb97cf45d
Build id: 3.10.0-862.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffffb96cebfc
Build id: 3.10.0-862.el7.x86_64
|
0x18c
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffb97cf61c
Build id: 3.10.0-862.el7.x86_64
|
0x10c
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffffb97cf9a2
Build id: 3.10.0-862.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffffb97cfac3
Build id: 3.10.0-862.el7.x86_64
|
0x13
|
|
9
|
tracesys
|
vmlinux |
0xffffffffb9d1fa51
Build id: 3.10.0-862.el7.x86_64
|
0x9d
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [java:3482]
Modules linked in: fuse tcp_diag inet_diag xt_set xt_multiport iptable_raw ip_set_hash_ip ip_set_hash_net ip_set veth nf_conntrack_netlink nfnetlink xt_nat xt_statistic ip_vs_sh ip_vs_wrr ip_vs_rr cfg80211 rfkill ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 xt_comment xt_mark xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack ipt_REJECT nf_reject_ipv4 ip_vs nf_conntrack tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink overlay(T) vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel snd_ens1371 ppdev snd_rawmidi snd_ac97_codec ac97_bus snd_seq
vmw_balloon aesni_intel snd_seq_device lrw gf128mul glue_helper ablk_helper cryptd snd_pcm snd_timer pcspkr joydev snd nfit vmw_vmci i2c_piix4 sg soundcore libnvdimm shpchp parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel mptspi libata scsi_transport_spi e1000 serio_raw mptscsih mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 3482 Comm: java Kdump: loaded Tainted: G ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff9c98befc9fa0 ti: ffff9c984cff4000 task.ti: ffff9c984cff4000
RIP: 0010:[<ffffffffb9707e3a>] [<ffffffffb9707e3a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9c984cff7cd0 EFLAGS: 00000202
RAX: 0000000000000001 RBX: 00080000b9676e50 RCX: ffff9c992565cf50
RDX: 0000000000000001 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff9c984cff7d08 R08: ffff9c9476544c00 R09: ffffffffb994a3d9
R10: ffff9c992575bb00 R11: ffffe2d04f189000 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9c984cff7c80 R15: 0000000000000202
FS: 00007f78703ba700(0000) GS:ffff9c9925740000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd17d366040 CR3: 00000000b1242000 CR4: 00000000003607e0
Call Trace:
[<ffffffffb9677018>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb9677088>] flush_tlb_mm_range+0x68/0x140
[<ffffffffb97cf45d>] change_protection+0x5cd/0x680
[<ffffffffb96cebfc>] ? try_to_wake_up+0x18c/0x350
[<ffffffffb97cf61c>] mprotect_fixup+0x10c/0x240
[<ffffffffb97cf9a2>] do_mprotect_pkey+0x252/0x360
[<ffffffffb97cfac3>] SyS_mprotect+0x13/0x20
[<ffffffffb9d1fa51>] tracesys+0x9d/0xc3
Code: 48 63 35 8e b6 c3 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 53 33 ba f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 5d b6 c3 00 eb b7 0f b6 4d cc 4c 89
Complete report #186765
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff82d1761a
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff82c7e8f8
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff82c7e96b
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff82dfe26d
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff82dfe473
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffff8338d678
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x238
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff82dfe8ee
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff82dfea43
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff83392ed2
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x25
|
|
10
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffff83392e15
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xa2
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [node:4659]
Modules linked in: veth xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc xfs libcrc32c dm_mirror dm_region_hash dm_log dm_mod bochs_drm ttm drm_kms_helper syscopyarea virtio_net sysfillrect sysimgblt net_failover fb_sys_fops failover drm virtio_balloon drm_panel_orientation_quirks sg i2c_piix4 virtio_pci
virtio_ring virtio pcspkr joydev ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic crct10dif_common ata_generic pata_acpi ata_piix libata serio_raw floppy
CPU: 6 PID: 4659 Comm: node Kdump: loaded Tainted: G L ------------ T 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.14.0-0-g155821a1990b-prebuilt.qemu.org 04/01/2014
task: ffff88661a961070 ti: ffff886763314000 task.ti: ffff886763314000
RIP: 0010:[<ffffffff82d1761a>] [<ffffffff82d1761a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff886763317c70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 0008000082c7e730 RCX: ffff8869bfc204c8
RDX: 0000000000000000 RSI: 0000000000000008 RDI: 0000000000000000
RBP: ffff886763317ca8 R08: ffff8866f8f39c00 R09: ffffffff82f851b9
R10: ffff8869bfd9f160 R11: ffffe84c878cd200 R12: 0000000000000282
R13: 0000000000000282 R14: ffff886763317c20 R15: ffffffff82c2b621
FS: 00007f0076711740(0000) GS:ffff8869bfd80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000005b18a500000 CR3: 00000001a1c66000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff82c7e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff82c7e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff82dfe26d>] change_protection+0x5dd/0x680
[<ffffffff82dfe473>] mprotect_fixup+0x163/0x3a0
[<ffffffff8338d678>] ? __do_page_fault+0x238/0x500
[<ffffffff82dfe8ee>] do_mprotect_pkey+0x23e/0x380
[<ffffffff82dfea43>] SyS_mprotect+0x13/0x20
[<ffffffff83392ed2>] system_call_fastpath+0x25/0x2a
[<ffffffff83392e15>] ? system_call_after_swapgs+0xa2/0x13a
Code: 48 63 35 ce 7b c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 10 95 83 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 7b c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #183778
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffa430862a
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffa4277788
Build id: 3.10.0-862.9.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffa42777f8
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffffa43cfc1d
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffa43cfddc
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x10c
|
|
6
|
do_mprotect_pkey
|
vmlinux |
0xffffffffa43d0162
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x252
|
|
7
|
SyS_mprotect
|
vmlinux |
0xffffffffa43d0283
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x13
|
|
8
|
tracesys
|
vmlinux |
0xffffffffa4920a0f
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x9d
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [java:7672]
Modules linked in: veth xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat xt_addrtype iptable_filter xt_conntrack br_netfilter bridge stp llc devlink openvswitch nf_conntrack_ipv6 nf_nat_ipv6 nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_defrag_ipv6 nf_nat nf_conntrack overlay(T) sunrpc ppdev edac_mce_amd crc32_pclmul ghash_clmulni_intel snd_intel8x0 snd_ac97_codec aesni_intel ac97_bus snd_seq lrw gf128mul snd_seq_device glue_helper snd_pcm ablk_helper cryptd snd_timer sg snd soundcore joydev video parport_pc parport i2c_piix4 pcspkr i2c_core ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi ata_piix libata crct10dif_pclmul crct10dif_common e1000 crc32c_intel serio_raw dm_mirror dm_region_hash dm_log dm_mod
CPU: 6 PID: 7672 Comm: java Kdump: loaded Tainted: G ------------ T 3.10.0-862.9.1.el7.x86_64 #1
Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006
task: ffff8f0b99b01fa0 ti: ffff8f0bc7f38000 task.ti: ffff8f0bc7f38000
RIP: 0010:[<ffffffffa430862a>] [<ffffffffa430862a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8f0bc7f3bcd0 EFLAGS: 00000202
RAX: 0000000000000005 RBX: 00080000a42775c0 RCX: ffff8f0c1fd5ce28
RDX: 0000000000000005 RSI: 0000000000000008 RDI: 0000000000000000
RBP: ffff8f0bc7f3bd08 R08: ffff8f05744b8800 R09: ffffffffa454ae19
R10: ffff8f0c1fd9bb40 R11: ffffd142ce4cba00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8f0bc7f3bc80 R15: ffff8f0bc7f3bca8
FS: 00007f54d22c3700(0000) GS:ffff8f0c1fd80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fd5ada26090 CR3: 00000007a538e000 CR4: 00000000000406e0
Call Trace:
[<ffffffffa4277788>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa42777f8>] flush_tlb_mm_range+0x68/0x140
[<ffffffffa43cfc1d>] change_protection+0x5cd/0x680
[<ffffffffa43cfddc>] mprotect_fixup+0x10c/0x240
[<ffffffffa43d0162>] do_mprotect_pkey+0x252/0x360
[<ffffffffa43d0283>] SyS_mprotect+0x13/0x20
[<ffffffffa4920a0f>] tracesys+0x9d/0xc3
Code: 48 63 35 9e ae c3 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 53 f3 a4 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 6d ae c3 00 eb b7 0f b6 4d cc 4c 89
Complete report #155551
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffb9116e4a
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffb907e868
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffb907e8db
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffb91fe2fd
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffffb90c9a50
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffb91fe503
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffffb9156ffb
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x5b
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffffb91fe97e
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x23e
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffffb91fead3
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0x13
|
|
10
|
tracesys
|
vmlinux |
0xffffffffb9795226
Build id: 3.10.0-1160.15.2.el7.x86_64
|
0xa6
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [java:53880]
Modules linked in: nf_conntrack_netlink xt_set ip_set_hash_net ip_set nfnetlink iptable_raw vxlan ip6_udp_tunnel udp_tunnel xt_mark xfrm6_mode_tunnel xfrm4_mode_tunnel esp4 drbg ansi_cprng veth xt_nat xt_addrtype br_netfilter dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac snd_ens1371 snd_rawmidi coretemp snd_ac97_codec iosf_mbi crc32_pclmul ac97_bus ghash_clmulni_intel snd_seq aesni_intel lrw snd_seq_device gf128mul snd_pcm glue_helper
ablk_helper cryptd snd_timer snd ppdev sg soundcore pcspkr vmw_balloon joydev vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect crct10dif_pclmul crct10dif_common sysimgblt fb_sys_fops crc32c_intel ttm drm ata_piix nfit mptspi serio_raw libata libnvdimm scsi_transport_spi mptscsih e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 2 PID: 53880 Comm: java Kdump: loaded Tainted: G W L ------------ 3.10.0-1160.15.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff94a1b95b5280 ti: ffff94a0117e0000 task.ti: ffff94a0117e0000
RIP: 0010:[<ffffffffb9116e4a>] [<ffffffffb9116e4a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff94a0117e3c70 EFLAGS: 00000202
RAX: 000000000000000b RBX: 00080000b907e6a0 RCX: ffff94a55d8e0628
RDX: 000000000000000b RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff94a0117e3ca8 R08: ffff949eb2f5c800 R09: ffffffffb9386479
R10: ffff94a55d69f160 R11: ffffe43a8a65f600 R12: 0000000000000282
R13: 0000000000000282 R14: ffff94a0117e3c20 R15: ffffffffb902b621
FS: 00007fc4c8c21700(0000) GS:ffff94a55d680000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f628714d000 CR3: 00000003e83e2000 CR4: 00000000000607e0
Call Trace:
[<ffffffffb907e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb907e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb91fe2fd>] change_protection+0x5dd/0x680
[<ffffffffb90c9a50>] ? hrtimer_get_res+0x50/0x50
[<ffffffffb91fe503>] mprotect_fixup+0x163/0x3a0
[<ffffffffb9156ffb>] ? __seccomp_filter+0x5b/0x300
[<ffffffffb91fe97e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffb91fead3>] SyS_mprotect+0x13/0x20
[<ffffffffb9795226>] tracesys+0xa6/0xcc
Code: 48 63 35 de 86 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 d5 b9 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ad 86 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #142870
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff8bf16dda
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff8be7e868
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff8be7e8db
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff8bffe29d
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff8bffe4a3
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffff8bf56f9b
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x5b
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff8bffe91e
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff8bffea73
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x13
|
|
9
|
tracesys
|
vmlinux |
0xffffffff8c596226
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0xa6
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [file:// Content:4010]
Modules linked in: tcp_lp rfcomm xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack bridge stp llc ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vboxnetadp(OE) vboxnetflt(OE) vboxdrv(OE) bnep vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event btusb btrtl btbcm btintel bluetooth snd_ens1371 snd_rawmidi rfkill snd_ac97_codec kvm_amd ac97_bus kvm snd_seq irqbypass snd_seq_device snd_pcm crc32_pclmul
ghash_clmulni_intel snd_timer aesni_intel snd lrw gf128mul soundcore glue_helper ablk_helper cryptd ppdev sg joydev pcspkr vmw_balloon parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nfit ata_piix libnvdimm crct10dif_pclmul crct10dif_common libata crc32c_intel mptspi scsi_transport_spi serio_raw e1000 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 4010 Comm: file:// Content Kdump: loaded Tainted: G OE ------------ 3.10.0-1160.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff94eddb78b180 ti: ffff94eddb670000 task.ti: ffff94eddb670000
RIP: 0010:[<ffffffff8bf16dda>] [<ffffffff8bf16dda>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff94eddb673c70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 000800008be7e6a0 RCX: ffff94ef75620600
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff94eddb673ca8 R08: ffff94eebe34b000 R09: ffffffff8c186419
R10: ffff94ef7565f160 R11: ffffe8ad87b31000 R12: 0000000000000282
R13: 0000000000000018 R14: ffff94eddb673be0 R15: 0000000000000282
FS: 00007f6a552cc780(0000) GS:ffff94ef75640000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f6a27c48ff0 CR3: 000000009b602000 CR4: 0000000000340fe0
Call Trace:
[<ffffffff8be7e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8be7e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff8bffe29d>] change_protection+0x5dd/0x680
[<ffffffff8bffe4a3>] mprotect_fixup+0x163/0x3a0
[<ffffffff8bf56f9b>] ? __seccomp_filter+0x5b/0x300
[<ffffffff8bffe91e>] do_mprotect_pkey+0x23e/0x380
[<ffffffff8bffea73>] SyS_mprotect+0x13/0x20
[<ffffffff8c596226>] tracesys+0xa6/0xcc
Code: 48 63 35 0e 89 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 15 b5 8c f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 dd 88 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #126326
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffaad16dd8
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x208
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffaac7e868
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffaac7e8db
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffaadfe29d
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffaadfe4a3
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x163
|
|
6
|
do_mprotect_pkey
|
vmlinux |
0xffffffffaadfe91e
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x23e
|
|
7
|
SyS_mprotect
|
vmlinux |
0xffffffffaadfea73
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x13
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffffab395f92
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0x25
|
|
9
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffffab395ed5
Build id: 3.10.0-1160.21.1.el7.x86_64
|
0xa2
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [VM Thread:2784]
Modules linked in: event_collector_2_1_364486(OE) binfmt_misc ip6table_filter ip6_tables iptable_filter talpa_vfshook(OE) talpa_pedconnector(OE) talpa_pedevice(OE) talpa_vcdevice(OE) talpa_core(OE) talpa_linux(OE) talpa_syscallhook(OE) vmw_vsock_vmci_transport vsock crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev ablk_helper cryptd pcspkr sg vmw_balloon joydev parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common ata_piix crc32c_intel libata mptspi scsi_transport_spi mptscsih nfit serio_raw mptbase libnvdimm vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log
dm_mod fuse
CPU: 0 PID: 2784 Comm: VM Thread Kdump: loaded Tainted: G OEL ------------ 3.10.0-1160.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff9ba8eb06a100 ti: ffff9baa4bb54000 task.ti: ffff9baa4bb54000
RIP: 0010:[<ffffffffaad16dd8>] [<ffffffffaad16dd8>] smp_call_function_many+0x208/0x270
RSP: 0018:ffff9baa4bb57c70 EFLAGS: 00000202
RAX: 0000000000000003 RBX: 00080000aac7e6a0 RCX: ffff9baa756dfc10
RDX: 0000000000000003 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff9baa4bb57ca8 R08: ffff9ba9bfdd7000 R09: ffffffffaaf86419
R10: ffff9baa7561f160 R11: ffffecdf80d5ee00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9baa4bb57c20 R15: 0000000000000000
FS: 00007feec07dc700(0000) GS:ffff9baa75600000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007feeea27a600 CR3: 00000000a6a74000 CR4: 00000000000007f0
Call Trace:
[<ffffffffaac7e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffaac7e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffaadfe29d>] change_protection+0x5dd/0x680
[<ffffffffaadfe4a3>] mprotect_fixup+0x163/0x3a0
[<ffffffffaadfe91e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffaadfea73>] SyS_mprotect+0x13/0x20
[<ffffffffab395f92>] system_call_fastpath+0x25/0x2a
[<ffffffffab395ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: 28 00 48 63 35 0e 89 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 15 95 ab f6 41 20 01 74 cd 0f 1f 44 00 00 <f3> 90 f6 41 20 01 75 f8 48 63 35 dd 88 c4 00 eb b7 0f b6 4d cc
Complete report #79856
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffbd107e3a
Build id: 3.10.0-862.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffbd077018
Build id: 3.10.0-862.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffbd077088
Build id: 3.10.0-862.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffffbd1cf45d
Build id: 3.10.0-862.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffbd1cf61c
Build id: 3.10.0-862.el7.x86_64
|
0x10c
|
|
6
|
do_mprotect_pkey
|
vmlinux |
0xffffffffbd1cf9a2
Build id: 3.10.0-862.el7.x86_64
|
0x252
|
|
7
|
SyS_mprotect
|
vmlinux |
0xffffffffbd1cfac3
Build id: 3.10.0-862.el7.x86_64
|
0x13
|
|
8
|
tracesys
|
vmlinux |
0xffffffffbd71fa51
Build id: 3.10.0-862.el7.x86_64
|
0x9d
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [java:96622]
Modules linked in: veth xt_nat ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter ppdev joydev pcspkr virtio_balloon sg parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom virtio_blk virtio_console virtio_scsi virtio_net ata_generic pata_acpi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops
ttm drm ata_piix libata serio_raw virtio_pci virtio_ring virtio i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 96622 Comm: java Kdump: loaded Tainted: G W ------------ T 3.10.0-862.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.10.2-0-g5f4c7b1-prebuilt.qemu-project.org 04/01/2014
task: ffff9e4189002f70 ti: ffff9e400a27c000 task.ti: ffff9e400a27c000
RIP: 0010:[<ffffffffbd107e3a>] [<ffffffffbd107e3a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9e400a27fcd0 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00080000bd076e50 RCX: ffff9e3fb5a1c4d8
RDX: 0000000000000000 RSI: 0000000000000070 RDI: 0000000000000000
RBP: ffff9e400a27fd08 R08: ffff9e3efcf6bc00 R09: ffffffffbd34a3d9
R10: ffff9e3fb5a9bb00 R11: fffff5c8000c9e00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9e400a27fc80 R15: ffff9e400a27fca8
FS: 00007f42f9eb3b10(0000) GS:ffff9e3fb5a80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f43142abdb8 CR3: 0000000282064000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffbd077018>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffbd077088>] flush_tlb_mm_range+0x68/0x140
[<ffffffffbd1cf45d>] change_protection+0x5cd/0x680
[<ffffffffbd1cf61c>] mprotect_fixup+0x10c/0x240
[<ffffffffbd1cf9a2>] do_mprotect_pkey+0x252/0x360
[<ffffffffbd1cfac3>] SyS_mprotect+0x13/0x20
[<ffffffffbd71fa51>] tracesys+0x9d/0xc3
Code: 48 63 35 8e b6 c3 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 53 d3 bd f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 5d b6 c3 00 eb b7 0f b6 4d cc 4c 89
Complete report #55828
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff8d116eaa
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff8d07e868
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff8d07e8db
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff8d1fe2fd
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff8d1fe503
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffff8d15705b
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x5b
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff8d1fe97e
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff8d1fead3
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x13
|
|
9
|
tracesys
|
vmlinux |
0xffffffff8d794226
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0xa6
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [VM Thread:1624]
Modules linked in: xt_nat veth xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink nfnetlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilter bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop overlay snd_hda_codec_generic snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device iosf_mbi snd_pcm crc32_pclmul ghash_clmulni_intel ppdev aesni_intel snd_timer snd joydev lrw gf128mul glue_helper ablk_helper cryptd virtio_rng parport_pc virtio_balloon pcspkr parport soundcore i2c_piix4 ip_tables xfs libcrc32c ata_generic pata_acpi virtio_blk virtio_console qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common
serio_raw libata crc32c_intel virtio_pci virtio_ring virtio e1000 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 1624 Comm: VM Thread Not tainted 3.10.0-1160.11.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 1.11.0-2.el7 04/01/2014
task: ffff9226e99c0000 ti: ffff9227e1db4000 task.ti: ffff9227e1db4000
RIP: 0010:[<ffffffff8d116eaa>] [<ffffffff8d116eaa>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9227e1db7c70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 000800008d07e6a0 RCX: ffff9227ffc20370
RDX: 0000000000000000 RSI: 0000000000000004 RDI: 0000000000000000
RBP: ffff9227e1db7ca8 R08: ffff9227b43c2000 R09: ffffffff8d386199
R10: ffff9227ffd9f160 R11: ffffd78606429700 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9227e1db7c20 R15: ffffffff8d02b621
FS: 00007f2771245700(0000) GS:ffff9227ffd80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f26e8e8baa8 CR3: 00000000a5252000 CR4: 00000000003606e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff8d07e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8d07e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff8d1fe2fd>] change_protection+0x5dd/0x680
[<ffffffff8d1fe503>] mprotect_fixup+0x163/0x3a0
[<ffffffff8d15705b>] ? __seccomp_filter+0x5b/0x300
[<ffffffff8d1fe97e>] do_mprotect_pkey+0x23e/0x380
[<ffffffff8d1fead3>] SyS_mprotect+0x13/0x20
[<ffffffff8d794226>] tracesys+0xa6/0xcc
Code: 48 63 35 7e 86 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 d5 8d f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 4d 86 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #45370
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffa9516eaa
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffa947e868
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffa947e8db
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffa95fe2fd
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffffa94c9ab0
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffa95fe503
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffffa942b621
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x151
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffffa95fe97e
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x23e
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffffa95fead3
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffffa9b93f92
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x25
|
|
11
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffffa9b93ed5
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0xa2
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [VM Thread:3681]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc ppdev pcspkr joydev virtio_balloon sg i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_console net_failover failover virtio_blk virtio_scsi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix
libata serio_raw virtio_pci virtio_ring virtio drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 3681 Comm: VM Thread Tainted: G L ------------ 3.10.0-1160.11.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.7.5-0-ge51488c-20140602_164612-nilsson.home.kraxel.org 04/01/2014
task: ffff9688b573e300 ti: ffff9688fd474000 task.ti: ffff9688fd474000
RIP: 0010:[<ffffffffa9516eaa>] [<ffffffffa9516eaa>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9688fd477c70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00080000a947e6a0 RCX: ffff9689baa20400
RDX: 0000000000000000 RSI: 0000000000000030 RDI: 0000000000000000
RBP: ffff9688fd477ca8 R08: ffff9689b9356c00 R09: ffffffffa9786199
R10: ffff9689baa5f160 R11: ffffe35fc1f6e800 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9688fd477c20 R15: ffffffffa942b621
FS: 00007f06f04dc700(0000) GS:ffff9689baa40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3ac1542000 CR3: 000000007da5a000 CR4: 00000000000006e0
Call Trace:
[<ffffffffa947e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa947e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffa95fe2fd>] change_protection+0x5dd/0x680
[<ffffffffa94c9ab0>] ? hrtimer_get_res+0x50/0x50
[<ffffffffa95fe503>] mprotect_fixup+0x163/0x3a0
[<ffffffffa942b621>] ? __switch_to+0x151/0x580
[<ffffffffa95fe97e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffa95fead3>] SyS_mprotect+0x13/0x20
[<ffffffffa9b93f92>] system_call_fastpath+0x25/0x2a
[<ffffffffa9b93ed5>] ? system_call_after_swapgs+0xa2/0x13a
Code: 48 63 35 7e 86 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 15 aa f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 4d 86 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #37220
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff85916eaa
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff8587e868
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff8587e8db
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff859fe2fd
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff859fe503
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x163
|
|
6
|
do_mprotect_pkey
|
vmlinux |
0xffffffff859fe97e
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x23e
|
|
7
|
SyS_mprotect
|
vmlinux |
0xffffffff859fead3
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x13
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffff85f93f92
Build id: 3.10.0-1160.11.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [firefox:34195]
Modules linked in: tcp_lp rfcomm xt_nat veth nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter binfmt_misc ebtables devlink ip6table_filter ip6_tables iptable_filter des_generic md4 nls_utf8 cifs ccm dns_resolver overlay(T) vmw_vsock_vmci_transport vsock bnep sunrpc snd_seq_midi snd_seq_midi_event squashfs loop ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq aesni_intel btusb btrtl snd_seq_device lrw btbcm gf128mul btintel glue_helper ablk_helper bluetooth cryptd snd_pcm joydev sg pcspkr snd_timer rfkill
snd soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm nfit crct10dif_pclmul drm crct10dif_common crc32c_intel ata_piix libnvdimm libata mptspi serio_raw scsi_transport_spi e1000 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 1 PID: 34195 Comm: firefox Kdump: loaded Tainted: G L ------------ T 3.10.0-1160.11.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff980e64363180 ti: ffff980b2bdac000 task.ti: ffff980b2bdac000
RIP: 0010:[<ffffffff85916eaa>] [<ffffffff85916eaa>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff980b2bdafc70 EFLAGS: 00000202
RAX: 0000000000000004 RBX: 000800008587e6a0 RCX: ffff981673b20600
RDX: 0000000000000004 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff980b2bdafca8 R08: ffff9809f4b63000 R09: ffffffff85b86199
R10: ffff981673a5f160 R11: fffffaafa9d00600 R12: 0000000000000282
R13: 0000000000000282 R14: ffff980b2bdafc20 R15: ffff980b2bdafbf0
FS: 00007f03a87c4780(0000) GS:ffff981673a40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00003f5796085030 CR3: 0000000a3b60a000 CR4: 00000000003607e0
Call Trace:
[<ffffffff8587e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8587e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff859fe2fd>] change_protection+0x5dd/0x680
[<ffffffff859fe503>] mprotect_fixup+0x163/0x3a0
[<ffffffff859fe97e>] do_mprotect_pkey+0x23e/0x380
[<ffffffff859fead3>] SyS_mprotect+0x13/0x20
[<ffffffff85f93f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 7e 86 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 55 86 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 4d 86 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #21304
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffac3150ce
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x20e
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffac27d398
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffac27d40b
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffac3fa5ad
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffac3fa7b3
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffffac2d3efe
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x4e
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffffac3fac42
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffffac3fad63
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffffac98cede
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0x25
|
|
10
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffffac98ce21
Build id: 3.10.0-1062.1.1.el7.x86_64
|
0xae
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [gnome-shell:3010]
Modules linked in: tcp_lp uinput fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink sunrpc ppdev snd_hda_codec_generic snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_seq snd_seq_device snd_pcm snd_timer snd virtio_balloon parport_pc soundcore joydev i2c_piix4 parport pcspkr sch_fq_codel ip_tables xfs libcrc32c virtio_console virtio_net virtio_blk qxl drm_kms_helper ata_generic pata_acpi syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix libata virtio_pci serio_raw floppy virtio_ring drm_panel_orientation_quirks virtio dm_mirror dm_region_hash
dm_log dm_mod
CPU: 0 PID: 3010 Comm: gnome-shell Kdump: loaded Tainted: G L ------------ 3.10.0-1062.1.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
task: ffff9b78e16062a0 ti: ffff9b78aefa0000 task.ti: ffff9b78aefa0000
RIP: 0010:[<ffffffffac3150ce>] [<ffffffffac3150ce>] smp_call_function_many+0x20e/0x270
RSP: 0018:ffff9b78aefa3c70 EFLAGS: 00000202
RAX: 0000000000000001 RBX: 00080000ac27d1d0 RCX: ffff9b79bfc5fc10
RDX: 0000000000000001 RSI: 0000000000000006 RDI: 0000000000000000
RBP: ffff9b78aefa3ca8 R08: ffff9b77ffd4f800 R09: ffffffffac57f629
R10: ffff9b79bfc1f160 R11: ffffeef787f69b00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9b78aefa3c20 R15: ffffffffac2e375c
FS: 00007f7e74ec4a80(0000) GS:ffff9b79bfc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7de5662a38 CR3: 0000000242716000 CR4: 00000000000006f0
Call Trace:
[<ffffffffac27d398>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffac27d40b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffac3fa5ad>] change_protection+0x5cd/0x670
[<ffffffffac3fa7b3>] mprotect_fixup+0x163/0x3a0
[<ffffffffac2d3efe>] ? finish_task_switch+0x4e/0x1c0
[<ffffffffac3fac42>] do_mprotect_pkey+0x252/0x360
[<ffffffffac3fad63>] SyS_mprotect+0x13/0x20
[<ffffffffac98cede>] system_call_fastpath+0x25/0x2a
[<ffffffffac98ce21>] ? system_call_after_swapgs+0xae/0x146
Code: 68 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 d7 f4 ac f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 f6 41 20 01 <75> f8 48 63 35 0d 68 c4 00 eb b7 0f b6 4d cc 4c 89 f2 4c 89 ee
Complete report #21046
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffb651185a
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffb647a5c8
Build id: 3.10.0-957.5.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffb647a638
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffffb65f43fd
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffffb64c5820
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffb65f4612
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x162
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffffb65f4a62
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffffb65f4b83
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffffb6b74ddb
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x22
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [java:20833]
Modules linked in: fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc nfsv3 nfs_acl nfs lockd ebtable_filter grace ebtables fscache ip6table_filter ip6_tables devlink iptable_filter mvfs(OE) vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev snd_ens1371 snd_rawmidi snd_ac97_codec pcspkr ac97_bus snd_seq snd_seq_device snd_pcm sg snd_timer snd soundcore vmw_vmci i2c_piix4 nfit libnvdimm parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif
crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops e1000 ttm serio_raw drm mptspi scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks ata_piix libata floppy
CPU: 6 PID: 20833 Comm: java Kdump: loaded Tainted: G OE ------------ 3.10.0-957.5.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff918549a91040 ti: ffff917ffb9a0000 task.ti: ffff917ffb9a0000
RIP: 0010:[<ffffffffb651185a>] [<ffffffffb651185a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff917ffb9a3c70 EFLAGS: 00000202
RAX: 0000000000000003 RBX: ffffffffb647a400 RCX: ffff9185764e0678
RDX: 0000000000000003 RSI: 0000000000000040 RDI: 0000000000000000
RBP: ffff917ffb9a3ca8 R08: ffff9180b6644c00 R09: ffffffffb6775ba9
R10: ffff91857659f160 R11: ffffdedf13ceb600 R12: 0000000000000286
R13: ffff917ffb9a3c20 R14: ffff9180bfc03500 R15: ffffffffb642a621
FS: 00007f45c84fa700(0000) GS:ffff918576580000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5a773a6870 CR3: 00000005a2b92000 CR4: 00000000001607e0
Call Trace:
[<ffffffffb647a5c8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb647a638>] flush_tlb_mm_range+0x68/0x140
[<ffffffffb65f43fd>] change_protection+0x5cd/0x680
[<ffffffffb64c5820>] ? hrtimer_get_res+0x50/0x50
[<ffffffffb65f4612>] mprotect_fixup+0x162/0x360
[<ffffffffb65f4a62>] do_mprotect_pkey+0x252/0x360
[<ffffffffb65f4b83>] SyS_mprotect+0x13/0x20
[<ffffffffb6b74ddb>] system_call_fastpath+0x22/0x27
Code: 48 63 35 2e 82 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 b9 14 b7 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 fd 81 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #20215
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffb7f16c0a
Build id: 3.10.0-1160.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffb7e7e868
Build id: 3.10.0-1160.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffb7e7e8db
Build id: 3.10.0-1160.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffb7ffe11d
Build id: 3.10.0-1160.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffb7ffe323
Build id: 3.10.0-1160.el7.x86_64
|
0x163
|
|
6
|
|
vmlinux |
0xffffffffb804a6fa
Build id: 3.10.0-1160.el7.x86_64
|
0x1ca
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffffb7ffe79e
Build id: 3.10.0-1160.el7.x86_64
|
0x23e
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffffb7ffe8f3
Build id: 3.10.0-1160.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffffb8593f92
Build id: 3.10.0-1160.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [gnome-shell:2568]
Modules linked in: tcp_lp nls_utf8 isofs xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd soundcore coretemp sg iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper
ablk_helper cryptd joydev pcspkr vmw_balloon parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nfit ata_piix libnvdimm crct10dif_pclmul crct10dif_common crc32c_intel libata mptspi scsi_transport_spi serio_raw e1000 mptscsih mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod fuse
CPU: 4 PID: 2568 Comm: gnome-shell Kdump: loaded Not tainted 3.10.0-1160.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2015
task: ffff8ab4ad9d2100 ti: ffff8ab621fd8000 task.ti: ffff8ab621fd8000
RIP: 0010:[<ffffffffb7f16c0a>] [<ffffffffb7f16c0a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8ab621fdbc70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 00080000b7e7e6a0 RCX: ffff8ab635620678
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff8ab621fdbca8 R08: ffff8ab57e34bc00 R09: ffffffffb8185f99
R10: ffff8ab63571f160 R11: ffffd2e64785ac00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8ab621fdbc20 R15: ffffffffb7e2b621
FS: 00007fdd6fc92a80(0000) GS:ffff8ab635700000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005638ebbbd000 CR3: 0000000217e20000 CR4: 00000000003607e0
Call Trace:
[<ffffffffb7e7e868>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb7e7e8db>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb7ffe11d>] change_protection+0x5dd/0x680
[<ffffffffb7ffe323>] mprotect_fixup+0x163/0x3a0
[<ffffffffb804a6fa>] ? __check_object_size+0x1ca/0x250
[<ffffffffb7ffe79e>] do_mprotect_pkey+0x23e/0x380
[<ffffffffb7ffe8f3>] SyS_mprotect+0x13/0x20
[<ffffffffb8593f92>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 1e 89 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 13 b5 b8 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 ed 88 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #16946
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff9a11761a
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9a07e8f8
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9a07e96b
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff9a1fe26d
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x5dd
|
|
5
|
|
vmlinux |
0xffffffff9a0ca2d0
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff9a1fe473
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffff9a15770b
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x5b
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffff9a1fe8ee
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x23e
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffff9a1fea43
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x13
|
|
10
|
tracesys
|
vmlinux |
0xffffffff9a793166
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xa6
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [VM Thread:23585]
Modules linked in: xt_nat veth nf_conntrack_netlink xt_addrtype br_netfilter overlay(T) xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ppdev snd_ens1371 ghash_clmulni_intel snd_rawmidi snd_ac97_codec ac97_bus aesni_intel
vmw_balloon snd_seq lrw gf128mul snd_seq_device glue_helper ablk_helper cryptd snd_pcm snd_timer snd sg joydev pcspkr soundcore vmw_vmci i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel nfit mptspi libnvdimm ata_piix scsi_transport_spi drm mptscsih e1000 libata serio_raw mptbase drm_panel_orientation_quirks
CPU: 3 PID: 23585 Comm: VM Thread Tainted: G ------------ T 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 02/27/2020
task: ffff9b18b9e1c1c0 ti: ffff9b18654a4000 task.ti: ffff9b18654a4000
RIP: 0010:[<ffffffff9a11761a>] [<ffffffff9a11761a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9b18654a7c70 EFLAGS: 00000202
RAX: 0000000000000002 RBX: 000800009a07e730 RCX: ffff9b18ed6a0650
RDX: 0000000000000002 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff9b18654a7ca8 R08: ffff9b1639ccb800 R09: ffffffff9a3851b9
R10: ffff9b18ed6df160 R11: ffffdde90b276400 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9b18654a7c20 R15: ffffffff9a02b981
FS: 00007f0530220700(0000) GS:ffff9b18ed6c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c4201f7010 CR3: 000000036bc1a000 CR4: 00000000003607e0
Call Trace:
[<ffffffff9a07e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9a07e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9a1fe26d>] change_protection+0x5dd/0x680
[<ffffffff9a0ca2d0>] ? hrtimer_get_res+0x50/0x50
[<ffffffff9a1fe473>] mprotect_fixup+0x163/0x3a0
[<ffffffff9a15770b>] ? __seccomp_filter+0x5b/0x300
[<ffffffff9a1fe8ee>] do_mprotect_pkey+0x23e/0x380
[<ffffffff9a1fea43>] SyS_mprotect+0x13/0x20
[<ffffffff9a793166>] tracesys+0xa6/0xcc
Code: 48 63 35 ce 7b c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 10 d5 9a f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 9d 7b c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #15627
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffa2512b6e
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x20e
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffa247b788
Build id: 3.10.0-957.27.2.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffa247b7f8
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffffa25f578d
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffffa24c6a30
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffa25f59a2
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x162
|
|
7
|
|
vmlinux |
0xffffffffa2b71628
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x228
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffffa25f5df2
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x252
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffffa25f5f13
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffffa2b76ddb
Build id: 3.10.0-957.27.2.el7.x86_64
|
0x22
|
|
11
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffffa2b76d21
Build id: 3.10.0-957.27.2.el7.x86_64
|
0xae
|
NMI watchdog: BUG: soft lockup - CPU#9 stuck for 22s! [java:115901]
Modules linked in: binfmt_misc ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter sunrpc ppdev sg joydev pcspkr virtio_balloon parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom virtio_console virtio_blk virtio_scsi virtio_net ata_generic pata_acpi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata floppy serio_raw virtio_pci virtio_ring virtio drm_panel_orientation_quirks
dm_mirror dm_region_hash dm_log dm_mod
CPU: 9 PID: 115901 Comm: java Kdump: loaded Not tainted 3.10.0-957.27.2.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff9c8a000d6180 ti: ffff9c888631c000 task.ti: ffff9c888631c000
RIP: 0010:[<ffffffffa2512b6e>] [<ffffffffa2512b6e>] smp_call_function_many+0x20e/0x270
RSP: 0018:ffff9c888631fc70 EFLAGS: 00000202
RAX: 000000000000000e RBX: 00080000a247b5c0 RCX: ffff9c88351a0500
RDX: 000000000000000e RSI: 00000000000000a0 RDI: 0000000000000000
RBP: ffff9c888631fca8 R08: ffff9c877cfccc00 R09: ffffffffa27774a9
R10: ffff9c883505f160 R11: ffffd5f9800aea00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9c888631fc20 R15: ffffffffa242a621
FS: 00007f77a3efe700(0000) GS:ffff9c8835040000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f77e056c600 CR3: 00000003acf3c000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa247b788>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffa247b7f8>] flush_tlb_mm_range+0x68/0x140
[<ffffffffa25f578d>] change_protection+0x5cd/0x680
[<ffffffffa24c6a30>] ? hrtimer_get_res+0x50/0x50
[<ffffffffa25f59a2>] mprotect_fixup+0x162/0x360
[<ffffffffa2b71628>] ? __do_page_fault+0x228/0x4f0
[<ffffffffa25f5df2>] do_mprotect_pkey+0x252/0x360
[<ffffffffa25f5f13>] SyS_mprotect+0x13/0x20
[<ffffffffa2b76ddb>] system_call_fastpath+0x22/0x27
[<ffffffffa2b76d21>] ? system_call_after_swapgs+0xae/0x146
Code: 75 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 bf 14 a3 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 f6 41 20 01 <75> f8 48 63 35 2d 75 c4 00 eb b7 0f b6 4d cc 4c 89 f2 4c 89 ee
Complete report #14811
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff9cf1173a
Build id: 3.10.0-957.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9ce7a598
Build id: 3.10.0-957.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9ce7a608
Build id: 3.10.0-957.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffff9cff404d
Build id: 3.10.0-957.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff9cff4262
Build id: 3.10.0-957.el7.x86_64
|
0x162
|
|
6
|
|
vmlinux |
0xffffffff9ce2a621
Build id: 3.10.0-957.el7.x86_64
|
0x151
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff9cff46b2
Build id: 3.10.0-957.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff9cff47d3
Build id: 3.10.0-957.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff9d574ddb
Build id: 3.10.0-957.el7.x86_64
|
0x22
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [java:21876]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables devlink iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper snd_ens1371 vmw_balloon cryptd ppdev snd_rawmidi snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd pcspkr joydev soundcore parport_pc parport sg vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel ata_generic pata_acpi serio_raw
vmwgfx drm_kms_helper syscopyarea sysfillrect e1000 sysimgblt fb_sys_fops ttm ata_piix drm libata mptspi scsi_transport_spi mptscsih mptbase drm_panel_orientation_quirks nfit libnvdimm dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 21876 Comm: java Kdump: loaded Tainted: G L ------------ 3.10.0-957.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff9ae8720f6180 ti: ffff9ae872160000 task.ti: ffff9ae872160000
RIP: 0010:[<ffffffff9cf1173a>] [<ffffffff9cf1173a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9ae872163c70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 000800009ce7a3d0 RCX: ffff9ae879620600
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff9ae872163ca8 R08: ffff9ae87764cc00 R09: ffffffff9d1755c9
R10: ffff9ae8796df160 R11: fffff02d04c9c800 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9ae872163c20 R15: ffffffff9ce2a621
FS: 00007f674ca46700(0000) GS:ffff9ae8796c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f6766802280 CR3: 00000000845d6000 CR4: 00000000001607e0
Call Trace:
[<ffffffff9ce7a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9ce7a608>] flush_tlb_mm_range+0x68/0x140
[<ffffffff9cff404d>] change_protection+0x5cd/0x680
[<ffffffff9cff4262>] mprotect_fixup+0x162/0x360
[<ffffffff9ce2a621>] ? __switch_to+0x151/0x580
[<ffffffff9cff46b2>] do_mprotect_pkey+0x252/0x360
[<ffffffff9cff47d3>] SyS_mprotect+0x13/0x20
[<ffffffff9d574ddb>] system_call_fastpath+0x22/0x27
Code: 48 63 35 4e 83 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 b9 b4 9d f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 1d 83 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #10857
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffab711738
Build id: 3.10.0-957.el7.x86_64
|
0x208
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffab67a598
Build id: 3.10.0-957.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffab67a608
Build id: 3.10.0-957.el7.x86_64
|
0x68
|
|
4
|
change_protection
|
vmlinux |
0xffffffffab7f404d
Build id: 3.10.0-957.el7.x86_64
|
0x5cd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffffab7f4262
Build id: 3.10.0-957.el7.x86_64
|
0x162
|
|
6
|
|
vmlinux |
0xffffffffab62a621
Build id: 3.10.0-957.el7.x86_64
|
0x151
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffffab7f46b2
Build id: 3.10.0-957.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffffab7f47d3
Build id: 3.10.0-957.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffffabd74ddb
Build id: 3.10.0-957.el7.x86_64
|
0x22
|
NMI watchdog: BUG: soft lockup - CPU#9 stuck for 22s! [gnome-shell:13970]
Modules linked in: tcp_lp isofs ext4 mbcache jbd2 rfcomm fuse cmac xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun ipmi_devintf ipmi_msghandler drbg ansi_cprng ccm ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter bnep sunrpc vfat fat arc4 snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic snd_hda_intel snd_hda_codec snd_hda_core rtsx_pci_ms nouveau snd_hwdep snd_seq ath10k_pci ath10k_core ath
mac80211 snd_seq_device edac_mce_amd kvm_amd snd_pcm kvm mxm_wmi video i2c_algo_bit ttm snd_timer drm_kms_helper snd cfg80211 irqbypass soundcore syscopyarea sysfillrect btusb btrtl btbcm dell_wmi btintel dell_smbios memstick bluetooth sysimgblt dcdbas sparse_keymap rfkill fb_sys_fops rtsx_pci_sdmmc dell_wmi_descriptor drm crc32_pclmul ghash_clmulni_intel drm_panel_orientation_quirks aesni_intel lrw gf128mul glue_helper ablk_helper wmi cryptd sg wdat_wdt rtsx_pci pcspkr sdhci_acpi r8169 sdhci mii ccp k10temp i2c_piix4 pinctrl_amd gpio_amdpt acpi_cpufreq mmc_core iosf_mbi i2c_designware_platform i2c_designware_core binfmt_misc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ahci libahci libata dm_mirror dm_region_hash
dm_log dm_mod
CPU: 9 PID: 13970 Comm: gnome-shell Tainted: G W L ------------ 3.10.0-957.el7.x86_64 #1
Hardware name: Dell Inc. Inspiron 5675/07PR60, BIOS 1.1.2 05/04/2017
task: ffff8b227e7e30c0 ti: ffff8b2290604000 task.ti: ffff8b2290604000
RIP: 0010:[<ffffffffab711738>] [<ffffffffab711738>] smp_call_function_many+0x208/0x270
RSP: 0018:ffff8b2290607c70 EFLAGS: 00000202
RAX: 0000000000000005 RBX: ffffffffab67a3d0 RCX: ffff8b22b63606f0
RDX: 0000000000000005 RSI: 0000000000000010 RDI: 0000000000000000
RBP: ffff8b2290607ca8 R08: ffff8b21bceed400 R09: ffffffffab9755c9
R10: ffff8b22b645f160 R11: ffffdb338887fe00 R12: 0000000000000286
R13: ffff8b2290607c20 R14: ffff8b22b651ac00 R15: ffffffffab62a621
FS: 00007fa896586a80(0000) GS:ffff8b22b6440000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0a37c8d80d CR3: 0000000252e3a000 CR4: 00000000003407e0
Call Trace:
[<ffffffffab67a598>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffab67a608>] flush_tlb_mm_range+0x68/0x140
[<ffffffffab7f404d>] change_protection+0x5cd/0x680
[<ffffffffab7f4262>] mprotect_fixup+0x162/0x360
[<ffffffffab62a621>] ? __switch_to+0x151/0x580
[<ffffffffab7f46b2>] do_mprotect_pkey+0x252/0x360
[<ffffffffab7f47d3>] SyS_mprotect+0x13/0x20
[<ffffffffabd74ddb>] system_call_fastpath+0x22/0x27
Code: 27 00 48 63 35 4e 83 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 60 b9 34 ac f6 41 20 01 74 cd 0f 1f 44 00 00 <f3> 90 f6 41 20 01 75 f8 48 63 35 1d 83 c4 00 eb b7 0f b6 4d cc
Complete report #10214
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffb7b16a7a
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffb7a7e478
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffb7a7e4eb
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffb7bfc4dd
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffffb7ac9e30
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffb7bfc6e3
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffffb8188678
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x238
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffffb7bfcb72
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x252
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffffb7bfcc93
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffffb818dede
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x25
|
|
11
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffffb818de21
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0xae
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [java:113895]
Modules linked in: xt_NFQUEUE nfnetlink_log nfnetlink nfring(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache sunrpc ppdev sg virtio_balloon joydev i2c_piix4 pcspkr parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi virtio_net virtio_console virtio_blk virtio_scsi cirrus drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata virtio_pci serio_raw virtio_ring virtio drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 113895 Comm: java Kdump: loaded Tainted: G OEL ------------ 3.10.0-1062.12.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org 04/01/2014
task: ffff985649863150 ti: ffff9859b8220000 task.ti: ffff9859b8220000
RIP: 0010:[<ffffffffb7b16a7a>] [<ffffffffb7b16a7a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9859b8223c70 EFLAGS: 00000202
RAX: 0000000000000004 RBX: 00080000b7a7e2b0 RCX: ffff985e5cf20450
RDX: 0000000000000004 RSI: 00000000000000a0 RDI: 0000000000000000
RBP: ffff9859b8223ca8 R08: ffff9857b44abc00 R09: ffffffffb7d81839
R10: ffff985e5cedf160 R11: ffffd77a42ac2800 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9859b8223c20 R15: ffffffffb7a2b621
FS: 00007f10c7626700(0000) GS:ffff985e5cec0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9ebc0ed438 CR3: 00000003871b2000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffb7a7e478>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb7a7e4eb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb7bfc4dd>] change_protection+0x5cd/0x670
[<ffffffffb7ac9e30>] ? hrtimer_get_res+0x50/0x50
[<ffffffffb7bfc6e3>] mprotect_fixup+0x163/0x3a0
[<ffffffffb8188678>] ? __do_page_fault+0x238/0x500
[<ffffffffb7bfcb72>] do_mprotect_pkey+0x252/0x360
[<ffffffffb7bfcc93>] SyS_mprotect+0x13/0x20
[<ffffffffb818dede>] system_call_fastpath+0x25/0x2a
[<ffffffffb818de21>] ? system_call_after_swapgs+0xae/0x146
Code: 48 63 35 ee 5e c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 20 e8 74 b8 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 bd 5e c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #8918
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff84d16a6a
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff84c7e478
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff84c7e4eb
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff84dfc46d
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffff84cc9e30
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff84dfc673
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x163
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff84dfcb02
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff84dfcc23
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x13
|
|
9
|
tracesys
|
vmlinux |
0xffffffff8538e172
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0xa6
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 23s! [VM Thread:25671]
Modules linked in: nfsv3 nfs_acl rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache veth nf_conntrack_netlink xt_addrtype br_netfilter xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink overlay(T) ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat iptable_mangle iptable_security iptable_raw nf_conntrack ip_set nfnetlink ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc ppdev vmw_balloon sb_edac iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel
lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc vmw_vmci parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm nfit crct10dif_pclmul libata mptspi crct10dif_common crc32c_intel libnvdimm scsi_transport_spi serio_raw mptscsih mptbase vmxnet3 drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 6 PID: 25671 Comm: VM Thread Kdump: loaded Tainted: G W L ------------ T 3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff97c69c7b3150 ti: ffff97c6ac728000 task.ti: ffff97c6ac728000
RIP: 0010:[<ffffffff84d16a6a>] [<ffffffff84d16a6a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff97c6ac72bc70 EFLAGS: 00000202
RAX: 0000000000000007 RBX: ffffffff84c7e2b0 RCX: ffff97c6ffde06c8
RDX: 0000000000000007 RSI: 0000000000000008 RDI: 0000000000000000
RBP: ffff97c6ac72bca8 R08: ffff97c0344b2400 R09: ffffffff84f817e9
R10: ffff97c6ffd9f160 R11: ffffcd859fe49600 R12: ffff97c6ac72bc40
R13: ffffffff84f8173f R14: ffff97c6ffd80000 R15: ffffffff84c2b981
FS: 00007fcd06e07700(0000) GS:ffff97c6ffd80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fcd1c146000 CR3: 000000080d29e000 CR4: 00000000001607e0
Call Trace:
[<ffffffff84c7e478>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff84c7e4eb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff84dfc46d>] change_protection+0x5cd/0x670
[<ffffffff84cc9e30>] ? hrtimer_get_res+0x50/0x50
[<ffffffff84dfc673>] mprotect_fixup+0x163/0x3a0
[<ffffffff84dfcb02>] do_mprotect_pkey+0x252/0x360
[<ffffffff84dfcc23>] SyS_mprotect+0x13/0x20
[<ffffffff8538e172>] tracesys+0xa6/0xcc
Code: 48 63 35 fe 5e c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 20 e8 94 85 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 cd 5e c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #8263
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff9a517618
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x208
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9a47e8f8
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9a47e96b
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff9a5fe26d
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x5dd
|
|
5
|
mprotect_fixup
|
vmlinux |
0xffffffff9a5fe473
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x163
|
|
6
|
do_mprotect_pkey
|
vmlinux |
0xffffffff9a5fe8ee
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x23e
|
|
7
|
SyS_mprotect
|
vmlinux |
0xffffffff9a5fea43
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x13
|
|
8
|
system_call_fastpath
|
vmlinux |
0xffffffff9ab92ed2
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0x25
|
|
9
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffff9ab92e15
Build id: 3.10.0-1127.19.1.el7.x86_64
|
0xa2
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [VM Thread:4620]
Modules linked in: ip6table_filter ip6_tables xt_time nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack tcp_diag inet_diag ipt_REJECT nf_reject_ipv4 xt_owner xt_multiport iptable_filter ext4 mbcache jbd2 loop dm_mirror dm_region_hash dm_log dm_mod pcspkr ppdev parport_pc sg parport joydev i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx drm_kms_helper virtio_blk syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm libata e1000 virtio_pci virtio_ring serio_raw virtio drm_panel_orientation_quirks floppy
CPU: 2 PID: 4620 Comm: VM Thread Kdump: loaded Tainted: G L ------------ 3.10.0-1127.19.1.el7.x86_64 #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.13.0-0-gf21b5a4aeb02-prebuilt.qemu.org 04/01/2014
task: ffff971e16fdc1c0 ti: ffff971de0658000 task.ti: ffff971de0658000
RIP: 0010:[<ffffffff9a517618>] [<ffffffff9a517618>] smp_call_function_many+0x208/0x270
RSP: 0018:ffff971de065bc70 EFLAGS: 00000202
RAX: 0000000000000004 RBX: 000800009a47e730 RCX: ffff971e27d20428
RDX: 0000000000000004 RSI: 0000000000000006 RDI: 0000000000000000
RBP: ffff971de065bca8 R08: ffff971b7a191400 R09: ffffffff9a7851b9
R10: ffff971e27c9f160 R11: ffffdf75ceaede00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff971de065bc20 R15: ffffffff9a42b621
FS: 00007fbf04f25700(0000) GS:ffff971e27c80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00002b940926fbd0 CR3: 00000003e5670000 CR4: 00000000000006e0
Call Trace:
[<ffffffff9a47e8f8>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9a47e96b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9a5fe26d>] change_protection+0x5dd/0x680
[<ffffffff9a5fe473>] mprotect_fixup+0x163/0x3a0
[<ffffffff9a5fe8ee>] do_mprotect_pkey+0x23e/0x380
[<ffffffff9a5fea43>] SyS_mprotect+0x13/0x20
[<ffffffff9ab92ed2>] system_call_fastpath+0x25/0x2a
[<ffffffff9ab92e15>] ? system_call_after_swapgs+0xa2/0x13a
Code: 28 00 48 63 35 ce 7b c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 10 15 9b f6 41 20 01 74 cd 0f 1f 44 00 00 <f3> 90 f6 41 20 01 75 f8 48 63 35 9d 7b c4 00 eb b7 0f b6 4d cc
Complete report #6066
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff9751519a
Build id: 3.10.0-1062.4.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9747d478
Build id: 3.10.0-1062.4.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9747d4eb
Build id: 3.10.0-1062.4.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff975fab9d
Build id: 3.10.0-1062.4.1.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffff974c8df0
Build id: 3.10.0-1062.4.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff975fada3
Build id: 3.10.0-1062.4.1.el7.x86_64
|
0x163
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff975fb232
Build id: 3.10.0-1062.4.1.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff975fb353
Build id: 3.10.0-1062.4.1.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff97b8bede
Build id: 3.10.0-1062.4.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#11 stuck for 24s! [java:13224]
Modules linked in: vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod sb_edac coretemp ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev sg i2c_piix4 vmw_vmci parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul ata_generic pata_acpi crct10dif_common mptsas crc32c_intel ahci serio_raw drm scsi_transport_sas ata_piix libahci mptscsih libata vmxnet3 mptbase drm_panel_orientation_quirks
CPU: 11 PID: 13224 Comm: java Kdump: loaded Not tainted 3.10.0-1062.4.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff8b2f92f9a0e0 ti: ffff8b2f91f4c000 task.ti: ffff8b2f91f4c000
RIP: 0010:[<ffffffff9751519a>] [<ffffffff9751519a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8b2f91f4fc70 EFLAGS: 00000202
RAX: 0000000000000007 RBX: 000800009747d2b0 RCX: ffff8b2f9d7e0790
RDX: 0000000000000007 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff8b2f91f4fca8 R08: ffff8b28f41b9400 R09: ffffffff9777fe99
R10: ffff8b2f9d8df160 R11: ffffed2de04ca000 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8b2f91f4fc20 R15: ffffffff9742b621
FS: 00007fb2ed3d5700(0000) GS:ffff8b2f9d8c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7d7cbf8020 CR3: 0000000800b58000 CR4: 00000000001607e0
Call Trace:
[<ffffffff9747d478>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9747d4eb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff975fab9d>] change_protection+0x5cd/0x670
[<ffffffff974c8df0>] ? hrtimer_get_res+0x50/0x50
[<ffffffff975fada3>] mprotect_fixup+0x163/0x3a0
[<ffffffff975fb232>] do_mprotect_pkey+0x252/0x360
[<ffffffff975fb353>] SyS_mprotect+0x13/0x20
[<ffffffff97b8bede>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 6e 66 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 d6 14 98 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 3d 66 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #3523
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff9c116a7a
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9c07e478
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9c07e4eb
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff9c1fc4dd
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffff9c0c9e30
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff9c1fc6e3
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x163
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff9c1fcb72
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff9c1fcc93
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff9c78dede
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0x25
|
|
10
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffff9c78de21
Build id: 3.10.0-1062.12.1.el7.x86_64
|
0xae
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 23s! [java:28681]
Modules linked in: xt_nat veth dcdbas nf_conntrack_netlink nfnetlink br_netfilter bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop overlay vmw_vsock_vmci_transport vsock xt_comment xt_conntrack iptable_filter ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_addrtype iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack ext4 mbcache jbd2 sb_edac ppdev vmw_balloon iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul parport_pc glue_helper ablk_helper sg vmw_vmci parport cryptd pcspkr i2c_piix4 joydev binfmt_misc auth_rpcgss sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix mptspi crct10dif_pclmul libata
scsi_transport_spi crct10dif_common nfit crc32c_intel mptscsih e1000 serio_raw libnvdimm mptbase drm_panel_orientation_quirks floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 4 PID: 28681 Comm: java Kdump: loaded Tainted: G L ------------ 3.10.0-1062.12.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff8c2f8833c1c0 ti: ffff8c2a1c294000 task.ti: ffff8c2a1c294000
RIP: 0010:[<ffffffff9c116a7a>] [<ffffffff9c116a7a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8c2a1c297c70 EFLAGS: 00000202
RAX: 0000000000000012 RBX: ffffffff9c07e2b0 RCX: ffff8c32cd4a0678
RDX: 0000000000000012 RSI: 0000000000000014 RDI: 0000000000000000
RBP: ffff8c2a1c297ca8 R08: ffff8c27acd51c00 R09: ffffffff9c381839
R10: ffff8c32cd11f160 R11: ffffe39af21f4e00 R12: 0000000000000286
R13: ffff8c2a1c297c20 R14: ffff8c32cd100000 R15: ffffffff9c02b621
FS: 00007fd1775dd700(0000) GS:ffff8c32cd100000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fedcbb1a600 CR3: 0000000427a20000 CR4: 00000000000407e0
Call Trace:
[<ffffffff9c07e478>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9c07e4eb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff9c1fc4dd>] change_protection+0x5cd/0x670
[<ffffffff9c0c9e30>] ? hrtimer_get_res+0x50/0x50
[<ffffffff9c1fc6e3>] mprotect_fixup+0x163/0x3a0
[<ffffffff9c1fcb72>] do_mprotect_pkey+0x252/0x360
[<ffffffff9c1fcc93>] SyS_mprotect+0x13/0x20
[<ffffffff9c78dede>] system_call_fastpath+0x25/0x2a
[<ffffffff9c78de21>] ? system_call_after_swapgs+0xae/0x146
Code: 48 63 35 ee 5e c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 20 e8 d4 9c f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 bd 5e c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #770
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffffb2716a6a
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffffb267e478
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffffb267e4eb
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffffb27fc46d
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffffb26c9e30
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x50
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffffb27fc673
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x163
|
|
7
|
|
vmlinux |
0xffffffffb2d88678
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x238
|
|
8
|
do_mprotect_pkey
|
vmlinux |
0xffffffffb27fcb02
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x252
|
|
9
|
SyS_mprotect
|
vmlinux |
0xffffffffb27fcc23
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x13
|
|
10
|
system_call_fastpath
|
vmlinux |
0xffffffffb2d8dede
Build id: 3.10.0-1062.9.1.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 21s! [VM Thread:11273]
Modules linked in: tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter binfmt_misc sunrpc nfit libnvdimm ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper sg ablk_helper cryptd joydev pcspkr virtio_balloon parport_pc parport i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom cirrus ata_generic drm_kms_helper pata_acpi syscopyarea sysfillrect sysimgblt fb_sys_fops ttm virtio_console virtio_blk ata_piix crct10dif_pclmul drm 8139too libata crct10dif_common crc32c_intel virtio_pci virtio_ring serio_raw 8139cp floppy drm_panel_orientation_quirks
mii virtio dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 11273 Comm: VM Thread Kdump: loaded Tainted: G L ------------ 3.10.0-1062.9.1.el7.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
task: ffff8b316da4b150 ti: ffff8b3235010000 task.ti: ffff8b3235010000
RIP: 0010:[<ffffffffb2716a6a>] [<ffffffffb2716a6a>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff8b3235013c70 EFLAGS: 00000202
RAX: 0000000000000003 RBX: 00080000b267e2b0 RCX: ffff8b323a1a0320
RDX: 0000000000000003 RSI: 000000000000000a RDI: 0000000000000000
RBP: ffff8b3235013ca8 R08: ffff8b3237ab9c00 R09: ffffffffb29817e9
R10: ffff8b323a09f160 R11: ffffd6dcc5cc1600 R12: 0000000000000282
R13: 0000000000000282 R14: ffff8b3235013c20 R15: ffffd6dcc52f7100
FS: 00007f30423e3700(0000) GS:ffff8b323a080000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3078f2d600 CR3: 00000000a7120000 CR4: 00000000007606e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffffb267e478>] native_flush_tlb_others+0xb8/0xc0
[<ffffffffb267e4eb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffffb27fc46d>] change_protection+0x5cd/0x670
[<ffffffffb26c9e30>] ? hrtimer_get_res+0x50/0x50
[<ffffffffb27fc673>] mprotect_fixup+0x163/0x3a0
[<ffffffffb2d88678>] ? __do_page_fault+0x238/0x500
[<ffffffffb27fcb02>] do_mprotect_pkey+0x252/0x360
[<ffffffffb27fcc23>] SyS_mprotect+0x13/0x20
[<ffffffffb2d8dede>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 fe 5e c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 20 e8 34 b3 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 cd 5e c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #768192
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff8b9150ca
Build id: 3.10.0-1062.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff8b87d398
Build id: 3.10.0-1062.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff8b87d40b
Build id: 3.10.0-1062.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff8b9fa5ad
Build id: 3.10.0-1062.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffff8b9ef4a5
Build id: 3.10.0-1062.el7.x86_64
|
0x3d5
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff8b9fa7b3
Build id: 3.10.0-1062.el7.x86_64
|
0x163
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff8b9fac42
Build id: 3.10.0-1062.el7.x86_64
|
0x252
|
NMI watchdog: BUG: soft lockup - CPU#10 stuck for 21s! [java:70357]
Modules linked in: binfmt_misc nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus snd_seq ppdev snd_seq_device snd_pcm vmw_balloon snd_timer snd iosf_mbi crc32_pclmul ghash_clmulni_intel sg soundcore aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev parport_pc parport i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic
ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nfit libnvdimm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel mptspi libata scsi_transport_spi e1000 mptscsih serio_raw mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 10 PID: 70357 Comm: java Kdump: loaded Tainted: G L ------------ T 3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff93da8baa62a0 ti: ffff93da4aa40000 task.ti: ffff93da4aa40000
RIP: 0010:[<ffffffff8b9150ca>] [<ffffffff8b9150ca>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff93da4aa43c70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 000800008b87d1d0 RCX: ffff93dc3d620718
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff93da4aa43ca8 R08: ffff93cda9665800 R09: ffffffff8bb7f629
R10: ffff93dc3d89f160 R11: fffffd107c8bf000 R12: 0000000000000282
R13: 0000000000000018 R14: ffff93da4aa43be0 R15: 0000000000000282
FS: 00007f424d595700(0000) GS:ffff93dc3d880000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f42b290a600 CR3: 0000000b613b4000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffff8b87d398>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8b87d40b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff8b9fa5ad>] change_protection+0x5cd/0x670
[<ffffffff8b9ef4a5>] ? handle_pte_fault+0x3d5/0xe20
[<ffffffff8b9fa7b3>] mprotect_fixup+0x163/0x3a0
[<ffffffff8b9fac42>] do_mprotect_pkey+0x252/0x360
Complete report #592716
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff985161da
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff9847e478
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff9847e4eb
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff985fbbdd
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffff985f0ad5
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x3d5
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff985fbde3
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x163
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff985fc272
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff985fc393
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff98b8cede
Build id: 3.10.0-1062.4.3.el7.x86_64
|
0x25
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 22s! [VM Thread:4755]
Modules linked in: veth xt_nat nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter devlink ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc coretemp nfit libnvdimm iosf_mbi ppdev crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper vmw_balloon ablk_helper cryptd joydev pcspkr sg i2c_piix4 vmw_vmci parport_pc parport binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi vmwgfx sd_mod crc_t10dif crct10dif_generic drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ahci ata_piix
libahci drm libata crct10dif_pclmul crct10dif_common vmw_pvscsi crc32c_intel serio_raw vmxnet3 drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 6 PID: 4755 Comm: VM Thread Kdump: loaded Tainted: G L ------------ T 3.10.0-1062.4.3.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff9e8a03fb41c0 ti: ffff9e89fb370000 task.ti: ffff9e89fb370000
RIP: 0010:[<ffffffff985161da>] [<ffffffff985161da>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff9e89fb373c70 EFLAGS: 00000202
RAX: 0000000000000004 RBX: 000800009847e2b0 RCX: ffff9e8a3fd206c8
RDX: 0000000000000004 RSI: 0000000000000008 RDI: 0000000000000000
RBP: ffff9e89fb373ca8 R08: ffff9e887ace8000 R09: ffffffff98780ed9
R10: ffff9e8a3fd9f160 R11: ffffddbac9f4aa00 R12: 0000000000000282
R13: 0000000000000282 R14: ffff9e89fb373c20 R15: ffffffffc02d3644
FS: 00007f8e16fef700(0000) GS:ffff9e8a3fd80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8e5019a600 CR3: 0000000314394000 CR4: 00000000007607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
PKRU: 55555554
Call Trace:
[<ffffffff9847e478>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff9847e4eb>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff985fbbdd>] change_protection+0x5cd/0x670
[<ffffffff985f0ad5>] ? handle_pte_fault+0x3d5/0xe20
[<ffffffff985fbde3>] mprotect_fixup+0x163/0x3a0
[<ffffffff985fc272>] do_mprotect_pkey+0x252/0x360
[<ffffffff985fc393>] SyS_mprotect+0x13/0x20
[<ffffffff98b8cede>] system_call_fastpath+0x25/0x2a
Code: 48 63 35 0e 57 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 a0 d7 14 99 f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 dd 56 c4 00 eb b7 0f b6 4d cc 4c 89
Complete report #386987
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
smp_call_function_many
|
vmlinux |
0xffffffff8d9150ca
Build id: 3.10.0-1062.el7.x86_64
|
0x20a
|
|
2
|
native_flush_tlb_others
|
vmlinux |
0xffffffff8d87d398
Build id: 3.10.0-1062.el7.x86_64
|
0xb8
|
|
3
|
flush_tlb_mm_range
|
vmlinux |
0xffffffff8d87d40b
Build id: 3.10.0-1062.el7.x86_64
|
0x6b
|
|
4
|
change_protection
|
vmlinux |
0xffffffff8d9fa5ad
Build id: 3.10.0-1062.el7.x86_64
|
0x5cd
|
|
5
|
|
vmlinux |
0xffffffff8d9ef4a5
Build id: 3.10.0-1062.el7.x86_64
|
0x3d5
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff8d9fa7b3
Build id: 3.10.0-1062.el7.x86_64
|
0x163
|
|
7
|
do_mprotect_pkey
|
vmlinux |
0xffffffff8d9fac42
Build id: 3.10.0-1062.el7.x86_64
|
0x252
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff8d9fad63
Build id: 3.10.0-1062.el7.x86_64
|
0x13
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff8df8bede
Build id: 3.10.0-1062.el7.x86_64
|
0x25
|
|
10
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffff8df8be21
Build id: 3.10.0-1062.el7.x86_64
|
0xae
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [java:15488]
Modules linked in: tcp_lp nls_utf8 isofs fuse nf_conntrack_netlink nfnetlink xt_addrtype br_netfilter xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter devlink ebtables ip6table_filter ip6_tables iptable_filter overlay(T) vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 snd_seq_midi snd_seq_midi_event snd_ens1371 ppdev snd_rawmidi vmw_balloon snd_ac97_codec ac97_bus snd_seq snd_seq_device snd_pcm snd_timer snd crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul soundcore glue_helper ablk_helper pcspkr cryptd joydev sg parport_pc parport vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif
crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel nfit ata_piix libnvdimm mptspi libata scsi_transport_spi serio_raw mptscsih e1000 mptbase drm_panel_orientation_quirks dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 15488 Comm: java Kdump: loaded Tainted: G ------------ T 3.10.0-1062.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/13/2018
task: ffff97febefa3150 ti: ffff97fe73f9c000 task.ti: ffff97fe73f9c000
RIP: 0010:[<ffffffff8d9150ca>] [<ffffffff8d9150ca>] smp_call_function_many+0x20a/0x270
RSP: 0018:ffff97fe73f9fc70 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 000800008d87d1d0 RCX: ffff98021d620470
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffff97fe73f9fca8 R08: ffff97fb74533c00 R09: ffffffff8db7f629
R10: ffff98021d65f160 R11: ffffe9f3606c8200 R12: 0000000000000282
R13: 0000000000000282 R14: ffff97fe73f9fc20 R15: ffffffffc069c644
FS: 00007efe76481700(0000) GS:ffff98021d640000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007efe9dae5600 CR3: 000000047565c000 CR4: 00000000000007e0
Call Trace:
[<ffffffff8d87d398>] native_flush_tlb_others+0xb8/0xc0
[<ffffffff8d87d40b>] flush_tlb_mm_range+0x6b/0x140
[<ffffffff8d9fa5ad>] change_protection+0x5cd/0x670
[<ffffffff8d9ef4a5>] ? handle_pte_fault+0x3d5/0xe20
[<ffffffff8d9fa7b3>] mprotect_fixup+0x163/0x3a0
[<ffffffff8d9fac42>] do_mprotect_pkey+0x252/0x360
[<ffffffff8d9fad63>] SyS_mprotect+0x13/0x20
[<ffffffff8df8bede>] system_call_fastpath+0x25/0x2a
[<ffffffff8df8be21>] ? system_call_after_swapgs+0xae/0x146
Code: 48 63 35 3e 68 c4 00 89 c2 39 f0 0f 8d 7d fe ff ff 48 98 49 8b 0f 48 03 0c c5 e0 d7 54 8e f6 41 20 01 74 cd 0f 1f 44 00 00 f3 90 <f6> 41 20 01 75 f8 48 63 35 0d 68 c4 00 eb b7 0f b6 4d cc 4c 89