Complete report #1422715
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_queued_spin_lock_slowpath
|
vmlinux |
0xffffffff810fdead
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x1d
|
|
2
|
queued_spin_lock_slowpath
|
vmlinux |
0xffffffff816a8ff4
Build id: 3.10.0-693.21.1.el7.x86_64
|
0xb
|
|
3
|
_raw_spin_lock
|
vmlinux |
0xffffffff816b6850
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x20
|
|
4
|
change_protection_range
|
vmlinux |
0xffffffff811be2c4
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x354
|
|
5
|
change_protection
|
vmlinux |
0xffffffff811be7b5
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x65
|
|
6
|
|
vmlinux |
0xffffffff811bb8cf
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x3f
|
|
7
|
mprotect_fixup
|
vmlinux |
0xffffffff811be8f7
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x107
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff811beb9b
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x16b
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff816c0715
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x1c
|
|
10
|
?
system_call_after_swapgs
|
vmlinux |
0xffffffff816c0661
Build id: 3.10.0-693.21.1.el7.x86_64
|
0xae
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 32s! [java:27592]
Modules linked in: sctp_diag sctp dccp_diag dccp tcp_diag udp_diag inet_diag unix_diag nfsv3 nfs fscache xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter binfmt_misc vmw_vsock_vmci_transport vsock sb_edac edac_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd sg ppdev joydev vmw_balloon parport_pc pcspkr nfit libnvdimm parport shpchp i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc fuse ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm crc32c_intel serio_raw ata_piix mptspi libata scsi_transport_spi mptscsih mptbase vmxnet3 i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 4 PID: 27592 Comm: java Tainted: G L ------------ 3.10.0-693.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 12/12/2018
task: ffff880168618fd0 ti: ffff8801642d4000 task.ti: ffff8801642d4000
RIP: 0010:[<ffffffff810fdead>] [<ffffffff810fdead>] native_queued_spin_lock_slowpath+0x1d/0x200
RSP: 0018:ffff8801642d7d10 EFLAGS: 00000293
RAX: 0000000000000001 RBX: ffff88043fd539a0 RCX: 0000000000000001
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffea00014d3bb0
RBP: ffff8801642d7d10 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: ffff8801642d7f10 R12: ffff8801642d7d38
R13: ffffffff810b7c46 R14: ffff8801642d7ca8 R15: ffff88043fd539a0
FS: 00007faecade6700(0000) GS:ffff88043fd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007faee42b0a00 CR3: 0000000061a38000 CR4: 00000000000607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff816a8ff4>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffff816b6850>] _raw_spin_lock+0x20/0x30
[<ffffffff811be2c4>] change_protection_range+0x354/0x7e0
[<ffffffff811be7b5>] change_protection+0x65/0xa0
[<ffffffff811bb8cf>] ? vma_set_page_prot+0x3f/0x60
[<ffffffff811be8f7>] mprotect_fixup+0x107/0x240
[<ffffffff811beb9b>] SyS_mprotect+0x16b/0x290
[<ffffffff816c0715>] system_call_fastpath+0x1c/0x21
[<ffffffff816c0661>] ? system_call_after_swapgs+0xae/0x146
Code: 3f fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 66 90 b9 01 00 00 00 8b 17 85 d2 74 0d 83 fa 03 74 08 f3 90 <8b> 17 85 d2 75 f3 89 d0 f0 0f b1 0f 39 c2 75 e3 5d 66 90 c3 0f
Complete report #408921
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_queued_spin_lock_slowpath
|
vmlinux |
0xffffffff810c96b2
Build id: 4.4.60-1.el7.elrepo.x86_64
|
0x22
|
|
2
|
queued_spin_lock_slowpath
|
vmlinux |
0xffffffff811875b4
Build id: 4.4.60-1.el7.elrepo.x86_64
|
0xb
|
|
3
|
_raw_spin_lock
|
vmlinux |
0xffffffff816fb370
Build id: 4.4.60-1.el7.elrepo.x86_64
|
0x20
|
|
4
|
change_protection_range
|
vmlinux |
0xffffffff811c22f7
Build id: 4.4.60-1.el7.elrepo.x86_64
|
0x647
|
|
5
|
change_protection
|
vmlinux |
0xffffffff811c24f4
Build id: 4.4.60-1.el7.elrepo.x86_64
|
0x14
|
|
6
|
mprotect_fixup
|
vmlinux |
0xffffffff811c2607
Build id: 4.4.60-1.el7.elrepo.x86_64
|
0xf7
|
|
7
|
SyS_mprotect
|
vmlinux |
0xffffffff811c28ca
Build id: 4.4.60-1.el7.elrepo.x86_64
|
0x16a
|
|
8
|
entry_SYSCALL_64_fastpath
|
vmlinux |
0xffffffff816fb72e
Build id: 4.4.60-1.el7.elrepo.x86_64
|
0x12
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 28s! [VM Thread:13271]
Modules linked in: zram lz4_compress ip6t_REJECT nf_reject_ipv6 nf_conntrack_ipv6 nf_defrag_ipv6 xt_conntrack nf_conntrack ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock coretemp crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ppdev vmw_balloon ablk_helper cryptd sg pcspkr input_leds 8250_fintek parport_pc parport vmw_vmci shpchp i2c_piix4 acpi_cpufreq sch_fq_codel fuse binfmt_misc ip_tables ext4 mbcache jbd2 sr_mod cdrom ata_generic pata_acpi sd_mod crc32c_intel vmwgfx drm_kms_helper serio_raw syscopyarea sysfillrect sysimgblt fb_sys_fops ttm vmxnet3 ata_piix drm vmw_pvscsi libata floppy fjes dm_mirror dm_region_hash dm_log dm_mod
CPU: 4 PID: 13271 Comm: VM Thread Tainted: G L 4.4.60-1.el7.elrepo.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff88061ed81500 ti: ffff880b1d8f8000 task.ti: ffff880b1d8f8000
RIP: 0010:[<ffffffff810c96b2>] [<ffffffff810c96b2>] native_queued_spin_lock_slowpath+0x22/0x170
RSP: 0000:ffff880b1d8fbd38 EFLAGS: 00000202
RAX: 0000000000000001 RBX: 00003ffffffff000 RCX: 000000085860e000
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffea00216183b0
RBP: ffff880b1d8fbd38 R08: 0000000000000000 R09: ffffea00216183b0
R10: ffff880b1d8fbf10 R11: 0000000000000000 R12: ffff88085860e360
R13: ffff880be3be3418 R14: 00007f445066d000 R15: 00007f445066c000
FS: 00007f44349b0700(0000) GS:ffff880c4d700000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f7e19e3f000 CR3: 0000000b1df42000 CR4: 00000000000006e0
Stack:
ffff880b1d8fbd48 ffffffff811875b4 ffff880b1d8fbd58 ffffffff816fb370
ffff880b1d8fbe60 ffffffff811c22f7 00007f445066c000 ffff880bc7b00f80
0000000000000000 00007f445066cfff 0000000000000000 00007f445066d000
Call Trace:
[<ffffffff811875b4>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffff816fb370>] _raw_spin_lock+0x20/0x30
[<ffffffff811c22f7>] change_protection_range+0x647/0x830
[<ffffffff811c24f4>] change_protection+0x14/0x30
[<ffffffff811c2607>] mprotect_fixup+0xf7/0x250
[<ffffffff811c28ca>] SyS_mprotect+0x16a/0x260
[<ffffffff816fb72e>] entry_SYSCALL_64_fastpath+0x12/0x71
Code: 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 66 90 ba 01 00 00 00 8b 07 85 c0 75 0a f0 0f b1 17 85 c0 75 f2 5d c3 f3 90 <eb> ec 81 fe 00 01 00 00 0f 84 8e 00 00 00 41 b8 01 01 00 00 b9
Complete report #107868
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
native_queued_spin_lock_slowpath
|
vmlinux |
0xffffffff810fa232
Build id: 3.10.0-693.el7.x86_64
|
0x22
|
|
2
|
queued_spin_lock_slowpath
|
vmlinux |
0xffffffff8169e5ff
Build id: 3.10.0-693.el7.x86_64
|
0xb
|
|
3
|
_raw_spin_lock
|
vmlinux |
0xffffffff816abb50
Build id: 3.10.0-693.el7.x86_64
|
0x20
|
|
4
|
change_protection_range
|
vmlinux |
0xffffffff811b9a44
Build id: 3.10.0-693.el7.x86_64
|
0x354
|
|
5
|
change_protection
|
vmlinux |
0xffffffff811b9f35
Build id: 3.10.0-693.el7.x86_64
|
0x65
|
|
6
|
|
vmlinux |
0xffffffff811b704f
Build id: 3.10.0-693.el7.x86_64
|
0x3f
|
|
7
|
mprotect_fixup
|
vmlinux |
0xffffffff811ba077
Build id: 3.10.0-693.el7.x86_64
|
0x107
|
|
8
|
SyS_mprotect
|
vmlinux |
0xffffffff811ba31b
Build id: 3.10.0-693.el7.x86_64
|
0x16b
|
|
9
|
system_call_fastpath
|
vmlinux |
0xffffffff816b4fc9
Build id: 3.10.0-693.el7.x86_64
|
0x16
|
NMI watchdog: BUG: soft lockup - CPU#5 stuck for 22s! [java:48518]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event coretemp crc32_pclmul snd_ens1371 ghash_clmulni_intel snd_rawmidi snd_ac97_codec ac97_bus ppdev aesni_intel snd_seq lrw gf128mul glue_helper ablk_helper cryptd snd_seq_device vmw_balloon snd_pcm snd_timer pcspkr joydev snd soundcore sg vmw_vmci i2c_piix4 shpchp parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom ata_generic sd_mod crc_t10dif crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea
sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm crc32c_intel ata_piix mptspi libata e1000 scsi_transport_spi serio_raw mptscsih mptbase i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 5 PID: 48518 Comm: java Tainted: G L ------------ 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/02/2012
task: ffff8801a6395ee0 ti: ffff88022c264000 task.ti: ffff88022c264000
RIP: 0010:[<ffffffff810fa232>] [<ffffffff810fa232>] native_queued_spin_lock_slowpath+0x22/0x1e0
RSP: 0018:ffff88022c267d40 EFLAGS: 00000202
RAX: 0000000000000001 RBX: ffff88022c267d68 RCX: ffff8800000006d0
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffea0002de6ab0
RBP: ffff88022c267d40 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: ffff88022c267f40 R12: ffff8801a6395ee0
R13: ffff8801a6395ee0 R14: ffff88022c267fd8 R15: ffff88022c267fd8
FS: 00007fc63e561700(0000) GS:ffff880236740000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f2872bc8000 CR3: 000000004a10f000 CR4: 00000000000007e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
ffff88022c267d50 ffffffff8169e5ff ffff88022c267d60 ffffffff816abb50
ffff88022c267e60 ffffffff811b9a44 00007fc6638da000 ffff8802321e7080
0000000000000000 00007fc6638dafff 0000000000000000 00007fc6638db000
Call Trace:
[<ffffffff8169e5ff>] queued_spin_lock_slowpath+0xb/0xf
[<ffffffff816abb50>] _raw_spin_lock+0x20/0x30
[<ffffffff811b9a44>] change_protection_range+0x354/0x7e0
[<ffffffff811b9f35>] change_protection+0x65/0xa0
[<ffffffff811b704f>] ? vma_set_page_prot+0x3f/0x60
[<ffffffff811ba077>] mprotect_fixup+0x107/0x240
[<ffffffff811ba31b>] SyS_mprotect+0x16b/0x290
[<ffffffff816b4fc9>] system_call_fastpath+0x16/0x1b
Code: 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 55 48 89 e5 66 90 ba 01 00 00 00 8b 07 85 c0 75 0a f0 0f b1 17 85 c0 75 f2 5d c3 f3 90 <eb> ec 0f 1f 40 00 81 fe 00 01 00 00 66 90 0f 84 5c 01 00 00 41