Complete report #1418630
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
isolate_freepages_block
|
vmlinux |
0xffffffff811a77ec
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x9c
|
|
2
|
compaction_alloc
|
vmlinux |
0xffffffff811a7c3d
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x22d
|
|
3
|
migrate_pages
|
vmlinux |
0xffffffff811e6be1
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x221
|
|
4
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff811a7a10
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x2c0
|
|
5
|
compact_zone
|
vmlinux |
0xffffffff811a8aa9
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x2d9
|
|
6
|
|
vmlinux |
0xffffffff8159529b
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x11b
|
|
7
|
compact_zone_order
|
vmlinux |
0xffffffff811a8c9c
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x9c
|
|
8
|
|
vmlinux |
0xffffffff811a3128
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x88
|
|
9
|
try_to_compact_pages
|
vmlinux |
0xffffffff811a9051
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x121
|
|
10
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff8169f69d
Build id: 3.10.0-693.11.1.el7.x86_64
|
0xac
|
|
11
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff8169fb6d
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x3e9
|
|
12
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118cdb5
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x405
|
|
13
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1078
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x98
|
|
14
|
get_huge_zero_page
|
vmlinux |
0xffffffff811ea775
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x45
|
|
15
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff811edaed
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x31d
|
|
16
|
handle_mm_fault
|
vmlinux |
0xffffffff811b24ff
Build id: 3.10.0-693.11.1.el7.x86_64
|
0xd0f
|
|
17
|
__do_page_fault
|
vmlinux |
0xffffffff816b0074
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x154
|
|
18
|
do_page_fault
|
vmlinux |
0xffffffff816b03a5
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x35
|
|
19
|
page_fault
|
vmlinux |
0xffffffff816ac5c8
Build id: 3.10.0-693.11.1.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [pool:31654]
Modules linked in: tcp_lp fuse tcp_diag inet_diag binfmt_misc ebtable_filter ebtables ip6_tables iptable_filter vmw_vsock_vmci_transport vsock dm_mirror dm_region_hash dm_log dm_mod edac_core iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev nfit vmw_balloon pcspkr sg joydev libnvdimm parport_pc parport i2c_piix4 vmw_vmci shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw drm mptspi scsi_transport_spi ata_piix mptscsih mptbase vmxnet3 libata i2c_core
CPU: 3 PID: 31654 Comm: pool Not tainted 3.10.0-693.11.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff88040cadaf70 ti: ffff880426724000 task.ti: ffff880426724000
RIP: 0010:[<ffffffff811a77ec>] [<ffffffff811a77ec>] isolate_freepages_block+0x9c/0x2c0
RSP: 0000:ffff880426727878 EFLAGS: 00010206
RAX: 00000000ffffffff RBX: ffff880420252fa0 RCX: ffff880426727a70
RDX: 000000000024c200 RSI: ffff880426727ac8 RDI: ffff880426727a70
RBP: ffff880426727908 R08: 0000000000000000 R09: ffff88043ffd8000
R10: 0000000000100200 R11: 0000000000440000 R12: ffff88003567ee00
R13: ffff8804267278f0 R14: 0000000000000000 R15: ffff88042b73cae0
FS: 00007f8ec7fff700(0000) GS:ffff88043fd80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8df1ff9bec CR3: 000000041f6bf000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000440000 ffff88043fbd4ee0 ffff880426727960 0000000000000004
ffff880426727a70 ffff880426727ab0 ffff880426727ac8 ffff880426727a70
ffff88043ffd6900 0000000000000000 000000000024c200 0000000000000001
Call Trace:
[<ffffffff811a7c3d>] compaction_alloc+0x22d/0x2a0
[<ffffffff811e6be1>] migrate_pages+0x221/0x7a0
[<ffffffff811a7a10>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff811a8aa9>] compact_zone+0x2d9/0x430
[<ffffffff8159529b>] ? neigh_resolve_output+0x11b/0x220
[<ffffffff811a8c9c>] compact_zone_order+0x9c/0xf0
[<ffffffff811a3128>] ? zone_statistics+0x88/0xa0
[<ffffffff811a9051>] try_to_compact_pages+0x121/0x1a0
[<ffffffff8169f69d>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff8169fb6d>] __alloc_pages_slowpath+0x3e9/0x724
[<ffffffff8118cdb5>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff811d1078>] alloc_pages_current+0x98/0x110
[<ffffffff811ea775>] get_huge_zero_page+0x45/0xb0
[<ffffffff811edaed>] do_huge_pmd_anonymous_page+0x31d/0x530
[<ffffffff811b24ff>] handle_mm_fault+0xd0f/0xfa0
[<ffffffff816b0074>] __do_page_fault+0x154/0x450
[<ffffffff816b03a5>] do_page_fault+0x35/0x90
[<ffffffff816ac5c8>] page_fault+0x28/0x30
Code: 45 89 c5 48 89 75 a0 48 89 4d 90 83 f8 80 74 2e 45 84 ed 0f 85 16 01 00 00 49 83 c4 01 48 83 c3 40 4c 39 65 c0 0f 86 04 01 00 00 <8b> 43 18 41 83 c7 01 4d 85 f6 4c 0f 44 f3 83 f8 80 75 d2 48 8b
Complete report #1174079
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
isolate_freepages_block
|
vmlinux |
0xffffffff867b9e2c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
2
|
|
vmlinux |
0xffffffff866bbde5
Build id: 3.10.0-862.el7.x86_64
|
0x25
|
|
3
|
compaction_alloc
|
vmlinux |
0xffffffff867ba27d
Build id: 3.10.0-862.el7.x86_64
|
0x22d
|
|
4
|
migrate_pages
|
vmlinux |
0xffffffff867fef44
Build id: 3.10.0-862.el7.x86_64
|
0x224
|
|
5
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff867ba050
Build id: 3.10.0-862.el7.x86_64
|
0x2c0
|
|
6
|
compact_zone
|
vmlinux |
0xffffffff867bb139
Build id: 3.10.0-862.el7.x86_64
|
0x2d9
|
|
7
|
compact_zone_order
|
vmlinux |
0xffffffff867bb32c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
8
|
try_to_compact_pages
|
vmlinux |
0xffffffff867bb6e1
Build id: 3.10.0-862.el7.x86_64
|
0x121
|
|
9
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff86d09531
Build id: 3.10.0-862.el7.x86_64
|
0xac
|
|
10
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8679e95c
Build id: 3.10.0-862.el7.x86_64
|
0x99c
|
|
11
|
alloc_pages_current
|
vmlinux |
0xffffffff867e8528
Build id: 3.10.0-862.el7.x86_64
|
0x98
|
|
12
|
get_huge_zero_page
|
vmlinux |
0xffffffff86802ea5
Build id: 3.10.0-862.el7.x86_64
|
0x45
|
|
13
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff86807405
Build id: 3.10.0-862.el7.x86_64
|
0x2c5
|
|
14
|
handle_mm_fault
|
vmlinux |
0xffffffff867c7972
Build id: 3.10.0-862.el7.x86_64
|
0x892
|
|
15
|
__do_page_fault
|
vmlinux |
0xffffffff86d1a597
Build id: 3.10.0-862.el7.x86_64
|
0x197
|
|
16
|
do_page_fault
|
vmlinux |
0xffffffff86d1a925
Build id: 3.10.0-862.el7.x86_64
|
0x35
|
|
17
|
page_fault
|
vmlinux |
0xffffffff86d16768
Build id: 3.10.0-862.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#6 stuck for 21s! [java:11628]
Modules linked in: binfmt_misc xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c vfio_pci irqbypass vfio_iommu_type1 vfio ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr nfit sg vmw_pvscsi libnvdimm parport_pc vmw_vmci parport shpchp i2c_piix4 ip_tables ext4 mbcache jbd2 sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt
fb_sys_fops ttm ahci drm ata_piix libahci libata crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmxnet3 i2c_core
CPU: 6 PID: 11628 Comm: java Tainted: G L ------------ 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/28/2017
task: ffff8a76e86a8fd0 ti: ffff8a765cc2c000 task.ti: ffff8a765cc2c000
RIP: 0010:[<ffffffff867b9e2c>] [<ffffffff867b9e2c>] isolate_freepages_block+0x9c/0x2c0
RSP: 0018:ffff8a765cc2f8d8 EFLAGS: 00010202
RAX: 00000000ffffffff RBX: ffff8a765cc2f930 RCX: ffff8a765cc2fad0
RDX: 0000000000443a00 RSI: ffff8a765cc2fb28 RDI: ffff8a765cc2fad0
RBP: ffff8a765cc2f968 R08: 0000000000000000 R09: ffff8a7a3ffda000
R10: 0000000000101200 R11: 0000000000640000 R12: ffffed4cc4042c00
R13: 000000009c69b071 R14: ffff8a7579988800 R15: ffff8a764581be38
FS: 00007f091c53d700(0000) GS:ffff8a7a27380000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f60602f69e5 CR3: 000000020fdd6000 CR4: 00000000001607e0
Call Trace:
[<ffffffff866bbde5>] ? wake_up_bit+0x25/0x30
[<ffffffff867ba27d>] compaction_alloc+0x22d/0x2a0
[<ffffffff867fef44>] migrate_pages+0x224/0x7a0
[<ffffffff867ba050>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff867bb139>] compact_zone+0x2d9/0x430
[<ffffffff867bb32c>] compact_zone_order+0x9c/0xf0
[<ffffffff867bb6e1>] try_to_compact_pages+0x121/0x1a0
[<ffffffff86d09531>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff8679e95c>] __alloc_pages_nodemask+0x99c/0xbb0
[<ffffffff867e8528>] alloc_pages_current+0x98/0x110
[<ffffffff86802ea5>] get_huge_zero_page+0x45/0xb0
[<ffffffff86807405>] do_huge_pmd_anonymous_page+0x2c5/0x4a0
[<ffffffff867c7972>] handle_mm_fault+0x892/0x9b0
[<ffffffff86d1a597>] __do_page_fault+0x197/0x4f0
[<ffffffff86d1a925>] do_page_fault+0x35/0x90
[<ffffffff86d16768>] page_fault+0x28/0x30
Code: 45 89 c5 48 89 75 a0 48 89 4d 90 83 f8 80 74 2e 45 84 ed 0f 85 16 01 00 00 49 83 c4 01 48 83 c3 40 4c 39 65 c0 0f 86 04 01 00 00 <8b> 43 18 41 83 c7 01 4d 85 f6 4c 0f 44 f3 83 f8 80 75 d2 48 8b
Complete report #1035289
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
isolate_freepages_block
|
vmlinux |
0xffffffff98bb9e2c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
2
|
compaction_alloc
|
vmlinux |
0xffffffff98bba27d
Build id: 3.10.0-862.el7.x86_64
|
0x22d
|
|
3
|
migrate_pages
|
vmlinux |
0xffffffff98bfef44
Build id: 3.10.0-862.el7.x86_64
|
0x224
|
|
4
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff98bba050
Build id: 3.10.0-862.el7.x86_64
|
0x2c0
|
|
5
|
compact_zone
|
vmlinux |
0xffffffff98bbb139
Build id: 3.10.0-862.el7.x86_64
|
0x2d9
|
|
6
|
compact_zone_order
|
vmlinux |
0xffffffff98bbb32c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
7
|
try_to_compact_pages
|
vmlinux |
0xffffffff98bbb6e1
Build id: 3.10.0-862.el7.x86_64
|
0x121
|
|
8
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff99109531
Build id: 3.10.0-862.el7.x86_64
|
0xac
|
|
9
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff98b9e751
Build id: 3.10.0-862.el7.x86_64
|
0x791
|
|
10
|
|
xfs |
0xffffffffc047186e
Build id: 3.10.0-862.el7.x86_64
|
0x6e
|
|
11
|
alloc_pages_current
|
vmlinux |
0xffffffff98be8528
Build id: 3.10.0-862.el7.x86_64
|
0x98
|
|
12
|
get_huge_zero_page
|
vmlinux |
0xffffffff98c02ea5
Build id: 3.10.0-862.el7.x86_64
|
0x45
|
|
13
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff98c07405
Build id: 3.10.0-862.el7.x86_64
|
0x2c5
|
|
14
|
handle_mm_fault
|
vmlinux |
0xffffffff98bc7972
Build id: 3.10.0-862.el7.x86_64
|
0x892
|
|
15
|
__do_page_fault
|
vmlinux |
0xffffffff9911a597
Build id: 3.10.0-862.el7.x86_64
|
0x197
|
|
16
|
do_page_fault
|
vmlinux |
0xffffffff9911a925
Build id: 3.10.0-862.el7.x86_64
|
0x35
|
|
17
|
|
vmlinux |
0xffffffff99116ab6
Build id: 3.10.0-862.el7.x86_64
|
0xa7
|
|
18
|
page_fault
|
vmlinux |
0xffffffff99116768
Build id: 3.10.0-862.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [java:48629]
Modules linked in: ip6t_REJECT nf_reject_ipv6 nf_log_ipv6 nf_log_ipv4 nf_log_common nf_nat_ftp xt_REDIRECT nf_nat_redirect nf_conntrack_ftp xt_LOG xt_limit xt_multiport xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_conntrack tun bridge stp llc devlink ebtable_filter ebtables ip6table_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 ip6table_mangle ip6table_raw ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 nf_nat nf_conntrack ip6_tables iptable_mangle iptable_raw ipt_REJECT nf_reject_ipv4 iptable_filter vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event sb_edac coretemp snd_ens1371 iosf_mbi crc32_pclmul ghash_clmulni_intel snd_rawmidi ppdev aesni_intel snd_ac97_codec lrw gf128mul glue_helper ac97_bus ablk_helper vmw_balloon cryptd snd_seq
snd_seq_device snd_pcm pcspkr joydev snd_timer snd soundcore sg vmw_vmci shpchp i2c_piix4 parport_pc parport ip_tables xfs libcrc32c sd_mod sr_mod crc_t10dif crct10dif_generic cdrom crct10dif_pclmul crct10dif_common crc32c_intel ata_generic pata_acpi serio_raw vmwgfx drm_kms_helper syscopyarea ata_piix sysfillrect sysimgblt fb_sys_fops ttm e1000 libata drm mptspi scsi_transport_spi mptscsih i2c_core mptbase dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 48629 Comm: java Kdump: loaded Tainted: G L ------------ 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff9313a3af9fa0 ti: ffff931476adc000 task.ti: ffff931476adc000
RIP: 0010:[<ffffffff98bb9e2c>] [<ffffffff98bb9e2c>] isolate_freepages_block+0x9c/0x2c0
RSP: 0018:ffff931476adf8d8 EFLAGS: 00010202
RAX: 00000000ffffffff RBX: ffff931476adf888 RCX: ffff931476adfad0
RDX: 000000000011ce00 RSI: ffff931476adfb28 RDI: ffff931476adfad0
RBP: ffff931476adf968 R08: 0000000000000000 R09: ffff93157ffd6000
R10: 0000000000118000 R11: 0000000000340000 R12: ffff931476adf8a8
R13: 0000000000000000 R14: fffffc94845fa340 R15: fffffc94851a0200
FS: 00007fa39cbe5700(0000) GS:ffff9315716c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3685cf5400 CR3: 000000019d044000 CR4: 00000000000607e0
Call Trace:
[<ffffffff98bba27d>] compaction_alloc+0x22d/0x2a0
[<ffffffff98bfef44>] migrate_pages+0x224/0x7a0
[<ffffffff98bba050>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff98bbb139>] compact_zone+0x2d9/0x430
[<ffffffff98bbb32c>] compact_zone_order+0x9c/0xf0
[<ffffffff98bbb6e1>] try_to_compact_pages+0x121/0x1a0
[<ffffffff99109531>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff98b9e751>] __alloc_pages_nodemask+0x791/0xbb0
[<ffffffffc047186e>] ? xfs_filemap_fault+0x6e/0xe0 [xfs]
[<ffffffff98be8528>] alloc_pages_current+0x98/0x110
[<ffffffff98c02ea5>] get_huge_zero_page+0x45/0xb0
[<ffffffff98c07405>] do_huge_pmd_anonymous_page+0x2c5/0x4a0
[<ffffffff98bc7972>] handle_mm_fault+0x892/0x9b0
[<ffffffff9911a597>] __do_page_fault+0x197/0x4f0
[<ffffffff9911a925>] do_page_fault+0x35/0x90
[<ffffffff99116ab6>] ? error_swapgs+0xa7/0xbd
[<ffffffff99116768>] page_fault+0x28/0x30
Code: 45 89 c5 48 89 75 a0 48 89 4d 90 83 f8 80 74 2e 45 84 ed 0f 85 16 01 00 00 49 83 c4 01 48 83 c3 40 4c 39 65 c0 0f 86 04 01 00 00 <8b> 43 18 41 83 c7 01 4d 85 f6 4c 0f 44 f3 83 f8 80 75 d2 48 8b
Complete report #869448
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
compaction_alloc
|
vmlinux |
0xffffffff811a7bce
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x12e
|
|
2
|
migrate_pages
|
vmlinux |
0xffffffff811e6c61
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x221
|
|
3
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff811a7aa0
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x2c0
|
|
4
|
compact_zone
|
vmlinux |
0xffffffff811a8b39
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x2d9
|
|
5
|
compact_zone_order
|
vmlinux |
0xffffffff811a8d2c
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x9c
|
|
6
|
|
vmlinux |
0xffffffff811a31b8
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x88
|
|
7
|
try_to_compact_pages
|
vmlinux |
0xffffffff811a90e1
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x121
|
|
8
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff8169f5ed
Build id: 3.10.0-693.2.2.el7.x86_64
|
0xac
|
|
9
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff8169fabd
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x3e9
|
|
10
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118cd85
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x405
|
|
11
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1108
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x98
|
|
12
|
get_huge_zero_page
|
vmlinux |
0xffffffff811ea7f5
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x45
|
|
13
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff811edb6d
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x31d
|
|
14
|
handle_mm_fault
|
vmlinux |
0xffffffff811b258f
Build id: 3.10.0-693.2.2.el7.x86_64
|
0xd0f
|
|
15
|
__do_page_fault
|
vmlinux |
0xffffffff816afff4
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x154
|
|
16
|
do_page_fault
|
vmlinux |
0xffffffff816b0325
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x35
|
|
17
|
page_fault
|
vmlinux |
0xffffffff816ac548
Build id: 3.10.0-693.2.2.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [cpla-sandbox:38599]
Modules linked in: scap(OE) xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter binfmt_misc vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev sg joydev vmw_balloon pcspkr parport_pc parport shpchp i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi drm ata_piix mptscsih
crct10dif_pclmul libata mptbase crct10dif_common crc32c_intel serio_raw vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: scap]
CPU: 4 PID: 38599 Comm: cpla-sandbox Tainted: G OEL ------------ 3.10.0-693.2.2.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/30/2013
task: ffff88021bbf8000 ti: ffff880214a6c000 task.ti: ffff880214a6c000
RIP: 0010:[<ffffffff811a7bce>] [<ffffffff811a7bce>] compaction_alloc+0x12e/0x2a0
RSP: 0018:ffff880214a6f918 EFLAGS: 00010286
RAX: ffff88023ffd54e0 RBX: 0000000200000001 RCX: ffffea0004e98000
RDX: ffff88023ffd5000 RSI: 0000000000000003 RDI: 0000000000000050
RBP: ffff880214a6f960 R08: 0000000000000004 R09: ffff88023ffd7000
R10: 000000000021f000 R11: 0000000000240000 R12: ffffea00087a0000
R13: 000000000021e8f8 R14: ffffffff811a78b4 R15: ffff880214a6f908
FS: 00007f832a44f740(0000) GS:ffff880236700000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8303c83000 CR3: 000000022fbc9000 CR4: 00000000000407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
000000000021f000 0000000000240000 ffff88023ffd7000 ffffea0004ea0000
ffffea000402f280 0000000000000000 ffffea000402f240 ffffea0008851480
0000000000000000 ffff880214a6fa08 ffffffff811e6c61 0000000000000000
Call Trace:
[<ffffffff811e6c61>] migrate_pages+0x221/0x7a0
[<ffffffff811a7aa0>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff811a8b39>] compact_zone+0x2d9/0x430
[<ffffffff811a8d2c>] compact_zone_order+0x9c/0xf0
[<ffffffff811a31b8>] ? zone_statistics+0x88/0xa0
[<ffffffff811a90e1>] try_to_compact_pages+0x121/0x1a0
[<ffffffff8169f5ed>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff8169fabd>] __alloc_pages_slowpath+0x3e9/0x724
[<ffffffff8118cd85>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff811d1108>] alloc_pages_current+0x98/0x110
[<ffffffff811ea7f5>] get_huge_zero_page+0x45/0xb0
[<ffffffff811edb6d>] do_huge_pmd_anonymous_page+0x31d/0x530
[<ffffffff811b258f>] handle_mm_fault+0xd0f/0xfa0
[<ffffffff816afff4>] __do_page_fault+0x154/0x450
[<ffffffff816b0325>] do_page_fault+0x35/0x90
[<ffffffff816ac548>] page_fault+0x28/0x30
Code: c1 ea 16 48 8b 14 d5 00 9a f9 81 48 85 d2 74 b9 83 e0 7f 48 c1 e0 05 48 01 d0 74 ad f6 00 02 74 a8 4c 89 e9 48 03 0d 1a c0 87 00 <48> 8b 01 a9 00 00 00 80 0f 85 74 ff ff ff 48 89 c2 48 c1 e8 29
Complete report #793234
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
isolate_freepages_block
|
vmlinux |
0xffffffff8ebb9e2c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
2
|
compaction_alloc
|
vmlinux |
0xffffffff8ebba27d
Build id: 3.10.0-862.el7.x86_64
|
0x22d
|
|
3
|
migrate_pages
|
vmlinux |
0xffffffff8ebfef44
Build id: 3.10.0-862.el7.x86_64
|
0x224
|
|
4
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff8ebba050
Build id: 3.10.0-862.el7.x86_64
|
0x2c0
|
|
5
|
compact_zone
|
vmlinux |
0xffffffff8ebbb139
Build id: 3.10.0-862.el7.x86_64
|
0x2d9
|
|
6
|
compact_zone_order
|
vmlinux |
0xffffffff8ebbb32c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
7
|
try_to_compact_pages
|
vmlinux |
0xffffffff8ebbb6e1
Build id: 3.10.0-862.el7.x86_64
|
0x121
|
|
8
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff8f109531
Build id: 3.10.0-862.el7.x86_64
|
0xac
|
|
9
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8eb9e751
Build id: 3.10.0-862.el7.x86_64
|
0x791
|
|
10
|
|
vmlinux |
0xffffffff8ebc1904
Build id: 3.10.0-862.el7.x86_64
|
0x2e4
|
|
11
|
alloc_pages_current
|
vmlinux |
0xffffffff8ebe8528
Build id: 3.10.0-862.el7.x86_64
|
0x98
|
|
12
|
get_huge_zero_page
|
vmlinux |
0xffffffff8ec02ea5
Build id: 3.10.0-862.el7.x86_64
|
0x45
|
|
13
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff8ec07405
Build id: 3.10.0-862.el7.x86_64
|
0x2c5
|
|
14
|
handle_mm_fault
|
vmlinux |
0xffffffff8ebc7972
Build id: 3.10.0-862.el7.x86_64
|
0x892
|
|
15
|
__do_page_fault
|
vmlinux |
0xffffffff8f11a597
Build id: 3.10.0-862.el7.x86_64
|
0x197
|
|
16
|
do_page_fault
|
vmlinux |
0xffffffff8f11a925
Build id: 3.10.0-862.el7.x86_64
|
0x35
|
|
17
|
page_fault
|
vmlinux |
0xffffffff8f116768
Build id: 3.10.0-862.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [java:70065]
Modules linked in: vmw_vsock_vmci_transport vsock sunrpc iosf_mbi snd_seq_midi crc32_pclmul snd_seq_midi_event ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_ens1371 snd_rawmidi snd_ac97_codec sg ppdev ac97_bus snd_seq pcspkr vmw_balloon snd_seq_device snd_pcm nfit snd_timer snd soundcore joydev libnvdimm parport_pc parport shpchp i2c_piix4 vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ata_piix crct10dif_pclmul crct10dif_common crc32c_intel mptspi libata scsi_transport_spi mptscsih e1000 mptbase serio_raw i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 70065 Comm: java Kdump: loaded Not tainted 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
task: ffff88eddeb35ee0 ti: ffff88edc11dc000 task.ti: ffff88edc11dc000
RIP: 0010:[<ffffffff8ebb9e2c>] [<ffffffff8ebb9e2c>] isolate_freepages_block+0x9c/0x2c0
RSP: 0000:ffff88edc11df8d8 EFLAGS: 00010202
RAX: 00000000ffffffff RBX: ffff88edc11df888 RCX: ffff88edc11dfad0
RDX: 0000000000057400 RSI: ffff88edc11dfb28 RDI: ffff88edc11dfad0
RBP: ffff88edc11df968 R08: 0000000000000000 R09: ffff88eefffd7800
R10: 000000000000e400 R11: 0000000000100000 R12: ffff88edc11df8a8
R13: 0000000000000000 R14: ffffdb7d4016da00 R15: ffffdb7d42afa840
FS: 00007f7df8aa0700(0000) GS:ffff88eef9600000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7de4cac0b0 CR3: 0000000134e2c000 CR4: 00000000003607f0
Call Trace:
[<ffffffff8ebba27d>] compaction_alloc+0x22d/0x2a0
[<ffffffff8ebfef44>] migrate_pages+0x224/0x7a0
[<ffffffff8ebba050>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff8ebbb139>] compact_zone+0x2d9/0x430
[<ffffffff8ebbb32c>] compact_zone_order+0x9c/0xf0
[<ffffffff8ebbb6e1>] try_to_compact_pages+0x121/0x1a0
[<ffffffff8f109531>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff8eb9e751>] __alloc_pages_nodemask+0x791/0xbb0
[<ffffffff8ebc1904>] ? wp_page_copy.isra.70+0x2e4/0x4f0
[<ffffffff8ebe8528>] alloc_pages_current+0x98/0x110
[<ffffffff8ec02ea5>] get_huge_zero_page+0x45/0xb0
[<ffffffff8ec07405>] do_huge_pmd_anonymous_page+0x2c5/0x4a0
[<ffffffff8ebc7972>] handle_mm_fault+0x892/0x9b0
[<ffffffff8f11a597>] __do_page_fault+0x197/0x4f0
[<ffffffff8f11a925>] do_page_fault+0x35/0x90
[<ffffffff8f116768>] page_fault+0x28/0x30
Code: 45 89 c5 48 89 75 a0 48 89 4d 90 83 f8 80 74 2e 45 84 ed 0f 85 16 01 00 00 49 83 c4 01 48 83 c3 40 4c 39 65 c0 0f 86 04 01 00 00 <8b> 43 18 41 83 c7 01 4d 85 f6 4c 0f 44 f3 83 f8 80 75 d2 48 8b
Complete report #785334
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
isolate_freepages_block
|
vmlinux |
0xffffffff9edba5ec
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x9c
|
|
2
|
compaction_alloc
|
vmlinux |
0xffffffff9edbaa3d
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x22d
|
|
3
|
migrate_pages
|
vmlinux |
0xffffffff9edff704
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x224
|
|
4
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff9edba810
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x2c0
|
|
5
|
compact_zone
|
vmlinux |
0xffffffff9edbb8f9
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x2d9
|
|
6
|
compact_zone_order
|
vmlinux |
0xffffffff9edbbaec
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x9c
|
|
7
|
try_to_compact_pages
|
vmlinux |
0xffffffff9edbbea1
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x121
|
|
8
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff9f30a617
Build id: 3.10.0-862.9.1.el7.x86_64
|
0xac
|
|
9
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff9ed9ef11
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x791
|
|
10
|
|
xfs |
0xffffffffc069086e
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x6e
|
|
11
|
?
__mem_cgroup_begin_update_page_stat
|
vmlinux |
0xffffffff9ee0f800
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x30
|
|
12
|
alloc_pages_current
|
vmlinux |
0xffffffff9ede8ce8
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x98
|
|
13
|
get_huge_zero_page
|
vmlinux |
0xffffffff9ee03665
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x45
|
|
14
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff9ee07bc5
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x2c5
|
|
15
|
handle_mm_fault
|
vmlinux |
0xffffffff9edc8132
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x892
|
|
16
|
__do_page_fault
|
vmlinux |
0xffffffff9f31b557
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x197
|
|
17
|
do_page_fault
|
vmlinux |
0xffffffff9f31b8e5
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x35
|
|
18
|
page_fault
|
vmlinux |
0xffffffff9f317758
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [nxserver.bin:81768]
Modules linked in: tcp_lp fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel ppdev snd_ens1371 snd_rawmidi snd_ac97_codec vmw_balloon aesni_intel ac97_bus snd_seq snd_seq_device lrw gf128mul snd_pcm glue_helper ablk_helper cryptd snd_timer snd joydev soundcore pcspkr sg vmw_vmci i2c_piix4 shpchp nfit libnvdimm parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom
sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm e1000 ata_piix libata crct10dif_pclmul crct10dif_common mptspi scsi_transport_spi crc32c_intel mptscsih mptbase i2c_core serio_raw dm_mirror dm_region_hash dm_log dm_mod
CPU: 2 PID: 81768 Comm: nxserver.bin Kdump: loaded Tainted: G L ------------ 3.10.0-862.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff90325d340000 ti: ffff902d3bebc000 task.ti: ffff902d3bebc000
RIP: 0010:[<ffffffff9edba5ec>] [<ffffffff9edba5ec>] isolate_freepages_block+0x9c/0x2c0
RSP: 0000:ffff902d3bebf8d8 EFLAGS: 00010202
RAX: 00000000ffffffff RBX: ffff902d3bebf888 RCX: ffff902d3bebfad0
RDX: 00000000006d6e00 RSI: ffff902d3bebfb28 RDI: ffff902d3bebfad0
RBP: ffff902d3bebf968 R08: 0000000000000000 R09: ffff903312fda000
R10: 0000000000102400 R11: 0000000000793000 R12: ffff902d3bebf8a8
R13: 0000000000000000 R14: ffffddf384088b80 R15: ffffddf39e4a0c00
FS: 00007f9b9a435700(0000) GS:ffff9032f3080000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9b9a3c08b0 CR3: 000000059c76e000 CR4: 00000000001607e0
Call Trace:
[<ffffffff9edbaa3d>] compaction_alloc+0x22d/0x2a0
[<ffffffff9edff704>] migrate_pages+0x224/0x7a0
[<ffffffff9edba810>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff9edbb8f9>] compact_zone+0x2d9/0x430
[<ffffffff9edbbaec>] compact_zone_order+0x9c/0xf0
[<ffffffff9edbbea1>] try_to_compact_pages+0x121/0x1a0
[<ffffffff9f30a617>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff9ed9ef11>] __alloc_pages_nodemask+0x791/0xbb0
[<ffffffffc069086e>] ? xfs_filemap_fault+0x6e/0xe0 [xfs]
[<ffffffff9ee0f800>] ? __mem_cgroup_begin_update_page_stat+0x30/0x90
[<ffffffff9ede8ce8>] alloc_pages_current+0x98/0x110
[<ffffffff9ee03665>] get_huge_zero_page+0x45/0xb0
[<ffffffff9ee07bc5>] do_huge_pmd_anonymous_page+0x2c5/0x4a0
[<ffffffff9edc8132>] handle_mm_fault+0x892/0x9b0
[<ffffffff9f31b557>] __do_page_fault+0x197/0x4f0
[<ffffffff9f31b8e5>] do_page_fault+0x35/0x90
[<ffffffff9f317758>] page_fault+0x28/0x30
Code: 45 89 c5 48 89 75 a0 48 89 4d 90 83 f8 80 74 2e 45 84 ed 0f 85 16 01 00 00 49 83 c4 01 48 83 c3 40 4c 39 65 c0 0f 86 04 01 00 00 <8b> 43 18 41 83 c7 01 4d 85 f6 4c 0f 44 f3 83 f8 80 75 d2 48 8b
Complete report #541093
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
compaction_alloc
|
vmlinux |
0xffffffff811a7bce
Build id: 3.10.0-693.el7.x86_64
|
0x12e
|
|
2
|
migrate_pages
|
vmlinux |
0xffffffff811e6c51
Build id: 3.10.0-693.el7.x86_64
|
0x221
|
|
3
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff811a7aa0
Build id: 3.10.0-693.el7.x86_64
|
0x2c0
|
|
4
|
compact_zone
|
vmlinux |
0xffffffff811a8b39
Build id: 3.10.0-693.el7.x86_64
|
0x2d9
|
|
5
|
compact_zone_order
|
vmlinux |
0xffffffff811a8d2c
Build id: 3.10.0-693.el7.x86_64
|
0x9c
|
|
6
|
try_to_compact_pages
|
vmlinux |
0xffffffff811a90e1
Build id: 3.10.0-693.el7.x86_64
|
0x121
|
|
7
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff8169f5cd
Build id: 3.10.0-693.el7.x86_64
|
0xac
|
|
8
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff8169fa9d
Build id: 3.10.0-693.el7.x86_64
|
0x3e9
|
|
9
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118cd85
Build id: 3.10.0-693.el7.x86_64
|
0x405
|
|
10
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1108
Build id: 3.10.0-693.el7.x86_64
|
0x98
|
|
11
|
get_huge_zero_page
|
vmlinux |
0xffffffff811ea7e5
Build id: 3.10.0-693.el7.x86_64
|
0x45
|
|
12
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff811edb5d
Build id: 3.10.0-693.el7.x86_64
|
0x31d
|
|
13
|
|
vmlinux |
0xffffffff811b0b49
Build id: 3.10.0-693.el7.x86_64
|
0x159
|
|
14
|
handle_mm_fault
|
vmlinux |
0xffffffff811b258f
Build id: 3.10.0-693.el7.x86_64
|
0xd0f
|
|
15
|
|
vmlinux |
0xffffffff810cd794
Build id: 3.10.0-693.el7.x86_64
|
0x104
|
|
16
|
__do_page_fault
|
vmlinux |
0xffffffff816affb4
Build id: 3.10.0-693.el7.x86_64
|
0x154
|
|
17
|
do_page_fault
|
vmlinux |
0xffffffff816b02e5
Build id: 3.10.0-693.el7.x86_64
|
0x35
|
|
18
|
page_fault
|
vmlinux |
0xffffffff816ac508
Build id: 3.10.0-693.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#7 stuck for 23s! [java:7473]
Modules linked in: tcp_lp fuse xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 ipt_REJECT nf_reject_ipv4 iptable_filter xt_conntrack iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle ip_tables ip_set nfnetlink tun bridge stp llc binfmt_misc vmw_vsock_vmci_transport vsock ext4 sb_edac edac_core iosf_mbi mbcache jbd2 crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul ppdev glue_helper ablk_helper vmw_balloon cryptd sg joydev pcspkr i2c_piix4 vmw_vmci shpchp nfit libnvdimm parport_pc parport nfsd auth_rpcgss nfs_acl lockd grace sunrpc xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm ahci libahci ata_piix crct10dif_pclmul libata
crct10dif_common crc32c_intel serio_raw vmxnet3 i2c_core vmw_pvscsi floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip6_tables]
CPU: 7 PID: 7473 Comm: java Tainted: G L ------------ 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016
task: ffff8811996d2f70 ti: ffff881031eb4000 task.ti: ffff881031eb4000
RIP: 0010:[<ffffffff811a7bce>] [<ffffffff811a7bce>] compaction_alloc+0x12e/0x2a0
RSP: 0018:ffff881031eb7918 EFLAGS: 00010286
RAX: ffff880c3ffd77e0 RBX: ffff880c3ffd4e00 RCX: ffffea0017e98000
RDX: ffff880c3ffd7000 RSI: 0000000000000003 RDI: 0000000000000050
RBP: ffff881031eb7960 R08: 0000000000000004 R09: ffff880c3ffda000
R10: 0000000000110c00 R11: 0000000000c40000 R12: ffff880c3ffd4e00
R13: 0000000000c40000 R14: ffffffff811a78b4 R15: ffff881031eb7908
FS: 00007fc868fff700(0000) GS:ffff880c0fdc0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f285ab8c000 CR3: 0000000fc3871000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
0000000000110c00 0000000000c40000 ffff880c3ffda000 ffffea0017ea0000
ffffea000442ba40 ffff881031eb7a80 ffffea000442ba00 ffff881031eb7a70
0000000000000000 ffff881031eb7a08 ffffffff811e6c51 00ff880c00000001
Call Trace:
[<ffffffff811e6c51>] migrate_pages+0x221/0x7a0
[<ffffffff811a7aa0>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff811a8b39>] compact_zone+0x2d9/0x430
[<ffffffff811a8d2c>] compact_zone_order+0x9c/0xf0
[<ffffffff811a90e1>] try_to_compact_pages+0x121/0x1a0
[<ffffffff8169f5cd>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff8169fa9d>] __alloc_pages_slowpath+0x3e9/0x724
[<ffffffff8118cd85>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff811d1108>] alloc_pages_current+0x98/0x110
[<ffffffff811ea7e5>] get_huge_zero_page+0x45/0xb0
[<ffffffff811edb5d>] do_huge_pmd_anonymous_page+0x31d/0x530
[<ffffffff811b0b49>] ? do_numa_page+0x159/0x1e0
[<ffffffff811b258f>] handle_mm_fault+0xd0f/0xfa0
[<ffffffff810cd794>] ? update_curr+0x104/0x190
[<ffffffff816affb4>] __do_page_fault+0x154/0x450
[<ffffffff816b02e5>] do_page_fault+0x35/0x90
[<ffffffff816ac508>] page_fault+0x28/0x30
Code: c1 ea 16 48 8b 14 d5 00 9a f9 81 48 85 d2 74 b9 83 e0 7f 48 c1 e0 05 48 01 d0 74 ad f6 00 02 74 a8 4c 89 e9 48 03 0d 1a c0 87 00 <48> 8b 01 a9 00 00 00 80 0f 85 74 ff ff ff 48 89 c2 48 c1 e8 29
Complete report #419970
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
isolate_freepages_block
|
vmlinux |
0xffffffff91ddcdff
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x7f
|
|
2
|
compaction_alloc
|
vmlinux |
0xffffffff91ddd408
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x248
|
|
3
|
migrate_pages
|
vmlinux |
0xffffffff91e248b4
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x224
|
|
4
|
?
__reset_isolation_suitable
|
vmlinux |
0xffffffff91ddd1c0
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x120
|
|
5
|
compact_zone
|
vmlinux |
0xffffffff91dde280
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x2f0
|
|
6
|
compact_zone_order
|
vmlinux |
0xffffffff91dde46c
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x9c
|
|
7
|
|
vmlinux |
0xffffffff91c61253
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x13
|
|
8
|
try_to_compact_pages
|
vmlinux |
0xffffffff91dde831
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x121
|
|
9
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff9235ccb1
Build id: 3.10.0-957.5.1.el7.x86_64
|
0xac
|
|
10
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff9235d43b
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x6a3
|
|
11
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff91dc1145
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x405
|
|
12
|
alloc_pages_current
|
vmlinux |
0xffffffff91e0e0a8
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x98
|
|
13
|
get_huge_zero_page
|
vmlinux |
0xffffffff91e289c5
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x45
|
|
14
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff91e2d635
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x2f5
|
|
15
|
handle_mm_fault
|
vmlinux |
0xffffffff91dec512
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x892
|
|
16
|
__do_page_fault
|
vmlinux |
0xffffffff9236f5e3
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x203
|
|
17
|
do_page_fault
|
vmlinux |
0xffffffff9236f915
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x35
|
|
18
|
|
vmlinux |
0xffffffff9236ba96
Build id: 3.10.0-957.5.1.el7.x86_64
|
0xa7
|
|
19
|
page_fault
|
vmlinux |
0xffffffff9236b758
Build id: 3.10.0-957.5.1.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [java:15505]
Modules linked in: binfmt_misc xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables devlink ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock ppdev vmw_balloon coretemp crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd joydev pcspkr sg parport_pc parport i2c_piix4 vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel serio_raw vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm floppy drm ata_piix
libata drm_panel_orientation_quirks mptspi vmxnet3 scsi_transport_spi mptscsih mptbase dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 15505 Comm: java Kdump: loaded Tainted: G L ------------ 3.10.0-957.5.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff95a5593e8000 ti: ffff95ac178a0000 task.ti: ffff95ac178a0000
RIP: 0010:[<ffffffff91ddcdff>] [<ffffffff91ddcdff>] isolate_freepages_block+0x7f/0x320
RSP: 0000:ffff95ac178a3858 EFLAGS: 00010246
RAX: 0000000000000000 RBX: 00007f9110447000 RCX: ffff95ac178a3aa0
RDX: 0000000000000000 RSI: 0000000000000246 RDI: ffff95acfffbd868
RBP: ffff95ac178a38f0 R08: ffff95ac178a3ab8 R09: 000000000007cc00
R10: ffff95acfffbd800 R11: ffff95ac178a3fd8 R12: ffff95ac178a37f0
R13: fffff06b01fe8600 R14: fffff06b01fe8600 R15: ffffffff91e35446
FS: 00007faa5a06c700(0000) GS:ffff95acffc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fdebbee99b8 CR3: 00000002c3ae0000 CR4: 00000000000007f0
Call Trace:
[<ffffffff91ddd408>] compaction_alloc+0x248/0x360
[<ffffffff91e248b4>] migrate_pages+0x224/0x790
[<ffffffff91ddd1c0>] ? __reset_isolation_suitable+0x120/0x120
[<ffffffff91dde280>] compact_zone+0x2f0/0x440
[<ffffffff91dde46c>] compact_zone_order+0x9c/0xf0
[<ffffffff91c61253>] ? x2apic_send_IPI_mask+0x13/0x20
[<ffffffff91dde831>] try_to_compact_pages+0x121/0x1a0
[<ffffffff9235ccb1>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff9235d43b>] __alloc_pages_slowpath+0x6a3/0x724
[<ffffffff91dc1145>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff91e0e0a8>] alloc_pages_current+0x98/0x110
[<ffffffff91e289c5>] get_huge_zero_page+0x45/0xb0
[<ffffffff91e2d635>] do_huge_pmd_anonymous_page+0x2f5/0x4d0
[<ffffffff91dec512>] handle_mm_fault+0x892/0x9b0
[<ffffffff9236f5e3>] __do_page_fault+0x203/0x500
[<ffffffff9236f915>] do_page_fault+0x35/0x90
[<ffffffff9236ba96>] ? error_swapgs+0xa7/0xbd
[<ffffffff9236b758>] page_fault+0x28/0x30
Code: 00 00 48 8d 4f 58 48 83 c0 40 45 89 c6 45 31 e4 c7 45 b4 00 00 00 00 45 31 ff 48 89 4d a0 48 89 45 98 f6 c3 1f 0f 84 b1 00 00 00 <41> 8b 45 18 41 83 c7 01 4d 85 e4 4d 0f 44 e5 83 f8 80 0f 84 d1
Complete report #352441
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
compaction_alloc
|
vmlinux |
0xffffffffbb5ba93e
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x12e
|
|
2
|
migrate_pages
|
vmlinux |
0xffffffffbb5ff704
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x224
|
|
3
|
?
isolate_freepages_block
|
vmlinux |
0xffffffffbb5ba810
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x2c0
|
|
4
|
compact_zone
|
vmlinux |
0xffffffffbb5bb8f9
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x2d9
|
|
5
|
compact_zone_order
|
vmlinux |
0xffffffffbb5bbaec
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x9c
|
|
6
|
try_to_compact_pages
|
vmlinux |
0xffffffffbb5bbea1
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x121
|
|
7
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffffbbb0a617
Build id: 3.10.0-862.9.1.el7.x86_64
|
0xac
|
|
8
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffbb59ef11
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x791
|
|
9
|
alloc_pages_current
|
vmlinux |
0xffffffffbb5e8ce8
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x98
|
|
10
|
get_huge_zero_page
|
vmlinux |
0xffffffffbb603665
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x45
|
|
11
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffffbb607bc5
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x2c5
|
|
12
|
handle_mm_fault
|
vmlinux |
0xffffffffbb5c8132
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x892
|
|
13
|
__do_page_fault
|
vmlinux |
0xffffffffbbb1b557
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x197
|
|
14
|
do_page_fault
|
vmlinux |
0xffffffffbbb1b8e5
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x35
|
|
15
|
page_fault
|
vmlinux |
0xffffffffbbb17758
Build id: 3.10.0-862.9.1.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [gdb:2688]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache vmw_vsock_vmci_transport vsock snd_seq_midi snd_seq_midi_event sb_edac iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul snd_ens1371 snd_rawmidi glue_helper snd_ac97_codec ablk_helper cryptd ac97_bus ppdev snd_seq snd_seq_device snd_pcm vmw_balloon snd_timer snd soundcore joydev pcspkr nfit libnvdimm sg parport_pc parport i2c_piix4 vmw_vmci shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod sd_mod cdrom
crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper ata_piix syscopyarea sysfillrect sysimgblt fb_sys_fops ttm libata drm crct10dif_pclmul crct10dif_common mptspi scsi_transport_spi mptscsih crc32c_intel mptbase e1000 serio_raw i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 2688 Comm: gdb Kdump: loaded Tainted: G L ------------ 3.10.0-862.9.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff9129b4e6eeb0 ti: ffff9128bbcf4000 task.ti: ffff9128bbcf4000
RIP: 0010:[<ffffffffbb5ba93e>] [<ffffffffbb5ba93e>] compaction_alloc+0x12e/0x2a0
RSP: 0000:ffff9128bbcf7978 EFLAGS: 00010286
RAX: ffff912fd2fd82a0 RBX: ffff912fd2fdb008 RCX: ffffe13542b58000
RDX: ffff912fd2fd8000 RSI: 0000000000000001 RDI: 00000000000000b4
RBP: ffff9128bbcf79c0 R08: ffff912fd2bd5520 R09: ffff912fd2fd9800
R10: 0000000000002400 R11: 0000000000100000 R12: ffff9129b4e6eeb0
R13: 0000000000000001 R14: ffffffffbb5ba7d4 R15: ffff9128bbcf7968
FS: 00007f5fe0ef0840(0000) GS:ffff912fb30c0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000043da198 CR3: 00000000b758c000 CR4: 00000000001607e0
Call Trace:
[<ffffffffbb5ff704>] migrate_pages+0x224/0x7a0
[<ffffffffbb5ba810>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffffbb5bb8f9>] compact_zone+0x2d9/0x430
[<ffffffffbb5bbaec>] compact_zone_order+0x9c/0xf0
[<ffffffffbb5bbea1>] try_to_compact_pages+0x121/0x1a0
[<ffffffffbbb0a617>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffffbb59ef11>] __alloc_pages_nodemask+0x791/0xbb0
[<ffffffffbb5e8ce8>] alloc_pages_current+0x98/0x110
[<ffffffffbb603665>] get_huge_zero_page+0x45/0xb0
[<ffffffffbb607bc5>] do_huge_pmd_anonymous_page+0x2c5/0x4a0
[<ffffffffbb5c8132>] handle_mm_fault+0x892/0x9b0
[<ffffffffbbb1b557>] __do_page_fault+0x197/0x4f0
[<ffffffffbbb1b8e5>] do_page_fault+0x35/0x90
[<ffffffffbbb17758>] page_fault+0x28/0x30
Code: c1 ea 16 48 8b 14 d5 c0 a5 5d bc 48 85 d2 74 b9 83 e0 7f 48 c1 e0 05 48 01 d0 74 ad f6 00 02 74 a8 4c 89 e9 48 03 0d f2 6a a8 00 <48> 8b 01 a9 00 00 00 80 0f 85 74 ff ff ff 48 89 c2 48 c1 e8 29
Complete report #326829
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
isolate_freepages_block
|
vmlinux |
0xffffffffa6bb9e2c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
2
|
compaction_alloc
|
vmlinux |
0xffffffffa6bba27d
Build id: 3.10.0-862.el7.x86_64
|
0x22d
|
|
3
|
migrate_pages
|
vmlinux |
0xffffffffa6bfef44
Build id: 3.10.0-862.el7.x86_64
|
0x224
|
|
4
|
?
isolate_freepages_block
|
vmlinux |
0xffffffffa6bba050
Build id: 3.10.0-862.el7.x86_64
|
0x2c0
|
|
5
|
compact_zone
|
vmlinux |
0xffffffffa6bbb139
Build id: 3.10.0-862.el7.x86_64
|
0x2d9
|
|
6
|
compact_zone_order
|
vmlinux |
0xffffffffa6bbb32c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
7
|
|
vmlinux |
0xffffffffa6b0779a
Build id: 3.10.0-862.el7.x86_64
|
0xfa
|
|
8
|
try_to_compact_pages
|
vmlinux |
0xffffffffa6bbb6e1
Build id: 3.10.0-862.el7.x86_64
|
0x121
|
|
9
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffffa7109531
Build id: 3.10.0-862.el7.x86_64
|
0xac
|
|
10
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffa6b9e751
Build id: 3.10.0-862.el7.x86_64
|
0x791
|
|
11
|
|
vmlinux |
0xffffffffa6bc1904
Build id: 3.10.0-862.el7.x86_64
|
0x2e4
|
|
12
|
alloc_pages_current
|
vmlinux |
0xffffffffa6be8528
Build id: 3.10.0-862.el7.x86_64
|
0x98
|
|
13
|
get_huge_zero_page
|
vmlinux |
0xffffffffa6c02ea5
Build id: 3.10.0-862.el7.x86_64
|
0x45
|
|
14
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffffa6c07405
Build id: 3.10.0-862.el7.x86_64
|
0x2c5
|
|
15
|
handle_mm_fault
|
vmlinux |
0xffffffffa6bc7972
Build id: 3.10.0-862.el7.x86_64
|
0x892
|
|
16
|
__do_page_fault
|
vmlinux |
0xffffffffa711a597
Build id: 3.10.0-862.el7.x86_64
|
0x197
|
|
17
|
do_page_fault
|
vmlinux |
0xffffffffa711a925
Build id: 3.10.0-862.el7.x86_64
|
0x35
|
|
18
|
page_fault
|
vmlinux |
0xffffffffa7116768
Build id: 3.10.0-862.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [java:6222]
Modules linked in: tcp_lp nls_utf8 isofs fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc ext4 mbcache jbd2 snd_seq_midi snd_seq_midi_event ppdev iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel snd_ens1371 lrw gf128mul glue_helper snd_rawmidi snd_ac97_codec ablk_helper cryptd ac97_bus snd_seq snd_seq_device snd_pcm vmw_balloon snd_timer snd nfit soundcore joydev libnvdimm pcspkr sg parport_pc parport shpchp vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic pata_acpi
vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw mptspi e1000 scsi_transport_spi ata_piix mptscsih libata i2c_core mptbase dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 6222 Comm: java Tainted: G L ------------ 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/19/2017
task: ffff9e6c5ec96eb0 ti: ffff9e6d75944000 task.ti: ffff9e6d75944000
RIP: 0010:[<ffffffffa6bb9e2c>] [<ffffffffa6bb9e2c>] isolate_freepages_block+0x9c/0x2c0
RSP: 0000:ffff9e6d759478d8 EFLAGS: 00010206
RAX: 00000000ffffffff RBX: 0000000000000002 RCX: ffff9e6d75947ad0
RDX: 000000000007fc00 RSI: ffff9e6d75947b28 RDI: ffff9e6d75947ad0
RBP: ffff9e6d75947968 R08: 0000000000000000 R09: ffff9e6d7ffd7800
R10: 0000000000001c00 R11: 0000000000100000 R12: ffff9e6d7ffd8000
R13: ffff9e6cfb545178 R14: 00000000000001c1 R15: ffff9e6d7ffd9008
FS: 00007f7bae697700(0000) GS:ffff9e6d79600000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f7bad54faf8 CR3: 000000001ed1c000 CR4: 00000000003607f0
Call Trace:
[<ffffffffa6bba27d>] compaction_alloc+0x22d/0x2a0
[<ffffffffa6bfef44>] migrate_pages+0x224/0x7a0
[<ffffffffa6bba050>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffffa6bbb139>] compact_zone+0x2d9/0x430
[<ffffffffa6bbb32c>] compact_zone_order+0x9c/0xf0
[<ffffffffa6b0779a>] ? generic_exec_single+0xfa/0x1b0
[<ffffffffa6bbb6e1>] try_to_compact_pages+0x121/0x1a0
[<ffffffffa7109531>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffffa6b9e751>] __alloc_pages_nodemask+0x791/0xbb0
[<ffffffffa6bc1904>] ? wp_page_copy.isra.70+0x2e4/0x4f0
[<ffffffffa6be8528>] alloc_pages_current+0x98/0x110
[<ffffffffa6c02ea5>] get_huge_zero_page+0x45/0xb0
[<ffffffffa6c07405>] do_huge_pmd_anonymous_page+0x2c5/0x4a0
[<ffffffffa6bc7972>] handle_mm_fault+0x892/0x9b0
[<ffffffffa711a597>] __do_page_fault+0x197/0x4f0
[<ffffffffa711a925>] do_page_fault+0x35/0x90
[<ffffffffa7116768>] page_fault+0x28/0x30
Code: 45 89 c5 48 89 75 a0 48 89 4d 90 83 f8 80 74 2e 45 84 ed 0f 85 16 01 00 00 49 83 c4 01 48 83 c3 40 4c 39 65 c0 0f 86 04 01 00 00 <8b> 43 18 41 83 c7 01 4d 85 f6 4c 0f 44 f3 83 f8 80 75 d2 48 8b
Complete report #139857
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
compaction_alloc
|
vmlinux |
0xffffffffb9bba17e
Build id: 3.10.0-862.el7.x86_64
|
0x12e
|
|
2
|
migrate_pages
|
vmlinux |
0xffffffffb9bfef44
Build id: 3.10.0-862.el7.x86_64
|
0x224
|
|
3
|
?
isolate_freepages_block
|
vmlinux |
0xffffffffb9bba050
Build id: 3.10.0-862.el7.x86_64
|
0x2c0
|
|
4
|
compact_zone
|
vmlinux |
0xffffffffb9bbb139
Build id: 3.10.0-862.el7.x86_64
|
0x2d9
|
|
5
|
compact_zone_order
|
vmlinux |
0xffffffffb9bbb32c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
6
|
try_to_compact_pages
|
vmlinux |
0xffffffffb9bbb6e1
Build id: 3.10.0-862.el7.x86_64
|
0x121
|
|
7
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffffba109531
Build id: 3.10.0-862.el7.x86_64
|
0xac
|
|
8
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffb9b9e751
Build id: 3.10.0-862.el7.x86_64
|
0x791
|
|
9
|
|
vmlinux |
0xffffffffb9bc1904
Build id: 3.10.0-862.el7.x86_64
|
0x2e4
|
|
10
|
alloc_pages_current
|
vmlinux |
0xffffffffb9be8528
Build id: 3.10.0-862.el7.x86_64
|
0x98
|
|
11
|
get_huge_zero_page
|
vmlinux |
0xffffffffb9c02ea5
Build id: 3.10.0-862.el7.x86_64
|
0x45
|
|
12
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffffb9c07405
Build id: 3.10.0-862.el7.x86_64
|
0x2c5
|
|
13
|
handle_mm_fault
|
vmlinux |
0xffffffffb9bc7972
Build id: 3.10.0-862.el7.x86_64
|
0x892
|
|
14
|
__do_page_fault
|
vmlinux |
0xffffffffba11a597
Build id: 3.10.0-862.el7.x86_64
|
0x197
|
|
15
|
do_page_fault
|
vmlinux |
0xffffffffba11a925
Build id: 3.10.0-862.el7.x86_64
|
0x35
|
|
16
|
page_fault
|
vmlinux |
0xffffffffba116768
Build id: 3.10.0-862.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [java:6683]
Modules linked in: tcp_lp nls_utf8 isofs fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd snd_ens1371 snd_rawmidi ppdev snd_ac97_codec ac97_bus joydev snd_seq pcspkr vmw_balloon snd_seq_device snd_pcm snd_timer snd sg soundcore nfit libnvdimm parport_pc parport shpchp vmw_vmci i2c_piix4 ip_tables xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper
syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel serio_raw ata_piix e1000 mptspi scsi_transport_spi mptscsih i2c_core libata mptbase dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 6683 Comm: java Not tainted 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff9a6d5afebf40 ti: ffff9a6d5a464000 task.ti: ffff9a6d5a464000
RIP: 0010:[<ffffffffb9bba17e>] [<ffffffffb9bba17e>] compaction_alloc+0x12e/0x2a0
RSP: 0018:ffff9a6d5a467978 EFLAGS: 00010286
RAX: ffff9a6dbffd8020 RBX: ffff9a6d6c428c80 RCX: ffffddf9c0298000
RDX: ffff9a6dbffd8000 RSI: 0000000000000001 RDI: 0000000000000054
RBP: ffff9a6d5a4679c0 R08: ffff9a6dbffd7e20 R09: ffff9a6dbffd9800
R10: 0000000000004200 R11: 0000000000080000 R12: ffff9a6d75a51900
R13: ffff9a6d6c428c80 R14: ffffffffb9bba014 R15: ffff9a6d5a467968
FS: 00007f32ac6f5700(0000) GS:ffff9a6dbb600000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3298867368 CR3: 000000000f944000 CR4: 00000000003607f0
Call Trace:
[<ffffffffb9bfef44>] migrate_pages+0x224/0x7a0
[<ffffffffb9bba050>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffffb9bbb139>] compact_zone+0x2d9/0x430
[<ffffffffb9bbb32c>] compact_zone_order+0x9c/0xf0
[<ffffffffb9bbb6e1>] try_to_compact_pages+0x121/0x1a0
[<ffffffffba109531>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffffb9b9e751>] __alloc_pages_nodemask+0x791/0xbb0
[<ffffffffb9bc1904>] ? wp_page_copy.isra.70+0x2e4/0x4f0
[<ffffffffb9be8528>] alloc_pages_current+0x98/0x110
[<ffffffffb9c02ea5>] get_huge_zero_page+0x45/0xb0
[<ffffffffb9c07405>] do_huge_pmd_anonymous_page+0x2c5/0x4a0
[<ffffffffb9bc7972>] handle_mm_fault+0x892/0x9b0
[<ffffffffba11a597>] __do_page_fault+0x197/0x4f0
[<ffffffffba11a925>] do_page_fault+0x35/0x90
[<ffffffffba116768>] page_fault+0x28/0x30
Code: c1 ea 16 48 8b 14 d5 c0 a5 bd ba 48 85 d2 74 b9 83 e0 7f 48 c1 e0 05 48 01 d0 74 ad f6 00 02 74 a8 4c 89 e9 48 03 0d b2 72 a8 00 <48> 8b 01 a9 00 00 00 80 0f 85 74 ff ff ff 48 89 c2 48 c1 e8 29
Complete report #135919
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
isolate_freepages_block
|
vmlinux |
0xffffffffa9fb9e2c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
2
|
compaction_alloc
|
vmlinux |
0xffffffffa9fba27d
Build id: 3.10.0-862.el7.x86_64
|
0x22d
|
|
3
|
migrate_pages
|
vmlinux |
0xffffffffa9ffef44
Build id: 3.10.0-862.el7.x86_64
|
0x224
|
|
4
|
?
isolate_freepages_block
|
vmlinux |
0xffffffffa9fba050
Build id: 3.10.0-862.el7.x86_64
|
0x2c0
|
|
5
|
compact_zone
|
vmlinux |
0xffffffffa9fbb139
Build id: 3.10.0-862.el7.x86_64
|
0x2d9
|
|
6
|
compact_zone_order
|
vmlinux |
0xffffffffa9fbb32c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
7
|
try_to_compact_pages
|
vmlinux |
0xffffffffa9fbb6e1
Build id: 3.10.0-862.el7.x86_64
|
0x121
|
|
8
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffffaa509531
Build id: 3.10.0-862.el7.x86_64
|
0xac
|
|
9
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffa9f9e751
Build id: 3.10.0-862.el7.x86_64
|
0x791
|
|
10
|
alloc_pages_current
|
vmlinux |
0xffffffffa9fe8528
Build id: 3.10.0-862.el7.x86_64
|
0x98
|
|
11
|
get_huge_zero_page
|
vmlinux |
0xffffffffaa002ea5
Build id: 3.10.0-862.el7.x86_64
|
0x45
|
|
12
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffffaa007405
Build id: 3.10.0-862.el7.x86_64
|
0x2c5
|
|
13
|
|
vmlinux |
0xffffffffa9f033a0
Build id: 3.10.0-862.el7.x86_64
|
0x90
|
|
14
|
handle_mm_fault
|
vmlinux |
0xffffffffa9fc7972
Build id: 3.10.0-862.el7.x86_64
|
0x892
|
|
15
|
__do_page_fault
|
vmlinux |
0xffffffffaa51a597
Build id: 3.10.0-862.el7.x86_64
|
0x197
|
|
16
|
do_page_fault
|
vmlinux |
0xffffffffaa51a925
Build id: 3.10.0-862.el7.x86_64
|
0x35
|
|
17
|
page_fault
|
vmlinux |
0xffffffffaa516768
Build id: 3.10.0-862.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [java:3016]
Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun devlink lp ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul pcspkr glue_helper ablk_helper ppdev joydev cryptd vmw_balloon sg parport_pc parport shpchp vmw_vmci i2c_piix4 ip_tables xfs libcrc32c
sd_mod crc_t10dif crct10dif_generic sr_mod cdrom ata_generic pata_acpi vmwgfx crct10dif_pclmul crct10dif_common drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crc32c_intel drm e1000 serio_raw mptspi ata_piix libata scsi_transport_spi mptscsih i2c_core mptbase floppy
CPU: 0 PID: 3016 Comm: java Kdump: loaded Not tainted 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 05/20/2014
task: ffff98dfff3b3f40 ti: ffff98e02b7bc000 task.ti: ffff98e02b7bc000
RIP: 0010:[<ffffffffa9fb9e2c>] [<ffffffffa9fb9e2c>] isolate_freepages_block+0x9c/0x2c0
RSP: 0018:ffff98e02b7bf8d8 EFLAGS: 00010206
RAX: 00000000ffffffff RBX: 0000000000000002 RCX: ffff98e02b7bfad0
RDX: 0000000000062000 RSI: ffff98e02b7bfb28 RDI: ffff98e02b7bfad0
RBP: ffff98e02b7bf968 R08: 0000000000000000 R09: ffff98e0bffd7800
R10: 00000000000bfe00 R11: 0000000000100000 R12: ffffffffa9f9e157
R13: ffff98e02b7bf970 R14: 0000000000000002 R15: 0000000000000000
FS: 00007f86fc15a700(0000) GS:ffff98e0b9600000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000d22598 CR3: 0000000134818000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffffa9fba27d>] compaction_alloc+0x22d/0x2a0
[<ffffffffa9ffef44>] migrate_pages+0x224/0x7a0
[<ffffffffa9fba050>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffffa9fbb139>] compact_zone+0x2d9/0x430
[<ffffffffa9fbb32c>] compact_zone_order+0x9c/0xf0
[<ffffffffa9fbb6e1>] try_to_compact_pages+0x121/0x1a0
[<ffffffffaa509531>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffffa9f9e751>] __alloc_pages_nodemask+0x791/0xbb0
[<ffffffffa9fe8528>] alloc_pages_current+0x98/0x110
[<ffffffffaa002ea5>] get_huge_zero_page+0x45/0xb0
[<ffffffffaa007405>] do_huge_pmd_anonymous_page+0x2c5/0x4a0
[<ffffffffa9f033a0>] ? futex_wake+0x90/0x180
[<ffffffffa9fc7972>] handle_mm_fault+0x892/0x9b0
[<ffffffffaa51a597>] __do_page_fault+0x197/0x4f0
[<ffffffffaa51a925>] do_page_fault+0x35/0x90
[<ffffffffaa516768>] page_fault+0x28/0x30
Code: 45 89 c5 48 89 75 a0 48 89 4d 90 83 f8 80 74 2e 45 84 ed 0f 85 16 01 00 00 49 83 c4 01 48 83 c3 40 4c 39 65 c0 0f 86 04 01 00 00 <8b> 43 18 41 83 c7 01 4d 85 f6 4c 0f 44 f3 83 f8 80 75 d2 48 8b
Complete report #111919
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
compaction_alloc
|
vmlinux |
0xffffffffbd3ba17e
Build id: 3.10.0-862.el7.x86_64
|
0x12e
|
|
2
|
migrate_pages
|
vmlinux |
0xffffffffbd3fef44
Build id: 3.10.0-862.el7.x86_64
|
0x224
|
|
3
|
?
isolate_freepages_block
|
vmlinux |
0xffffffffbd3ba050
Build id: 3.10.0-862.el7.x86_64
|
0x2c0
|
|
4
|
compact_zone
|
vmlinux |
0xffffffffbd3bb139
Build id: 3.10.0-862.el7.x86_64
|
0x2d9
|
|
5
|
compact_zone_order
|
vmlinux |
0xffffffffbd3bb32c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
6
|
try_to_compact_pages
|
vmlinux |
0xffffffffbd3bb6e1
Build id: 3.10.0-862.el7.x86_64
|
0x121
|
|
7
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffffbd909531
Build id: 3.10.0-862.el7.x86_64
|
0xac
|
|
8
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffffbd39e95c
Build id: 3.10.0-862.el7.x86_64
|
0x99c
|
|
9
|
alloc_pages_current
|
vmlinux |
0xffffffffbd3e8528
Build id: 3.10.0-862.el7.x86_64
|
0x98
|
|
10
|
get_huge_zero_page
|
vmlinux |
0xffffffffbd402ea5
Build id: 3.10.0-862.el7.x86_64
|
0x45
|
|
11
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffffbd407405
Build id: 3.10.0-862.el7.x86_64
|
0x2c5
|
|
12
|
handle_mm_fault
|
vmlinux |
0xffffffffbd3c7972
Build id: 3.10.0-862.el7.x86_64
|
0x892
|
|
13
|
__do_page_fault
|
vmlinux |
0xffffffffbd91a597
Build id: 3.10.0-862.el7.x86_64
|
0x197
|
|
14
|
do_page_fault
|
vmlinux |
0xffffffffbd91a925
Build id: 3.10.0-862.el7.x86_64
|
0x35
|
|
15
|
page_fault
|
vmlinux |
0xffffffffbd916768
Build id: 3.10.0-862.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [git:111855]
Modules linked in: tcp_lp rfcomm fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink binfmt_misc vmhgfs(OE) vmw_vsock_vmci_transport vsock bnep sunrpc snd_seq_midi snd_seq_midi_event snd_ens1371 snd_rawmidi snd_ac97_codec ac97_bus btusb snd_seq btrtl snd_seq_device btbcm btintel snd_pcm snd_timer bluetooth snd soundcore iosf_mbi crc32_pclmul ppdev ghash_clmulni_intel aesni_intel pcspkr rfkill lrw gf128mul nfit glue_helper ablk_helper joydev cryptd libnvdimm sg vmw_balloon parport_pc parport i2c_piix4 shpchp vmw_vmci ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif
crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper crct10dif_pclmul crct10dif_common syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crc32c_intel drm ata_piix serio_raw i2c_core libata mptspi scsi_transport_spi e1000 mptscsih mptbase dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 111855 Comm: git Kdump: loaded Tainted: G OE ------------ 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/22/2020
task: ffff967f2b336eb0 ti: ffff967ff4aa4000 task.ti: ffff967ff4aa4000
RIP: 0010:[<ffffffffbd3ba17e>] [<ffffffffbd3ba17e>] compaction_alloc+0x12e/0x2a0
RSP: 0018:ffff967ff4aa7978 EFLAGS: 00010286
RAX: ffff967ffffd84e0 RBX: 0000000100000000 RCX: ffffe6f484ee8000
RDX: ffff967ffffd8000 RSI: 0000000000000001 RDI: 000000000000007c
RBP: ffff967ff4aa79c0 R08: ffff967fffbd7fe0 R09: ffff967ffffda000
R10: 000000000013fa00 R11: 0000000000140000 R12: ffffe6f484fe0000
R13: 000000000013f84d R14: ffffffffbd3ba014 R15: ffff967ff4aa7968
FS: 00007f1df9ea4740(0000) GS:ffff967ff9640000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc02d655000 CR3: 00000001089e8000 CR4: 00000000003607e0
Call Trace:
[<ffffffffbd3fef44>] migrate_pages+0x224/0x7a0
[<ffffffffbd3ba050>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffffbd3bb139>] compact_zone+0x2d9/0x430
[<ffffffffbd3bb32c>] compact_zone_order+0x9c/0xf0
[<ffffffffbd3bb6e1>] try_to_compact_pages+0x121/0x1a0
[<ffffffffbd909531>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffffbd39e95c>] __alloc_pages_nodemask+0x99c/0xbb0
[<ffffffffbd3e8528>] alloc_pages_current+0x98/0x110
[<ffffffffbd402ea5>] get_huge_zero_page+0x45/0xb0
[<ffffffffbd407405>] do_huge_pmd_anonymous_page+0x2c5/0x4a0
[<ffffffffbd3c7972>] handle_mm_fault+0x892/0x9b0
[<ffffffffbd91a597>] __do_page_fault+0x197/0x4f0
[<ffffffffbd91a925>] do_page_fault+0x35/0x90
[<ffffffffbd916768>] page_fault+0x28/0x30
Code: c1 ea 16 48 8b 14 d5 c0 a5 3d be 48 85 d2 74 b9 83 e0 7f 48 c1 e0 05 48 01 d0 74 ad f6 00 02 74 a8 4c 89 e9 48 03 0d b2 72 a8 00 <48> 8b 01 a9 00 00 00 80 0f 85 74 ff ff ff 48 89 c2 48 c1 e8 29
Complete report #42839
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
isolate_freepages_block
|
vmlinux |
0xffffffff811a787c
Build id: 3.10.0-693.el7.x86_64
|
0x9c
|
|
2
|
compaction_alloc
|
vmlinux |
0xffffffff811a7ccd
Build id: 3.10.0-693.el7.x86_64
|
0x22d
|
|
3
|
migrate_pages
|
vmlinux |
0xffffffff811e6c51
Build id: 3.10.0-693.el7.x86_64
|
0x221
|
|
4
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff811a7aa0
Build id: 3.10.0-693.el7.x86_64
|
0x2c0
|
|
5
|
compact_zone
|
vmlinux |
0xffffffff811a8b39
Build id: 3.10.0-693.el7.x86_64
|
0x2d9
|
|
6
|
compact_zone_order
|
vmlinux |
0xffffffff811a8d2c
Build id: 3.10.0-693.el7.x86_64
|
0x9c
|
|
7
|
try_to_compact_pages
|
vmlinux |
0xffffffff811a90e1
Build id: 3.10.0-693.el7.x86_64
|
0x121
|
|
8
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff8169f5cd
Build id: 3.10.0-693.el7.x86_64
|
0xac
|
|
9
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff8169fa9d
Build id: 3.10.0-693.el7.x86_64
|
0x3e9
|
|
10
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118cd85
Build id: 3.10.0-693.el7.x86_64
|
0x405
|
|
11
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1108
Build id: 3.10.0-693.el7.x86_64
|
0x98
|
|
12
|
get_huge_zero_page
|
vmlinux |
0xffffffff811ea7e5
Build id: 3.10.0-693.el7.x86_64
|
0x45
|
|
13
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff811edb5d
Build id: 3.10.0-693.el7.x86_64
|
0x31d
|
|
14
|
handle_mm_fault
|
vmlinux |
0xffffffff811b258f
Build id: 3.10.0-693.el7.x86_64
|
0xd0f
|
|
15
|
__do_page_fault
|
vmlinux |
0xffffffff816affb4
Build id: 3.10.0-693.el7.x86_64
|
0x154
|
|
16
|
do_page_fault
|
vmlinux |
0xffffffff816b02e5
Build id: 3.10.0-693.el7.x86_64
|
0x35
|
|
17
|
page_fault
|
vmlinux |
0xffffffff816ac508
Build id: 3.10.0-693.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [java:2010]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack libcrc32c ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon pcspkr joydev sg parport_pc parport vmw_vmci shpchp i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables ext4 mbcache jbd2 sr_mod cdrom sd_mod crc_t10dif ata_generic crct10dif_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel
mptspi serio_raw scsi_transport_spi ata_piix mptscsih libata mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 3 PID: 2010 Comm: java Tainted: G L ------------ 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff88001275af70 ti: ffff8800a36f0000 task.ti: ffff8800a36f0000
RIP: 0010:[<ffffffff811a787c>] [<ffffffff811a787c>] isolate_freepages_block+0x9c/0x2c0
RSP: 0018:ffff8800a36f3878 EFLAGS: 00010202
RAX: 00000000ffffffff RBX: ffff8800a36f3828 RCX: ffff8800a36f3a70
RDX: 000000000000e800 RSI: ffff8800a36f3ac8 RDI: ffff8800a36f3a70
RBP: ffff8800a36f3908 R08: 0000000000000000 R09: ffff88023ffd6800
R10: 0000000000001c00 R11: 0000000000100000 R12: ffffea00040a8ec0
R13: ffffffff811f5396 R14: ffff8800a36f37f0 R15: ffff8801efb8a580
FS: 00007f17b2119700(0000) GS:ffff88023fd80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f1c801fa7c8 CR3: 000000022cf94000 CR4: 00000000000407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000100000 0000000000001c00 ffff8800a36f3960 0000000000000004
ffff8800a36f3a70 ffff8800a36f3ab0 ffff8800a36f3ac8 ffff8800a36f3a70
ffff88023ffd5000 0000000000000000 000000000000e800 0000000000000001
Call Trace:
[<ffffffff811a7ccd>] compaction_alloc+0x22d/0x2a0
[<ffffffff811e6c51>] migrate_pages+0x221/0x7a0
[<ffffffff811a7aa0>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff811a8b39>] compact_zone+0x2d9/0x430
[<ffffffff811a8d2c>] compact_zone_order+0x9c/0xf0
[<ffffffff811a90e1>] try_to_compact_pages+0x121/0x1a0
[<ffffffff8169f5cd>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff8169fa9d>] __alloc_pages_slowpath+0x3e9/0x724
[<ffffffff8118cd85>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff811d1108>] alloc_pages_current+0x98/0x110
[<ffffffff811ea7e5>] get_huge_zero_page+0x45/0xb0
[<ffffffff811edb5d>] do_huge_pmd_anonymous_page+0x31d/0x530
[<ffffffff811b258f>] handle_mm_fault+0xd0f/0xfa0
[<ffffffff816affb4>] __do_page_fault+0x154/0x450
[<ffffffff816b02e5>] do_page_fault+0x35/0x90
[<ffffffff816ac508>] page_fault+0x28/0x30
Code: 45 89 c5 48 89 75 a0 48 89 4d 90 83 f8 80 74 2e 45 84 ed 0f 85 16 01 00 00 49 83 c4 01 48 83 c3 40 4c 39 65 c0 0f 86 04 01 00 00 <8b> 43 18 41 83 c7 01 4d 85 f6 4c 0f 44 f3 83 f8 80 75 d2 48 8b
Complete report #21361
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
isolate_freepages_block
|
vmlinux |
0xffffffff811a787c
Build id: 3.10.0-693.el7.x86_64
|
0x9c
|
|
2
|
compaction_alloc
|
vmlinux |
0xffffffff811a7ccd
Build id: 3.10.0-693.el7.x86_64
|
0x22d
|
|
3
|
migrate_pages
|
vmlinux |
0xffffffff811e6c51
Build id: 3.10.0-693.el7.x86_64
|
0x221
|
|
4
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff811a7aa0
Build id: 3.10.0-693.el7.x86_64
|
0x2c0
|
|
5
|
compact_zone
|
vmlinux |
0xffffffff811a8b39
Build id: 3.10.0-693.el7.x86_64
|
0x2d9
|
|
6
|
compact_zone_order
|
vmlinux |
0xffffffff811a8d2c
Build id: 3.10.0-693.el7.x86_64
|
0x9c
|
|
7
|
|
vmlinux |
0xffffffff811a31b8
Build id: 3.10.0-693.el7.x86_64
|
0x88
|
|
8
|
try_to_compact_pages
|
vmlinux |
0xffffffff811a90e1
Build id: 3.10.0-693.el7.x86_64
|
0x121
|
|
9
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff8169f5cd
Build id: 3.10.0-693.el7.x86_64
|
0xac
|
|
10
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff8169fa9d
Build id: 3.10.0-693.el7.x86_64
|
0x3e9
|
|
11
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118cd85
Build id: 3.10.0-693.el7.x86_64
|
0x405
|
|
12
|
alloc_pages_current
|
vmlinux |
0xffffffff811d1108
Build id: 3.10.0-693.el7.x86_64
|
0x98
|
|
13
|
get_huge_zero_page
|
vmlinux |
0xffffffff811ea7e5
Build id: 3.10.0-693.el7.x86_64
|
0x45
|
|
14
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff811edb5d
Build id: 3.10.0-693.el7.x86_64
|
0x31d
|
|
15
|
handle_mm_fault
|
vmlinux |
0xffffffff811b258f
Build id: 3.10.0-693.el7.x86_64
|
0xd0f
|
|
16
|
|
vmlinux |
0xffffffff811b8c6e
Build id: 3.10.0-693.el7.x86_64
|
0x31e
|
|
17
|
__do_page_fault
|
vmlinux |
0xffffffff816affb4
Build id: 3.10.0-693.el7.x86_64
|
0x154
|
|
18
|
do_page_fault
|
vmlinux |
0xffffffff816b02e5
Build id: 3.10.0-693.el7.x86_64
|
0x35
|
|
19
|
page_fault
|
vmlinux |
0xffffffff816ac508
Build id: 3.10.0-693.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [runc:16949]
Modules linked in: xt_nat xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack ip_tables veth br_netfilter tun ip_set nfnetlink bridge stp llc overlay(T) vmw_vsock_vmci_transport vsock coretemp ppdev vmw_balloon sg pcspkr joydev parport_pc parport i2c_piix4 shpchp vmw_vmci nfsd auth_rpcgss nfs_acl lockd grace sunrpc xfs libcrc32c sd_mod crc_t10dif sr_mod crct10dif_generic cdrom crct10dif_common ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptspi scsi_transport_spi ata_piix mptscsih drm libata mptbase vmxnet3 serio_raw i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
CPU: 1 PID: 16949 Comm: runc Tainted: G L ------------ T 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/14/2014
task: ffff880415ffaf70 ti: ffff880408ba8000 task.ti: ffff880408ba8000
RIP: 0010:[<ffffffff811a787c>] [<ffffffff811a787c>] isolate_freepages_block+0x9c/0x2c0
RSP: 0000:ffff880408bab878 EFLAGS: 00010202
RAX: 00000000ffffffff RBX: 0000000000000000 RCX: ffff880408baba70
RDX: 000000000012a800 RSI: ffff880408babac8 RDI: ffff880408baba70
RBP: ffff880408bab908 R08: 0000000000000000 R09: ffff8804437d2000
R10: 0000000000101e00 R11: 0000000000443800 R12: 0000000000000000
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
FS: 0000000001517880(0063) GS:ffff880443440000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9e83c71000 CR3: 000000040b6bb000 CR4: 00000000000007e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Stack:
0000000000443800 0000000000101e00 ffff880408bab960 ffff8804433ce3a0
ffff880408baba70 ffff880408babab0 ffff880408babac8 ffff880408baba70
ffff8804437d0400 0000000000000000 000000000012a800 0000000000000001
Call Trace:
[<ffffffff811a7ccd>] compaction_alloc+0x22d/0x2a0
[<ffffffff811e6c51>] migrate_pages+0x221/0x7a0
[<ffffffff811a7aa0>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff811a8b39>] compact_zone+0x2d9/0x430
[<ffffffff811a8d2c>] compact_zone_order+0x9c/0xf0
[<ffffffff811a31b8>] ? zone_statistics+0x88/0xa0
[<ffffffff811a90e1>] try_to_compact_pages+0x121/0x1a0
[<ffffffff8169f5cd>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff8169fa9d>] __alloc_pages_slowpath+0x3e9/0x724
[<ffffffff8118cd85>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff811d1108>] alloc_pages_current+0x98/0x110
[<ffffffff811ea7e5>] get_huge_zero_page+0x45/0xb0
[<ffffffff811edb5d>] do_huge_pmd_anonymous_page+0x31d/0x530
[<ffffffff811b258f>] handle_mm_fault+0xd0f/0xfa0
[<ffffffff811b8c6e>] ? do_mmap_pgoff+0x31e/0x3e0
[<ffffffff816affb4>] __do_page_fault+0x154/0x450
[<ffffffff816b02e5>] do_page_fault+0x35/0x90
[<ffffffff816ac508>] page_fault+0x28/0x30
Code: 45 89 c5 48 89 75 a0 48 89 4d 90 83 f8 80 74 2e 45 84 ed 0f 85 16 01 00 00 49 83 c4 01 48 83 c3 40 4c 39 65 c0 0f 86 04 01 00 00 <8b> 43 18 41 83 c7 01 4d 85 f6 4c 0f 44 f3 83 f8 80 75 d2 48 8b
Complete report #11545
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
compaction_alloc
|
vmlinux |
0xffffffff811ac2be
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x12e
|
|
2
|
migrate_pages
|
vmlinux |
0xffffffff811eb664
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x224
|
|
3
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff811ac190
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x2c0
|
|
4
|
compact_zone
|
vmlinux |
0xffffffff811ad279
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x2d9
|
|
5
|
compact_zone_order
|
vmlinux |
0xffffffff811ad46c
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x9c
|
|
6
|
|
vmlinux |
0xffffffff811a76f8
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x88
|
|
7
|
try_to_compact_pages
|
vmlinux |
0xffffffff811ad821
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x121
|
|
8
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff816a9fd7
Build id: 3.10.0-693.21.1.el7.x86_64
|
0xac
|
|
9
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff816aa4a7
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x3e9
|
|
10
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff811912a5
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x405
|
|
11
|
alloc_pages_current
|
vmlinux |
0xffffffff811d5a38
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x98
|
|
12
|
get_huge_zero_page
|
vmlinux |
0xffffffff811ef215
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x45
|
|
13
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff811f258d
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x31d
|
|
14
|
handle_mm_fault
|
vmlinux |
0xffffffff811b6dff
Build id: 3.10.0-693.21.1.el7.x86_64
|
0xd0f
|
|
15
|
|
vmlinux |
0xffffffff811a57e2
Build id: 3.10.0-693.21.1.el7.x86_64
|
0xe2
|
|
16
|
__do_page_fault
|
vmlinux |
0xffffffff816bb504
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x154
|
|
17
|
do_page_fault
|
vmlinux |
0xffffffff816bb835
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x35
|
|
18
|
page_fault
|
vmlinux |
0xffffffff816b7768
Build id: 3.10.0-693.21.1.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [kubelet:9198]
Modules linked in: iptable_filter fuse binfmt_misc vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr joydev ppdev vmw_balloon sg parport_pc vmw_vmci parport shpchp i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul libata mptspi crct10dif_common crc32c_intel scsi_transport_spi serio_raw mptscsih e1000 mptbase i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 0 PID: 9198 Comm: kubelet Tainted: G W L ------------ 3.10.0-693.21.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/30/2014
task: ffff880256f8eeb0 ti: ffff8804959d0000 task.ti: ffff8804959d0000
RIP: 0010:[<ffffffff811ac2be>] [<ffffffff811ac2be>] compaction_alloc+0x12e/0x2a0
RSP: 0018:ffff8804959d3918 EFLAGS: 00010286
RAX: ffff88073ffd6060 RBX: ffff880486fad140 RCX: ffffea0000628000
RDX: ffff88073ffd6000 RSI: 0000000000000003 RDI: 0000000000000018
RBP: ffff8804959d3960 R08: 0000000000000004 R09: ffff88073ffd7800
R10: 0000000000004c00 R11: 0000000000100000 R12: ffff88073fc18a40
R13: 0000000000000000 R14: ffffffff811abfa4 R15: ffff8804959d3908
FS: 00007f9d3aaa6740(0000) GS:ffff88073fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f27ce729000 CR3: 000000020b2cc000 CR4: 00000000003607f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff811eb664>] migrate_pages+0x224/0x7a0
[<ffffffff811ac190>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff811ad279>] compact_zone+0x2d9/0x430
[<ffffffff811ad46c>] compact_zone_order+0x9c/0xf0
[<ffffffff811a76f8>] ? zone_statistics+0x88/0xa0
[<ffffffff811ad821>] try_to_compact_pages+0x121/0x1a0
[<ffffffff816a9fd7>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff816aa4a7>] __alloc_pages_slowpath+0x3e9/0x724
[<ffffffff811912a5>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff811d5a38>] alloc_pages_current+0x98/0x110
[<ffffffff811ef215>] get_huge_zero_page+0x45/0xb0
[<ffffffff811f258d>] do_huge_pmd_anonymous_page+0x31d/0x530
[<ffffffff811b6dff>] handle_mm_fault+0xd0f/0xfa0
[<ffffffff811a57e2>] ? vm_mmap_pgoff+0xe2/0x110
[<ffffffff816bb504>] __do_page_fault+0x154/0x450
[<ffffffff816bb835>] do_page_fault+0x35/0x90
[<ffffffff816b7768>] page_fault+0x28/0x30
Code: c1 ea 16 48 8b 14 d5 40 1a fb 81 48 85 d2 74 b9 83 e0 7f 48 c1 e0 05 48 01 d0 74 ad f6 00 02 74 a8 4c 89 e9 48 03 0d 6a 89 88 00 <48> 8b 01 a9 00 00 00 80 0f 85 74 ff ff ff 48 89 c2 48 c1 e8 29
Complete report #6057
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
isolate_freepages_block
|
vmlinux |
0xffffffff811a980c
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x9c
|
|
2
|
compaction_alloc
|
vmlinux |
0xffffffff811a9c5d
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x22d
|
|
3
|
migrate_pages
|
vmlinux |
0xffffffff811e8d81
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x221
|
|
4
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff811a9a30
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x2c0
|
|
5
|
compact_zone
|
vmlinux |
0xffffffff811aaac9
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x2d9
|
|
6
|
compact_zone_order
|
vmlinux |
0xffffffff811aacbc
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x9c
|
|
7
|
try_to_compact_pages
|
vmlinux |
0xffffffff811ab071
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x121
|
|
8
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff816a18ad
Build id: 3.10.0-693.17.1.el7.x86_64
|
0xac
|
|
9
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff816a2037
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x6a3
|
|
10
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118ec85
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x405
|
|
11
|
alloc_pages_current
|
vmlinux |
0xffffffff811d3218
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x98
|
|
12
|
get_huge_zero_page
|
vmlinux |
0xffffffff811ec915
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x45
|
|
13
|
do_huge_pmd_anonymous_page
|
vmlinux |
0xffffffff811efc8d
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x31d
|
|
14
|
handle_mm_fault
|
vmlinux |
0xffffffff811b462f
Build id: 3.10.0-693.17.1.el7.x86_64
|
0xd0f
|
|
15
|
|
vmlinux |
0xffffffff811a3102
Build id: 3.10.0-693.17.1.el7.x86_64
|
0xe2
|
|
16
|
__do_page_fault
|
vmlinux |
0xffffffff816b37e4
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x154
|
|
17
|
do_page_fault
|
vmlinux |
0xffffffff816b3b15
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x35
|
|
18
|
page_fault
|
vmlinux |
0xffffffff816af8f8
Build id: 3.10.0-693.17.1.el7.x86_64
|
0x28
|
NMI watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [firefox:60166]
Modules linked in: rfcomm xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun ip6t_rpfilter ipt_REJECT nf_reject_ipv4 ip6t_REJECT nf_reject_ipv6 xt_conntrack ip_set nfnetlink ebtable_nat ebtable_broute bridge stp llc ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6table_mangle ip6table_security ip6table_raw iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack iptable_mangle iptable_security iptable_raw ebtable_filter ebtables vmw_vsock_vmci_transport vsock ip6table_filter ip6_tables iptable_filter fuse vmhgfs(OE) bnep ext4 mbcache jbd2 snd_seq_midi snd_seq_midi_event iosf_mbi crc32_pclmul ghash_clmulni_intel snd_ens1371 aesni_intel snd_rawmidi snd_ac97_codec lrw gf128mul ac97_bus ppdev glue_helper ablk_helper cryptd btusb snd_seq btrtl snd_seq_device
btbcm snd_pcm btintel bluetooth snd_timer snd vmw_balloon rfkill soundcore pcspkr joydev nfit sg libnvdimm parport_pc parport vmw_vmci i2c_piix4 shpchp nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs libcrc32c sr_mod cdrom sd_mod ata_generic crc_t10dif crct10dif_generic pata_acpi vmwgfx crct10dif_pclmul drm_kms_helper crct10dif_common crc32c_intel syscopyarea sysfillrect sysimgblt fb_sys_fops ttm serio_raw ata_piix drm mptspi libata scsi_transport_spi mptscsih vmxnet3 mptbase i2c_core dm_mirror dm_region_hash dm_log dm_mod
CPU: 1 PID: 60166 Comm: firefox Tainted: G OE ------------ 3.10.0-693.17.1.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff88008830eeb0 ti: ffff88008f2f0000 task.ti: ffff88008f2f0000
RIP: 0010:[<ffffffff811a980c>] [<ffffffff811a980c>] isolate_freepages_block+0x9c/0x2c0
RSP: 0018:ffff88008f2f3878 EFLAGS: 00010206
RAX: 0000000000000000 RBX: ffff88008f2f3828 RCX: ffff88008f2f3a70
RDX: 0000000000071a00 RSI: ffff88008f2f3ac8 RDI: ffff88008f2f3a70
RBP: ffff88008f2f3908 R08: 0000000000000000 R09: ffff8800b4fd9800
R10: 0000000000001e00 R11: 00000000000b5000 R12: ffffea0000072e40
R13: ffffffff811f74c6 R14: ffff88008f2f37f0 R15: 00007f40730aa000
FS: 00007f48ed343740(0000) GS:ffff8800af840000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f917c23e000 CR3: 000000008ca7a000 CR4: 00000000003607e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
[<ffffffff811a9c5d>] compaction_alloc+0x22d/0x2a0
[<ffffffff811e8d81>] migrate_pages+0x221/0x7a0
[<ffffffff811a9a30>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff811aaac9>] compact_zone+0x2d9/0x430
[<ffffffff811aacbc>] compact_zone_order+0x9c/0xf0
[<ffffffff811ab071>] try_to_compact_pages+0x121/0x1a0
[<ffffffff816a18ad>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff816a2037>] __alloc_pages_slowpath+0x6a3/0x724
[<ffffffff8118ec85>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff811d3218>] alloc_pages_current+0x98/0x110
[<ffffffff811ec915>] get_huge_zero_page+0x45/0xb0
[<ffffffff811efc8d>] do_huge_pmd_anonymous_page+0x31d/0x530
[<ffffffff811b462f>] handle_mm_fault+0xd0f/0xfa0
[<ffffffff811a3102>] ? vm_mmap_pgoff+0xe2/0x110
[<ffffffff816b37e4>] __do_page_fault+0x154/0x450
[<ffffffff816b3b15>] do_page_fault+0x35/0x90
[<ffffffff816af8f8>] page_fault+0x28/0x30
Code: 45 89 c5 48 89 75 a0 48 89 4d 90 83 f8 80 74 2e 45 84 ed 0f 85 16 01 00 00 49 83 c4 01 48 83 c3 40 4c 39 65 c0 0f 86 04 01 00 00 <8b> 43 18 41 83 c7 01 4d 85 f6 4c 0f 44 f3 83 f8 80 75 d2 48 8b