Complete report #1420964
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
compaction_alloc
|
vmlinux |
0xffffffff811a7bce
Build id: 3.10.0-693.el7.x86_64
|
0x12e
|
|
2
|
migrate_pages
|
vmlinux |
0xffffffff811e6c51
Build id: 3.10.0-693.el7.x86_64
|
0x221
|
|
3
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff811a7aa0
Build id: 3.10.0-693.el7.x86_64
|
0x2c0
|
|
4
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff811a7aa0
Build id: 3.10.0-693.el7.x86_64
|
0x2c0
|
|
5
|
compact_zone
|
vmlinux |
0xffffffff811a8b39
Build id: 3.10.0-693.el7.x86_64
|
0x2d9
|
|
6
|
compact_zone_order
|
vmlinux |
0xffffffff811a8d2c
Build id: 3.10.0-693.el7.x86_64
|
0x9c
|
|
7
|
try_to_compact_pages
|
vmlinux |
0xffffffff811a90e1
Build id: 3.10.0-693.el7.x86_64
|
0x121
|
|
8
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff8169f5cd
Build id: 3.10.0-693.el7.x86_64
|
0xac
|
|
9
|
__alloc_pages_slowpath
|
vmlinux |
0xffffffff8169fa9d
Build id: 3.10.0-693.el7.x86_64
|
0x3e9
|
|
10
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff8118cd85
Build id: 3.10.0-693.el7.x86_64
|
0x405
|
|
11
|
copy_process
|
vmlinux |
0xffffffff8108510d
Build id: 3.10.0-693.el7.x86_64
|
0x1dd
|
|
12
|
|
vmlinux |
0xffffffff812032ac
Build id: 3.10.0-693.el7.x86_64
|
0x5c
|
|
13
|
do_fork
|
vmlinux |
0xffffffff81086a51
Build id: 3.10.0-693.el7.x86_64
|
0x91
|
|
14
|
SyS_clone
|
vmlinux |
0xffffffff81086d66
Build id: 3.10.0-693.el7.x86_64
|
0x16
|
|
15
|
stub_clone
|
vmlinux |
0xffffffff816b5319
Build id: 3.10.0-693.el7.x86_64
|
0x69
|
|
16
|
|
vmlinux |
0xffffffff816b4fc9
Build id: 3.10.0-693.el7.x86_64
|
0x16
|
NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [kvservice:12053]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter arc4 md4 nls_utf8 cifs dns_resolver vmw_vsock_vmci_transport vsock sb_edac edac_core coretemp iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev vmw_balloon joydev pcspkr sg parport_pc parport shpchp vmw_vmci i2c_piix4 nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sr_mod cdrom ata_generic pata_acpi sd_mod crc_t10dif crct10dif_generic vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm mptsas drm scsi_transport_sas
ata_piix mptscsih crct10dif_pclmul crct10dif_common libata crc32c_intel serio_raw mptbase vmxnet3 i2c_core floppy dm_mirror dm_region_hash dm_log dm_mod
CPU: 4 PID: 12053 Comm: kvservice Tainted: G L ------------ 3.10.0-693.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 09/21/2015
task: ffff88042eecdee0 ti: ffff880bba6b8000 task.ti: ffff880bba6b8000
RIP: 0010:[<ffffffff811a7bce>] [<ffffffff811a7bce>] compaction_alloc+0x12e/0x2a0
RSP: 0018:ffff880bba6bb9e8 EFLAGS: 00010286
RAX: ffff880c3ffd5200 RBX: 0000000000000004 RCX: ffffea00120a0000
RDX: ffff880c3ffd5000 RSI: 0000000000000003 RDI: 0000000000000054
RBP: ffff880bba6bba30 R08: 0000000000000004 R09: ffff880c3ffd8000
R10: 0000000000100200 R11: 0000000000c40000 R12: ffff880c3fbd1200
R13: 0000000000c40000 R14: ffffffff811a7a64 R15: ffff880bba6bb9c0
FS: 00007f350ce70700(0000) GS:ffff880c0f100000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f3508002000 CR3: 0000000bef790000 CR4: 00000000003407e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Stack:
0000000000100200 0000000000c40000 ffff880c3ffd8000 ffffea00120a8000
ffffea00040007c0 ffff880bba6bbb50 ffffea0004000780 ffff880bba6bbb40
0000000000000000 ffff880bba6bbad8 ffffffff811e6c51 00ff880100000001
Call Trace:
[<ffffffff811e6c51>] migrate_pages+0x221/0x7a0
[<ffffffff811a7aa0>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff811a7aa0>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff811a8b39>] compact_zone+0x2d9/0x430
[<ffffffff811a8d2c>] compact_zone_order+0x9c/0xf0
[<ffffffff811a90e1>] try_to_compact_pages+0x121/0x1a0
[<ffffffff8169f5cd>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff8169fa9d>] __alloc_pages_slowpath+0x3e9/0x724
[<ffffffff8118cd85>] __alloc_pages_nodemask+0x405/0x420
[<ffffffff8108510d>] copy_process+0x1dd/0x1970
[<ffffffff812032ac>] ? get_empty_filp+0x5c/0x1a0
[<ffffffff81086a51>] do_fork+0x91/0x320
[<ffffffff81086d66>] SyS_clone+0x16/0x20
[<ffffffff816b5319>] stub_clone+0x69/0x90
[<ffffffff816b4fc9>] ? system_call_fastpath+0x16/0x1b
Code: c1 ea 16 48 8b 14 d5 00 9a f9 81 48 85 d2 74 b9 83 e0 7f 48 c1 e0 05 48 01 d0 74 ad f6 00 02 74 a8 4c 89 e9 48 03 0d 1a c0 87 00 <48> 8b 01 a9 00 00 00 80 0f 85 74 ff ff ff 48 89 c2 48 c1 e8 29
Complete report #16885
| Frame # |
Function |
Binary |
Source or offset |
Line |
|
1
|
isolate_freepages_block
|
vmlinux |
0xffffffff9edb9e2c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
2
|
|
vmlinux |
0xffffffff9ee312fe
Build id: 3.10.0-862.el7.x86_64
|
0x73e
|
|
3
|
compaction_alloc
|
vmlinux |
0xffffffff9edba27d
Build id: 3.10.0-862.el7.x86_64
|
0x22d
|
|
4
|
migrate_pages
|
vmlinux |
0xffffffff9edfef44
Build id: 3.10.0-862.el7.x86_64
|
0x224
|
|
5
|
?
isolate_freepages_block
|
vmlinux |
0xffffffff9edba050
Build id: 3.10.0-862.el7.x86_64
|
0x2c0
|
|
6
|
compact_zone
|
vmlinux |
0xffffffff9edbb139
Build id: 3.10.0-862.el7.x86_64
|
0x2d9
|
|
7
|
compact_zone_order
|
vmlinux |
0xffffffff9edbb32c
Build id: 3.10.0-862.el7.x86_64
|
0x9c
|
|
8
|
try_to_compact_pages
|
vmlinux |
0xffffffff9edbb6e1
Build id: 3.10.0-862.el7.x86_64
|
0x121
|
|
9
|
__alloc_pages_direct_compact
|
vmlinux |
0xffffffff9f309531
Build id: 3.10.0-862.el7.x86_64
|
0xac
|
|
10
|
__alloc_pages_nodemask
|
vmlinux |
0xffffffff9ed9e751
Build id: 3.10.0-862.el7.x86_64
|
0x791
|
|
11
|
copy_process
|
vmlinux |
0xffffffff9ec8ed4d
Build id: 3.10.0-862.el7.x86_64
|
0x1dd
|
|
12
|
do_fork
|
vmlinux |
0xffffffff9ec90761
Build id: 3.10.0-862.el7.x86_64
|
0x91
|
|
13
|
SyS_clone
|
vmlinux |
0xffffffff9ec90a76
Build id: 3.10.0-862.el7.x86_64
|
0x16
|
|
14
|
stub_clone
|
vmlinux |
0xffffffff9f31fb94
Build id: 3.10.0-862.el7.x86_64
|
0x44
|
|
15
|
|
vmlinux |
0xffffffff9f31f7d5
Build id: 3.10.0-862.el7.x86_64
|
0x1c
|
NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [postmaster:1274]
Modules linked in: xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink vmw_vsock_vmci_transport vsock sunrpc dm_mirror dm_region_hash dm_log dm_mod snd_seq_midi snd_seq_midi_event ext4 mbcache jbd2 iosf_mbi crc32_pclmul snd_ens1371 ghash_clmulni_intel snd_rawmidi snd_ac97_codec ac97_bus ppdev snd_seq vmw_balloon snd_seq_device snd_pcm aesni_intel lrw gf128mul glue_helper ablk_helper cryptd vmw_vmci nfit i2c_piix4 sg snd_timer joydev snd pcspkr soundcore libnvdimm shpchp parport_pc parport ip_tables xfs libcrc32c sr_mod cdrom sd_mod crc_t10dif crct10dif_generic ata_generic
pata_acpi vmwgfx drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm ata_piix drm crct10dif_pclmul crct10dif_common crc32c_intel libata mptspi scsi_transport_spi e1000 serio_raw mptscsih mptbase i2c_core
CPU: 2 PID: 1274 Comm: postmaster Kdump: loaded Not tainted 3.10.0-862.el7.x86_64 #1
Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/29/2019
task: ffff95fded348000 ti: ffff95fdff844000 task.ti: ffff95fdff844000
RIP: 0010:[<ffffffff9edb9e2c>] [<ffffffff9edb9e2c>] isolate_freepages_block+0x9c/0x2c0
RSP: 0018:ffff95fdff8479a8 EFLAGS: 00010206
RAX: 00000000ffffffff RBX: 0000000000000000 RCX: ffff95fdff847ba0
RDX: 0000000000021e00 RSI: ffff95fdff847bf8 RDI: ffff95fdff847ba0
RBP: ffff95fdff847a38 R08: 0000000000000000 R09: ffff95fdfffd9800
R10: 0000000000001200 R11: 0000000000100000 R12: 0000000000000000
R13: ffff95fdf56939e0 R14: ffffffff9ecbe870 R15: 000068ca7cb8296d
FS: 00007f9787a3b8c0(0000) GS:ffff95fdf5680000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000d70284 CR3: 00000002212a0000 CR4: 00000000003607e0
Call Trace:
[<ffffffff9ee312fe>] ? do_select+0x73e/0x7c0
[<ffffffff9edba27d>] compaction_alloc+0x22d/0x2a0
[<ffffffff9edfef44>] migrate_pages+0x224/0x7a0
[<ffffffff9edba050>] ? isolate_freepages_block+0x2c0/0x2c0
[<ffffffff9edbb139>] compact_zone+0x2d9/0x430
[<ffffffff9edbb32c>] compact_zone_order+0x9c/0xf0
[<ffffffff9edbb6e1>] try_to_compact_pages+0x121/0x1a0
[<ffffffff9f309531>] __alloc_pages_direct_compact+0xac/0x193
[<ffffffff9ed9e751>] __alloc_pages_nodemask+0x791/0xbb0
[<ffffffff9ec8ed4d>] copy_process+0x1dd/0x1a40
[<ffffffff9ec90761>] do_fork+0x91/0x320
[<ffffffff9ec90a76>] SyS_clone+0x16/0x20
[<ffffffff9f31fb94>] stub_clone+0x44/0x70
[<ffffffff9f31f7d5>] ? system_call_fastpath+0x1c/0x21
Code: 45 89 c5 48 89 75 a0 48 89 4d 90 83 f8 80 74 2e 45 84 ed 0f 85 16 01 00 00 49 83 c4 01 48 83 c3 40 4c 39 65 c0 0f 86 04 01 00 00 <8b> 43 18 41 83 c7 01 4d 85 f6 4c 0f 44 f3 83 f8 80 75 d2 48 8b