Re: [PATCH v3 2/6] mm: Allow dynamically requesting additional memory regions

[Daniel Axtens]

>>    I think you get away with this on EFI because you use BYTES_TO_PAGES
>>    and get page-aligned memory, but I think you should probably round up
>>    to the next power of 2 for smaller allocations or to the next page or
>>    so for larger allocations.
>
> I think we could allocate at least e.g. 128 MiB from firmware if there is
> not enough memory available in the GRUB mm. This way we would avoid frequent
> calls to firmware and could satisfy requests for larger alignments.

128 MiB and 64 MiB cause some tests to fail (cannot allocate memory in echo1
or compression tests because there isn't enough free memory to get a
64MiB chunk). 32 MiB chunk size seems to work and seems fast enough.

[It's a bit hard to tell because at some point in time time the powerpc
machine stopped shutting down when we got to the end of the tests. oh
well.]

>>  - After fixing that in the ieee1275 code, all_functional_test
>>    hangs trying to run the cmdline_cat test. I think this is from a slow
>>    algorithm somewhere - the grub allocator isn't exactly optimised for
>>    a proliferation of regions.
>
> Could you try the solution proposed above? Maybe it will solve problem of
> frequent additions of memory to the GRUB mm.
>
>>  - I noticed that nearly all the allocations were under 1MB. This seems
>>    inefficient for a trip out to firmware. So I made the ieee1275 code
>>    allocate at least max(4MB, (size of allocation rounded up nearest
>>    1MB) + 4kB). This makes the tests run with only the usual failures,
>>    at least on pseries with debug on... still chasing some bugs beyond
>>    that.
>
> Yeah, this is similar to what I proposed above. Though I would want to see
> larger numbers tested as I said earlier.
>
>>  - The speed impact depends on the allocation size. I'll post something
>>    on that tomorrow, hopefully, but larger minimum allocations work
>>    noticably better.
>>
>>  - We only have 4GB max to play with because (at least) powerpc-ieee1275
>>    is technically defined to be 32 bit. So I'm a bit nervous about
>>    further large allocations unless we have a way to release them back
>>    to _firmware_, not just to grub.
>
> Ugh... This can be difficult. I am not sure the GRUB mm is smart enough
> to release memory regions if they are not used anymore by it.
>
>> I would think a better overall approach would be to allocate the 1/4 of
>> ram when grub starts, and create a whole new interface for large slabs
>
> I am not very happy with allocating 1/4 of memory at start of the day.
> I think allocating larger chunks of memory from firmware should be
> enough to make things working as expected.

Maybe the per-platform memory chunk allocator just needs to be smart
enough to make sure that there is enough memory left over to load a
"normal sized" kernel and initrd... although the sizes of distro images
keep going up so that's going to be a bit fraught.

>> of memory that are directly allocated from, and directly returned to,
>> the firmware.

I still would really prefer to bypass grub mm completely as described in
my other mail. If we are able to give memory back to fw, we can claim
1GB chunks (on SLOF, PFW is going to be another issue) without having to
worry about where we put them and if we have enough memory to load a
kernel or initrd. It makes it much harder accidentally render your
system unbootable.

Kind regards,
Daniel