Lines Matching full:populated

181  * The number of empty populated pages, protected by pcpu_lock.
187 * The number of populated pages in use by the allocator, protected by
196 * try to keep the number of populated free pages between
1058 * pcpu_is_populated - determines if the region is populated
1064 * For atomic allocations, check if the backing pages are populated.
1067 * Bool if the backing pages are populated.
1079 bitmap_next_clear_region(chunk->populated, &rs, &re, page_end); in pcpu_is_populated()
1092 * @pop_only: use populated regions only
1363 alloc_size = struct_size(chunk, populated, in pcpu_alloc_first_chunk()
1404 /* manage populated page bitmap */ in pcpu_alloc_first_chunk()
1406 bitmap_fill(chunk->populated, chunk->nr_pages); in pcpu_alloc_first_chunk()
1515 * @chunk: pcpu_chunk which got populated
1519 * Pages in [@page_start,@page_end) have been populated to @chunk. Update
1530 bitmap_set(chunk->populated, page_start, nr); in pcpu_chunk_populated()
1554 bitmap_clear(chunk->populated, page_start, nr); in pcpu_chunk_depopulated()
1859 bitmap_for_each_clear_region(chunk->populated, rs, re, in pcpu_alloc()
1977 * @empty_only: free chunks only if there are no populated pages
1980 * number of populated pages. Otherwise, only reclaim chunks that have no
1981 * populated pages.
2016 bitmap_for_each_set_region(chunk->populated, rs, re, 0, in pcpu_balance_free()
2030 * pcpu_balance_populated - manage the amount of populated pages
2032 * Maintain a certain amount of populated pages to satisfy atomic allocations.
2051 * Ensure there are certain number of free populated pages for in pcpu_balance_populated()
2087 bitmap_for_each_clear_region(chunk->populated, rs, re, 0, in pcpu_balance_populated()
2123 * Scan over chunks in the depopulate list and try to release unused populated
2127 * populated pages threshold, reintegrate the chunk if it has empty free pages.
2128 * Each chunk is scanned in the reverse order to keep populated pages close to
2149 * allocator not touching the populated bitmap. in pcpu_reclaim_populated()
2157 * Scan chunk's pages in the reverse order to keep populated in pcpu_reclaim_populated()
2175 * If the page is empty and populated, start or in pcpu_reclaim_populated()
2182 test_bit(i, chunk->populated)) { in pcpu_reclaim_populated()
2227 * pcpu_balance_workfn - manage the amount of free chunks and populated pages
2231 * populated pages. An important thing to consider is when pages are freed and
2711 pcpu_chunk_struct_size = struct_size(chunk, populated, in pcpu_setup_first_chunk()
3228 /* pte already populated, the following shouldn't fail */ in pcpu_page_first_chunk()
3352 * pcpu_nr_pages - calculate total number of populated backing pages
3354 * This reflects the number of pages populated to back chunks. Metadata is
3360 * Total number of populated backing pages in use by the allocator.