Lines Matching full:stable

66  * Therefore KSM uses two data structures - the stable and the unstable tree.
68 * The stable tree holds pointers to all the merged pages (ksm pages), sorted
71 * and therefore this tree is called the stable tree.
73 * The stable tree node includes information required for reverse
77 * KSM maintains two types of nodes in the stable tree:
88 * In addition to the stable tree, KSM uses a second data structure called the
106 * 4) KSM never flushes the stable tree, which means that even if it were to
108 * it is secured in the stable tree. (When we scan a new page, we first
109 * compare it against the stable tree, and then against the unstable tree.)
112 * stable trees and multiple unstable trees: one of each for each NUMA node.
142 * struct ksm_stable_node - node of the stable rbtree
143 * @node: rb node of this ksm page in the stable tree
151 * @nid: NUMA node id of stable tree in which linked (may not match kpfn)
155 struct rb_node node; /* when node of stable tree */
184 * @anon_vma: pointer to anon_vma for this mm,address, when in stable tree
190 * @head: pointer to stable_node heading this list in the stable tree
196 struct anon_vma *anon_vma; /* when stable */
206 struct { /* when listed from stable tree */
215 #define STABLE_FLAG 0x200 /* is listed from the stable tree */
217 /* The stable and unstable tree heads */
223 /* Recently migrated nodes of stable tree, pending proper placement */
241 /* The number of nodes in the stable tree */
262 /* Maximum number of page slots sharing a stable node */
479 * than we're counting as nodes in the stable tree; but ksm_do_scan in break_ksm()
551 * stable and unstable pages from all nodes with roots in index 0. Otherwise,
552 * every node has its own stable and unstable tree.
574 * Put the stable node chain in the first dimension of in alloc_stable_node_chain()
575 * the stable tree and at the same time remove the old in alloc_stable_node_chain()
576 * stable node. in alloc_stable_node_chain()
581 * Move the old stable node to the second dimension in alloc_stable_node_chain()
646 * get_ksm_page: checks if the page indicated by the stable node
650 * remove the stale node from the stable tree and return NULL.
651 * But beware, the stable node's page might be being migrated.
657 * "keyhole reference": access to the ksm page from the stable node peeps
659 * pointing back to this stable node. This relies on freeing a PageAnon
740 * Removing rmap_item from stable or unstable tree.
741 * This function will clean the information from the stable/unstable tree.
804 * Though it's very tempting to unmerge rmap_items from stable tree rather
806 * that - an rmap_item is assigned to the stable tree after inserting ksm
875 * The stable node did not yet appear stale to get_ksm_page(), in remove_stable_node()
993 /* Clean up stable nodes, but don't worry if some are still busy */ in unmerge_and_remove_all_rmap_items()
1218 * We need the page lock to read a stable PageSwapCache in in try_to_merge_one_page()
1286 /* Unstable nid is in union with stable anon_vma: remove first */ in try_to_merge_with_ksm_page()
1372 * stable nodes during lookup. in stable_node_dup()
1435 * otherwise left as a stable pointer, the in stable_node_dup()
1537 * stable_tree_search - search for page inside the stable tree
1539 * This function checks if there is a page inside the stable tree
1542 * This function returns the stable tree node of identical content if found,
1584 * stable rbtree and stable_node will be equal to in stable_tree_search()
1638 * into a stable node dup. If the mapcount is in stable_tree_search()
1711 * from the case there was no chain in the stable in stable_tree_search()
1762 * from the case there was no chain in the stable in stable_tree_search()
1789 * stable_tree_insert - insert stable tree node pointing to new ksm page
1790 * into the stable tree.
1792 * This function returns the stable tree node just allocated on success,
1983 * rmap_items hanging off a given node of the stable tree, all sharing
2021 * cmp_and_merge_page - first see if page can be merged into the stable tree;
2024 * both transferred to the stable tree.
2060 /* We first start with searching the page inside the stable tree */ in cmp_and_merge_page()
2077 * add its rmap_item to the stable tree. in cmp_and_merge_page()
2150 * node in the stable tree and add both rmap_items. in cmp_and_merge_page()
2163 * If we fail to insert the page into the stable tree, in cmp_and_merge_page()
2165 * to a ksm page left outside the stable tree, in cmp_and_merge_page()
2628 * to that page's node of the stable tree. in rmap_walk_ksm()
2656 /* Ignore the stable/unstable/sqnr flags */ in rmap_walk_ksm()
2805 * it is unsafe for them to touch the stable tree at this time. in ksm_memory_callback()
2978 * Allocate stable and unstable together: in merge_across_nodes_store()
2989 /* Stable tree is empty but not the unstable */ in merge_across_nodes_store()