Lines Matching full:period
17 * Record the start of an expedited grace period.
26 * Return the value that the expedited-grace-period counter will have
27 * at the end of the current grace period.
35 * Record the end of an expedited grace period.
45 * Take a snapshot of the expedited-grace-period counter, which is the
46 * earliest value that will indicate that a full grace period has
61 * if a full expedited grace period has elapsed since that snapshot
131 * a new expedited grace period.
148 * Return non-zero if there is no RCU expedited grace period in progress
151 * for the current expedited grace period.
180 * grace period. This event is reported either to the rcu_node structure on
278 * if some other task completed an expedited grace period that this task
281 * expedited grace period.
338 * expedited grace period needs to wait for.
454 * Work-queue handler to drive an expedited grace period forward.
506 * Work-queue handler to drive an expedited grace period forward.
529 * Select the nodes that the upcoming expedited grace period needs
563 * Wait for the expedited grace period to elapse, within time limit.
564 * If the time limit is exceeded without the grace period elapsing,
583 * Wait for the expedited grace period to elapse, issuing any needed
684 * Wait for the current expedited grace period to complete, and then
686 * grace period. Also update all the ->exp_seq_rq counters as needed
696 // End the previous grace period only after acquiring the mutex in rcu_exp_wait_wake()
718 * Common code to drive an expedited grace period forward, used by
770 * grace period is still waiting on this CPU, set ->deferred_qs in rcu_exp_handler()
790 /* PREEMPTION=y, so no PREEMPTION=n expedited grace period to clean up after. */
798 * expedited grace period.
824 * expedited grace period.
916 * blocking the current expedited grace period.
926 * the current expedited grace period.
935 * synchronize_rcu_expedited - Brute-force RCU grace period
937 * Wait for an RCU grace period, but expedite it. The basic idea is to
967 /* Is the state is such that the call is a grace period? */ in synchronize_rcu_expedited()
1000 /* Marshall arguments & schedule the expedited grace period. */ in synchronize_rcu_expedited()
1005 /* Wait for expedited grace period to complete. */ in synchronize_rcu_expedited()
1011 /* Let the next expedited grace period start. */ in synchronize_rcu_expedited()
1050 … start_poll_synchronize_rcu_expedited - Snapshot current RCU state and start expedited grace period
1054 * allowing them to determine whether or not any sort of grace period has
1055 * elapsed in the meantime. If the needed expedited grace period is not
1056 * already slated to start, initiates that grace period.
1084 * start_poll_synchronize_rcu_expedited_full - Take a full snapshot and start expedited grace period
1085 * @rgosp: Place to put snapshot of grace-period state
1087 * Places the normal and expedited grace-period states in rgosp. This
1090 * grace period (whether normal or expedited) has elapsed in the meantime.
1091 * If the needed expedited grace period is not already slated to start,
1092 * initiates that grace period.
1102 * cond_synchronize_rcu_expedited - Conditionally wait for an expedited RCU grace period
1106 * If any type of full RCU grace period has elapsed since the earlier
1109 * invoke synchronize_rcu_expedited() to wait for a full grace period.
1129 * cond_synchronize_rcu_expedited_full - Conditionally wait for an expedited RCU grace period
1132 * If a full RCU grace period has elapsed since the call to
1136 * to wait for a full grace period.