Lines Matching full:period

16  * Record the start of an expedited grace period.
25 * Return the value that the expedited-grace-period counter will have
26 * at the end of the current grace period.
34 * Record the end of an expedited grace period.
44 * Take a snapshot of the expedited-grace-period counter, which is the
45 * earliest value that will indicate that a full grace period has
60 * if a full expedited grace period has elapsed since that snapshot
130 * a new expedited grace period.
147 * Return non-zero if there is no RCU expedited grace period in progress
150 * for the current expedited grace period.
179 * grace period. This event is reported either to the rcu_node structure on
277 * if some other task completed an expedited grace period that this task
280 * expedited grace period.
337 * expedited grace period needs to wait for.
453 * Work-queue handler to drive an expedited grace period forward.
505 * Work-queue handler to drive an expedited grace period forward.
528 * Select the nodes that the upcoming expedited grace period needs
562 * Wait for the expedited grace period to elapse, within time limit.
563 * If the time limit is exceeded without the grace period elapsing,
582 * Wait for the expedited grace period to elapse, issuing any needed
679 * Wait for the current expedited grace period to complete, and then
681 * grace period. Also update all the ->exp_seq_rq counters as needed
691 // End the previous grace period only after acquiring the mutex in rcu_exp_wait_wake()
713 * Common code to drive an expedited grace period forward, used by
765 * grace period is still waiting on this CPU, set ->deferred_qs in rcu_exp_handler()
785 /* PREEMPTION=y, so no PREEMPTION=n expedited grace period to clean up after. */
793 * expedited grace period.
879 * blocking the current expedited grace period.
889 * synchronize_rcu_expedited - Brute-force RCU grace period
891 * Wait for an RCU grace period, but expedite it. The basic idea is to
921 /* Is the state is such that the call is a grace period? */ in synchronize_rcu_expedited()
954 /* Marshall arguments & schedule the expedited grace period. */ in synchronize_rcu_expedited()
959 /* Wait for expedited grace period to complete. */ in synchronize_rcu_expedited()
965 /* Let the next expedited grace period start. */ in synchronize_rcu_expedited()
1004 … start_poll_synchronize_rcu_expedited - Snapshot current RCU state and start expedited grace period
1008 * allowing them to determine whether or not any sort of grace period has
1009 * elapsed in the meantime. If the needed expedited grace period is not
1010 * already slated to start, initiates that grace period.
1037 * start_poll_synchronize_rcu_expedited_full - Take a full snapshot and start expedited grace period
1038 * @rgosp: Place to put snapshot of grace-period state
1040 * Places the normal and expedited grace-period states in rgosp. This
1043 * grace period (whether normal or expedited) has elapsed in the meantime.
1044 * If the needed expedited grace period is not already slated to start,
1045 * initiates that grace period.
1055 * cond_synchronize_rcu_expedited - Conditionally wait for an expedited RCU grace period
1059 * If any type of full RCU grace period has elapsed since the earlier
1062 * invoke synchronize_rcu_expedited() to wait for a full grace period.
1082 * cond_synchronize_rcu_expedited_full - Conditionally wait for an expedited RCU grace period
1085 * If a full RCU grace period has elapsed since the call to
1089 * to wait for a full grace period.