Struct TokenCursor 

pub struct TokenCursor {
    curr: TokenTreeCursor,
    stack: Vec<TokenTreeCursor>,
}

A TokenStream cursor that produces Tokens. It’s a bit odd that we (a) lex tokens into a nice tree structure (TokenStream), and then (b) use this type to emit them as a linear sequence. But a linear sequence is what the parser expects, for the most part.

Fields

curr: TokenTreeCursor

stack: Vec<TokenTreeCursor>

Implementations

impl TokenCursor

pub fn new(stream: TokenStream) -> Self

pub fn next(&mut self) -> (Token, Spacing)

pub fn look_ahead(&self, n: usize) -> Option<&TokenTree>

An n of zero is the next token tree in the current token stream; won’t look outside the current token stream.

pub fn look_ahead_past_close_delim(&self) -> Option<&TokenTree>

Returns the first token tree (if there is one) past the close delimiter of the enclosing delimited sequence. Panics if we are not within a delimited sequence.

pub fn clone_enclosing_delim(&self) -> TokenTree

Clones the TokenTree::Delimited that we are currently within. Panics if we are not within a delimited sequence.

pub fn bump_to_end(&mut self)

For skipping to the end of the current sequence, in rare circumstances.

pub fn depth(&self) -> usize

Note: the outermost stream has depth of 0.

pub fn parent_delim_and_span(&self) -> Option<(Delimiter, DelimSpan)>

Returns details about the parent delimited sequence, if there is one.

pub fn inlined_next(&mut self) -> (Token, Spacing)

This always-inlined version should only be used on hot code paths.

Trait Implementations

impl Clone for TokenCursor

fn clone(&self) -> TokenCursor

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenCursor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

Layout

Note: Most layout information is completely unstable and may even differ between compilations. The only exception is types with certain repr(...) attributes. Please see the Rust Reference's “Type Layout” chapter for details on type layout guarantees.

Size: 40 bytes