Struct Classifier 

struct Classifier<'src> {
    tokens: PeekIter<'src>,
    in_attribute: bool,
    in_macro: bool,
    in_macro_nonterminal: bool,
    byte_pos: u32,
    file_span: Span,
    src: &'src str,
    decorations: Option<Decorations>,
}

Processes program tokens, classifying strings of text by highlighting category (Class).

Fields

tokens: PeekIter<'src>

in_attribute: bool

in_macro: bool

in_macro_nonterminal: bool

byte_pos: u32

file_span: Span

src: &'src str

decorations: Option<Decorations>

Implementations

impl<'src> Classifier<'src>

fn new( src: &'src str, byte_pos: usize, file_span: Span, decoration_info: Option<&DecorationInfo>, ) -> Self

Takes as argument the source code to HTML-ify and the source code file span which will be used later on by the span_correspondence_map.

fn get_full_ident_path(&mut self) -> Vec<(TokenKind, usize, usize)>

Concatenate colons and idents as one when possible.

fn next(&mut self) -> Option<(TokenKind, &'src str, u32)>

Wraps the tokens iteration to ensure that the byte_pos is always correct.

It returns the token’s kind, the token as a string and its byte position in the source string.

fn new_macro_span( &mut self, text: &'src str, sink: &mut dyn FnMut(Span, Highlight<'src>), before: u32, file_span: Span, )

fn advance( &mut self, token: TokenKind, text: &'src str, sink: &mut dyn FnMut(Span, Highlight<'src>), before: u32, )

Single step of highlighting. This will classify token, but maybe also a couple of following ones as well.

before is the position of the given token in the source string and is used as “lo” byte in case we want to try to generate a link for this token using the span_correspondence_map.

fn is_weak_keyword(&mut self, text: &str) -> bool

fn peek(&mut self) -> Option<TokenKind>

fn peek_non_trivia(&mut self) -> Option<(TokenKind, &str)>

Layout

Note: Most layout information is completely unstable and may even differ between compilations. The only exception is types with certain repr(...) attributes. Please see the Rust Reference's “Type Layout” chapter for details on type layout guarantees.

Size: 168 bytes