Enum rustc_ast::token::TokenKind[][src]

pub enum TokenKind {
Show 37 variants Eq, Lt, Le, EqEq, Ne, Ge, Gt, AndAnd, OrOr, Not, Tilde, BinOp(BinOpToken), BinOpEq(BinOpToken), At, Dot, DotDot, DotDotDot, DotDotEq, Comma, Semi, Colon, ModSep, RArrow, LArrow, FatArrow, Pound, Dollar, Question, SingleQuote, OpenDelim(DelimToken), CloseDelim(DelimToken), Literal(Lit), Ident(Symbolbool), Lifetime(Symbol), Interpolated(Lrc<Nonterminal>), DocComment(CommentKindAttrStyleSymbol), Eof,
}

Variants

Eq

Lt

Le

EqEq

Ne

Ge

Gt

AndAnd

OrOr

Not

Tilde

BinOp(BinOpToken)

Tuple Fields

BinOpEq(BinOpToken)

Tuple Fields

At

Dot

DotDot

DotDotDot

DotDotEq

Comma

Semi

Colon

ModSep

RArrow

LArrow

FatArrow

Pound

Dollar

Question

SingleQuote

Used by proc macros for representing lifetimes, not generated by lexer right now.

OpenDelim(DelimToken)

Tuple Fields

An opening delimiter (e.g., {).

CloseDelim(DelimToken)

Tuple Fields

A closing delimiter (e.g., }).

Literal(Lit)

Tuple Fields

0: Lit

Ident(Symbolbool)

Tuple Fields

0: Symbol
1: bool

Identifier token. Do not forget about NtIdent when you want to match on identifiers. It’s recommended to use Token::(ident,uninterpolate,uninterpolated_span) to treat regular and interpolated identifiers in the same way.

Lifetime(Symbol)

Tuple Fields

0: Symbol

Lifetime identifier token. Do not forget about NtLifetime when you want to match on lifetime identifiers. It’s recommended to use Token::(lifetime,uninterpolate,uninterpolated_span) to treat regular and interpolated lifetime identifiers in the same way.

Interpolated(Lrc<Nonterminal>)

Tuple Fields

DocComment(CommentKindAttrStyleSymbol)

Tuple Fields

2: Symbol

A doc comment token. Symbol is the doc comment’s data excluding its “quotes” (///, /**, etc) similarly to symbols in string literal tokens.

Eof

Implementations

Returns tokens that are likely to be typed accidentally instead of the current token. Enables better error recovery when the wrong token is found.

Trait Implementations

Returns a copy of the value. Read more

Performs copy-assignment from source. Read more

Formats the value using the given formatter. Read more

This method tests for self and other values to be equal, and is used by ==. Read more

This method tests for !=.

This method tests for self and other values to be equal, and is used by ==. Read more

This method tests for !=.

Auto Trait Implementations

Blanket Implementations

Gets the TypeId of self. Read more

Immutably borrows from an owned value. Read more

Mutably borrows from an owned value. Read more

Performs the conversion.

Performs the conversion.

The resulting type after obtaining ownership.

Creates owned data from borrowed data, usually by cloning. Read more

🔬 This is a nightly-only experimental API. (toowned_clone_into)

Uses borrowed data to replace owned data, usually by cloning. Read more

The type returned in the event of a conversion error.

Performs the conversion.

The type returned in the event of a conversion error.

Performs the conversion.

Layout

Note: Most layout information is completely unstable and may even differ between compilations. The only exception is types with certain repr(...) attributes. Please see the Rust Reference’s “Type Layout” chapter for details on type layout guarantees.

Size: 16 bytes

Size for each variant:

  • Eq: 0 bytes
  • Lt: 0 bytes
  • Le: 0 bytes
  • EqEq: 0 bytes
  • Ne: 0 bytes
  • Ge: 0 bytes
  • Gt: 0 bytes
  • AndAnd: 0 bytes
  • OrOr: 0 bytes
  • Not: 0 bytes
  • Tilde: 0 bytes
  • BinOp: 1 byte
  • BinOpEq: 1 byte
  • At: 0 bytes
  • Dot: 0 bytes
  • DotDot: 0 bytes
  • DotDotDot: 0 bytes
  • DotDotEq: 0 bytes
  • Comma: 0 bytes
  • Semi: 0 bytes
  • Colon: 0 bytes
  • ModSep: 0 bytes
  • RArrow: 0 bytes
  • LArrow: 0 bytes
  • FatArrow: 0 bytes
  • Pound: 0 bytes
  • Dollar: 0 bytes
  • Question: 0 bytes
  • SingleQuote: 0 bytes
  • OpenDelim: 1 byte
  • CloseDelim: 1 byte
  • Literal: 15 bytes
  • Ident: 7 bytes
  • Lifetime: 7 bytes
  • Interpolated: 15 bytes
  • DocComment: 7 bytes
  • Eof: 0 bytes