Skip to main content Module transcribe Copy item path Source use std::mem ; 🔒 use rustc_ast::token ; 🔒 use rustc_ast::token::Delimiter ; 🔒 use rustc_ast::token::IdentKind ; 🔒 use rustc_ast::token::InvisibleOrigin ; 🔒 use rustc_ast::token::Lit ; 🔒 use rustc_ast::token::LitKind ; 🔒 use rustc_ast::token::MetaVarKind ; 🔒 use rustc_ast::token::Token ; 🔒 use rustc_ast::token::TokenKind ; 🔒 use rustc_ast::tokenstream::DelimSpacing ; 🔒 use rustc_ast::tokenstream::DelimSpan ; 🔒 use rustc_ast::tokenstream::Spacing ; 🔒 use rustc_ast::tokenstream::TokenStream ; 🔒 use rustc_ast::tokenstream::TokenTree ; 🔒 use rustc_ast::ExprKind ; 🔒 use rustc_ast::StmtKind ; 🔒 use rustc_ast::TyKind ; 🔒 use rustc_ast::UnOp ; 🔒 use rustc_data_structures::fx::FxHashMap ; 🔒 use rustc_errors::Diag ; 🔒 use rustc_errors::DiagCtxtHandle ; 🔒 use rustc_errors::PResult ; 🔒 use rustc_errors::listify ; 🔒 use rustc_errors::pluralize ; 🔒 use rustc_parse::lexer::nfc_normalize ; 🔒 use rustc_parse::parser::ParseNtResult ; 🔒 use rustc_session::parse::ParseSess ; 🔒 use rustc_span::hygiene::LocalExpnId ; 🔒 use rustc_span::hygiene::Transparency ; 🔒 use rustc_span::BytePos ; 🔒 use rustc_span::Ident ; 🔒 use rustc_span::MacroRulesNormalizedIdent ; 🔒 use rustc_span::Span ; 🔒 use rustc_span::Symbol ; 🔒 use rustc_span::SyntaxContext ; 🔒 use rustc_span::kw ; 🔒 use rustc_span::sym ; 🔒 use rustc_span::with_metavar_spans ; 🔒 use smallvec::SmallVec ; 🔒 use smallvec::smallvec ; 🔒 use crate::diagnostics::ConcatInvalidIdent ; 🔒 use crate::diagnostics::CountRepetitionMisplaced ; 🔒 use crate::diagnostics::InvalidIdentReason ; 🔒 use crate::diagnostics::MacroVarStillRepeating ; 🔒 use crate::diagnostics::MetaVarsDifSeqMatchers ; 🔒 use crate::diagnostics::MustRepeatOnce ; 🔒 use crate::diagnostics::MveUnrecognizedVar ; 🔒 use crate::diagnostics::NoRepeatableVar ; 🔒 use crate::diagnostics::NoSyntaxVarsExprRepeat ; 🔒 use crate::diagnostics::VarNoTypo ; 🔒 use crate::diagnostics::VarTypoSuggestionRepeatable ; 🔒 use crate::diagnostics::VarTypoSuggestionUnrepeatable ; 🔒 use crate::diagnostics::VarTypoSuggestionUnrepeatableLabel ; 🔒 use crate::mbe::macro_parser::NamedMatch ; 🔒 use crate::mbe::metavar_expr::MetaVarExprConcatElem ; 🔒 use crate::mbe::metavar_expr::validate_ident_kind ; 🔒 use crate::mbe ; 🔒 use crate::mbe::KleeneOp ; 🔒 use crate::mbe::MetaVarExpr ; 🔒 use crate::mbe::macro_parser::NamedMatch ::*; 🔒 Frame 🔒 An iterator over the token trees in a delimited token tree ({ ... }) or a sequence ($(...)). Marker 🔒 A Marker adds the given mark to the syntax context. TranscrCtx 🔒 Context needed to perform transcription of metavariable expressions. FrameKind 🔒 LockstepIterSize 🔒 An accumulator over a TokenTree to be used with fold. During transcription, we need to make
sure that the size of each sequence and all of its nested sequences are the same as the sizes
of all the matched (nested) sequences in the macro invocation. If they don’t match, somebody
has made a mistake (either the macro writer or caller). count_repetitions 🔒 Used solely by the count meta-variable expression, counts the outermost repetitions at a
given optional nested depth. extract_symbol_from_pnr 🔒 Extracts an metavariable symbol that can be an identifier, a token tree or a literal. lockstep_iter_size 🔒 Given a tree, make sure that all sequences have the same length as the matches for the
appropriate meta-vars in interpolations. lookup_cur_matched 🔒 Lookup the meta-var named ident and return the matched token tree from the invocation using
the set of matches interpolations. matched_from_ident 🔒 Returns a NamedMatch item declared on the LHS given an arbitrary Ident maybe_use_metavar_location 🔒 Store the metavariable span for this original span into a side table.
FIXME: Try to put the metavariable span into SpanData instead of a side table (#118517).
An optimal encoding for inlined spans will need to be selected to minimize regressions.
The side table approach is relatively good, but not perfect due to collisions.
In particular, collisions happen when token is passed as an argument through several macro
calls, like in recursive macros.
The old heuristic below is used to improve spans in case of collisions, but diagnostics are
still degraded sometimes in those cases. metavar_expr_concat 🔒 Shared logic for concat/concat_str metavariable expressions metavar_expr_concat_ident 🔒 Handle the ${concat(...)} metavariable expression. metavar_expr_concat_str 🔒 Handle the ${concat_str(...)} metavariable expression. out_of_bounds_err 🔒 Used by meta-variable expressions when an user input is out of the actual declared bounds. For
example, index(999999) in an repetition of only three elements. transcribe 🔒 This can do Macro-By-Example transcription. transcribe_metavar 🔒 Find the matched nonterminal from the macro invocation, and use it to replace
the meta-var. transcribe_metavar_expr 🔒 Turn ${expr(...)} metavariable expressionss into tokens. transcribe_pnr 🔒 transcribe_sequence 🔒 Turn $(...)* sequences into tokens.