Function clippy_utils::tokenize_with_text
source ยท pub fn tokenize_with_text(s: &str) -> impl Iterator<Item = (TokenKind, &str)>
Expand description
Tokenizes the input while keeping the text associated with each token.
pub fn tokenize_with_text(s: &str) -> impl Iterator<Item = (TokenKind, &str)>
Tokenizes the input while keeping the text associated with each token.