struct TokenBuffer::MarkedFile

Declaration

struct TokenBuffer::MarkedFile { /* full declaration omitted */ };

Description

Spelled tokens of the file with information about the subranges.

Declared at: clang/include/clang/Tooling/Syntax/Tokens.h:337

Member Variables

public std::vector<syntax::Token> SpelledTokens

Lexed, but not preprocessed, tokens of the file. These map directly to text in the corresponding files and include tokens of all preprocessor directives. FIXME: spelled tokens don't change across FileID that map to the same FileEntry. We could consider deduplicating them to save memory.

public std::vector<Mapping> Mappings

A sorted list to convert between the spelled and expanded token streams.

public unsigned int BeginExpanded = 0

The first expanded token produced for this FileID.

public unsigned int EndExpanded = 0