ΒΆstd::vector<syntax::Token> tokenize(
const clang::syntax::FileRange& FR,
const clang::SourceManager& SM,
const clang::LangOptions& LO)
std::vector<syntax::Token> tokenize(
const clang::syntax::FileRange& FR,
const clang::SourceManager& SM,
const clang::LangOptions& LO)
Description
Similar to one above, instead of whole file tokenizes a part of it. Note that, the first token might be incomplete if FR.startOffset is not at the beginning of a token, and the last token returned will start before the FR.endOffset but might end after it.
Declared at: clang/include/clang/Tooling/Syntax/Tokens.h:413
Parameters
- const clang::syntax::FileRange& FR
- const clang::SourceManager& SM
- const clang::LangOptions& LO