pub fn scan(sql: &str) -> Result<Vec<(TokenType, Range<usize>)>>Expand description
Each token of sql, without comments and whitespace, with its kind and
its byte range in sql. SQLite’s parameter names and unterminated block
comments are accepted as SQLite accepts them.