5f3da9955a
## Summary This crate now contains utilities for dealing with trivia more broadly: whitespace, newlines, "simple" trivia lexing, etc. So renaming it to reflect its increased responsibilities. To avoid conflicts, I've also renamed `Token` and `TokenKind` to `SimpleToken` and `SimpleTokenKind`.
10 lines
143 B
Rust
10 lines
143 B
Rust
mod cursor;
|
|
mod newlines;
|
|
mod tokenizer;
|
|
mod whitespace;
|
|
|
|
pub use cursor::*;
|
|
pub use newlines::*;
|
|
pub use tokenizer::*;
|
|
pub use whitespace::*;
|