7 Commits

Author	SHA1	Message	Date
Micha Reiser	f1a4eb9c28	Use the unicode-ident crate (#7212)	2023-09-07 08:19:25 +00:00
Victor Hugo Gomes	041cdb95e0	Update identifier Unicode character validation to match Python spec (#7209) ... Co-authored-by: Micha Reiser <micha@reiser.io>	2023-09-07 07:08:42 +00:00
Charlie Marsh	7f7df852e8	Remove some extraneous newlines in Cargo.toml (#6577)	2023-08-14 23:39:41 +00:00
Micha Reiser	40f54375cb	Pull in RustPython parser (#6099)	2023-07-27 09:29:11 +00:00
Micha Reiser	2cf00fee96	Remove parser dependency from ruff-python-ast (#6096)	2023-07-26 17:47:22 +02:00
Micha Reiser	76e9ce6dc0	Fix SimpleTokenizer's backward lexing of # (#5878)	2023-07-20 11:54:18 +02:00
Charlie Marsh	5f3da9955a	Rename ruff_python_whitespace to ruff_python_trivia (#5886) ... ## Summary This crate now contains utilities for dealing with trivia more broadly: whitespace, newlines, "simple" trivia lexing, etc. So renaming it to reflect its increased responsibilities. To avoid conflicts, I've also renamed `Token` and `TokenKind` to `SimpleToken` and `SimpleTokenKind`.	2023-07-19 11:48:27 -04:00