This is still early days, but I hope the framework introduced here makes it very easy to add new truth data. Truth data should be seen as a form of regression test for non-ideal ranking of completion suggestions. I think it would help to read `crates/ty_completion_eval/README.md` first to get an idea of what you're reviewing.
12 lines
490 B
Markdown
12 lines
490 B
Markdown
This directory contains truth data for ty's completion evaluation.
|
|
|
|
# Adding new truth data
|
|
|
|
To add new truth data, you can either add a new `<CURSOR>` directive to an
|
|
existing Python project in this directory or create a new Python project. To
|
|
create a new directory, just `cp -a existing new` and modify it as needed. Then:
|
|
|
|
1. Check `completion.toml` for relevant settings.
|
|
2. Run `uv.lock` after updating `pyproject.toml` (if necessary) to ensure the
|
|
dependency versions are locked.
|