ruff/crates/ty_completion_eval/completion-evaluation-tasks.csv at 2196ef3a33550c9580c39c6b9df23c14fd0a2a78

Files

Andrew Gallant 2196ef3a33 [ty] Add package priority completion evaluation tasks

This commit adds two new tests. One checks that a symbol in the current
project gets priority over a symbol in the standard library. Another
checks that a symbol in a third party dependency gets priority over a
symbol in the standard library. We don't get either of these right
today.

Note that these comparisons are done ceteris paribus. A symbol from the
standard library could still be ranked above a symbol elsewhere.
(Although I believe currently this is somewhat rare.)

2026-01-09 09:55:32 -05:00

1.5 KiB

Raw Blame History

1	name	file	index	rank
2	auto-import-includes-modules	main.py	0	1
3	auto-import-includes-modules	main.py	1	7
4	auto-import-includes-modules	main.py	2	1
5	auto-import-skips-current-module	main.py	0	1
6	class-arg-completion	main.py	0	1
7	exact-over-fuzzy	main.py	0	2
8	fstring-completions	main.py	0	1
9	higher-level-symbols-preferred	main.py	0
10	higher-level-symbols-preferred	main.py	1	1
11	import-deprioritizes-dunder	main.py	0	1
12	import-deprioritizes-sunder	main.py	0	1
13	import-deprioritizes-type_check_only	main.py	0	1
14	import-deprioritizes-type_check_only	main.py	1	1
15	import-deprioritizes-type_check_only	main.py	2	1
16	import-deprioritizes-type_check_only	main.py	3	2
17	import-deprioritizes-type_check_only	main.py	4	3
18	import-keyword-completion	main.py	0	1
19	internal-typeshed-hidden	main.py	0	2
20	local-over-auto-import	main.py	0	1
21	none-completion	main.py	0	1
22	numpy-array	main.py	0	161
23	numpy-array	main.py	1	1
24	object-attr-instance-methods	main.py	0	1
25	object-attr-instance-methods	main.py	1	1
26	pass-keyword-completion	main.py	0	1
27	raise-uses-base-exception	main.py	0	1
28	scope-existing-over-new-import	main.py	0	1
29	scope-prioritize-closer	main.py	0	2
30	scope-simple-long-identifier	main.py	0	1
31	third-party-over-stdlib	main.py	0	3
32	tighter-over-looser-scope	main.py	0	3
33	tstring-completions	main.py	0	1
34	ty-extensions-lower-stdlib	main.py	0	1
35	type-var-typing-over-ast	main.py	0	1
36	type-var-typing-over-ast	main.py	1	14
37	typing-gets-priority	main.py	0	1
38	typing-gets-priority	main.py	1	1
39	typing-gets-priority	main.py	2	1
40	typing-gets-priority	main.py	3	3
41	typing-gets-priority	main.py	4	2

1.5 KiB Raw Blame History

1.5 KiB

Raw Blame History