maturin build generally works when cargo build works, so imho it's not worth running it with every CI run.
ruff