Skip to content

feat(lit): add llvm-lit test runner output filtering - #3514

Open
DeepTrial wants to merge 2 commits into
rtk-ai:developfrom
DeepTrial:feat/llvm-lit-support
Open

feat(lit): add llvm-lit test runner output filtering#3514
DeepTrial wants to merge 2 commits into
rtk-ai:developfrom
DeepTrial:feat/llvm-lit-support

Conversation

@DeepTrial

@DeepTrial DeepTrial commented Aug 10, 2026

Copy link
Copy Markdown

Summary

  • Add rtk lit command that filters llvm-lit / lit (LLVM Integrated Tester) output for LLM contexts.
  • Suppresses per-test PASS/XFAIL/UNSUPPORTED status lines (the bulk of the noise) while preserving FAIL/UNRESOLVED/TIMEOUT detail blocks and the Testing Time summary block.
  • Collapses fully-passing runs to a one-line [ok] lit: passed=N failed=M ... summary.
  • Respects verbose flags (-v, --verbose, --show-all, --show-output) by passing raw output through unchanged (Correctness over savings).

Scope

Single feature, focused PR per CONTRIBUTING.md.

Test plan

  • Unit tests in src/cmds/system/lit_cmd.rs: suppress-PASS-keep-FAIL-detail, verbose passthrough, clean-run collapse, flag detection.
  • cargo fmt --all && cargo clippy --all-targets && cargo test --all all pass.

Docs

  • README.md command table + Test Runners section updated.
  • src/cmds/system/README.md lists lit_cmd.rs.

Filter llvm-lit/lit output to suppress per-test PASS/XFAIL/UNSUPPORTED
status lines while preserving FAIL/UNRESOLVED/TIMEOUT detail blocks and the
Testing Time summary. Collapse clean runs to a one-line [ok] summary. Respect
verbose flags (-v/--verbose/--show-output) by passing raw output through.

- Add src/cmds/system/lit_cmd.rs with pure filter_lit() + run()
- Register Lit subcommand in main.rs and rewrite rule in discover/rules.rs
- Add unit tests covering suppression, verbose passthrough, and clean collapse
- Fix test_every_subcommand_is_classified by adding lit to PASSTHROUGH
@CLAassistant

CLAassistant commented Aug 10, 2026

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants