chore: expand cli live execution coverage
This commit is contained in:
1 parent
1501d2388a
commit
4f94b98f4f
4 files changed
+186
-5
No files matched your search
@@ -334,3 +334,22 @@
|
||||
- New objective: raise the CLI benchmark from internal backend response previews to final user-facing live output rendering for the already live-compatible workflows `status`, `models list`, and `bench throughput`.
|
||||
- Benchmark driver: `./autoresearch.sh` still runs ignored `localllm-cli` tests and reports `cli_surface_score`, `passed_cases`, `failed_cases`, and `total_cases`.
|
||||
- Keep/discard rule remains test-driven: higher `cli_surface_score` wins while the normal non-ignored suites remain green.
|
||||
|
||||
### Run 35: baseline - cli_surface_score=90.476 (KEEP)
|
||||
- Timestamp: 2026-03-26 20:06
|
||||
- What changed: Expanded the benchmark from backend response previews to final user-facing live output rendering, but left `render_backend_response()` as a shallow `LIVE {summary}` placeholder.
|
||||
- Result: cli_surface_score=90.476, passed_cases=57, failed_cases=6, total_cases=63.
|
||||
- Insight: The CLI already parsed health, model-list, and throughput responses correctly, but it still lacked final text/json presentation for those live-compatible workflows.
|
||||
- Next: render `BackendResponsePreview` into final `STATUS`, `MODELS`, and `THROUGHPUT` text/json outputs.
|
||||
|
||||
### Run 36: render cli live outputs - cli_surface_score=100.0 (KEEP)
|
||||
- Timestamp: 2026-03-26 20:07
|
||||
- What changed: Implemented `render_backend_response()` in `crates/localllm-cli/src/main.rs` so the live-compatible commands now render final text/json output directly from `BackendResponsePreview`, including health summaries, model-id lists, and throughput usage output.
|
||||
- Result: cli_surface_score=100.0, passed_cases=63, failed_cases=0, total_cases=63.
|
||||
- Insight: The CLI now closes the full loop for the first live-compatible workflows, from parser and planning all the way to final user-facing live output.
|
||||
- Next: move from live output rendering to the first real executable handlers for commands that already work today.
|
||||
|
||||
## Segment 16: CLI Live Execution
|
||||
- New objective: raise the CLI benchmark from final live output rendering to the first real executable handlers for the live-compatible workflows `status`, `models list`, and `bench throughput` using an injectable transport seam.
|
||||
- Benchmark driver: `./autoresearch.sh` still runs ignored `localllm-cli` tests and reports `cli_surface_score`, `passed_cases`, `failed_cases`, and `total_cases`.
|
||||
- Keep/discard rule remains test-driven: higher `cli_surface_score` wins while the normal non-ignored suites remain green.
|
||||
Reference in new issue
Block a user