chore: expand cli live output coverage
This commit is contained in:
1 parent
71274e26ce
commit
9435b208ac
4 files changed
+151
-4
No files matched your search
@@ -315,3 +315,22 @@
|
||||
- New objective: raise the CLI benchmark from executable backend request construction to backend response interpretation for the same live-compatible workflows, starting with `status`, `models list`, and `bench throughput`.
|
||||
- Benchmark driver: `./autoresearch.sh` still runs ignored `localllm-cli` tests and reports `cli_surface_score`, `passed_cases`, `failed_cases`, and `total_cases`.
|
||||
- Keep/discard rule remains test-driven: higher `cli_surface_score` wins while the normal non-ignored suites remain green.
|
||||
|
||||
### Run 33: baseline - cli_surface_score=94.737 (KEEP)
|
||||
- Timestamp: 2026-03-26 20:01
|
||||
- What changed: Added the segment 14 response-preview seam and local deserializable DTOs for health, models list, and throughput usage responses, but left `backend_response_preview()` intentionally unimplemented for the new live-compatible workflows.
|
||||
- Result: cli_surface_score=94.737, passed_cases=54, failed_cases=3, total_cases=57.
|
||||
- Insight: The CLI already had every layer through executable backend request construction, but it still collapsed real response parsing for `status`, `models list`, and `bench throughput` to `SummaryOnly { command: "response-unimplemented" }`.
|
||||
- Next: parse the real response bodies into CLI-local previews for health status, model ids/count, and throughput usage metrics.
|
||||
|
||||
### Run 34: add cli backend response previews - cli_surface_score=100.0 (KEEP)
|
||||
- Timestamp: 2026-03-26 20:02
|
||||
- What changed: Implemented `backend_response_preview()` in `crates/localllm-cli/src/main.rs` so `status` parses health payloads, `models list` collects model ids/count, and `bench throughput` reads `usage.total_tokens` plus `usage.tokens_per_second` into CLI-local preview values.
|
||||
- Result: cli_surface_score=100.0, passed_cases=57, failed_cases=0, total_cases=57.
|
||||
- Insight: The first live-compatible CLI workflows now preserve the full response side of the contract too: request construction plus deterministic response interpretation without forcing reuse of server-only DTOs.
|
||||
- Next: raise the bar from response previews to the first real executable handlers or user-facing live output rendering for commands that already work against the current backend.
|
||||
|
||||
## Segment 15: CLI Live Output
|
||||
- New objective: raise the CLI benchmark from internal backend response previews to final user-facing live output rendering for the already live-compatible workflows `status`, `models list`, and `bench throughput`.
|
||||
- Benchmark driver: `./autoresearch.sh` still runs ignored `localllm-cli` tests and reports `cli_surface_score`, `passed_cases`, `failed_cases`, and `total_cases`.
|
||||
- Keep/discard rule remains test-driven: higher `cli_surface_score` wins while the normal non-ignored suites remain green.
|
||||
Reference in new issue
Block a user