docs: finalize cli autoresearch segment 17
This commit is contained in:
1 parent
257aed4cc7
commit
13ba05b02a
4 files changed
+39
-6
No files matched your search
@@ -353,3 +353,30 @@
|
||||
- New objective: raise the CLI benchmark from final live output rendering to the first real executable handlers for the live-compatible workflows `status`, `models list`, and `bench throughput` using an injectable transport seam.
|
||||
- Benchmark driver: `./autoresearch.sh` still runs ignored `localllm-cli` tests and reports `cli_surface_score`, `passed_cases`, `failed_cases`, and `total_cases`.
|
||||
- Keep/discard rule remains test-driven: higher `cli_surface_score` wins while the normal non-ignored suites remain green.
|
||||
|
||||
### Run 37: baseline - cli_surface_score=95.455 (KEEP)
|
||||
- Timestamp: 2026-03-26 20:12
|
||||
- What changed: Expanded the benchmark from live output rendering to an injectable live-execution seam, but left `execute_live_command_with()` as a placeholder that ignored the transport response and returned `LIVE EXEC {summary}`.
|
||||
- Result: cli_surface_score=95.455, passed_cases=63, failed_cases=3, total_cases=66.
|
||||
- Insight: The pipeline already had correct request construction and response rendering, but the executor still dropped the returned status/body instead of feeding them into the live renderer.
|
||||
- Next: wire the transport response through `render_backend_response()` without changing any other CLI seam.
|
||||
|
||||
### Run 38: add cli live execution pipeline - cli_surface_score=100.0 (KEEP)
|
||||
- Timestamp: 2026-03-26 20:13
|
||||
- What changed: Implemented `execute_live_command_with()` in `crates/localllm-cli/src/main.rs` so live-compatible commands now call the injected transport with `BackendRequest`, then pass the returned `status_code` and `body` into `render_backend_response()`.
|
||||
- Result: cli_surface_score=100.0, passed_cases=66, failed_cases=0, total_cases=66.
|
||||
- Insight: The CLI now completes the first fully executable end-to-end path for the live-compatible workflows, from parser to transport invocation to final rendered output.
|
||||
- Next: move from transport-injected execution to the first concrete HTTP client seam for commands that can already hit the current backend directly.
|
||||
|
||||
## Segment 17: CLI ureq HTTP Transport
|
||||
|
||||
- Objective: replace the injectable fake transport with a concrete `ureq` HTTP client for `status`, `models list`, and `bench throughput`.
|
||||
- Benchmark: `./autoresearch.sh` runs ignored `cli_surface_*` tests in `crates/localllm-cli/src/main.rs`.
|
||||
- Keep/discard rule: higher `cli_surface_score` wins while the normal non-ignored suites remain green.
|
||||
|
||||
### Run 39: add ureq http transport and execute_live_command - cli_surface_score=100.0 (KEEP)
|
||||
- Timestamp: 2026-03-26 20:36
|
||||
- What changed: Added `ureq` to workspace and `localllm-cli` deps. Implemented `execute_live_command(cli)` using `ureq` as the real HTTP transport, delegating to `execute_live_command_with()`. Updated `main()` to call `execute_live_command()` instead of the scaffold placeholder. Added 3 new ignored benchmark tests verifying the injectable seam correctly routes status/models/bench through the transport pipeline.
|
||||
- Result: cli_surface_score=100.0, passed_cases=69, failed_cases=0, total_cases=69.
|
||||
- Insight: The CLI now has a real HTTP client (`ureq`) wired end-to-end for live-compatible commands. The injectable transport seam remains available for testing without a running server. The CLI is functionally complete for the commands that the current backend already supports.
|
||||
- Next: CLI is at natural saturation given the current backend. Further progress requires new admin/control-plane endpoints in the backend for scan, load, auth, config, and watch commands.
|
||||
Reference in new issue
Block a user