chore: initialize autoresearch baseline
This commit is contained in:
commit
f83e8b83f6
42 files changed
+10550
No files matched your search
@@ -0,0 +1,13 @@
|
||||
# Autoresearch Worklog: latency-p95-chat-completions
|
||||
|
||||
## Session Summary
|
||||
- Objective: reduce end-to-end p95 latency for local `POST /v1/chat/completions`
|
||||
- Primary metric: `p95_ms` (lower is better)
|
||||
- Secondary metrics: `p50_ms`, `mean_ms`, `completion_tps_mean`, `success_count`
|
||||
- Benchmark harness: `./autoresearch.sh`
|
||||
|
||||
## Key Insights
|
||||
- No experiment runs logged yet.
|
||||
|
||||
## Next Ideas
|
||||
- Measure baseline first, then inspect the hottest latency contributors in prompt preparation, request handling, and session creation.
|
||||
Reference in new issue
Block a user