14 lines
521 B
Markdown
14 lines
521 B
Markdown
# Autoresearch Worklog: latency-p95-chat-completions
|
|
|
|
## Session Summary
|
|
- Objective: reduce end-to-end p95 latency for local `POST /v1/chat/completions`
|
|
- Primary metric: `p95_ms` (lower is better)
|
|
- Secondary metrics: `p50_ms`, `mean_ms`, `completion_tps_mean`, `success_count`
|
|
- Benchmark harness: `./autoresearch.sh`
|
|
|
|
## Key Insights
|
|
- No experiment runs logged yet.
|
|
|
|
## Next Ideas
|
|
- Measure baseline first, then inspect the hottest latency contributors in prompt preparation, request handling, and session creation.
|