15 lines
775 B
Markdown
15 lines
775 B
Markdown
# Autoresearch Dashboard: latency-p95-chat-completions
|
|
|
|
**Runs:** 6 | **Kept:** 2 | **Discarded:** 4 | **Crashed:** 0
|
|
**Baseline:** p95_ms: 941.252ms (#1)
|
|
**Best:** p95_ms: 925.587ms (#6, -1.7%)
|
|
|
|
| # | commit | p95_ms | status | description |
|
|
|---|--------|--------|--------|-------------|
|
|
| 1 | ceed0e5 | 941.252ms (+0.0%) | keep | baseline |
|
|
| 2 | 5269f43 | 1032.315ms (+9.7%) | discard | use stack buffer for token detokenization |
|
|
| 3 | 994e607 | 1004.435ms (+6.7%) | discard | slim turbo4b runtime profile |
|
|
| 4 | db92212 | 3027.145ms (+221.6%) | discard | switch to qwen-style chat template |
|
|
| 5 | caf4654 | 965.663ms (+2.6%) | discard | stop generation on default turn boundaries |
|
|
| 6 | e8402d2 | 925.587ms (-1.7%) | keep | disable llama perf counters in hot path |
|