ForgeLM/experiments/localllm-live-stdout.log

2026-03-27T15:10:47.602969Z INFO Loading model via llama-sys model=D:\Documents\Github\ai-backend-studio\models\Qwen3.5-4B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled.i1-Q6_K.gguf profile=Turbo4B n_gpu_layers=999 n_ctx=16384 n_batch=128 n_ubatch=128 flash_attn=true use_mmap=false
2026-03-27T15:10:47.603056Z INFO Loading llama library path=llama.dll
2026-03-27T15:10:47.691116Z INFO llama backend initialised
2026-03-27T15:10:49.551993Z INFO Model loaded desc=qwen35 4B Q6_K params_b=4.205751296 is_hybrid=true is_recurrent=false
2026-03-27T15:10:49.664247Z INFO Context initialised n_ctx=16384
2026-03-27T15:10:49.664284Z INFO Running engine warmup (dummy decode)…
2026-03-27T15:10:49.722289Z INFO Warmup complete
 
╔══════════════════════════════════════════════════╗
║ ForgeLM • Local LLM Runtime ║
╚══════════════════════════════════════════════════╝
 
Model : Qwen3.5-4B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled.i1-Q6_K
 
API Endpoints:
GET http://127.0.0.1:18083/health
GET http://127.0.0.1:18083/v1/models
POST http://127.0.0.1:18083/v1/chat/completions
 
Chat UI:
file://$(pwd)/ui/chat.html
(open ui/chat.html in your browser and set server to http://127.0.0.1:18083)
 
2026-03-27T15:10:50.807302Z INFO Prefill finished in 134.37 ms (2143.28 t/s)
2026-03-27T15:10:53.092803Z INFO Generation complete tokens_generated=128 tps="56.0" prefill_ms="134.4"