2026-03-27T15:10:47.602969Z  INFO Loading model via llama-sys model=D:\Documents\Github\ai-backend-studio\models\Qwen3.5-4B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled.i1-Q6_K.gguf profile=Turbo4B n_gpu_layers=999 n_ctx=16384 n_batch=128 n_ubatch=128 flash_attn=true use_mmap=false
2026-03-27T15:10:47.603056Z  INFO Loading llama library path=llama.dll
2026-03-27T15:10:47.691116Z  INFO llama backend initialised
2026-03-27T15:10:49.551993Z  INFO Model loaded desc=qwen35 4B Q6_K params_b=4.205751296 is_hybrid=true is_recurrent=false
2026-03-27T15:10:49.664247Z  INFO Context initialised n_ctx=16384
2026-03-27T15:10:49.664284Z  INFO Running engine warmup (dummy decode)…
2026-03-27T15:10:49.722289Z  INFO Warmup complete

  ╔══════════════════════════════════════════════════╗
  ║           ForgeLM  •  Local LLM Runtime          ║
  ╚══════════════════════════════════════════════════╝

  Model  : Qwen3.5-4B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled.i1-Q6_K

  API Endpoints:
    GET   http://127.0.0.1:18083/health
    GET   http://127.0.0.1:18083/v1/models
    POST  http://127.0.0.1:18083/v1/chat/completions

  Chat UI:
    file://$(pwd)/ui/chat.html
    (open ui/chat.html in your browser and set server to http://127.0.0.1:18083)

2026-03-27T15:10:50.807302Z  INFO Prefill finished in 134.37 ms (2143.28 t/s)
2026-03-27T15:10:53.092803Z  INFO Generation complete tokens_generated=128 tps="56.0" prefill_ms="134.4"