Llama Server Manager is a desktop manager for llama-server, covering model downloads and inventory, engine management, instance lifecycle, cluster workers, unified API routing, performance telemetry, and logs.
Screenshots
Llama Server Manager is a desktop manager for llama-server, covering model downloads and inventory, engine management, instance lifecycle, cluster workers, unified API routing, performance telemetry, and logs.