winget install --id IvanCharapanau.HarborAbout Harbor
Harbor is a containerized LLM toolkit that allows you to run LLMs and additional services. It consists of a CLI and a companion App that allows you to manage and run AI services with ease.
What's new in 0.5.4
Misc A hardening release: a runnable integration suite now exercises 40 Harbor services end-to-end, and everything it caught is fixed. - New tests/services-integration.sh runs the whole service integration suite (grouped, with --groups/--list), backed by a written spec in tests/services-integration.md. - First-boot failures fixed across many services: SearXNG (stale settings crash-loop), Langflow and AnythingLLM (storage permissions), LibreChat (RAG database race and a broken Ollama endpoint URL), LibreTranslate, Plandex (install source, server image, port, postgres pin), webtop builds, fabric, cmdh, and metamcp headless start. - chat-ui works with Harbor backends again on current upstream versions. - LDR's SearXNG search integration and persistent data storage now work; Presenton reaches Ollama and no longer requires login setup. - Bifrost restarts cleanly with a persisted config; optillm is reachable on its published port; mcp-inspector no longer spawns runaway processes. - LiteLLM gains ready-made llama.cpp and optillm routing configs. - harbor up accepts cross-file service selectors like harbor up mcpo mcp-server-time. - Boost now returns the backend's real HTTP status and error body instead of an empty 200 when a request is rejected, and logs handled backend errors as a single concise line. - harbor pull rejects unknown service names with a clear error instead of starting Ollama. - ROCm GPU variants (llama.cpp, Ollama, LocalAI, Lemonade) verified with real inference on AMD hardware, with the runner detecting ROCm hosts automatically. Full Changelog: https://github.com/...
Version history
| Version | Updated | Notes |
|---|---|---|
| 0.5.4 | Unknown | Misc A hardening release: a runnable integration suite now exercises 40 Harbor services end-to-end, and everything it caught is fixed. - New tests/services-integration.sh runs the whole service integration suite (grouped... |
| 0.5.3 | Unknown | Misc - Harbor Boost gains agentic modules: quickhop and deephop for web research, autocheck for deliverable audits, and diffscope for scoped file-change checks, with caveman and ponytail as response style modules. - harb... |
| 0.5.0 | Unknown | TL;DR Four new backends - DMR (Docker Model Runner), MLX, oMLX, and Daytona sandbox - with cross-service integrations rolled out to 26 services each. llamacpp replaces Ollama as the default backend (harbor defaults add o... |
| 0.4.19 | Unknown | Changes https://github.com/user-attachments/assets/e4897391-c5a8-4391-93c3-9f8b76155f11 A new launch command to spawn pre-configured local agentic coding tools on host pointing to inference backends in Harbor. # Uses the... |
| 0.4.18 | Unknown | Open Design Local-first design artifact workspace with BYOK model providers, design systems, decks, prototypes, and Harbor backend integrations. harbor up open-design Voicebox Local-first AI voice studio for voice clonin... |
| 0.4.17 | Unknown | Needle Needle adds a Harbor-built OpenAI-compatible tool-calling backend for Cactus Compute's small function-calling model. harbor up needle npcsh npcsh adds an agentic shell/API service with local backend integrations a... |
| 0.4.16 | Unknown | ML Intern Hugging Face ML engineering agent for researching papers, inspecting Hugging Face resources, training models, and shipping ML-related code with local or cloud LLM backends. harbor up ml-intern ollama --open fac... |
| 0.4.15 | Unknown | Lemonade AMD Lemonade inference server for ROCm GPUs. harbor up lemonade Tokscale Token-level autoscaling proxy for LLM backends. harbor up tokscale Misc - TabbyAPI switched to official image with updated default model a... |
| 0.4.14 | Unknown | Bifrost Fast OpenAI-compatible AI gateway with provider routing, failover, observability, and Harbor backend bootstrapping. harbor up bifrost SurfSense Private NotebookLM-style research workspace with RAG, citations, bro... |
| 0.4.13 | Unknown | Unsloth Studio No-code fine-tuning UI for the Unsloth library, with a zero-click API key bootstrap that registers Studio as an OpenAI-compatible backend across other Harbor services. harbor up unsloth-studio Cross-integr... |
| 0.4.12 | Unknown | Beszel Lightweight server monitoring with Docker stats, pre-provisioned to track the Harbor host on first run. harbor up beszel DBHub Universal database gateway exposed as MCP, pre-connected to Open WebUI via native MCP... |
| 0.4.10 | Unknown | Misc - Fixed SearXNG settings.yml not enabling JSON format, causing WebUI web search to return 403. - Fixed SearXNG workspace pointing away from the service template directory. - Fixed seed-cdi script incorrectly process... |
| 0.4.9 | Unknown | Misc - New Boost module analogical: generates analogies to ground LLM responses. - New Boost module deaf: humorously misinterprets user queries and responds to the warped version. - Open WebUI now defaults to native func... |
| 0.4.8 | Unknown | Solo CLI Local-first AI agent for automating tasks and deploying Physical AI on edge devices, with support for Ollama, vLLM, and llama.cpp backends. harbor build solo harbor up solo ROS MCP Server MCP bridge that lets LL... |
| 0.4.7 | Unknown | Hermes Agent Autonomous AI agent by Nous Research with persistent memory, extensible skills, multi-platform gateway, and OpenAI-compatible API. harbor up hermes Misc - llamacpp can now be built from source with harbor ll... |
| 0.4.6 | Unknown | SillyTavern Feature-rich, locally-installed web UI for interacting with LLMs with support for multiple backends, personas, lorebooks, and extensions. harbor up sillytavern Misc - Fixed llama.cpp cache location in a conta... |
| 0.4.5 | Unknown | Harbor App Updates This release introduces multiple QoL improvements in the Harbor desktop app. - You can pin favorite services, service cards are cleaner - UI for harbor models - download llama.cpp, HuggingFace and Olla... |
| 0.4.4 | Unknown | Open Terminal Lightweight remote shell and file-management API for AI agents — works with Open WebUI out of the box. harbor up openterminal harbor models You can now manage your llama.cpp, HuggingFace and Ollama models i... |
| 0.4.1 | Unknown | Misc - Fixing incorrect CLI versioning Full Changelog: https://github.com/av/harbor/compare/v0.4.0...v0.4.1 |
| 0.3.41 | Unknown | Misc - Renamed Moltbot to OpenClaw across compose files, docs, and assets. Full Changelog: https://github.com/av/harbor/compare/v0.3.40...v0.3.41 |