winget install --id mostlygeek.llama-swapAbout llama-swap
llama-swap is a light weight, transparent proxy server that provides automatic model swapping to llama.cpp's server.
What's new in 249
Changelog - f94c94a various: improvements to code layout and naming (#1003) - 249797f internal/server: add ComfyUI compatibility endpoint (#1002)
Version history
| Version | Updated | Notes |
|---|---|---|
| 249 | Unknown | Changelog - f94c94a various: improvements to code layout and naming (#1003) - 249797f internal/server: add ComfyUI compatibility endpoint (#1002) |
| 248 | Unknown | Changelog - 00515cd internal/server,shared: preserve percent encoded in upstream (#988) |
| 247 | Unknown | Changelog - 40027d6 ui-svelte: security update - 298848d internal/hw: detect inference host hardware (#978) |
| 246 | Unknown | Changelog - 22df230 ui-svelte: show configured selectors and strategies on Models page (#975) - 8d61908 internal/perf: fix rocm-smi GPU memory utilization (#973) - 1f3c68e docker: install rocm-smi for vulkan backend (#96... |
| 245 | Unknown | Changelog - 30470a4 ui-svelte: show profiles on model page (#966) - 27782ab AGENTS.md,CONTRIBUTING.md: update contribution guidelines (#964) - b9c3738 docker: add -watch-config (#963) |
| 244 | Unknown | Changelog - 0c42333 internal/matrix: solve matrix expressions symbolically (#960) |
| 243 | Unknown | Changelog - 4c50064 internal/config: relax matrix model reference constraints (#957) - 4bffcfa cmd/vllm-wrapper: add helper for sleep/wake (#941) - fa607fe internal/config: refactor macro expansion (#955) |
| 242 | Unknown | Changelog - 7aa7f52 internal/server,ui-svelte: add peer model namespaces (#950) - 5e9f887 Fix process start race during concurrent stop operations (#949) - 12af351 ui-svelte: remove audio file size limit (#948) |
| 241 | Unknown | Changelog - 8b61e3d internal/server: implement selectors (#942) - c6adf57 internal/server,shared: reduce request model body functions to one (#940) - 3e87c02 internal/server: add support for profiles (#935) - 378a26e ui-... |
| 240 | Unknown | Changelog - 6b5320d internal/server: expand inflight request details (#923) - cd22a8c Add configurable UnloadTimeout variable (#904) - 61f83ac ui-svelte: code-split routes and trim highlight.js/chart.js bundles (#925) -... |
| 239 | Unknown | Changelog - dd81801 internal/config: preserve yaml anchors in capabilities |
| 238 | Unknown | Changelog - 3c79461 internal/server: improve vllm response metric calculation (#913) - 8945d2b internal/config: resolve macros in capabilities fields (#907) |
| 236 | Unknown | Changelog - b834706 internal/server: add status to v1/models for llama-server (#901) - 6291bb8 internal/store: persist activity metrics to sqlite (#898) - 579b1e7 fix starhistory |
| 235 | Unknown | Changelog - c59816b internal/server: show inflight activity requests (#895) - d8ed077 Add llama-tts binary (#894) - 0d2d851 Makefile: improve build version stamping (#891) |
| 234 | Unknown | Changelog - 4a6b8a8 internal/router: reject concurrency excess before streaming (#889) - 3023ab4 add /props to modelGetRoutes (#886) |
| 233 | Unknown | Bug and Performance improvements for the UI - fixed streaming logs blocking llama-server inference. Logs are pushed to connected UI clients via an async channel now so if they are slow it does not affect reading from std... |
| 232 | Unknown | Changelog - 25b27cb ui-svelte: add rounded borders - 18cc854 update hero image |
| 230 | Unknown | This release adds the -config-dir flag! Using a config-dir it’s now possible to split huge config.yaml files into fragments that get automatically merged together. You can have one model per file and combined with -watch... |
| 229 | Unknown | Changelog - 316ad63 config,server: add upstream.ignorePaths (#869) - e37077a feat: hide performance menu item if disabled (#832) - eff9b60 server: capture failed (non-200) LLM requests (#862) - 9bcddad internal/server,ui... |
| 228 | Unknown | Changelog - a15e479 proxy: meter /upstream requests via metrics middleware (#858) |