winget install --id Mozilla.llamafileAbout llamafile
llamafile lets you distribute and run LLMs with a single file. Our goal is to make open LLMs much more accessible to both developers and end users. We're doing that by combining llama.cpp with Cosmopolitan Libc into one framework that collapses all the complexity of LLMs down to a single-file executable (called a "llamafile") that runs locally on most computers, with no installation.
What's new in 0.10.5
What's Changed 0.10.5 is a release that focused on making the "sync with upstream llama.cpp" task simpler and better. In the span of 2 weeks we performed three syncs and took advantage of these iterations to improve the llamafile skill/plugin for AI agents. The result is a better process that provides more reliable code, requiring fewer iterations to go from an auto-generated draft PR to the final merged code. As a byproduct, llamafile now supports very recent models such as Ternary Bonsai 27B and Laguna-S-2.1. Thanks to our community's contributions, this release also brings significant documentation updates clarifying the new help system, the difference between different lllamafile executables, and up-to-date llamafile GPU support. Many thanks everyone for the huge help! - Update llama.cpp to b10052 (b2dd28a) by @aittalam in https://github.com/mozilla-ai/llamafile/pull/1021 - Update llama.cpp to b10083 (846e991) by @aittalam in https://github.com/mozilla-ai/llamafile/pull/1026 - Improve llamacpp update skill by @aittalam in https://github.com/mozilla-ai/llamafile/pull/1027 - Update llama.cpp to b10103 (c588c4f) by @aittalam in https://github.com/mozilla-ai/llamafile/pull/1030 - docs(quickstart): clarify llamafile vs llamafile-thin and other release binaries (#1022) by @Anai-Guo in https://github.com/mozilla-ai/llamafile/pull/1023 - build(install): install transcribefile so it ships as a release artifact (#1035) by @Anai-Guo in https://github.com/mozilla-ai/llamafile/pull/1036 - Fix typo in README.md for 'architectures' by @shawntax in https://github.com/mozilla-ai/llamafi...
Version history
| Version | Updated | Notes |
|---|---|---|
| 0.10.5 | Unknown | What's Changed 0.10.5 is a release that focused on making the "sync with upstream llama.cpp" task simpler and better. In the span of 2 weeks we performed three syncs and took advantage of these iterations to improve the... |
| 0.10.4 | Unknown | What's Changed The most exciting feature that this release of llamafile brings is the first version of transcribefile! 🎉 Our transcribefile is nothing more than a cosmocc-build of the CLI tool from transcribe.cpp, @cjpai... |
| 0.10.3 | Unknown | What's Changed This release is mainly a bugfix to a regression introduced in 0.10.2 (many many thanks to @niutech for opening the issue! 🙏) As releases become more frequent, we are working to better automate the process... |
| 0.10.2 | Unknown | What's Changed - Add gpu accel probe by @aittalam in https://github.com/mozilla-ai/llamafile/pull/953 - Added executable dir to list of dylib valid paths by @aittalam in https://github.com/mozilla-ai/llamafile/pull/959 -... |
| 0.10.1 | Unknown | What's Changed Summary: - Added support for vulkan dylibs - Added windows build scripts → we now have cuda, rocm, vulkan both as .so and as .dll libraries - Updated llama.cpp submodule to 5e9c63546 → we now have llama.cp... |
| 0.10.0 | Unknown | llamafile versions starting from 0.10.0 use a new build system, aimed at keeping our code more easily aligned with the latest versions of llama.cpp. This means they support more recent models and functionalities, but at... |
| 0.9.3 | Unknown | Release notes |
| 0.9.2 | Unknown | Release notes |
| 0.9.1 | Unknown | Release notes |
| 0.9.0 | Unknown | Release notes |
| 0.8.17 | Unknown | Release notes |
| 0.8.16 | Unknown | Release notes |
| 0.8.15 | Unknown | Release notes |
| 0.8.14 | Unknown | This release introduces our new CLI chatbot interface. It supports multi-line input using triple quotes. It will syntax highlight Python, C, C++, Java, and JavaScript code. This chatbot is now the default mode of operati... |