Unclaimed project
Are you a maintainer of llamafile? Claim this project to take control of your public changelog and roadmap.
Llamafile v0.9.2 is a significant release. It adds support for:
In addition 0.9.2 introduces LocalScore, a benchmarking utility and website.
LocalScore is an open-source tool that both benchmarks how fast Large Language Models (LLMs) run on your specific hardware and serves a...
This release adds support for DeepSeek Distil models. It improves some documentation, and fixes a segfault when running with an Nvidia GPU.
We've solved all the known issues with the new llamafiler server, and
improved its web gui. In addition to the llamafiler binary below, the
new server is available as llamafile --server --v2. Its manual can be
accessed via llamafile --server --v2 --help.
llamafiler has a new web UI which supports two modes of operation: chatbot and raw completion. Its syntax highlighting is just as advanced as the CLI chatbot. It looks much nicer than the old web ui. In a future release, llamafiler will be folded into llamafile to replace the old server.