AI tools, scored for your job
Get paid to train AI
🤝 You're in the Free & Open Source library — community-built tools you can use without paying. A different concept from our scored AI directory.
Home › Free & Open Source › Audio & Music › llamafile
✦ Free & open sourceAudio & Music

llamafile

Distribute and run LLMs and speech-to-text models locally with a single executable file.

Run local LLMs and audio tools with a single file

Combine llama.cpp and Cosmopolitan Libc to execute language and audio models locally without installation.

Free forever · open source · Apache-2.0
✓ Light setup✓ Browser-based✓ Real-time collaboration
7.4
ZEKAI
Single-file local AI runner
Free & open source · Audio & Music
Ease of setup3
Usefulness8
Maintenance9.5
Community9.2
★ 26,021
GITHUB
Sep 2026
UPDATED
Apache-2.0
LICENSE
🛠 Don't want to self-host? We can set it up →
⚡ Quick answer

llamafile lets you package and run open LLMs and speech-to-text models in a single executable that works across multiple operating systems. It is built for developers and audio professionals who want to run models locally without complex software installations.

Runs on
Cross-platform
Hosting
Desktop
Languages
C++
License
Apache-2.0

What it is

The tool combines llama.cpp and whisper.cpp with Cosmopolitan Libc to create standalone executables called llamafiles and whisperfiles. It supports local inference, transcription, and translation of audio files across various CPU architectures and operating systems.

Who it's for

It suits audio engineers and developers who want local speech-to-text transcription and LLM inference without complex dependencies. It does not suit users looking for traditional cloud-managed APIs or those running Windows with models exceeding 4GB due to executable size limits.

Key features

Single-File Executable

Distribute and run models in one file using Cosmopolitan Libc packaging.

Built-in Whisperfile

Includes speech-to-text transcription and translation based on whisper.cpp.

Cross-Platform Support

Runs locally on most operating systems and CPU architectures without installation.

External Weights Support

Run larger models by pairing the binary with external GGUF weight files.

How to start

Up and running in 3 steps

1
Download an example llamafile or whisperfile binary from the repository or release page.
2
Make the file executable on macOS, Linux, or BSD using chmod +x, or add the .exe extension on Windows.
3
Run the file directly in your terminal to start local inference or audio transcription.
Real talk

Our honest verdict

What's great

  • Runs entirely locally with no installation or complex dependency setup required
  • Includes whisperfile for out-of-the-box local speech transcription and translation
  • Cross-platform support across multiple operating systems and CPU architectures
  • Allows you to bypass the 4GB Windows executable limit by using external GGUF weights

Where it falls short

  • Windows users cannot run standalone executable files larger than 4GB without external weights
  • Recent build system updates may alter or omit features found in older classic versions
  • Requires sufficient local hardware and GPU resources to run larger models effectively
Cost

Pricing & license

The only cost is running it yourself on your own hardware, as the software is open source.

Paid work

Open remote AI-training roles

873 open remote AI-training roles, updated November 15, 2026; most pay $20–$170 an hour. Zekai lists them free; the application goes to the employer’s platform.

See all open roles →
Compare

Alternatives

🎁 Free & open-source alternatives

These reviewed AI tools do the same job instantly — from our scored directory.

Get more

Use it, or have us set it up

📄 Free PDF: llamafile for Audio & Music
A plain-language guide to getting your first result. Sent to your inbox.
🔔 64 people want a full video tutorial — add your vote
🛠 Don't want to set it up yourself?
We'll install, host & configure llamafile for you — and train your team.
Get it done for you ↗
Questions

FAQ

What is a llamafile?

It is a single-file executable that combines weights and code to run LLMs locally without installation.

Does it support audio transcription?

Yes, it includes whisperfile for local speech-to-text transcription and translation using whisper.cpp.

Are there file size limits on Windows?

Yes, only executables under 4GB can run directly on Windows, so larger models require external GGUF weights.

Radar

Latest AI news

✉️ The weekly free toolkit
The best new free & open-source tools for Audio & Music — one short email a week, in your language.
Free · 1 email/week · unsubscribe anytime
Get paid to train AI →

See Zekai first in Google