Release

A whole workday on local models

LokalBot now does the job of three or four subscription apps (a meeting notetaker, dictation, autocomplete, and a memory of your day) on your own hardware, with no subscription and no API keys.

Update, October 2026: several default models have changed since this post; the current ones are on the benchmarks page.

What it does

New in 0.5

The models in daily use

One setup, on a 48 GB M4 Max, all through the bundled llama.cpp with full Metal offload:

Models in daily use
JobModelQuantizationSizeSpeed
TranscriptionGranite Speech 4.1 2BQ4_K_M + F16 projector2.3 GBFaster than real time
Summaries and chatQwen3.5 4BQ4_K_M2.7 GBAbout 100 tokens/s
AutocompleteGemma 4 E4BUD-Q5_K_XL6.7 GBAbout 78 tokens/s
EmbeddingsQwen3-Embedding 0.6BQ8_00.6 GB—
Diarizationpyannote community-1Core ML0.1 GB—

The full list of changes is in the 0.5.0 release notes.

Try it locally

Meeting notes that stay on your computer by default.

Free, open source, and no account. For Mac, with Windows and Linux in alpha.

Download for macOS

Apple Silicon · macOS 15+ · or with Homebrew: brew install --cask stevyhacker/tap/lokalbot

macOS · Windows · Linux (alpha) · requirements