Edge

Tiny C/C++ inference engine for LLaMA-family models — runs on CPU + many GPUs.

OpenAI Whisper speech-to-text, ported to C/C++ — fast, offline transcription.

Fast, small neural TTS that runs on a Raspberry Pi — by the Rhasspy project.