SmartSub
An open-source desktop app for video transcription, translation, and AI dubbing.
Generate, translate, dub, and burn video subtitles locally with GPU acceleration.
SmartSub is a cross-platform desktop application that manages your entire video localization pipeline from transcription to subtitle burning. It is designed for urban planners, municipal communications teams, and public sector creators who need to process public meeting recordings or smart city documentation locally.
What it is
The tool handles local speech-to-text transcription using whisper.cpp or FunASR, translates text across multiple engines, and provides AI dubbing with voice cloning. It also features an AI assistant with multi-modal vision diagnostics and MCP automation support.
Who it's for
It suits government agencies and municipal video teams needing strict local data privacy for public meetings. It does not suit teams looking for a cloud-native collaborative web editing suite without desktop client installations.
Key features
Local Transcription
Transcribe audio offline using Whisper, FunASR, or FireRedASR models to keep municipal data private.
AI Assistant & MCP
Use natural language commands or integrate with external AI agents via 111 standard MCP tools and CLI.
Voice Cloning & TTS
Generate custom audio tracks and clone voices using local engines like Kokoro, VITS, or ZipVoice.
Video Download & Burn
Download online videos from platforms via yt-dlp and burn hard or soft subtitles directly into footage.
Up and running in 3 steps
Our honest verdict
What's great
- Processes files locally to protect sensitive municipal audio and video data.
- Supports hardware acceleration across NVIDIA, AMD, Intel, and Apple Silicon.
- Runs a completely free offline pipeline with zero required API keys.
- Offers advanced automation via MCP and CLI for command-line workflows.
Where it falls short
- Requires downloading large local speech and AI models depending on the engine chosen.
- GPU acceleration setup depends on your specific hardware and may require additional downloads.
- Desktop-only application without a native cloud server architecture for team co-editing.
Pricing & license
Free under its license, with optional paid cloud APIs available if you choose to connect commercial translation or TTS providers.
Open remote AI-training roles
870 open remote AI-training roles, updated November 14, 2026; most pay $20–$170 an hour. Zekai lists them free; the application goes to the employer’s platform.
Alternatives
Use it, or have us set it up
FAQ
Can SmartSub run completely offline?
Yes, local transcription models, offline TTS, and ffmpeg burning operate entirely without an internet connection.
Does it require paid API keys to function?
No, the core transcription, local translation options, and local TTS engines run completely free without API keys.
How can I automate processing via scripts?
You can utilize the built-in smartsub CLI commands and standard MCP protocol tools to execute pipelines.
