AI tools, scored for your job
Get paid to train AI
🤝 You're in the Free & Open Source library — community-built tools you can use without paying. A different concept from our scored AI directory.
Home › Free & Open Source › Customer Support › AI-Powered Video Analyzer
✦ Free & open sourceCustomer Support

AI-Powered Video Analyzer

Offline AI-powered video analysis tool with object detection, captioning, and transcription.

Offline AI Video Analysis Tool

Process videos locally with object detection, speech transcription, and LLM summaries.

Free forever · open source · MIT
✓ Light setup✓ Browser-based✓ Real-time collaboration
6
ZEKAI
Local-first video analysis pipeline.
Free & open source · Customer Support
Ease of setup5
Usefulness7
Maintenance7
Community5
★ 109
GITHUB
Jun 2026
UPDATED
MIT
LICENSE
🛠 Don't want to self-host? We can set it up →
⚡ Quick answer

An offline, privacy-first video analysis tool that runs entirely on your local machine without cloud uploads. It suits technical professionals who need structured data extraction from video files.

Runs on
Cross-platform
Hosting
Desktop
Languages
Python
License
MIT

What it is

It runs a local AI pipeline combining VisionServeX D-FINE object detection, Salesforce BLIP captioning, OpenAI Whisper transcription, PANNs audio events, and Ollama LLM summarization. The output includes structured JSON files, Markdown reports, and plain-text summaries.

Who it's for

Suits privacy-conscious developers and support engineers who need to parse and analyze video footage locally. It does not suit non-technical users looking for a simple plug-and-play cloud SaaS platform.

Key features

Local D-FINE Detection

Runs VisionServeX D-FINE object detection across frames with adjustable speed presets.

Offline Speech Transcription

Transcribes spoken audio locally using OpenAI Whisper without sending data externally.

Audio Event Recognition

Detects specific audio events in video files using PANNs CNN14.

Evidence-Grounded Summaries

Generates factual summaries via Ollama that separate observed facts from interpretations.

Built-in GUI and CLI

Provides both a command-line interface and a Tkinter graphical interface for local use.

How to start

Up and running in 3 steps

1
Clone the repository and install the vision package using pip install -e ".[vision]".
2
Run ai-video-analyzer doctor to check your environment and missing dependencies.
3
Analyze a video file using ai-video-analyzer analyze "/path/to/video.mp4".
Real talk

Our honest verdict

What's great

  • Operates entirely offline with zero cloud dependency or telemetry.
  • Supports multiple detection speed presets from fast to high-accuracy.
  • Outputs structured JSON data alongside human-readable Markdown reports.
  • Includes a built-in doctor command to diagnose missing dependencies.

Where it falls short

  • Requires local installation of Python, PyTorch, and ffmpeg.
  • Optional stages require manual setup of external tools like Ollama.
  • COCO-80 object detection lacks direct classes for fire, smoke, or weather.
  • Heavy models require substantial local GPU resources for acceptable speed.
Cost

Pricing & license

Free under its license, with no paid hosted option since it runs locally. The only cost is your own hardware and electricity.

Paid work

Open remote AI-training roles

877 open remote AI-training roles, updated November 16, 2026; most pay $20–$175 an hour. Zekai lists them free; the application goes to the employer’s platform.

See all open roles →
Compare

Alternatives

Get more

Use it, or have us set it up

📄 Free PDF: AI-Powered Video Analyzer for Customer Support
A plain-language guide to getting your first result. Sent to your inbox.
🔔 64 people want a full video tutorial — add your vote
🛠 Don't want to set it up yourself?
We'll install, host & configure AI-Powered Video Analyzer for you — and train your team.
Get it done for you ↗
Questions

FAQ

Does this tool send any video data to the cloud?

No, all processing runs entirely on your local machine with no cloud upload or telemetry.

What is required for LLM summarization?

You must install and run Ollama locally and pull a compatible model like phi4:latest.

Can I use a legacy YOLO backend?

Yes, legacy YOLO detection is available as an optional extra, though VisionServeX D-FINE is recommended.

Radar

Latest AI news

✉️ The weekly free toolkit
The best new free & open-source tools for Customer Support — one short email a week, in your language.
Free · 1 email/week · unsubscribe anytime
Get paid to train AI →

See Zekai first in Google