AI tools, scored for your job
Get paid to train AI
🤝 You're in the Free & Open Source library — community-built tools you can use without paying. A different concept from our scored AI directory.
Home › Free & Open Source › Audio & Music › UltraSinger
✦ Free & open sourceAudio & Music

UltraSinger

Automates the creation of UltraStar karaoke files, MIDI, and note data from audio using AI-driven transcription.

AI-Powered UltraStar Karaoke Automation

Convert audio and YouTube links into fully synced UltraStar karaoke files with automated pitch and lyrics.

Free forever · open source · MIT
✓ Needs IT✓ Browser-based✓ Real-time collaboration
6.4
ZEKAI
Essential for UltraStar creators
Free & open source · Audio & Music
Ease of setup4
Usefulness8
Maintenance7
Community6.5
★ 555
GITHUB
Jun 2026
UPDATED
MIT
LICENSE
🛠 Don't want to self-host? We can set it up →
⚡ Quick answer

UltraSinger is an automation tool for karaoke enthusiasts and producers who want to generate UltraStar-compatible files from raw audio. It uses AI models to handle the heavy lifting of transcription, pitch detection, and note alignment.

Runs on
Cross-platform
Hosting
Desktop
Languages
Python
License
MIT

What it is

The tool processes audio or video files to generate UltraStar.txt files, MIDI, and sheet music. It utilizes Whisper for lyrics transcription and various separation models to isolate vocals, then automatically handles pitch detection and note tapping.

Who it's for

It suits users who want to digitize music for karaoke without manual note entry. It is not for users who lack technical familiarity with Python environments or those without a capable GPU for efficient model inference.

Key features

Automated Vocal Transcription

Uses Whisper models to convert singing into synchronized text lyrics.

Pitch Detection and Quantization

Extracts vocal pitch and aligns notes to the musical key.

Audio Track Separation

Employs demucs models to isolate vocals from background music.

YouTube Integration

Directly processes audio from YouTube links via yt-dlp integration.

How to start

Up and running in 3 steps

1
Install Python 3.12 and ffmpeg on your system.
2
Run the provided installation script for your OS to set up dependencies.
3
Execute the tool via command line or batch file using the -i flag for your audio input.
Real talk

Our honest verdict

What's great

  • Automates the tedious manual labor of tapping and syncing karaoke notes.
  • Supports re-pitching existing UltraStar files to improve accuracy.
  • Includes specific features for musical key quantization and hyphenation.
  • Provides an interactive mode for users who prefer guided configuration.

Where it falls short

  • Requires a local Python environment and manual dependency management.
  • High VRAM requirements for optimal performance on larger Whisper models.
  • Performance is heavily dependent on the quality of the source audio.
  • Setup involves installing Python, ffmpeg, and managing CUDA drivers.
Cost

Pricing & license

The tool is free under its license. There are no paid hosted options; the only cost is the electricity and hardware resources required to run the AI models locally.

Paid work

Open remote AI-training roles

879 open remote AI-training roles, updated November 15, 2026; most pay $20–$175 an hour. Zekai lists them free; the application goes to the employer’s platform.

See all open roles →
Compare

Alternatives

🎁 Free & open-source alternatives

These reviewed AI tools do the same job instantly — from our scored directory.

Get more

Use it, or have us set it up

📄 Free PDF: UltraSinger for Audio & Music
A plain-language guide to getting your first result. Sent to your inbox.
🔔 64 people want a full video tutorial — add your vote
🛠 Don't want to set it up yourself?
We'll install, host & configure UltraSinger for you — and train your team.
Get it done for you ↗
Questions

FAQ

Can I use this on any song?

The developers recommend using it only on Creative Commons licensed songs.

What if my GPU is too weak?

You can force CPU processing or reduce the Whisper batch size to prevent crashes, though this will significantly increase processing time.

Radar

Latest AI news

✉️ The weekly free toolkit
The best new free & open-source tools for Audio & Music — one short email a week, in your language.
Free · 1 email/week · unsubscribe anytime
Get paid to train AI →

See Zekai first in Google