AI tools, scored for your job
Get paid to train AI
🤝 You're in the Free & Open Source library — community-built tools you can use without paying. A different concept from our scored AI directory.
Home › Free & Open Source › Medical › MultiMed
✦ Free & open sourceMedical

MultiMed

Multilingual multitask medical speech processing, ASR, NER, and summarization.

MultiMed Medical Speech AI

Multilingual medical speech recognition, NER, and real-time conversation summarization datasets and models.

Free forever · source-available · Licence not stated in the repository
✓ Needs IT✓ Browser-based✓ Real-time collaboration
5.6
ZEKAI
Multilingual Medical Speech Suite
Free & open source · Medical
Ease of setup3
Usefulness9
Maintenance5.5
Community5
★ 381
GITHUB
Dec 2025
UPDATED
Licence not stated in the repository
LICENSE
🛠 Don't want to self-host? We can set it up →
⚡ Quick answer

MultiMed provides comprehensive open-source datasets, pre-trained models, and benchmarks for medical speech processing across multiple languages. It is designed for researchers and engineers building automated speech recognition, named entity recognition, and summarization tools for clinical environments.

Runs on
Cross-platform
Hosting
Self-host
Languages
Python
License
Licence not stated in the repository

What it is

It bundles research contributions including VietMed for speech recognition, VietMed-NER for spoken named entity recognition across 18 entity types, VietMed-Sum for real-time medical conversation summarization, and MultiMed for multilingual medical ASR in five languages. The framework supplies Attention Encoder-Decoder models, pre-trained w2v2-Viet and XLSR-53-Viet weights, and codebases spanning major NLP and speech conferences (LREC-COLING, Interspeech, NAACL, ACL).

Who it's for

It suits researchers, machine learning engineers, and healthcare technologists developing clinical voice interfaces or medical NLP pipelines. It does not suit clinicians looking for a ready-to-use end-user medical transcription app without technical deployment capability.

Key features

VietMed ASR Benchmark

Includes 16 hours of labeled and 1000 hours of unlabeled medical speech covering all ICD-10 disease groups.

Spoken Medical NER

Features VietMed-NER for extracting 18 distinct medical entity types from speech audio and transcripts.

Real-Time Summarization

Generates local summaries after every N utterances and global summaries at conversation end.

Multilingual Support

Provides end-to-end medical ASR models spanning Vietnamese, English, German, French, and Mandarin Chinese.

How to start

Up and running in 3 steps

1
Clone the MultiMed repository and navigate to the specific subdirectory for your task (VietMed, VietMed-NER, VietMed-Sum, or MultiMed).
2
Review the individual README and installation requirements within the chosen subfolder to configure Python environments and dependencies.
3
Download the specified dataset splits and pre-trained model weights to run the provided evaluation or training scripts.
Real talk

Our honest verdict

What's great

  • Publishes large-scale real-world medical speech datasets covering multiple accents and recording conditions
  • Outperforms standard XLSR-53 significantly on medical domain test sets without unsupervised medical pre-training
  • Includes deployable architectures for real-time local and global conversation summarization
  • Provides reproducible baselines and code for multiple peer-reviewed academic papers (LREC-COLING, NAACL, ACL)

Where it falls short

  • Requires deep learning infrastructure and technical machine learning expertise to train and run models
  • Raw datasets and model weights require substantial local storage and high-end GPU resources
  • Licensing terms are not explicitly stated in the repository metadata
  • Requires adaptation work to integrate raw research code into production clinical workflows
Cost

Pricing & license

The code, data, and models are provided freely via the repository links, and the only cost is running the required hardware infrastructure yourself.

Paid work

Open remote AI-training roles

873 open remote AI-training roles, updated November 15, 2026; most pay $20–$170 an hour. Zekai lists them free; the application goes to the employer’s platform.

See all open roles →
Compare

Alternatives

🎁 Free & open-source alternatives

These reviewed AI tools do the same job instantly — from our scored directory.

Get more

Use it, or have us set it up

📄 Free PDF: MultiMed for Medical
A plain-language guide to getting your first result. Sent to your inbox.
🔔 64 people want a full video tutorial — add your vote
🛠 Don't want to set it up yourself?
We'll install, host & configure MultiMed for you — and train your team.
Get it done for you ↗
Questions

FAQ

What languages are supported by MultiMed?

The core MultiMed ASR models support five languages: Vietnamese, English, German, French, and Mandarin Chinese.

Can this be used for text-based medical NER?

Yes, by translating the transcripts, the VietMed-NER dataset can be utilized for text-based named entity recognition in other languages.

Are pre-trained model weights publicly available?

Yes, the repository provides links to pre-trained models such as w2v2-Viet, XLSR-53-Viet, and fine-tuned medical ASR models.

Radar

Latest AI news

✉️ The weekly free toolkit
The best new free & open-source tools for Medical — one short email a week, in your language.
Free · 1 email/week · unsubscribe anytime
Get paid to train AI →

See Zekai first in Google