AI tools, scored for your job
Get paid to train AI
🤝 You're in the Free & Open Source library — community-built tools you can use without paying. A different concept from our scored AI directory.
Home › Free & Open Source › Writing › Guardrails
✦ Free & open sourceWriting

Guardrails

Add programmable guardrails to LLM-based conversational applications.

NVIDIA NeMo Guardrails

An open-source toolkit for adding programmable guardrails to LLM conversational systems.

Free forever · open source · Apache-2.0
✓ Light setup✓ Browser-based✓ Real-time collaboration
7.8
ZEKAI
Essential LLM safety toolkit
Free & open source · Writing
Ease of setup5
Usefulness9
Maintenance9.5
Community7.5
★ 7,479
GITHUB
Nov 2026
UPDATED
Apache-2.0
LICENSE
🛠 Don't want to self-host? We can set it up →
⚡ Quick answer

NeMo Guardrails is a Python toolkit that helps you control LLM outputs and steer conversational flows. It suits developers building secure, domain-specific chatbots and RAG applications.

Runs on
Cross-platform
Hosting
Self-host
Languages
Python
License
Apache-2.0

What it is

It lets you define input, dialog, retrieval, execution, and output rails to filter sensitive data, enforce fact-checking, and prevent jailbreaks. You can integrate it into your code using either the Python API or a standalone guardrails server.

Who it's for

It suits developers and engineers integrating LLMs into production environments who need strict conversational control and safety checks. It is not designed for non-technical users or those looking for a ready-to-use end-user chat interface.

Key features

Five Guardrail Types

Apply input, dialog, retrieval, execution, and output rails to thoroughly filter data.

Async Python API

Build performant applications using native synchronous and asynchronous methods.

Dialog Steering

Enforce pre-defined conversational paths and standard operating procedures using Colang.

Vulnerability Protection

Defend your chat application against common LLM vulnerabilities like jailbreaks and prompt injections.

How to start

Up and running in 3 steps

1
Install the library using pip install nemoguardrails
2
Create a configuration folder with your config.yml and guardrail rules
3
Initialize an LLMRails instance in your Python code to process messages
Real talk

Our honest verdict

What's great

  • Supports multiple underlying LLMs including OpenAI, LLaMa-2, Falcon, and Vicuna
  • Provides fine-grained control over both user inputs and model outputs
  • Integrates smoothly with LangChain pipelines and custom tools
  • Includes specialized retrieval rails specifically for RAG fact-checking

Where it falls short

  • Requires writing and maintaining custom guardrail configurations and Colang scripts
  • Depends heavily on the performance and behavior of the underlying LLM
  • Requires managing a Python environment and understanding async-first architectures
  • Running custom local models and servers incurs ongoing infrastructure costs
Cost

Pricing & license

The toolkit is free under its open-source license, and the only financial cost is running your own infrastructure, models, and API calls.

Paid work

Open remote AI-training roles

879 open remote AI-training roles, updated November 15, 2026; most pay $20–$175 an hour. Zekai lists them free; the application goes to the employer’s platform.

See all open roles →
Compare

Alternatives

Get more

Use it, or have us set it up

📄 Free PDF: Guardrails for Writing
A plain-language guide to getting your first result. Sent to your inbox.
🔔 64 people want a full video tutorial — add your vote
🛠 Don't want to set it up yourself?
We'll install, host & configure Guardrails for you — and train your team.
Get it done for you ↗
Questions

FAQ

What Python versions are supported?

Python 3.11, 3.12, and 3.13 are supported. Python 3.10 support was dropped in version 0.25.0.

Can I use this with LangChain?

Yes, you can add a guardrails layer around your LangChain chains by setting an environment variable.

How do I define conversational flows?

You can steer dialog paths using Colang, a domain-specific language designed for conversational interactions.

Radar

Latest AI news

✉️ The weekly free toolkit
The best new free & open-source tools for Writing — one short email a week, in your language.
Free · 1 email/week · unsubscribe anytime
Get paid to train AI →

See Zekai first in Google