NeMo Guardrails
by NVIDIA
Programmable guardrails for LLM applications
NeMo Guardrails is an open-source toolkit for adding programmable guardrails to LLM-based conversational systems. Define policies for what your app can/cannot do using Colang specification language.
🎯 Key Features
Topical rails (allowed topics)
Dialogue rails (conversation flow)
Fact-checking rails
Jailbreak detection
Prompt injection prevention
Output moderation
Custom policy definition with Colang
Multi-language support
Input/output filtering
Retrieval grounding
Strengths
Highly configurable with Colang DSL
Open-source and extensible
Excellent documentation
Active NVIDIA support
Multi-modal support
Composable rails architecture
Limitations
Requires configuration expertise
Python only
Adds latency to requests
Learning curve for Colang
Limited pre-built rails
Best For
- Enterprise applications
- Regulated industries
- High-risk deployments
- Custom policy requirements
- Complex conversation flows