👋 Welcome to XGrammar

XGrammar is open-source solution for flexible, portable, and fast structured generations. The mission of this project is to bring flexible zero-overhead structure generation everywhere.

Get Started

• Installation
• Quick Start
• Constrained Decoding
• Workflow of XGrammar

Structural Tag

• Structural Tag Usage
• Tool Calling and Reasoning
• Advanced Topics of Structural Tag

Using XGrammar

• Integration with LLM Engine
• Serialization
• Runtime Safeguards
• JavaScript API

Defining Structures

• JSON Generation
• EBNF Grammar
• Lark Grammar

Developer Guide

• Building Docs
• Code Coverage

API Reference

• XGrammar Python API