Overview
Library from Microsoft for controlling LLM generation with structured templates, constraints, and tools.
Details
Guidance is a library from Microsoft for controlling LLM generation with structured templates, constraints, regex matching, and tools. Guidance enables fine-grained control over LLM outputs through programmatic templates that interleave control flow with model generation. Guidance is part of the structured generation OSS ecosystem alongside Outlines.