Repository History
2 repositories tagged with Language Models
Jsonformer: Bulletproof Structured JSON Generation from Language Models
Jsonformer is a powerful library designed to generate syntactically correct and schema-conforming JSON from language models. It addresses the common challenge of unreliable JSON output by focusing on generating only content tokens, making the process more efficient and robust. This approach ensures bulletproof structured data generation for various applications.
LMQL: A Language for Constraint-Guided and Efficient LLM Programming
LMQL is an innovative programming language that extends Python, designed for efficient and constraint-guided programming of Large Language Models (LLMs). It allows developers to interweave traditional programming logic with native LLM calls, offering advanced control over model behavior through features like constraints, rich control flow, and optimized runtimes. This makes it easier to build complex LLM-powered applications with greater precision and efficiency.