st3w4r/openai-partial-stream

+5M Downloads! Repair invalid LLM JSON, commonly used to parse the output of LLMs — Parsing ChatGPT and llm JSON stream response — Partial and incomplete JSON parser python library for OpenAI | repair invalid JSON, parse output of LLMs

structured outputs for llms

🎒 Token-Oriented Object Notation (TOON) – compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.

structured extraction for llms

Super-fast Structured Outputs

Enforce the output format (JSON Schema, Regex etc) of a language model

🔧 Repair JSON！Solution for JSON Anomalies from LLMs.

🐍 TOON for Python (Token-Oriented Object Notation) Encoder/Decoder - Reduce LLM token costs by 30-60% with structured data.

Structured Outputs