TypeLLM 发布：单次 API 调用执行类型化工作流
TypeLLM：单次 API 调用执行类型化工作流
开源项目 TypeLLM 发布，可在单次 API 调用中执行整个类型化工作流，把多个相互依赖、条件存在的类型化输出写成一份 JSON Schema，并作为依赖图在共享上下文上执行。
Open source meets type-safe AI, with TypeLLM.
Chat models give you a reply and decision models give you a choice, but TypeLLM is built to run your whole workflow in one API call.
Most production pipelines need something in between: several typed answers, some depending on others, a few that should exist only under certain conditions.
TypeLLM takes that whole shape as one JSON Schema and executes it as a dependency graph over a single shared context.
Typed LLM outputs, built in the open.
You can get schema-guaranteed outputs from a stock Qwen checkpoint without touching its weights.
The guarantee comes from how the requests are built and decoded.
TypeLLM sits on SGLang and turns a JSON Schema into constrained decoding: one scored token for an enum or boolean, bounded digits for numbers, and a dependency graph that reuses cached prefixes.
So a field can’t return a value outside its enum, because the decoder only considers the allowed candidates.
来源：Rohan Paul · x.com