跳到正文
Testing Catalog· X:Testing Catalog (@testingcatalog)·· 4 小时前AI 评分42

Inworld 推出面向消费级 AI 应用的 Inworld Inference 推理 API

AI 导读

Inworld 发布 Inworld Inference 推理 API,面向消费级 AI 应用,支持 Gemma 4、GLM、DeepSeek、MiMo 等开源模型。

正文

Inworld just launched Inworld Inference, an LLM inference API built for consumer AI apps, serving open models including Gemma 4, GLM, DeepSeek, and MiMo.

@inworld optimizes how each model runs to deliver faster responses for tutors, companions, games, and other consumer apps.

On Gemma 4 26B, median time to first token is 0.17 seconds, compared with 0.61 seconds for the median of the other providers on OpenRouter - 3.6× faster.

At the 95th percentile, time to first token is 0.31 seconds versus 2.42 seconds for the median of those providers - 7.8× faster.

Developers can also set requests to switch automatically to a fallback model if the first model fails or takes too long.

来源:Testing Catalog · x.com