RouterPlus:聚合需求换取推理批量定价
RouterPlus 把多个团队的推理需求打包成一份大额采购协议,让每个团队按批量价格为自己那部分流量付费,小团队无需自身成为大买家也能拿到批量定价。它还会用你的真实使用数据测试模型,挑出在最低成本下够用的那一个,避免所有任务都调用最贵的模型。
Inference pricing has a size penalty. The best per-token rates go to whoever can commit the most volume.
RouterPlus groups demand from many teams into one large deal with a provider, and each team pays that rate on its share of the traffic.
Large buyers have done this with cloud commits for years. Applied to tokens, I’d guess it works best for popular open models, where many teams already want the same weights served on the same kind of hardware.
For a small team, this is a route to bulk pricing that doesn’t require being a bulk buyer.
They also test models on your real usage and pick the one that's good enough at the lowest cost. Many teams pay for a top model on every task when a cheaper one could do most of the work.
来源:Rohan Paul · x.com