跳到正文
Rohan Paul· X:Rohan Paul (@rohanpaul_ai)·· 3 小时前AI 评分24

Nature Will 发布 50B 参数 MoE 基础模型 Natura-1,让机器人灵巧手零样本执行语言指令

AI 导读

Nature Will 发布 50B 参数 MoE 基础模型 Natura-1,基于 100 万小时第一人称人类手部操作视频训练,可直接控制真实机器人手。该模型同时处理机器人通常难以兼顾的三类任务:抓取后的双手精细控制、无需额外训练的新任务,以及需要记忆早期步骤并从错误中恢复的长序列操作。

正文

The hardest thing to give a robot is a capable pair of hands, and Natura-1, from @naturewill is a strong attempt at it.

Nature Will trained their new Natura-1 on 1M hours of egocentric human data

first-person video of people using their hands, then used that to control real robot hands

Robot demonstrations are slow to collect, so human footage is the faster route to scale, provided the skills survive the move from human hands to robot hands.

One model handles 3 things robots usually fail at together: fine 2-handed control after the grasp, new tasks without extra training, and long sequences where it has to remember earlier steps and recover from mistakes. Many robot systems show 1 of these in a narrow setting.

https://x.com/naturewill/status/2109858475333570565/video/1

来源:Rohan Paul · x.com