Unsloth· X:Unsloth (@UnslothAI)·· 3 小时前AI 评分58
Unsloth 适配 NVIDIA RTX Spark,笔记本本地可运行并训练 120B+ 参数模型
AI 导读
Unsloth 宣布适配 NVIDIA RTX Spark,可在笔记本本地运行并训练 120B+ 参数模型。借助针对 ARM 上 CUDA 优化的 kernel 和二进制文件,训练扩散、决策与多模态模型的速度约提升 2.7 倍,全部在本地完成,统一内存最高 128GB。
正文
You can now run and train 120B+ parameter models locally on a laptop! NVIDIA RTX Spark is here. 💚
With Unsloth and RTX Spark, train diffusion, decision, multimodal models ~2.7× faster with optimized kernels and binaries for CUDA on ARM. All local with up to 128GB unified memory
来源:Unsloth · x.com