跳到正文
AI at Meta· X:AI at Meta (@AIatMeta)·· 3 小时前AI 评分38

Meta 介绍 Muse Spark Open 在 Mac Studio 与主流推理引擎上的运行方案

AI 导读

Muse Spark Open 可在两台搭载 Apple M5 Ultra 的 Mac Studio 上通过最新 MLX 框架运行,同时支持 SGLang、vLLM、TensorRT-LLM、Hugging Face Transformers、llama.cpp 和 Unsloth 等主流推理引擎,并针对 AMD、Apple、Intel 和 NVIDIA 芯片做了优化。

正文

To help make advanced models more accessible, Muse Spark Open is optimized to run on two Apple M5 Ultra Mac Studios with the latest MLX framework.

It also runs on leading inference engines like SGLang, vLLM, TensorRT-LLM, Hugging Face Transformers, llama.cpp, and Unsloth with optimizations for AMD, Apple, Intel, and NVIDIA silicon.

Developers can further customize the model with PyTorch, including TorchTitan for fine-tuning.

来源:AI at Meta · x.com