跳到正文
Rohan Paul· X:Rohan Paul (@rohanpaul_ai)·· 3 小时前AI 评分24

Hojo-ASR-Multi-V1 开源多语言 ASR 模型发布,5 种语言平均 WER 3.54

Hojo-ASR-Multi-V1 开源多语言 ASR 模型发布

AI 导读

Hojo-ASR-Multi-V1 开源多语言 ASR 模型发布,在 5 种语言上取得 3.54 的平均 WER。该模型采用声学编码器加 Qwen3-4B LLM 解码器的 Encoder-Adapter-LLM 架构,将解码阶段交给大语言模型。

正文

An open multilingual ASR model just posted 3.54 average WER across 5 languages

Hojo-ASR-Multi-V1 combines an acoustic encoder with a Qwen3-4B decoder, giving speech recognition an unusually strong language model at the final decoding stage.

  • Built with a Qwen3-4B LLM decoder
  • Designed for multilingual conversational speech recognition
  • Publicly available on Hugging Face, under the Apache 2.0 license
  • Installable through the hojo-asr Python package
  • Supports local inference
  • Accepts WAV file paths, audio byte streams and SCP inputs

There is a bigger technical story behind the 3.54 WER number.

Traditional ASR systems rely heavily on acoustic and language modeling components designed specifically for speech, while Hojo hands the decoding stage to a Qwen3-4B LLM after the audio has been encoded and adapted. So recognition gets access to a much richer model of how words naturally fit together while it is deciding what was actually said.

What makes Hojo even more interesting is that it is reaching that level across multiple languages rather than being built around only 1 language. And it does this with an openly available model that developers can actually run and inspect themselves.

The architecture is probably the most interesting part for me.

Hojo uses an Encoder, Adapter and LLM setup with Qwen3-4B as the decoder, so the final transcript is produced using both acoustic information from the speech and the language knowledge inside the LLM.

That gives the decoder much more context for resolving words that may sound ambiguous from audio alone.

来源:Rohan Paul · x.com