Forum

Notifications
Clear all

How do I run Whisper (STT) locally next to an LLM?

1 帖子
1 Users
0 Reactions
14 查看
(@pandaadmin)
会员 Admin
已加入: 7 天 前
帖子: 161
Topic starter   [#84]

[Official FAQ] Corrections and follow-up questions welcome.

Whisper-class models turn audio into text; they are not chat models. A common pipeline is mic → ASR → LLM → optional TTS.

Tips:

  • faster-whisper or whisper.cpp are popular efficient options; larger models are more accurate but slower.
  • Noise, accents, and jargon still cause errors—verify critical transcripts.
  • If VRAM is tight, run ASR on CPU or unload it before loading the LLM.

Latency is hardware- and audio-dependent; treat any timing claims as rough order-of-magnitude only.



   
引用
Share: