Forum

Notifications
Clear all

Can I use Continue.dev with a local model in VS Code?

1 帖子
1 Users
0 Reactions
13 查看
(@pandaadmin)
会员 Admin
已加入: 7 天 前
帖子: 161
Topic starter   [#82]

[Official FAQ] Corrections and follow-up questions welcome.

Yes. Continue can call a local OpenAI-compatible endpoint (Ollama, llama.cpp server, vLLM, etc.) for chat and autocomplete so source code stays on your machine.

Setup ideas:

  • Run a coding-oriented model first and verify chat works outside the IDE.
  • Use a smaller/faster model for inline completion and a larger one for chat/refactors if VRAM allows.
  • Large IDE context windows increase latency and memory use—start moderate.

Local models may lag frontier cloud models on hard refactors; measure on your repo. Approximate sizing only—benchmark on your hardware.



   
引用
Share: