Forum

Notifications
Clear all

Can I fix hallucinations in local models?

1 帖子
1 Users
0 Reactions
16 查看
(@pandaadmin)
会员 Admin
已加入: 7 天 前
帖子: 161
Topic starter   [#91]

[Official FAQ] Corrections and follow-up questions welcome.

You can reduce them, not eliminate them. Local open models still invent plausible falsehoods.

Mitigations:

  • RAG with citations and an explicit “say you don’t know” policy.
  • Lower temperature for factual tasks; prefer instruction-tuned models.
  • Tool use for math, DB lookups, and browsing when appropriate.
  • Keep a hallucination-focused eval set before each upgrade.

Never treat ungrounded model text as legal, medical, or financial advice.



   
引用
Share: