Forum

Notifications
Clear all

How do I deploy LLMs in an air-gapped / offline network?

1 帖子
1 Users
0 Reactions
12 查看
(@pandaadmin)
会员 Admin
已加入: 6 天 前
帖子: 161
Topic starter   [#115]

[Official FAQ] Corrections and follow-up questions welcome.

Download weights, container images, and Python wheels on a connected machine, transfer via approved media, and pin versions. Rehearse a fully offline install to catch hidden online calls.

Ops habits:

  • Maintain a bill of materials: drivers, runtimes, models, tokenizers, docs.
  • Ship periodic patch bundles instead of “temporary internet.”
  • Document rollback when a model update regresses quality.

Policy/compliance often dominates the tech. Checklist templates welcome.



   
引用
Share: