migrate knowledge atlas to llama.cpp
This commit is contained in:
@@ -98,6 +98,16 @@ Decision retained: always verify `/api/tags`; never infer deployed model aliases
|
||||
|
||||
Relevant commits: `47c301c`, `ac6e0e0`, and the 2026-07-12 handoff update.
|
||||
|
||||
On 2026-07-28 the runtime moved to llama.cpp after repeated Ollama runner churn and
|
||||
resource-residency ambiguity. Luna was isolated on the NAS AMD iGPU through Vulkan,
|
||||
while Terra and Sol became two API behaviors over one fixed 27B CUDA runner on the
|
||||
V100. The web app now uses the servers' OpenAI-compatible endpoints, fixes context
|
||||
at deployment time, and controls thinking by tier.
|
||||
|
||||
Decision retained: product tiers do not require separate physical model copies.
|
||||
Keep resource ownership in the serving layer and let Terra/Sol share one resident
|
||||
runner when their weights are identical.
|
||||
|
||||
## 6. Learning-System Reframing
|
||||
|
||||
The user clarified the real objective with three levels:
|
||||
|
||||
Reference in New Issue
Block a user