Betty
b656786602
All checks were successful
Hugo Build & Deploy / build-deploy (push) Successful in 12s
910 B
910 B
title, date, draft, tags, categories, summary, author
| title | date | draft | tags | categories | summary | author | ||||
|---|---|---|---|---|---|---|---|---|---|---|
| [bojemoi] fix(ollama): KEEP_ALIVE=-1 pour garder mistral chargé en VRAM | 2026-05-19T22:53:03+02:00 | false |
|
|
Commit 19a2864 par Betty dans bojemoi | Betty |
Commit 19a2864
| Repository | bojemoi |
| Branch | main |
| Author | Betty |
| Hash | 19a2864882a736c483cc27a94eb0b83cc8161118 |
Description
Sans KEEP_ALIVE, le modèle se décharge après 5min d'inactivité. Le cold start sur T400 4GB prend >60s → timeout enrich_tags dans nuclei-worker. Avec -1, le modèle reste en VRAM indéfiniment (inference ~0.9s à chaud vs >60s à froid).
Co-Authored-By: Claude Sonnet 4.6 noreply@anthropic.com
Files Changed
M stack/51-service-ollama.yml
Diff Summary
stack/51-service-ollama.yml | 1 +
1 file changed, 1 insertion(+)