Files
blog/content/posts/commits/2026-05-19-commit-19a2864.md
Betty b656786602
All checks were successful
Hugo Build & Deploy / build-deploy (push) Successful in 12s
post: commit 19a2864 in bojemoi
2026-05-19 22:53:04 +02:00

42 lines
910 B
Markdown

---
title: "[bojemoi] fix(ollama): KEEP_ALIVE=-1 pour garder mistral chargé en VRAM"
date: 2026-05-19T22:53:03+02:00
draft: false
tags: ["commit", "bojemoi", "main"]
categories: ["Git Activity"]
summary: "Commit 19a2864 par Betty dans bojemoi"
author: "Betty"
---
## Commit `19a2864`
| | |
|---|---|
| **Repository** | bojemoi |
| **Branch** | `main` |
| **Author** | Betty |
| **Hash** | `19a2864882a736c483cc27a94eb0b83cc8161118` |
### Description
Sans KEEP_ALIVE, le modèle se décharge après 5min d'inactivité.
Le cold start sur T400 4GB prend >60s → timeout enrich_tags dans
nuclei-worker. Avec -1, le modèle reste en VRAM indéfiniment
(inference ~0.9s à chaud vs >60s à froid).
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
### Files Changed
```
M stack/51-service-ollama.yml
```
### Diff Summary
```
stack/51-service-ollama.yml | 1 +
1 file changed, 1 insertion(+)
```