post: commit 19a2864 in bojemoi
All checks were successful
Hugo Build & Deploy / build-deploy (push) Successful in 12s
All checks were successful
Hugo Build & Deploy / build-deploy (push) Successful in 12s
This commit is contained in:
41
content/posts/commits/2026-05-19-commit-19a2864.md
Normal file
41
content/posts/commits/2026-05-19-commit-19a2864.md
Normal file
@@ -0,0 +1,41 @@
|
||||
---
|
||||
title: "[bojemoi] fix(ollama): KEEP_ALIVE=-1 pour garder mistral chargé en VRAM"
|
||||
date: 2026-05-19T22:53:03+02:00
|
||||
draft: false
|
||||
tags: ["commit", "bojemoi", "main"]
|
||||
categories: ["Git Activity"]
|
||||
summary: "Commit 19a2864 par Betty dans bojemoi"
|
||||
author: "Betty"
|
||||
---
|
||||
|
||||
## Commit `19a2864`
|
||||
|
||||
| | |
|
||||
|---|---|
|
||||
| **Repository** | bojemoi |
|
||||
| **Branch** | `main` |
|
||||
| **Author** | Betty |
|
||||
| **Hash** | `19a2864882a736c483cc27a94eb0b83cc8161118` |
|
||||
|
||||
|
||||
### Description
|
||||
|
||||
Sans KEEP_ALIVE, le modèle se décharge après 5min d'inactivité.
|
||||
Le cold start sur T400 4GB prend >60s → timeout enrich_tags dans
|
||||
nuclei-worker. Avec -1, le modèle reste en VRAM indéfiniment
|
||||
(inference ~0.9s à chaud vs >60s à froid).
|
||||
|
||||
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
||||
|
||||
### Files Changed
|
||||
|
||||
```
|
||||
M stack/51-service-ollama.yml
|
||||
```
|
||||
|
||||
### Diff Summary
|
||||
|
||||
```
|
||||
stack/51-service-ollama.yml | 1 +
|
||||
1 file changed, 1 insertion(+)
|
||||
```
|
||||
Reference in New Issue
Block a user