post: commit 533ae6e in myai
All checks were successful
Hugo Build & Deploy / build-deploy (push) Successful in 4m46s

This commit is contained in:
Betty
2026-08-14 22:02:59 +02:00
parent e1a9573f1d
commit ba65f7175c

View File

@@ -0,0 +1,47 @@
---
title: "[myai] feat(myai): switch to Qwen2.5-Coder-1.5B (local GPU, ~30s/64tok)"
date: 2026-08-14T22:02:59+02:00
draft: false
tags: ["commit", "myai", "main"]
categories: ["Git Activity"]
summary: "Commit 533ae6e par Betty dans myai"
author: "Betty"
---
## Commit `533ae6e`
| | |
|---|---|
| **Repository** | myai |
| **Branch** | `main` |
| **Author** | Betty |
| **Hash** | `533ae6e0010dacfbd8c941d98dca96a0c84f8575` |
### Description
Replace StarCoder2-3B with Qwen/Qwen2.5-Coder-1.5B:
- 1.5B params → ~3GB float16 → fits entirely in T400 4GB VRAM
- No CPU offloading → ~30s/64tok vs 3-7min before
- safetensors format → compatible with PyTorch 2.2 + transformers 4.57
- Not gated → no HF token needed for download
Removed hf_token secret dependency, restored GPU placement constraint,
adjusted resource limits to 2CPU/3G RAM.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
### Files Changed
```
M app/codegen.py
M stack/myai.yml
```
### Diff Summary
```
app/codegen.py | 8 ++++----
stack/myai.yml | 6 +++---
2 files changed, 7 insertions(+), 7 deletions(-)
```