post: commit 533ae6e in myai
All checks were successful
Hugo Build & Deploy / build-deploy (push) Successful in 4m46s
All checks were successful
Hugo Build & Deploy / build-deploy (push) Successful in 4m46s
This commit is contained in:
47
content/posts/commits/2026-08-14-commit-533ae6e.md
Normal file
47
content/posts/commits/2026-08-14-commit-533ae6e.md
Normal file
@@ -0,0 +1,47 @@
|
|||||||
|
---
|
||||||
|
title: "[myai] feat(myai): switch to Qwen2.5-Coder-1.5B (local GPU, ~30s/64tok)"
|
||||||
|
date: 2026-08-14T22:02:59+02:00
|
||||||
|
draft: false
|
||||||
|
tags: ["commit", "myai", "main"]
|
||||||
|
categories: ["Git Activity"]
|
||||||
|
summary: "Commit 533ae6e par Betty dans myai"
|
||||||
|
author: "Betty"
|
||||||
|
---
|
||||||
|
|
||||||
|
## Commit `533ae6e`
|
||||||
|
|
||||||
|
| | |
|
||||||
|
|---|---|
|
||||||
|
| **Repository** | myai |
|
||||||
|
| **Branch** | `main` |
|
||||||
|
| **Author** | Betty |
|
||||||
|
| **Hash** | `533ae6e0010dacfbd8c941d98dca96a0c84f8575` |
|
||||||
|
|
||||||
|
|
||||||
|
### Description
|
||||||
|
|
||||||
|
Replace StarCoder2-3B with Qwen/Qwen2.5-Coder-1.5B:
|
||||||
|
- 1.5B params → ~3GB float16 → fits entirely in T400 4GB VRAM
|
||||||
|
- No CPU offloading → ~30s/64tok vs 3-7min before
|
||||||
|
- safetensors format → compatible with PyTorch 2.2 + transformers 4.57
|
||||||
|
- Not gated → no HF token needed for download
|
||||||
|
|
||||||
|
Removed hf_token secret dependency, restored GPU placement constraint,
|
||||||
|
adjusted resource limits to 2CPU/3G RAM.
|
||||||
|
|
||||||
|
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
||||||
|
|
||||||
|
### Files Changed
|
||||||
|
|
||||||
|
```
|
||||||
|
M app/codegen.py
|
||||||
|
M stack/myai.yml
|
||||||
|
```
|
||||||
|
|
||||||
|
### Diff Summary
|
||||||
|
|
||||||
|
```
|
||||||
|
app/codegen.py | 8 ++++----
|
||||||
|
stack/myai.yml | 6 +++---
|
||||||
|
2 files changed, 7 insertions(+), 7 deletions(-)
|
||||||
|
```
|
||||||
Reference in New Issue
Block a user