post: commit 533ae6e in myai
All checks were successful
Hugo Build & Deploy / build-deploy (push) Successful in 4m46s
All checks were successful
Hugo Build & Deploy / build-deploy (push) Successful in 4m46s
This commit is contained in:
47
content/posts/commits/2026-08-14-commit-533ae6e.md
Normal file
47
content/posts/commits/2026-08-14-commit-533ae6e.md
Normal file
@@ -0,0 +1,47 @@
|
||||
---
|
||||
title: "[myai] feat(myai): switch to Qwen2.5-Coder-1.5B (local GPU, ~30s/64tok)"
|
||||
date: 2026-08-14T22:02:59+02:00
|
||||
draft: false
|
||||
tags: ["commit", "myai", "main"]
|
||||
categories: ["Git Activity"]
|
||||
summary: "Commit 533ae6e par Betty dans myai"
|
||||
author: "Betty"
|
||||
---
|
||||
|
||||
## Commit `533ae6e`
|
||||
|
||||
| | |
|
||||
|---|---|
|
||||
| **Repository** | myai |
|
||||
| **Branch** | `main` |
|
||||
| **Author** | Betty |
|
||||
| **Hash** | `533ae6e0010dacfbd8c941d98dca96a0c84f8575` |
|
||||
|
||||
|
||||
### Description
|
||||
|
||||
Replace StarCoder2-3B with Qwen/Qwen2.5-Coder-1.5B:
|
||||
- 1.5B params → ~3GB float16 → fits entirely in T400 4GB VRAM
|
||||
- No CPU offloading → ~30s/64tok vs 3-7min before
|
||||
- safetensors format → compatible with PyTorch 2.2 + transformers 4.57
|
||||
- Not gated → no HF token needed for download
|
||||
|
||||
Removed hf_token secret dependency, restored GPU placement constraint,
|
||||
adjusted resource limits to 2CPU/3G RAM.
|
||||
|
||||
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
||||
|
||||
### Files Changed
|
||||
|
||||
```
|
||||
M app/codegen.py
|
||||
M stack/myai.yml
|
||||
```
|
||||
|
||||
### Diff Summary
|
||||
|
||||
```
|
||||
app/codegen.py | 8 ++++----
|
||||
stack/myai.yml | 6 +++---
|
||||
2 files changed, 7 insertions(+), 7 deletions(-)
|
||||
```
|
||||
Reference in New Issue
Block a user