c111b3a9b0
Phase 01 (LLM Tuning): - Gemma4 26B: 74.65 t/s (fast) - Qwen 35B: 61.62 t/s (balanced) - Gemma4 31B: 16.0 t/s (deep-coder) - Qwen 27B: 16.7 t/s (deep-logic) - Qwen 122B: 8.95 t/s (ultra, GPU 1 only) Phase 02 (API Engine): - FastAPI reverse proxy on port 8000 - /engine/switch hot-swap with 503 protection - config/engine_models.json as single source of truth - Replaced 4 individual .bat files with unified engine File cleanup: - scripts/ 85 files -> 9 + _archive/ - Root .bat files -> _archive/
24 lines
1015 B
Markdown
24 lines
1015 B
Markdown
# Phase 01: LLM Tuning — Verification Report
|
|
|
|
## 검증 결과
|
|
|
|
| # | 모델 | 역할 | 실측 속도 | 컨텍스트 | GPU 구성 | 상태 |
|
|
|:-:|------|------|:--------:|:-------:|----------|:----:|
|
|
| 1 | Gemma 4 26B-A4B Q4_K_M | fast | 74.65 t/s | 256K | 듀얼 | ✅ |
|
|
| 2 | Qwen 3.5 35B-A3B Q4_K_M | balanced | 61.62 t/s | 256K | 듀얼 | ✅ |
|
|
| 3 | Gemma 4 31B Dense Q4_K_M | deep-coder | 16.0 t/s | 192K | 듀얼 | ✅ |
|
|
| 4 | Qwen 3.5 27B Dense Q4_K_M | deep-logic | 16.7 t/s | 256K | 듀얼 | ✅ |
|
|
| 5 | Qwen 3.5 122B-A10B Q4_K_M | ultra | 8.95 t/s | 256K | GPU 1만 | ✅ |
|
|
|
|
## UAT 기준 달성 여부
|
|
|
|
- [x] Fast tier ≥ 70 t/s → **74.65 t/s** ✅
|
|
- [x] Balanced tier ≥ 50 t/s → **61.62 t/s** ✅
|
|
- [x] Deep tier 안정 구동 → **16.0 / 16.7 t/s** ✅
|
|
- [x] Ultra tier 구동 가능 → **8.95 t/s** ✅
|
|
- [x] 모든 모델 VRAM 12GB x 2 이내 → ✅
|
|
- [x] 최적 설정값 JSON으로 체계화 → `config/engine_models.json` ✅
|
|
|
|
## Phase Status: ✅ COMPLETE
|
|
완료 일시: 2026-04-07
|