31 lines
1.2 KiB
Plaintext
31 lines
1.2 KiB
Plaintext
Dual-GPU Benchmark v2 — 2026-04-06T06:52:08.868Z
|
|
2x RTX 3060 12GB | 256K Context | 58 configs | 69.4 min
|
|
|
|
=======================================================
|
|
RANKING
|
|
=======================================================
|
|
|
|
🥇 #1: Gemma4-26B Q4_K_M
|
|
AVG: 76.4 t/s | BEST: 76.75 t/s | Boot: 9s
|
|
ngl=999 t=6 ub=512 b=2048 ctk=f16 ctv=f16
|
|
|
|
🥈 #2: Gemma4-26B MXFP4_MOE
|
|
AVG: 64.05 t/s | BEST: 64.29 t/s | Boot: 9s
|
|
ngl=999 t=2 ub=512 b=2048 ctk=q8_0 ctv=q8_0
|
|
|
|
🥉 #3: Qwen3.5-35B Q4_K_M
|
|
AVG: 52.05 t/s | BEST: 54.48 t/s | Boot: 12.1s
|
|
ngl=999 t=4 ub=256 b=1024 ctk=q4_0 ctv=q4_0
|
|
--n-cpu-moe 5
|
|
|
|
#4: Qwen3.5-35B MXFP4_MOE
|
|
AVG: 46.66 t/s | BEST: 47.09 t/s | Boot: 15s
|
|
ngl=999 t=6 ub=512 b=2048 ctk=q4_0 ctv=q4_0
|
|
--n-cpu-moe 5
|
|
|
|
=======================================================
|
|
★ CHAMPION: Gemma4-26B Q4_K_M — 76.4 t/s
|
|
=======================================================
|
|
|
|
Recommended:
|
|
llama-server --model models\gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 999 -c 262144 -t 6 -tb 6 -ub 512 -b 2048 -fa on --cache-type-k f16 --cache-type-v f16 --prio 3 --poll 50 --mlock --port 8000 --host 0.0.0.0 |