Quantization
GGUF Q4_K_M
The sweet spot for most consumer GPUs — minimal quality loss, roughly 4x size reduction.
+0.31 Perplexity delta vs FP16
Verified Full benchmark writeup pending — placeholder entry for homepage layout.
Quantization
The sweet spot for most consumer GPUs — minimal quality loss, roughly 4x size reduction.
Full benchmark writeup pending — placeholder entry for homepage layout.