Opening

Unsloth's official Qwen3.8-27B-GGUF release has racked up over 6.1 million downloads on Hugging Face, and it comes with multiple quantization levels ready to run. This issue also features NousResearch's uncensored 27B model Arete, plus ZONOS3-Mini, a bilingual speech model that runs in just 8 GB of VRAM. I'll tell you which one fits your current rig.

This Issue's Picks

1. NousResearch/Arete-27B: Uncensored, Long-Context, Commercially-Friendly 27B Base

• What it is: A 27-billion-parameter language model from NousResearch, Apache-2.0 licensed, in safetensors format. The official model card labels it as an Arete fine-tune; community discussion suggests stronger instruction-following and code generation.
• Where it fits:
  • Backend engineers building self-hosted chatbot projects who need an uncensored, long-context, commercially-permissive model as the core backend.
  • Indie developers running code generation and reasoning tasks offline with only a 24 GB consumer GPU.
  • MLOps engineers quantizing to 4-bit GGUF for deployment on llama.cpp or Ollama as a local knowledge-base QA model.
• Will it run: The official model card does not specify concrete hardware requirements, only notes 27B params, safetensors format, Apache-2.0 license. By 27B rule of thumb, 4-bit quantized weights sit around 14–15 GB; with context overhead, budget 16+ GB VRAM. Treat the above as unofficial estimates; go by actual quantized file size.
• Buzz this issue: HF trending score 443, 4.7k cumulative downloads, 471 likes.
• vs. peers: Same NousResearch family; closest to Hermes-3-27B but an Arete fine-tune. Reddit r/LocalLLaMA threads note Arete edges ahead on instruction-following and code.
• How to get it: Download safetensors weights from Hugging Face, load with transformers, or convert to GGUF for llama.cpp/Ollama.
• Link: https://huggingface.co/NousResearch/Arete-27B

2. unsloth/Qwen3.8-27B-GGUF: Official Pre-Quantized GGUF, One-Click Ollama, Multilingual Long-Context

• What it is: Unsloth's official GGUF quantization pack for the Qwen3-series 27B model, Apache-2.0 licensed, offering Q4_K_M, Q5_K_M, Q8_0 and more. README includes one-liners for llama.cpp and Ollama.
• Where it fits:
  • Backend engineers wanting to run latest Qwen3 on 16–24 GB VRAM without quantizing themselves, grab GGUF and go.
  • Full-stack engineers needing multilingual (Traditional Chinese included) long-context local coding assistants, deployed via Ollama in one command.
  • MLOps researchers comparing quantization tiers (Q4_K_M, Q5_K_M, Q8_0) for speed-quality trade-offs on their hardware.
• Will it run: Official README lists multiple GGUF versions and recommends 16+ GB VRAM for Q4_K_M, 24+ GB for Q5_K_M/Q8_0; also provides llama.cpp and Ollama one-liners.
• Buzz this issue: HF trending score 196, 6.1M cumulative downloads, 5.8k likes; this issue shows 6 quantized/repacked variants in the same family on Hugging Face, strong community adoption.
• vs. peers: Official Unsloth quantization, more stable, less quantization loss than community builds. At same param count, beats Qwen2.5-27B-Instruct-GGUF with longer context and stronger reasoning (per Unsloth blog).
• How to get it: Run ollama run hf.co/unsloth/Qwen3.8-27B-GGUF:Q4_K_M in Ollama; for llama.cpp, download the matching GGUF and run ./llama-cli -m Qwen3.8-27B-Q4_K_M.gguf -p "..." (from README).
• Link: https://huggingface.co/unsloth/Qwen3.8-27B-GGUF

3. Zyphra/ZONOS3-Mini: Bilingual Real-Time TTS on 8 GB VRAM, Edge-Ready

• What it is: Zyphra's lightweight text-to-speech model, positioned as "lightweight real-time TTS," Apache-2.0 licensed, available in both GGUF and safetensors.
• Where it fits:
  • Content creators generating Chinese-English bilingual voiceovers for audiobooks or podcasts offline, with only 8–12 GB VRAM.
  • Embedded engineers prototyping voice assistants on edge devices (Mac M-series, NVIDIA Jetson) with real-time synthesis.
  • Full-stack engineers integrating TTS into local RAG pipelines, turning retrieved results straight into spoken responses, with commercial-friendly licensing.
• Will it run: Official model card tags it as Mini, provides GGUF quantization; README states runs on 8+ GB VRAM consumer GPUs or Apple Silicon unified memory.
• Buzz this issue: HF trending score 193, 8.5k cumulative downloads, 221 likes.
• vs. peers: Larger than Kokoro-82M, more natural speech; far smaller and faster than Bark or Tortoise-TTS. Zyphra's own docs position it as "lightweight real-time TTS."
• How to get it: Download GGUF from Hugging Face, load via Zyphra's official inference scripts or compatible TTS frameworks (e.g., kokoro-onnx-style loaders); README includes a Python example.
• Link: https://huggingface.co/Zyphra/ZONOS3-Mini

Closing

All three models point to the same trend: 27B parameters paired with official or community GGUF quantization has become the sweet spot for consumer GPUs; speech models are also dropping Mini versions down to the 8 GB VRAM tier. If you have 16+ GB VRAM, Unsloth's Qwen3.8 GGUF with Ollama's one-liner is the lowest-friction starting point. See you next issue.