---
title: "🧪 3B supports 262K long context, 27B quantized fits 24GB GPU, 99M fine‑tuning data: Local AI Lab"
description: "This radar scan highlights three download‑and‑run picks: KRAFTON releases a 3B‑parameter bilingual model supporting 262K long context, ConceptCountry halves 27B inference tokens via weight‑space editing while improving performance, and MinimaLabs offers a 99M‑parameter fine‑tuning tutorial as the top choice, stay tuned to see which suits tonight’s hands‑on."
canonical_url: "https://blog.markkulab.net/en/local-ai-lab/local-ai-lab-2026-11-15"
author: "Mark Ku"
author_url: "https://blog.markkulab.net/en/author/mark-ku"
site: "Mark Ku's Tech Notes"
date_published: "2026-11-15T02:00:00.000Z"
category: "On-Device AI Lab"
tags: ["local-ai", "podcast", "地端模型", "lora", "開源模型", "Raon-1-nano", "qwen-concept-27b", "KLM-1.6"]
language: "en"
license: "CC BY 4.0"
license_url: "https://creativecommons.org/licenses/by/4.0/"
attribution: "when reusing or quoting, credit the author and link back to the original"
---

# 🧪 3B supports 262K long context, 27B quantized fits 24GB GPU, 99M fine‑tuning data: Local AI Lab

## Opening
This week's radar picked up three "download-and-run" highlights: KRAFTON released a 3B bilingual model with 262K context, ConceptCountry halved 27B inference tokens via weight-space editing while getting stronger, and MinimaLabs dropped a 99M parameter model that's the new go-to for fine-tuning tutorials. I'll tell you which one fits tonight's hack session.

## This Week's Picks

### 1. KRAFTON/Raon-1-nano: 3B Params, 262K Context, Native Mac Bilingual Tool Calling
- **What it is**: A 3B dense model distilled and pruned from KRAFTON's in-house 30B-A4B MoE. The official model card claims 262K context, supports mixed Traditional Chinese/English chat and tool calling, licensed Apache-2.0.
- **Where it fits**:
  - Running a local bilingual assistant with tool calling on your MacBook (Apple Silicon) without sending data to the cloud.
  - Corporate security policies forbid external APIs, but you need long-document summarization or code assistance, 3B + 262K context handles it on a single machine.
  - Deploying a voice assistant backend on a laptop or mini PC: run inference with GGUF via llama.cpp, no extra GPU needed.
- **Can it run?**: The model card lists BF16 (~6.3 GB, unquantized), GGUF (llama.cpp), MLX 4-bit GPTQ (Apple Silicon), and LiteRT-LM (4-bit weights, fp16 activations, 4K tokens). Mac users can load the MLX 4-bit quantized version directly for inference.
- **Buzz this week**: HF trending score 92 (1.3k downloads, 94 likes).
- **Versus peers**: The model card claims it leads same-size models across 17 benchmarks (e.g., Korean chat 91.0). Compared to its predecessor Raon-1 mini preview (30B-A4B MoE), pruning and distillation drastically shrank the model while retaining tool calling and bilingual abilities.
- **How to get it**: README provides full example code for Transformers, vLLM, llama.cpp, MLX, and LiteRT-LM. Mac users can load the MLX 4-bit quantized version directly.
- **Link**: [https://huggingface.co/KRAFTON/Raon-1-nano](https://huggingface.co/KRAFTON/Raon-1-nano)

### 2. ConceptCountry/qwen-concept-27b: Weight-Space Editing Qwen2.5-27B, No Fine-Tuning, No Prompt Engineering, 27-54% Fewer Reasoning Tokens
- **What it is**: ConceptCountry manually edited nine down-projection matrices in Qwen2.5-27B's weight space (the model card notes it's based on Qwen2.5-27B; a source reference to Qwen3.8-27B is a typo). No fine-tuning, no repacking, no prompt engineering. They published the paper, data, and fully reproducible code for every number. Licensed Apache-2.0.
- **Where it fits**:
  - Researchers or advanced practitioners wanting to understand whether "edit weights directly, no training" can improve model behavior, download the code and reproduce every figure in the paper.
  - Running Qwen2.5-27B lighter with more efficient reasoning (27-54% fewer thinking tokens). The Q4_K_M quant (16 GB) runs on a single 24 GB consumer GPU.
  - Tech reading groups or teaching "weight-space programming", the middle ground between fine-tuning and prompt engineering, using this as a living case study.
- **Can it run?**: Official formats: BF16 (52 GB), FP8 (30 GB), Q8_0 (27 GB), Q4_K_M (16 GB). The 16 GB quant fits on a single consumer GPU.
- **Buzz this week**: HF trending score 198 (64.0k downloads, 263 likes).
- **Versus peers**: The authors ran a "norm-matched random edit" control, proving gains come from precise editing, not random perturbation: +4.3 on GPQA Diamond, +13.0 on LiveCodeBench v6. They flag this as still experimental, under evaluation.
- **How to get it**: The model card notes support for llama.cpp, Ollama, LM Studio, and links to the paper, data, and "code that generates every number" (concept.country/research/weight-space-programming).
- **Link**: [https://huggingface.co/ConceptCountry/qwen-concept-27b](https://huggingface.co/ConceptCountry/qwen-concept-27b)

### 3. MinimaLabs/KLM-1.6: 99M Param Gated DeltaNet-2 Base Model, Runs on CPU, Fine-Tunes in Hours
- **What it is**: MinimaLabs' 99M parameter tiny base model using Gated DeltaNet-2 hybrid attention. Official stats: #1 Intelligence Index (33.95) on the Open SLM leaderboard for sub-100M models. Licensed Apache-2.0. This is a base model, no instruction tuning applied.
- **Where it fits**:
  - Running a base LLM entirely on CPU on a Raspberry Pi or old laptop, fine-tuning on your own domain data for lightweight experiments.
  - Teaching "fine-tune an LLM from scratch", 99M params is small enough to finish fine-tuning in hours on a consumer GPU or even CPU.
  - Studying how new attention architectures like Gated DeltaNet-2 behave on small models, use this model's config as a reference.
- **Can it run?**: Official note: "Runs on CPU and any GPU, no extra packages beyond Transformers." 99M params, tiny model files, consumer hardware handles it easily.
- **Buzz this week**: HF trending score 81 (1.7k downloads, 81 likes).
- **Versus peers**: Official claim: #1 Intelligence Index (33.95) among sub-100M models on Open SLM. But it's an untuned base model, needs instruction tuning to chat like an assistant. Compared to already-chat-tuned small models (like KRAFTON's Raon series), KLM-1.6 is better suited as a research and fine-tuning starting point, not a drop-in assistant.
- **How to get it**: Official Python examples cover basic usage and batched inference (fast_generate). Load directly with Transformers, no extra dependencies.
- **Link**: [https://huggingface.co/MinimaLabs/KLM-1.6](https://huggingface.co/MinimaLabs/KLM-1.6)

## Closing
These three models map perfectly to three on-device entry points: Raon-1-nano solves the Mac user's need for bilingual, long-context, tool-calling without leaving the laptop; qwen-concept-27b uses "weight surgery" to leap inference efficiency, giving GPU-budget engineers a no-retrain shortcut; KLM-1.6 drops the fine-tuning barrier to near zero, ideal as a teaching or architecture-experiment launchpad. If you want results tonight and have a Mac, grab Raon-1-nano's MLX build, fastest to first token. See you next week.

---

## About this article and its author

Originally published on [Mark Ku's Tech Notes](https://blog.markkulab.net/en/local-ai-lab/local-ai-lab-2026-11-15)

License: [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) — when reusing or quoting, credit the author and link back to the original

### About the author

**[Mark Ku](https://blog.markkulab.net/en/author/mark-ku)** — Software engineer

- 10+ years as a software engineer
- Built North-American e-commerce and AI SaaS subscription billing

### Free tools built by the author

All of these are free to use:

- [Free PDF Sign Tool](https://blog.markkulab.net/en/tools/pdf-sign): Online PDF sign tool — draw, type, or upload a signature, then drag, resize, and download. Everything runs in your browser; nothing is uploaded.
- [VS Code Refactory](https://blog.markkulab.net/en/tools/refactory): Refactory is a VS Code refactoring extension: 34 actions plus a 37-rule code-smell inspection layer with a Code Health dashboard, across 18 languages, backed by 534 tests. It learns your repo's conventions: where interfaces live, where DI is registered, whether 'use client' belongs. It ranks files by git churn × complexity so you know what to fix first, and hands any smell to the Claude Code already on your machine. Free to use, and your source never leaves your computer.
- [DB-Kit Database Manager](https://blog.markkulab.net/en/tools/db-kit): DB-Kit is a lightweight, cross-platform database manager built with Tauri + Rust + React. Manage MySQL, MariaDB, PostgreSQL, SQL Server, Oracle, SQLite, MongoDB, Redis, Kafka, Elasticsearch and RabbitMQ from one consistent interface: passwords encrypted in the OS keychain, SSH tunnels, full CRUD, a visual query builder, stacked multi-statement result sets, cross-connection data transfer, schema & data compare with sync SQL and schema snapshots, Excel / CSV import & export, visualized execution plans, ER diagrams, scheduled backups, SQL stress testing with p50–p99 latency percentiles, a 15-rule SQL review engine, Review & Run (AI review plus per-statement backups and an auto-generated rollback script), Kafka message browsing with monitoring & alerts, an SSH terminal with SFTP / FTP, Docker / Kubernetes, remote desktop (RDP / VNC / RustDesk), file / folder compare, stored procedure integration tests, six UI languages, a built-in AI assistant (a local CLI or any Anthropic / OpenAI-compatible API; natural-language SQL, AI review and tuning advice) and the dbk CLI. Free and open source (MIT), with installers for Windows, macOS and Linux.
- [VS Code Super Mermaid](https://blog.markkulab.net/en/tools/super-mermaid): Super Mermaid is a VS Code extension for beautiful Mermaid diagrams out of the box: auto-colored live preview, mouse pan & zoom, high-res PNG / SVG export, 21 templates and multiple themes. Free and open source (MIT).
- [React Super Mermaid](https://blog.markkulab.net/en/tools/react-super-mermaid): react-super-mermaid is an open-source React component library: render beautiful Mermaid diagrams with a single <MermaidViewer>, with built-in colorful / sketch themes, pan & zoom, in-diagram search, and high-res SVG / PNG export. Lightweight, SSR-safe, fully typed. Free and open source (MIT).
- [Jira / Confluence Super Mermaid](https://blog.markkulab.net/en/tools/jira-super-mermaid): An Atlassian Forge app: write Mermaid syntax directly inside a Jira issue or a Confluence page and get flowcharts, sequence diagrams, state machines and Gantt charts. 11 diagram types, SVG / PNG export, light and dark themes, full CJK support. Runs on Atlassian: your diagrams live in your own site and the app calls no third-party service. Free, coming soon to the Atlassian Marketplace.
- [Mermaid Live Preview](https://blog.markkulab.net/en/tools/mermaid-preview): Write Mermaid in your browser, see it render instantly, and share the whole diagram as a single link. No sign-up, nothing uploaded to a server, and mermaid.live share links work as-is.
- [React Intl Phone Number](https://blog.markkulab.net/en/tools/react-intl-phone-number): react-intl-phone-number is an open-source React component: framework-agnostic and antd-free, with E.164 in/out, a searchable flag / country-code dropdown, configurable validation levels (strict / mobile-strict / loose), themeable CSS, and i18n — phone logic powered by google-libphonenumber. Lightweight and fully typed. Free and open source (MIT).
- [Uptime Kuma Cluster](https://blog.markkulab.net/en/tools/uptime-kuma-cluster): Turn single-node Uptime Kuma into a highly available cluster: OpenResty + Lua smart load balancing, shared MariaDB state, health checks and automatic failover, plus cluster-management REST APIs. One Docker Compose command to start. Free and open source (MIT).
- [AI Podcast Cut](https://blog.markkulab.net/en/tools/ai-podcast-cut): Drop in a recording and it removes fillers and stutters, levels loudness segment by segment, and sends a second agent to review every cut. Cut points snap to word boundaries and zero crossings, every splice gets a fade, and sentence-end breaths are preserved. Desktop app for Windows, macOS and Linux. MIT licensed; the Windows installer bundles ffmpeg.
- [AI Video Cut](https://blog.markkulab.net/en/tools/ai-video-cut): Pick something in your video: type it (face, license plate, phone screen, logo), click points or drag a box, or let Claude Code / Codex pick it. AI Video Cut tracks it frame by frame, then mosaics or blurs it, recolors it, pins stickers and text to it, swaps a screen or poster for your own image or video, or removes it using background that other frames actually captured. Plus sequence editing, local captions and an AI assistant. Free, open-source (MIT) Windows desktop app (macOS / Linux experimental) that runs locally, nothing uploaded.
- [open-pos restaurant POS](https://blog.markkulab.net/en/tools/open-pos): One computer and one receipt printer is enough to open the shop. Your data lives on your own disk, no subscription, no lock-in, MIT licensed. Money is integer New Taiwan dollars with tax split by the statutory formula, so sales + tax always equals the total. Printing goes straight over ESC/POS on TCP 9100, with no vendor driver. Tauri + Rust + SQLite desktop app, v1.0 in development.
- [.NET e-commerce API template](https://blog.markkulab.net/en/tools/dotnet-ecommerce-api): An e-commerce backend API template built on .NET 10: Controller → Service → Repository layering, Autofac convention-based registration, SqlSugar for MySQL / MariaDB and SQL Server, Redis cache and message queue, Hangfire jobs, JWT auth, and an extensible payment provider module (ECPay, Newebpay). Apache 2.0.
- [Open Token Monitor team AI usage](https://blog.markkulab.net/en/tools/open-token-monitor): Collect token usage and equivalent cost from every employee's AI coding tools into a hub you host yourself: PostgreSQL, org roster, dashboards compared by company and department, and a reports API. Electron and Rust/Tauri clients upload every 30 minutes. MIT licensed, one Docker command.
- [ai-security-monitor defensive security](https://blog.markkulab.net/en/tools/ai-security-monitor): Your website is live. Who checks its certificates, security settings and known vulnerabilities? A self-hosted Security Hub brings website scans and host monitoring together, deduplicates findings and compares scans after fixes.

### Daily podcasts

- [Mark's Tech Insights — Daily AI News](https://blog.markkulab.net/en/category/tech-news): Daily curated AI and tech trends. Catch the latest developments via audio summaries — covering AI applications, software architecture, DevOps, and engineering practice. — RSS: https://blog.markkulab.net/feed.xml
- [AI股市蝦聊](https://blog.markkulab.net/en/category/ai-stock-chat): Every trading day, an AI-analyzed take on the Taiwan stock market, delivered as a two-host conversation covering the session and the next-day outlook. — RSS: https://blog.markkulab.net/ai-stock-chat/feed.xml
- [開源好物日報](https://blog.markkulab.net/en/category/open-source-weekly): A daily two-host pick of free open-source tools surfaced from real Hacker News, GitHub, and Reddit buzz — what pain they solve and the fastest way to get started. — RSS: https://blog.markkulab.net/open-source-weekly/feed.xml
- [AI 運動日報](https://blog.markkulab.net/en/category/sports-weekly): Two hosts talk NBA, MLB and world sport every day — scores, records and the stories behind them, from a Taiwanese fan perspective. — RSS: https://blog.markkulab.net/sports-weekly/feed.xml
- [AI 國際新聞快報](https://blog.markkulab.net/en/category/world-news): A daily two-host briefing that makes sense of the past 24 hours in world news — geopolitics, the global economy, conflict and security, disasters and climate — from a Taiwanese perspective, neutral and fully sourced. — RSS: https://blog.markkulab.net/world-news/feed.xml
- [地端 AI 實驗室](https://blog.markkulab.net/en/category/local-ai-lab): Every day, a two-host look at open-weight models and LoRAs you can actually run on your own machine: what they are for, whether your GPU can handle them, and how they compare — sourced from official model cards. — RSS: https://blog.markkulab.net/local-ai-lab/feed.xml
- [AI 行銷日報](https://blog.markkulab.net/en/category/ai-marketing): Every day, two hosts break down the latest in AI for marketing, advertising, SEO/GEO and content marketing: practical, never sponsored, every story sourced. — RSS: https://blog.markkulab.net/ai-marketing/feed.xml
- [AI 資安日報](https://blog.markkulab.net/en/category/ai-security): Every day, two hosts cover the latest where AI meets cybersecurity: LLM and AI agent vulnerabilities, prompt injection, model supply-chain risks and AI-powered attacks, from a defense-first angle with every story sourced. — RSS: https://blog.markkulab.net/ai-security/feed.xml

### Newsletter

[Subscribe to the newsletter](https://blog.markkulab.net/en/subscribe) — Be the first to know about new posts. No spam, unsubscribe anytime.