--- title: "🧪 Running Weights on CPU: Qwen3.5-4B-Qwenputer Directly Executes C: Local AI Lab" description: "Squeezing a 32-bit RISC-V CPU into 4B model weights, what kind of black magic is this? This episode introduces Qwen3.5-4B-Qwenputer, which allows LLMs to perform precise large-number arithmetic and even execute C code without a sandbox. We also feature maya2-native, a local, low-latency voice cloning model, and we'll show you how it outperforms commercial voice APIs!" canonical_url: "https://blog.markkulab.net/en/local-ai-lab/local-ai-lab-2026-10-30" author: "Mark Ku" author_url: "https://blog.markkulab.net/en/author/mark-ku" site: "Mark Ku's Tech Notes" date_published: "2026-10-30T02:00:00.000Z" category: "On-Premise AI Lab" tags: ["local-ai", "podcast", "地端模型", "lora", "開源模型", "Qwenputer", "maya2-native", "RISC_V", "語音合成", "聲音複製", "地端AI實驗室"] language: "en" license: "CC BY 4.0" license_url: "https://creativecommons.org/licenses/by/4.0/" attribution: "when reusing or quoting, credit the author and link back to the original" --- # 🧪 Running Weights on CPU: Qwen3.5-4B-Qwenputer Directly Executes C: Local AI Lab What kind of black magic is squeezing a 32-bit RISC-V CPU into 4B model weights? In this issue, we introduce Qwen3.5-4B-Qwenputer, which allows LLMs to perform precise large-number arithmetic and even execute C code without a sandbox. We also cover maya2-native, a voice cloning model that runs locally with low latency. Read on to find out how it outperforms commercial voice APIs! --- ## Featured Projects ### 1. divagr1925/Qwen3.5-4B-Qwenputer: A Geeky Model Running a RISC-V CPU Inside Its Weights - **What is it**: This is a unique 4B parameter model licensed under apache-2.0 and provided in safetensors format. The craziest part is that the author compiled a complete 32-bit RISC-V CPU and embedded it directly into the weights of Qwen3.5-4B, using the model's own Gated DeltaNet state as RAM to run. - **Use Cases**: - **Scenario 1 (Sandbox-free precise math)**: When you need precise calculations (such as multiplying or dividing large numbers like 123456789 * 987654321) but do not want to rely on an external Python execution environment or set up a secure sandbox, this model can perform precise calculations directly inside the LLM, avoiding the calculation errors common in traditional LLMs. - **Scenario 2 (Deterministic logic control)**: If you need completely deterministic, error-free logic control during the LLM's forward pass, this model can directly execute compiled C or MicroPython code to achieve this. - **Scenario 3 (Persistent file system across conversations)**: During multi-turn conversations, you can use the Gated DeltaNet state as a persistent file system to save file states between turns and load them directly in the next turn, without needing to maintain an external database. - **Can it run?**: According to the official README, the model file size is 18.8 GB in BF16 precision, though most of it is zero-padded. Its CPU runs on a Triton executor. The official README notes that when running on an NVIDIA L4 GPU, it can process about 3,200 trace tokens per second. - **Popularity**: It currently has a trending score of 89 on Hugging Face, with 572 downloads and 89 likes. - **Comparison**: The author notes that compared to the tool-free Qwen3.5-4B base model, Qwenputer's score on the DeepMind Mathematics benchmark jumped from 55%-90% to an impressive 97.5%-100%. In the NUPA test, it achieved a perfect 100% score, compared to just 48.6% for the base model. The author states that its performance is equivalent to calling a real Python interpreter on the host side, but it runs entirely within the weights. - **How to get it**: The official README explains that you can clone the project via `git clone https://github.com/divagr18/qwenputer` and use `uv run python -m chipformer.rv.chat` to load the firmware and model to start interacting with it. - **Link**: [divagr1925/Qwen3.5-4B-Qwenputer](https://huggingface.co/divagr1925/Qwen3.5-4B-Qwenputer) --- ### 2. maya-research/maya2-native: A Local, Low-Latency Speech Synthesis and Voice Cloning Powerhouse - **What is it**: This is an open-source speech synthesis and voice cloning model released by maya-research. It features a developer-friendly apache-2.0 license and safetensors format, focusing on excellent local execution efficiency. - **Use Cases**: - **Scenario 1 (Local real-time voice dialogue systems)**: If you want to set up a low-latency voice agent or Interactive Voice Response (IVR) system locally, this model can perform real-time streaming speech synthesis with 80ms audio frames, providing extremely smooth voice interactions without noticeable lag. - **Scenario 2 (Zero-shot cross-lingual voice cloning)**: Content creators who want to make their voice speak other languages only need to provide a clean 3 to 10-second audio clip of a single speaker. They can then perform zero-shot voice cloning locally and use the cloned voice to read text in other languages. - **Can it run?**: The official model card indicates that under a single connection (max_seats=1), the peak memory load is around 9.2 GB (this value excludes the CUDA context). The official recommendation is to use a GPU with 12 GB or more VRAM. - **Popularity**: It currently has a trending score of 119 on Hugging Face, with 1.5k downloads and 120 likes. - **Comparison**: The official model card cites VoiceArena's Hindi real-time TTS leaderboard data as of October 27, 2026, where Maya 2 Native ranked 2nd, outperforming well-known commercial and peer models such as Cartesia Sonic-3.5, Smallest AI Lightning 3.1 Pro, and xAI Grok TTS. - **How to get it**: The official README explains that you can install it via `pip install "maya3[server] @ git+https://github.com/MayaResearch/maya2-native"` and run `python -m maya3.server` to start the local HTTP and WebSocket servers. - **Link**: [maya-research/maya2-native](https://huggingface.co/maya-research/maya2-native) --- ## Conclusion The two local models introduced in this issue perfectly showcase the geek spirit of the open-source community pushing performance to its absolute limits. Whether it is squeezing a CPU directly into LLM weights to run deterministic logic, or achieving ultra-low-latency voice cloning locally with just a 12 GB graphics card, both demonstrate the infinite potential of local applications. If you are itching to try out some mind-blowing tech, we highly recommend starting with the Qwenputer project. See you in the next issue! --- ## About this article and its author Originally published on [Mark Ku's Tech Notes](https://blog.markkulab.net/en/local-ai-lab/local-ai-lab-2026-10-30) License: [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) — when reusing or quoting, credit the author and link back to the original ### About the author **[Mark Ku](https://blog.markkulab.net/en/author/mark-ku)** — Software engineer - 10+ years as a software engineer - Built North-American e-commerce and AI SaaS subscription billing ### Free tools built by the author All of these are free to use: - [Free PDF Sign Tool](https://blog.markkulab.net/en/tools/pdf-sign): Online PDF sign tool — draw, type, or upload a signature, then drag, resize, and download. Everything runs in your browser; nothing is uploaded. - [VS Code Refactory](https://blog.markkulab.net/en/tools/refactory): Refactory is a VS Code refactoring extension: 34 actions plus a 37-rule code-smell inspection layer with a Code Health dashboard, across 18 languages, backed by 534 tests. It learns your repo's conventions: where interfaces live, where DI is registered, whether 'use client' belongs. It ranks files by git churn × complexity so you know what to fix first, and hands any smell to the Claude Code already on your machine. Free to use, and your source never leaves your computer. - [DB-Kit Database Manager](https://blog.markkulab.net/en/tools/db-kit): DB-Kit is a lightweight, cross-platform database manager built with Tauri + Rust + React. Manage MySQL, MariaDB, PostgreSQL, SQL Server, Oracle, SQLite, MongoDB, Redis, Kafka, Elasticsearch and RabbitMQ from one consistent interface: passwords encrypted in the OS keychain, SSH tunnels, full CRUD, a visual query builder, stacked multi-statement result sets, cross-connection data transfer, schema & data compare with sync SQL and schema snapshots, Excel / CSV import & export, visualized execution plans, ER diagrams, scheduled backups, SQL stress testing with p50–p99 latency percentiles, a 15-rule SQL review engine, Review & Run (AI review plus per-statement backups and an auto-generated rollback script), Kafka message browsing with monitoring & alerts, an SSH terminal with SFTP / FTP, Docker / Kubernetes, remote desktop (RDP / VNC / RustDesk), file / folder compare, stored procedure integration tests, six UI languages, a built-in AI assistant (a local CLI or any Anthropic / OpenAI-compatible API; natural-language SQL, AI review and tuning advice) and the dbk CLI. Free and open source (MIT), with installers for Windows, macOS and Linux. - [VS Code Super Mermaid](https://blog.markkulab.net/en/tools/super-mermaid): Super Mermaid is a VS Code extension for beautiful Mermaid diagrams out of the box: auto-colored live preview, mouse pan & zoom, high-res PNG / SVG export, 21 templates and multiple themes. Free and open source (MIT). - [React Super Mermaid](https://blog.markkulab.net/en/tools/react-super-mermaid): react-super-mermaid is an open-source React component library: render beautiful Mermaid diagrams with a single , with built-in colorful / sketch themes, pan & zoom, in-diagram search, and high-res SVG / PNG export. Lightweight, SSR-safe, fully typed. Free and open source (MIT). - [Jira / Confluence Super Mermaid](https://blog.markkulab.net/en/tools/jira-super-mermaid): An Atlassian Forge app: write Mermaid syntax directly inside a Jira issue or a Confluence page and get flowcharts, sequence diagrams, state machines and Gantt charts. 11 diagram types, SVG / PNG export, light and dark themes, full CJK support. Runs on Atlassian: your diagrams live in your own site and the app calls no third-party service. Free, coming soon to the Atlassian Marketplace. - [Mermaid Live Preview](https://blog.markkulab.net/en/tools/mermaid-preview): Write Mermaid in your browser, see it render instantly, and share the whole diagram as a single link. No sign-up, nothing uploaded to a server, and mermaid.live share links work as-is. - [React Intl Phone Number](https://blog.markkulab.net/en/tools/react-intl-phone-number): react-intl-phone-number is an open-source React component: framework-agnostic and antd-free, with E.164 in/out, a searchable flag / country-code dropdown, configurable validation levels (strict / mobile-strict / loose), themeable CSS, and i18n — phone logic powered by google-libphonenumber. Lightweight and fully typed. Free and open source (MIT). - [Uptime Kuma Cluster](https://blog.markkulab.net/en/tools/uptime-kuma-cluster): Turn single-node Uptime Kuma into a highly available cluster: OpenResty + Lua smart load balancing, shared MariaDB state, health checks and automatic failover, plus cluster-management REST APIs. One Docker Compose command to start. Free and open source (MIT). - [AI Podcast Cut](https://blog.markkulab.net/en/tools/ai-podcast-cut): Drop in a recording and it removes fillers and stutters, levels loudness segment by segment, and sends a second agent to review every cut. Cut points snap to word boundaries and zero crossings, every splice gets a fade, and sentence-end breaths are preserved. Desktop app for Windows, macOS and Linux. MIT licensed; the Windows installer bundles ffmpeg. - [AI Video Cut](https://blog.markkulab.net/en/tools/ai-video-cut): Pick something in your video: type it (face, license plate, phone screen, logo), click points or drag a box, or let Claude Code / Codex pick it. AI Video Cut tracks it frame by frame, then mosaics or blurs it, recolors it, pins stickers and text to it, swaps a screen or poster for your own image or video, or removes it using background that other frames actually captured. Plus sequence editing, local captions and an AI assistant. Free, open-source (MIT) Windows desktop app (macOS / Linux experimental) that runs locally, nothing uploaded. - [open-pos restaurant POS](https://blog.markkulab.net/en/tools/open-pos): One computer and one receipt printer is enough to open the shop. Your data lives on your own disk, no subscription, no lock-in, MIT licensed. Money is integer New Taiwan dollars with tax split by the statutory formula, so sales + tax always equals the total. Printing goes straight over ESC/POS on TCP 9100, with no vendor driver. Tauri + Rust + SQLite desktop app, v1.0 in development. - [.NET e-commerce API template](https://blog.markkulab.net/en/tools/dotnet-ecommerce-api): An e-commerce backend API template built on .NET 10: Controller → Service → Repository layering, Autofac convention-based registration, SqlSugar for MySQL / MariaDB and SQL Server, Redis cache and message queue, Hangfire jobs, JWT auth, and an extensible payment provider module (ECPay, Newebpay). Apache 2.0. - [Open Token Monitor team AI usage](https://blog.markkulab.net/en/tools/open-token-monitor): Collect token usage and equivalent cost from every employee's AI coding tools into a hub you host yourself: PostgreSQL, org roster, dashboards compared by company and department, and a reports API. Electron and Rust/Tauri clients upload every 30 minutes. MIT licensed, one Docker command. - [ai-security-monitor defensive security](https://blog.markkulab.net/en/tools/ai-security-monitor): Your website is live. Who checks its certificates, security settings and known vulnerabilities? A self-hosted Security Hub brings website scans and host monitoring together, deduplicates findings and compares scans after fixes. ### Daily podcasts - [Mark's Tech Insights — Daily AI News](https://blog.markkulab.net/en/category/tech-news): Daily curated AI and tech trends. Catch the latest developments via audio summaries — covering AI applications, software architecture, DevOps, and engineering practice. — RSS: https://blog.markkulab.net/feed.xml - [AI股市蝦聊](https://blog.markkulab.net/en/category/ai-stock-chat): Every trading day, an AI-analyzed take on the Taiwan stock market, delivered as a two-host conversation covering the session and the next-day outlook. — RSS: https://blog.markkulab.net/ai-stock-chat/feed.xml - [開源好物日報](https://blog.markkulab.net/en/category/open-source-weekly): A daily two-host pick of free open-source tools surfaced from real Hacker News, GitHub, and Reddit buzz — what pain they solve and the fastest way to get started. — RSS: https://blog.markkulab.net/open-source-weekly/feed.xml - [AI 運動日報](https://blog.markkulab.net/en/category/sports-weekly): Two hosts talk NBA, MLB and world sport every day — scores, records and the stories behind them, from a Taiwanese fan perspective. — RSS: https://blog.markkulab.net/sports-weekly/feed.xml - [AI 國際新聞快報](https://blog.markkulab.net/en/category/world-news): A daily two-host briefing that makes sense of the past 24 hours in world news — geopolitics, the global economy, conflict and security, disasters and climate — from a Taiwanese perspective, neutral and fully sourced. — RSS: https://blog.markkulab.net/world-news/feed.xml - [地端 AI 實驗室](https://blog.markkulab.net/en/category/local-ai-lab): Every day, a two-host look at open-weight models and LoRAs you can actually run on your own machine: what they are for, whether your GPU can handle them, and how they compare — sourced from official model cards. — RSS: https://blog.markkulab.net/local-ai-lab/feed.xml - [AI 行銷日報](https://blog.markkulab.net/en/category/ai-marketing): Every day, two hosts break down the latest in AI for marketing, advertising, SEO/GEO and content marketing: practical, never sponsored, every story sourced. — RSS: https://blog.markkulab.net/ai-marketing/feed.xml - [AI 資安日報](https://blog.markkulab.net/en/category/ai-security): Every day, two hosts cover the latest where AI meets cybersecurity: LLM and AI agent vulnerabilities, prompt injection, model supply-chain risks and AI-powered attacks, from a defense-first angle with every story sourced. — RSS: https://blog.markkulab.net/ai-security/feed.xml ### Newsletter [Subscribe to the newsletter](https://blog.markkulab.net/en/subscribe) — Be the first to know about new posts. No spam, unsubscribe anytime.