--- title: "🧪 A 9B Labeled as 14.6B Inference: SenseNova-Loop-9B-Preview Runs Its 24 Layers Twice | Local AI Lab" description: "A multimodal model officially labeled ~9B total parameters, yet its model card also lists ~14.6B inference parameters: it's called SenseNova-Loop-9B-Preview, with an HF trending score of 184, 1.5k downloads, and 187 likes. The same batch also includes Edge0's Audio8-TTS-Realistic-Air, a 0.6B TTS model whose trending score shot up to 231 with 7.3k downloads." canonical_url: "https://blog.markkulab.net/en/local-ai-lab/local-ai-lab-2026-11-02" author: "Mark Ku" author_url: "https://blog.markkulab.net/en/author/mark-ku" site: "Mark Ku's Tech Notes" date_published: "2026-11-02T02:00:00.000Z" category: "On-Premises AI Lab" tags: ["local-ai", "podcast", "地端模型", "lora", "開源模型", "SenseNova-Loop-9B-Preview", "Audio8-TTS-Realistic-Air", "多模態模型", "文字轉語音", "零樣本語音克隆", "循環式架構"] language: "en" license: "CC BY 4.0" license_url: "https://creativecommons.org/licenses/by/4.0/" attribution: "when reusing or quoting, credit the author and link back to the original" --- # 🧪 A 9B Labeled as 14.6B Inference: SenseNova-Loop-9B-Preview Runs Its 24 Layers Twice | Local AI Lab ## Opening An officially labeled ~9B total-parameter multimodal model whose model card simultaneously lists ~14.6B inference parameters. It's called SenseNova-Loop-9B-Preview, with an HF trending score of 184, 1.5k downloads, and 187 likes. The same cycle also brought Edge0's Audio8-TTS-Realistic-Air, a 0.6B TTS that shot up to a trending score of 231 with 7.3k downloads. Where exactly do those extra inference parameters come from, and why can a third-party GGUF squeeze down to 3.84 GB? We'll get to that. ## This Issue's Picks ### 1. SenseNova-Loop-9B-Preview: a looped multimodal model that runs the same weights twice **Source**: Local Model Radar (). The official News section lists a release date of 2026.10.30, reproduced here as written in the source; for the actual availability date, go by the HF page. - **What it is**: The official model card tags the task as image-text-to-text, i.e. a multimodal model that "takes images plus text and outputs text." License is apache-2.0, and weights are openly downloadable as safetensors. The architecture per the official card is a 32-layer multimodal decoder combining shared-weight looped computation, hybrid attention, and mHC, and it lists both ~9B total parameters and ~14.6B inference parameters. The official News positions it as a looped multimodal model for long-context and agentic workflows. - **Where you'd use it**: **(a) You want a local "throw a screenshot at it and ask" assistant, but the screenshots can't leave the building** What you have on hand are internal system UIs, error screens from a customer's admin panel, or unreleased design mockups. Sending those to a cloud API is a compliance problem. The official card gives a transformers `pipeline('image-text-to-text', ...)` snippet directly, meaning you can stand up a service on your own machine, paste in a screenshot, and ask "what does this error mean, what do I click next," and generate an explanation or next-step instructions without anything leaving your data center. **(b) A small team wiring up a self-hosted agent and needing a local inference backend** The official News itself positions this for long-context and agentic workflows, and the official card says deployment paths like LightLLM are ready. The mindstudio write-up adds that there are currently three routes available: Transformers, LightLLM, and an SGLang PR. If you're moving your agent's LLM backend from the cloud to local and the agent needs to actually read the screen (reading report charts, monitoring dashboards), a model positioned as "multimodal plus long context" belongs on the shortlist. **(c) People who want to understand how a looped transformer actually works** This one is especially useful if you give tech talks or run reading groups. The `modeling_sensenova_loop.py` update notes in the repo mention support for inspecting the Loop's hidden states and attention, meaning the team left you the hooks for taking it apart. If you want to do a teaching breakdown like "how does the attention distribution differ between the first pass and the second pass through the same layer," the material is already there. - **Can you run it**: To be clear up front, **the official model card does not state a VRAM threshold**, only that you should "use the deployment environment and configuration parameters in our documentation." So any claim about "runs on X GB of VRAM" is not officially backed. What we do have is file sizes: the HF files page shows the official weights as 8 safetensors shards totaling roughly 38.2 GB, plus an mtp.safetensors. Community quantization pages list separately: notfakerv's Q8_0 GGUF at about 14.03 GiB, webmp3's Q3_K_M at about 4.64 GB and Q2_K at about 3.84 GB, and annelo additionally publishing a Q4_K_M with an F16 vision projector. Two caveats. First, the GiB and GB units above are reproduced verbatim from each source page with no unit normalization, so when you do a "38.2 GB vs 3.84 GB" gap estimate, mind the unit difference yourself. Second, those GGUFs are all third-party repackages, not official artifacts, and this is an image-text-to-text model, so check each packaging page yourself for how complete vision-side support is in the llama.cpp ecosystem. Don't pull down Q4_K_M only to discover you've got text-only. Estimating from the specs (this is an estimate, not a measurement): at roughly 38.2 GB for the native safetensors, fitting the whole thing on a single consumer GPU is unlikely, so `device_map='auto'` offloading or just using a community quantization is the more practical route. - **Buzz this issue**: HF trending score 184, 1.5k downloads, 187 likes. Community repackages currently visible come from three groups: notfakerv (Q8_0), webmp3 (Q3_K_M, Q2_K), and annelo (Q4_K_M plus F16 vision projector). - **Versus comparable models**: Among open-source multimodal models in the 9B class, its differentiator is what the official card itself describes: "shared weights run twice." The mindstudio analysis says the 24-layer block from layer 4 to layer 27 runs twice with identical weights, i.e. B(B(h)). Line the three numbers up and it stops being confusing: 32 layers overall, which 1-indexed works out to roughly 3 front layers, the 24-layer loop block in the middle, then 5 trailing layers, with those middle 24 counted twice. That's why the card lists both ~9B parameters (the weights actually stored on disk) and ~14.6B inference parameters (the compute actually executed). The layer-range numbers come from mindstudio's description; check the repo code for the indexing convention. The same vendor's SenseNova-U1.5-8B-MoT-Preview takes a different route (Any-to-Any, 18B) and is positioned differently. - **How to get it**: The official card gives three paths directly: transformers' `pipeline('image-text-to-text', model='sensenova/SenseNova-Loop-9B-Preview', trust_remote_code=True)`, `AutoModelForCausalLM.from_pretrained(..., device_map='auto')`, and `docker model run hf.co/sensenova/SenseNova-Loop-9B-Preview`. The mindstudio write-up specifically notes that you must `trust_remote_code=True` when loading, otherwise it won't pull in the custom Loop model code bundled in the repo. If you want GGUF, follow the `llama serve -hf` command on the respective third-party pages. - **Link**: https://huggingface.co/sensenova/SenseNova-Loop-9B-Preview --- ### 2. Audio8-TTS-Realistic-Air: 0.6B config, Apache-2.0, officially claims zero-shot voice cloning **Source**: Local Model Radar (). - **What it is**: A text-to-speech model released by Edge0. The official card lists it as a 0.6B config, apache-2.0 licensed, with weights in safetensors. The official usage is the transformers text-to-speech pipeline: text in, audio out. The Realistic series model card says zero-shot voice cloning is supported, and litert-community's conversion page adds that "a single reference recording plus its matching transcript is enough to set the voice, and it can also speak with no reference audio at all." - **Where you'd use it**: **(a) Self-hosting a speech generation service and done paying per-character for cloud TTS** You're building a product that continuously generates speech, maybe an in-app read-aloud feature, maybe notification audio. Once volume climbs, the cloud TTS bill gets very noticeable. A 0.6B config plus apache-2.0 commercial use means you can move the whole thing back onto your own hardware, turning the cost from "dollars per million characters" into "the electricity for one GPU." **(b) Podcasters and tutorial video creators who want narration in their own voice** This is the most intuitive use of zero-shot voice cloning: record a reference clip, attach the transcript, and from then on, change one line of script and regenerate that segment without booking studio time again. The above comes from the Realistic series model card and the litert-community conversion page, not from measurements by this show. **(c) Teams producing multilingual support or tour-guide audio** The Realistic series card says 23 languages are supported, 12 more than Preview, which puts Preview at 11 (back-calculated from the source's "12 more"), with the additions including Thai, Vietnamese, and Indonesian. For teams working Southeast Asian markets, that language coverage is worth a look. The repo also already bundles a 44.1 kHz neural codec, and the team says you don't need to download a separate codec checkpoint, one less environment landmine. **(d) High-throughput batch audio generation** The official card points to the SGLang Omni adapter for GPU serving, telling you to use the `sglang_omni/configs/audio8_tts_0_6b.yaml` 0.6B config set and point the model path at this model or a downloaded snapshot. If you've got a few thousand lines to render at once, this is the route. - **Can you run it**: Again, laying it out plainly: **Air's own page does not state a VRAM threshold**, only that it's a 0.6B config. The model card for the same-family Audio8-TTS-Realistic-0.6b says "Python 3.10+ and one CUDA GPU recommended," and notes that the 0.6B refers to the main model, excluding the codec. Separately, one figure that is **self-described by its source as an estimate, not a measurement**: a third-party tokenstrom article estimates around 4 GB VRAM. That article itself notes this is an estimate rather than a measurement, and the vendor has not endorsed it, so treat it as a ballpark, not a spec. Estimating from the specs (again, an estimate): a 0.6B main model combined with the vendor only asking for "one CUDA GPU" means this size puts noticeably less strain on a typical dev box than the 38.2 GB beast in item one. Also, litert-community has converted Realistic-0.6b into a LiteRT Android build, showing people are pushing this size toward phones too. - **Buzz this issue**: HF trending score 231, 7.3k downloads, 249 likes, the higher-profile of this issue's two picks. Edge0 also shipped an HF Space Playground for listening. - **Versus comparable models**: Read these numbers carefully. Air's model card compares itself side by side with Audio8-TTS-Preview (both 0.6B), with Realistic Air listed at a CV3 error rate of 4.86% and MiniMax 5.89%. The source summary doesn't clarify whether the MiniMax column is a different test set or a different vendor's model, so for whether these two numbers are directly comparable, go by the original table on the official card. This show isn't going to rule on it. The other data point is MarkTechPost's coverage, which reports the same-series Realistic's CV3 error rate of 4.86% beating Qwen3-TTS-1.7B's 7.73% and VoxCPM2's 5.35%, while the same piece notes that the 4B-class Higgs TTS 3 still leads on both CV3 and MiniMax. In one line: Realistic 4.86% / VoxCPM2 5.35% / Qwen3-TTS-1.7B 7.73% (CV3 error rate, lower is better). All of the above are figures relayed from the model card and MarkTechPost, not measurements by this show. - **How to get it**: The official card gives `pipeline('text-to-speech', model='Edge0/Audio8-TTS-Realistic-Air', trust_remote_code=True)`, or `AutoModel.from_pretrained(..., trust_remote_code=True, device_map='auto')`. The card also says to check the Audio8 TTS repo for CLI inference, batching, and supervised fine-tuning, with the model path again set to `Edge0/Audio8-TTS-Realistic-Air`. If you'd rather not set up an environment first, there's an official Audio8 TTS Realistic Air Playground Space you can listen to. - **Link**: https://huggingface.co/Edge0/Audio8-TTS-Realistic-Air --- ## Closing Both picks this issue are apache-2.0 with directly downloadable weights, yet they point in opposite directions: on one side, SenseNova-Loop-9B-Preview "borrows" compute via shared weights to reach ~14.6B-class inference volume; on the other, Audio8-TTS-Realistic-Air compresses TTS down to 0.6B, with people even converting it to a LiteRT build for Android. If you need to prioritize, purely on objective criteria, Air's barrier is clearly lower: a 0.6B config, only one CUDA GPU required per the vendor, and an official Space where you can listen before deciding whether to pull it local. SenseNova-Loop-9B-Preview is more of a "note the architecture now, re-evaluate once the deployment paths (Transformers, LightLLM, SGLang PR) stabilize" situation. One more reminder: every capability, performance, and hardware figure in this episode is quoted from official model cards and source reporting. This show has not actually run either model. See you tomorrow. --- ## About this article and its author Originally published on [Mark Ku's Tech Notes](https://blog.markkulab.net/en/local-ai-lab/local-ai-lab-2026-11-02) License: [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) — when reusing or quoting, credit the author and link back to the original ### About the author **[Mark Ku](https://blog.markkulab.net/en/author/mark-ku)** — Software engineer - 10+ years as a software engineer - Built North-American e-commerce and AI SaaS subscription billing ### Free tools built by the author All of these are free to use: - [Free PDF Sign Tool](https://blog.markkulab.net/en/tools/pdf-sign): Online PDF sign tool — draw, type, or upload a signature, then drag, resize, and download. Everything runs in your browser; nothing is uploaded. - [VS Code Refactory](https://blog.markkulab.net/en/tools/refactory): Refactory is a VS Code refactoring extension: 34 actions plus a 37-rule code-smell inspection layer with a Code Health dashboard, across 18 languages, backed by 534 tests. It learns your repo's conventions: where interfaces live, where DI is registered, whether 'use client' belongs. It ranks files by git churn × complexity so you know what to fix first, and hands any smell to the Claude Code already on your machine. Free to use, and your source never leaves your computer. - [DB-Kit Database Manager](https://blog.markkulab.net/en/tools/db-kit): DB-Kit is a lightweight, cross-platform database manager built with Tauri + Rust + React. Manage MySQL, MariaDB, PostgreSQL, SQL Server, Oracle, SQLite, MongoDB, Redis, Kafka, Elasticsearch and RabbitMQ from one consistent interface: passwords encrypted in the OS keychain, SSH tunnels, full CRUD, a visual query builder, stacked multi-statement result sets, cross-connection data transfer, schema & data compare with sync SQL and schema snapshots, Excel / CSV import & export, visualized execution plans, ER diagrams, scheduled backups, SQL stress testing with p50–p99 latency percentiles, a 15-rule SQL review engine, Review & Run (AI review plus per-statement backups and an auto-generated rollback script), Kafka message browsing with monitoring & alerts, an SSH terminal with SFTP / FTP, Docker / Kubernetes, remote desktop (RDP / VNC / RustDesk), file / folder compare, stored procedure integration tests, six UI languages, a built-in AI assistant (a local CLI or any Anthropic / OpenAI-compatible API; natural-language SQL, AI review and tuning advice) and the dbk CLI. Free and open source (MIT), with installers for Windows, macOS and Linux. - [VS Code Super Mermaid](https://blog.markkulab.net/en/tools/super-mermaid): Super Mermaid is a VS Code extension for beautiful Mermaid diagrams out of the box: auto-colored live preview, mouse pan & zoom, high-res PNG / SVG export, 21 templates and multiple themes. Free and open source (MIT). - [React Super Mermaid](https://blog.markkulab.net/en/tools/react-super-mermaid): react-super-mermaid is an open-source React component library: render beautiful Mermaid diagrams with a single , with built-in colorful / sketch themes, pan & zoom, in-diagram search, and high-res SVG / PNG export. Lightweight, SSR-safe, fully typed. Free and open source (MIT). - [Jira / Confluence Super Mermaid](https://blog.markkulab.net/en/tools/jira-super-mermaid): An Atlassian Forge app: write Mermaid syntax directly inside a Jira issue or a Confluence page and get flowcharts, sequence diagrams, state machines and Gantt charts. 11 diagram types, SVG / PNG export, light and dark themes, full CJK support. Runs on Atlassian: your diagrams live in your own site and the app calls no third-party service. Free, coming soon to the Atlassian Marketplace. - [Mermaid Live Preview](https://blog.markkulab.net/en/tools/mermaid-preview): Write Mermaid in your browser, see it render instantly, and share the whole diagram as a single link. No sign-up, nothing uploaded to a server, and mermaid.live share links work as-is. - [React Intl Phone Number](https://blog.markkulab.net/en/tools/react-intl-phone-number): react-intl-phone-number is an open-source React component: framework-agnostic and antd-free, with E.164 in/out, a searchable flag / country-code dropdown, configurable validation levels (strict / mobile-strict / loose), themeable CSS, and i18n — phone logic powered by google-libphonenumber. Lightweight and fully typed. Free and open source (MIT). - [Uptime Kuma Cluster](https://blog.markkulab.net/en/tools/uptime-kuma-cluster): Turn single-node Uptime Kuma into a highly available cluster: OpenResty + Lua smart load balancing, shared MariaDB state, health checks and automatic failover, plus cluster-management REST APIs. One Docker Compose command to start. Free and open source (MIT). - [AI Podcast Cut](https://blog.markkulab.net/en/tools/ai-podcast-cut): Drop in a recording and it removes fillers and stutters, levels loudness segment by segment, and sends a second agent to review every cut. Cut points snap to word boundaries and zero crossings, every splice gets a fade, and sentence-end breaths are preserved. Desktop app for Windows, macOS and Linux. MIT licensed; the Windows installer bundles ffmpeg. - [AI Video Cut](https://blog.markkulab.net/en/tools/ai-video-cut): Pick something in your video: type it (face, license plate, phone screen, logo), click points or drag a box, or let Claude Code / Codex pick it. AI Video Cut tracks it frame by frame, then mosaics or blurs it, recolors it, pins stickers and text to it, swaps a screen or poster for your own image or video, or removes it using background that other frames actually captured. Plus sequence editing, local captions and an AI assistant. Free, open-source (MIT) Windows desktop app (macOS / Linux experimental) that runs locally, nothing uploaded. - [open-pos restaurant POS](https://blog.markkulab.net/en/tools/open-pos): One computer and one receipt printer is enough to open the shop. Your data lives on your own disk, no subscription, no lock-in, MIT licensed. Money is integer New Taiwan dollars with tax split by the statutory formula, so sales + tax always equals the total. Printing goes straight over ESC/POS on TCP 9100, with no vendor driver. Tauri + Rust + SQLite desktop app, v1.0 in development. - [.NET e-commerce API template](https://blog.markkulab.net/en/tools/dotnet-ecommerce-api): An e-commerce backend API template built on .NET 10: Controller → Service → Repository layering, Autofac convention-based registration, SqlSugar for MySQL / MariaDB and SQL Server, Redis cache and message queue, Hangfire jobs, JWT auth, and an extensible payment provider module (ECPay, Newebpay). Apache 2.0. - [Open Token Monitor team AI usage](https://blog.markkulab.net/en/tools/open-token-monitor): Collect token usage and equivalent cost from every employee's AI coding tools into a hub you host yourself: PostgreSQL, org roster, dashboards compared by company and department, and a reports API. Electron and Rust/Tauri clients upload every 30 minutes. MIT licensed, one Docker command. - [ai-security-monitor defensive security](https://blog.markkulab.net/en/tools/ai-security-monitor): Your website is live. Who checks its certificates, security settings and known vulnerabilities? A self-hosted Security Hub brings website scans and host monitoring together, deduplicates findings and compares scans after fixes. ### Daily podcasts - [Mark's Tech Insights — Daily AI News](https://blog.markkulab.net/en/category/tech-news): Daily curated AI and tech trends. Catch the latest developments via audio summaries — covering AI applications, software architecture, DevOps, and engineering practice. — RSS: https://blog.markkulab.net/feed.xml - [AI股市蝦聊](https://blog.markkulab.net/en/category/ai-stock-chat): Every trading day, an AI-analyzed take on the Taiwan stock market, delivered as a two-host conversation covering the session and the next-day outlook. — RSS: https://blog.markkulab.net/ai-stock-chat/feed.xml - [開源好物日報](https://blog.markkulab.net/en/category/open-source-weekly): A daily two-host pick of free open-source tools surfaced from real Hacker News, GitHub, and Reddit buzz — what pain they solve and the fastest way to get started. — RSS: https://blog.markkulab.net/open-source-weekly/feed.xml - [AI 運動日報](https://blog.markkulab.net/en/category/sports-weekly): Two hosts talk NBA, MLB and world sport every day — scores, records and the stories behind them, from a Taiwanese fan perspective. — RSS: https://blog.markkulab.net/sports-weekly/feed.xml - [AI 國際新聞快報](https://blog.markkulab.net/en/category/world-news): A daily two-host briefing that makes sense of the past 24 hours in world news — geopolitics, the global economy, conflict and security, disasters and climate — from a Taiwanese perspective, neutral and fully sourced. — RSS: https://blog.markkulab.net/world-news/feed.xml - [地端 AI 實驗室](https://blog.markkulab.net/en/category/local-ai-lab): Every day, a two-host look at open-weight models and LoRAs you can actually run on your own machine: what they are for, whether your GPU can handle them, and how they compare — sourced from official model cards. — RSS: https://blog.markkulab.net/local-ai-lab/feed.xml - [AI 行銷日報](https://blog.markkulab.net/en/category/ai-marketing): Every day, two hosts break down the latest in AI for marketing, advertising, SEO/GEO and content marketing: practical, never sponsored, every story sourced. — RSS: https://blog.markkulab.net/ai-marketing/feed.xml - [AI 資安日報](https://blog.markkulab.net/en/category/ai-security): Every day, two hosts cover the latest where AI meets cybersecurity: LLM and AI agent vulnerabilities, prompt injection, model supply-chain risks and AI-powered attacks, from a defense-first angle with every story sourced. — RSS: https://blog.markkulab.net/ai-security/feed.xml ### Newsletter [Subscribe to the newsletter](https://blog.markkulab.net/en/subscribe) — Be the first to know about new posts. No spam, unsubscribe anytime.