DeepSeek V4.1-Flash is a 763B-parameter open model under the MIT license, and Strata can run DeepSeek V4.1-Flash locally on a gaming PC with a 12 GB GPU. The catch is everything else: you need about 46 GB of RAM or more (64 GB is comfortable) and 239 to 274 GB of free NVMe disk. On Strata's own measurements a 12 GB card with 46 to 64 GB of RAM answers at roughly 4 to 10 tokens per second, with an 8K context by default and one request at a time. Fine for a question, slow for a long agent run. Strata's DeepSeek engine runs on Windows and Linux. Fair warning, we build a local-first AI coding tool, so we are not neutral.
DeepSeek put V4.1-Flash-1017 on Hugging Face on October 17. On October 23, IST Austria's DASLab published 2-bit builds; they passed 890,000 downloads in three days. On October 24, Strata, the same tool that runs Qwen3.8-Flash-Next on a gaming PC, added DeepSeek support, and a day later put it in its desktop app. This is the hands-on version: what the model is, what your PC needs, which size to pick, what speed to expect, how to install it, and where it falls short.
What is DeepSeek V4.1-Flash?
DeepSeek V4.1-Flash-1017 is an open-weights mixture-of-experts model from DeepSeek with 763.2B parameters, a 1M-token context window and an MIT license. It has 384 routed experts in each layer and uses 6 of them for each token. About 196.6B of those parameters are two “Engram” lookup tables, which the model reads a few rows at a time rather than multiplying through, and that is part of why it can run with most of itself on disk.
The 1017 update improved its agent scores over the first V4.1-Flash. These are DeepSeek-reported numbers:
| Benchmark (DeepSeek-reported) | V4.1-Flash-1017 | Previous V4.1-Flash |
|---|---|---|
| Terminal-Bench 4.0 (Claude Code harness) | 42.3 | 31.2 |
| DeepSWE v1.1 | 77.0 | 74.2 |
| ProgramBench | 29.1 | 20.3 |
Those are numbers for the model as released. Everything below runs a 2-bit version, so read the quality section before you trust them on your own code.
What hardware do you need?
A 12 GB GPU, about 46 GB of RAM or more, and 239 to 274 GB of free space on an NVMe drive. Strata splits the model across your machine: as many experts as fit go in graphics memory, the rest are computed on the CPU from RAM, and the Engram tables are read from the SSD a few rows per word. That last part is why the drive matters. A slow disk slows every word, so keep the model files on NVMe, not a hard drive or a USB disk.
- GPU: 12 GB is the floor Strata and DASLab both point to. Strata's DeepSeek engine ships for NVIDIA (CUDA) on Windows and Linux, plus a Linux build for AMD's Radeon AI PRO R9700 and RX 9070; Strata notes the RX 9070 build is untested and that AMD engines hang under WSL.
- RAM: 46 GB is the smallest Strata measured; 64 GB is comfortable. Under about 40 GB, Strata calls it untested and slow, warns you, and still installs.
- Disk: 239 GB for the smallest set, 257 GB for the recommended one, 274 GB for the largest. The 111 GB Engram file and an 8 GB drafter are shared by all three.
- Mac: Strata's DeepSeek engine packages are for Windows and Linux only. There is no Mac build of the DeepSeek engine.
Our VRAM calculator and GPU guide only get you part of the way here: for this model, check your RAM and your free NVMe space first.
Which size should you pick?
Pick the 2.00-bit set (IQ2_XXS) unless you are short on disk. All three are official builds from IST Austria's DASLab, each one assigning a different precision to each tensor based on how sensitive it is:
| Build | Disk (with Engram and drafter) | Quality vs the original (Strata's measurement) |
|---|---|---|
| IQ1_M, 1.75 bits | 239 GB | Perplexity +21%; code +8.9%, agent work +10.2%, plain prose much worse |
| IQ2_XXS, 2.00 bits (recommended) | 257 GB | Perplexity +15.5%; code +8.6%, agent work +5.3% |
| IQ2_XS, 2.25 bits | 274 GB | Perplexity +7.3%; code +3.2%, agent work +2.2% |
Higher perplexity means the compressed model is further from the original; lower is better. DASLab's own model card says the 2.00 build matches the base model on AIME25, GPQA-Diamond and LiveCodeBench v6, reaching 100% of its task average, and the 1.75 build gives up 1.2 points. The 1.75 build keeps 98.7%, the figure Strata quotes for it. DASLab measured these at reasoning effort 50, while Strata defaults to high (75), so treat “almost no loss on those three tests” as the honest summary. Those are reasoning and coding puzzles, not long agent sessions in your repo.
How fast is it?
Roughly 4 to 10 tokens per second on a 12 GB gaming GPU, by Strata's own measurements. Here is what Strata reports:
| Machine (Strata-measured) | Answer speed | Reading prompts |
|---|---|---|
| RTX 3060 12 GB, 46 GB RAM | 8 to 10 tok/s (code 9.9, agent work 7.8) | 149 tok/s at 8K |
| RTX 5070 12 GB, 64 GB RAM, 3.6 GB/s NVMe | about 4.7 tok/s | 121 to 231 tok/s |
| Four Radeon AI PRO R9700 (32 GB each) | about 48 tok/s (2.00) / 80 (2.25) | - |
Two things to read into that. First, the older RTX 3060 setup answered faster than the 5070 one. Strata does not break that down, but on a 12 GB card the engine keeps the experts it uses most in RAM and streams the rest from your SSD, so your CPU, RAM and drive matter as much as the card. Do not read it as a GPU ranking. Second, these are short-task speeds. At 4 to 10 tokens per second, a long answer with thinking turned on takes minutes, not seconds.
Strata 0.2.5 added a “Faster” mode that uses 5 of the model's 6 experts per word. It is the default on PCs with 16 GB of graphics memory or less, and Strata measured it 16% faster on an RTX 5070 for code and agent work, at a small quality cost. Choose “Full quality” if you would rather have all six.
How do you run DeepSeek V4.1-Flash locally?
Install Strata 0.2.5 or later, pick DeepSeek V4.1-Flash and the 2.00 size, and let it download. Strata's app has one installer per system and downloads the right engine for your graphics card on first start. The DeepSeek engine is a separate download that Strata fetches when you pick the model. If you work from a source checkout of Strata, the setup script takes the family and the size (with the installed Terminal, use strata launch instead):
./setup.sh --family deepseek41 --model IST-DAS-2.00bpwBefore anything big downloads, you can ask Strata where the model would go on your machine without changing anything:
strata launch --model ist-das-2.00bpw --planDownloads resume and are checked with SHA-256, and setup finishes by asking the model a 16-token test question. Loading takes a few minutes. If setup cannot place the dense weights on your card, it says so before downloading, so you find out early.
What about llama.cpp?
llama.cpp merged DeepSeek V4.1-Flash support on October 25, but Strata runs it with its own engine, and that is the setup with published numbers. Strata's strata-dsv41 engine is ported from Project Maya's DeepSeek engine and is a separate download from its Qwen engine. Mainline llama.cpp support is new; we have not seen published speed numbers, or confirmation that DASLab's files and their separate Engram file load on it, and DASLab's card still described llama.cpp support as missing when it went up. If you already live in llama.cpp, it is worth watching, but for a first run, Strata is the tested path.
How do you connect a coding tool?
Strata serves the model through the same API it uses for its other models: an OpenAI-compatible /v1/chat/completions endpoint and an Anthropic-style /v1/messages endpoint. It converts DeepSeek's own tool-call format into OpenAI tool_calls and Anthropic tool_use, so tools that expect either work. Thinking is on by default; send reasoning_effort: "none" to turn it off for quick answers. Our Qwen3.8-Flash-Next with Strata guide covers connecting tools to Strata in more detail.
Mind the context. Strata runs DeepSeek at 8,192 tokens by default, the size it was checked at; --context asks for more, untested. A coding agent's system prompt and tool definitions can take a large share of 8K before your code is even in it, so this setup suits focused questions and short tasks better than a long autonomous run across a big repo. In an agent tool, start in chat or Ask mode rather than a long Act run.
For Bodega One Code, add Strata as a Custom OpenAI-Compatible provider pointing at its endpoint; see BYOLLM. With air-gap mode on, Bodega One Code itself only talks to local addresses; note that Strata's own launcher checks GitHub and its update feed for engine updates. We have not benchmarked Bodega One Code with Strata's DeepSeek engine; it is the same endpoint any client uses, and that is all we are claiming.
What are the honest caveats?
It runs, but it is slow, short on context and heavy on disk.
- It is slow. 4 to 10 tokens per second is fine for a question and painful for a long agent run.
- 8K context by default. The model supports 1M, but Strata runs and checks it at 8K.
- One request at a time, no images. Strata's DeepSeek engine ignores parallel requests and vision for now.
- The disk bill is real. 257 GB for the recommended set, on NVMe.
- The scores are DeepSeek's, for the model as released. The 2-bit quality numbers above are Strata's and DASLab's own measurements.
- The speeds are Strata's. Nobody has published independent numbers yet, and the 3060 and 5070 results are not a like-for-like comparison.
When is the simpler choice better?
If you want speed or a long context, a smaller model that fits your GPU will serve you better day to day. On a 24 GB card, a dense model like Qwen3.8-27B or the new Nanbeige4.3-33B fits at 4-bit with room for context and answers much faster. If you have 32 GB of RAM rather than 64, Strata's Qwen3.8-Flash-Next setup is the lighter big-model option. For a fast small coding model on a 12 GB card, see our Mellum 2.1 guide, and for the weekly picture, What's new in local AI.
DeepSeek V4.1-Flash on Strata earns the setup when you want a 763B model on your own hardware and are willing to trade speed and disk for it. That it runs on a 12 GB card at all is the point. Just do not expect it to feel like a cloud model.
Sources
- DeepSeek V4.1-Flash-1017 model card (license, context, benchmarks): huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash-1017
- DASLab GSQ-RCO 2-bit builds (sizes, parameters, quality): huggingface.co/ISTA-DASLab
- Strata's DeepSeek guide (hardware, speeds, install, API, limits): github.com/Niko1221/Strata
- Strata 0.2.4 to 0.2.6 release notes: github.com/Niko1221/Strata/releases
- llama.cpp DeepSeek V4.1-Flash support, merged October 25, 2026: github.com/ggml-org/llama.cpp/pull/31086
Common questions
- Can I run DeepSeek V4.1-Flash on a gaming PC?
- Yes, with Strata, if you have a 12 GB NVIDIA GPU (or a Radeon AI PRO R9700 or RX 9070 on Linux), about 46 GB of RAM or more, and 239 to 274 GB of free NVMe disk. Strata runs DASLab's 2-bit builds, keeps as many experts as fit on the GPU, computes the rest on the CPU and reads the Engram tables from the SSD.
- How fast is DeepSeek V4.1-Flash on Strata?
- Strata measured about 8 to 10 tokens per second on an RTX 3060 12 GB with 46 GB of RAM, and about 4.7 tokens per second on an RTX 5070 12 GB with 64 GB of RAM. Four Radeon AI PRO R9700 cards reached about 48 to 80 tokens per second. These are Strata's own numbers and the two 12 GB runs were not like-for-like.
- Which DeepSeek V4.1-Flash size should I download?
- The 2.00-bit IQ2_XXS set (257 GB with the shared Engram file and drafter) is the recommended one; DASLab says it matches the base model on AIME25, GPQA-Diamond and LiveCodeBench v6. The 1.75-bit set saves disk (239 GB) but is weaker, especially on prose. The 2.25-bit set (274 GB) is closest to the original.
- Does llama.cpp support DeepSeek V4.1-Flash?
- llama.cpp merged DeepSeek V4.1-Flash support on October 25, 2026. Strata runs the model with its own strata-dsv41 engine instead, and that is the setup with published speed numbers so far.
- Can I use DeepSeek V4.1-Flash on Strata with a coding agent?
- Strata serves an OpenAI-compatible /v1/chat/completions endpoint and an Anthropic-style /v1/messages endpoint, and converts DeepSeek tool calls for both. The default context is 8,192 tokens, which an agent's system prompt and tools can largely use up, so it suits focused tasks better than long autonomous runs.
Written by the Bodega One team. We build Bodega One Code, the local-first AI IDE, and we write here about local models, AI costs, and what we learn shipping it. More about the team and why we build local-first on the about page.
Related posts
Keep learning
Free, vendor-neutral courses and guides in the Bodega One AI Academy, from what a model is to shipping an app.
Stay in the loop
Build-in-public updates, model picks, and Copilot/Cursor news as it breaks.
Follow @BodegaOneAI on X →Ready to own your tools?
Free to use, and the beta is open to everyone. Download free.