Flash Onyx 2.2: teaching a local model law and game feel
(I know, ANOTHER Onyx post) Flash Onyx is the model line behind FLASH , the local-first agent shell I work on. Onyx 2 is gemma4 with a system prompt…
Latest News
⚑ Report a ProblemTech news from the best sources
All topics
- игры
AI
Gear
News
Tech
agents
ai
api
architecture
automation
beginners
career
database
devops
javascript
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
react
security
showdev
testing
tutorial
typescript
webdev
Moving Scheduled LLM Curation from Cloud APIs to Local Models
Scheduled LLM curation is the least glamorous agent workload you run. A cron job wakes up at 3am, reads a pile of memory, asks a model to dedupe it,…
Nine ways to talk to a local model
A nine-tool survey of local-model interfaces on one GPU: what worked, what silently failed, and why what sits between you and the model matters more…
Moving Half of Our AI Development to Local LLMs — by Splitting Work by Role, Not by Picking the Biggest Model
Uehara, EarthLink Network Co., Ltd. I build and run more than 20 products by myself, with Claude Code at the core of development. This is a field no…
Teaching a Local AI Agent to Search the Web (Without Lying to You)
Back in early May, someone on the team said something like "let's just add web search, shouldn't take more than a day." Three months and roughly twe…
Why My Local Coding Agent Could Act but Couldn't Finish
There was a month where I blew through my token budget without noticing. Claude Code and Codex, running most of the day, on a codebase I was explori…
local-llm: A Field Report on Running SOTA Models on Your Own Hardware
The most useful thing in jamesob/local-llm is not the GPU shopping list. It is the fifteen or so BIOS settings, kernel flags, and PCIe hacks that st…
Qwen 3.6 27b на 8-12gb vram в llama.cpp до 256к контекста
Вышло 2 модели prism-ml/Ternary-Bonsai-27B-gguf и prism-ml/Bonsai-27B-gguf Модели представлены в 2-битном и 1-битном вариантах и занимают всего 7,2…
LLM Quantization Levels Compared: Q4_K_M vs Q8_0 vs FP16 [2026]
Originally published at kunalganglani.com — read it there for inline code, hero image, and live links. LLM Quantization Levels Compared: Q4_K_M vs Q…
Local AI Agent Browser Extension: Hermes in 120ms
This article was originally published on BuildZn . Everyone's talking about connecting AI to the web, but nobody tells you how to do it privately, w…
Cool AI Projects That Failed: The File Integrity Gap
We ship tools that verify software artifacts. We deal with hashes, checksums, and provenance every day. But looking at the local AI landscape, there…
How to Tune llama.cpp --n-gpu-layers: A Practical VRAM Guide (2026)
You already know what --n-gpu-layers does. It moves transformer layers onto your GPU. This post is the next step: how to actually pick the number. I…
Fitting WhisperX large-v3 + a 24B LLM on one 3090: a reproducible context-capping recipe
This is the technical, reproducible version of a fix I shipped on my own homelab. If you want the narrative version, that's on Medium. This one is t…
Мой опыт с ИИ в России глазами европейца
Это история о том, как я собрал полностью локальную ИИ-среду разработки (и почему вам стоит сделать то же самое). Переезд из Евросоюза в Москву каза…
Run Cursor with a Local Model: Privacy-First AI Coding Without a Subscription
This article was originally published on runaihome.com If you write code for a living, your IDE is now an AI agent — Cursor, GitHub Copilot , Claude…
We pre-registered, ran, and verified the macro ablation: information per joule, measured
Maker disclosure: I build Macrokit (Apache-2.0, fully open). This is the data, not a pitch — links and the raw runs at the end. The multi-model benc…
[Day 9] A local Japanese sentiment AI (BERT) read 8 years of a LINE chat, and the ups and downs surfaced from numbers alone
Intro Day 9. Today is less about model internals and more of a personal experiment: have a local AI analyze the entire chat history with one LINE fr…
[Day 7] Does Giving an AI More 'Thinking Time' Really Make It Smarter? Training an OpenMythos-Style Mini Model on DGX
[Day 7] Does Giving an AI More "Thinking Time" Really Make It Smarter? Training an OpenMythos-Style Mini Model on DGX Intro Day 7! Reddit kept surfa…
OpenClaw: 13 Errors, $1.50/Month, and an AI Team That Doesn’t Need the Cloud
I run a team of AI agents on a Mac I bought in 2022. They handle my Slack, run research, draft content, monitor infrastructure, and spawn sub-agents…
SpeakShift: A Fully Local Desktop App Powered by Whisper.cpp + NLLB + FFmpeg
SpeakShift: Fully Local Whisper.cpp + NLLB Translation + FFmpeg Media Converter Hi DEV Community 👋 Like many of you, I spend a lot of time working w…
Choosing the Right Local AI Stack for SOC Alert Triage: Model, Engine, and Harness
Choosing the Right Local AI Stack for SOC Alert Triage: Model, Engine, and Harness Practical guidance for cybersecurity engineers who want local AI…
Localmaxxing isn't theory. Here's what my 3-GPU rig actually does.
Tom Tunguz wrote a post this week called Localmaxxing . His thesis: open-weight models on prosumer hardware now match cloud-tier quality for a slive…
TextGen vs LM Studio: Picking a Local LLM Runner in 2026
I've been running local LLMs on my workstation for about two years now. Started with llama.cpp raw on the command line, moved to LM Studio when I wa…
Local LLMs in 2026: What Actually Works on Consumer Hardware
Local LLMs in 2026 work on three hardware lanes: 32-core CPU with 64GB+ RAM hits 10-25 tokens per second on Qwen 3 14B, an RTX 4090 hits 30-80 token…
[Day 3] I Had a Local LLM Analyze a Year of My Credit Card Statements
[Day 3] I Had a Local LLM Analyze a Year of My Credit Card Statements Intro Day 3: I'm going to hand a year of credit card statements over to a loca…
[Day 2] I Trained an AI on 22 Photos of My Cat — Now It Draws Her in Any Scene
[Day 2] I Trained an AI on 22 Photos of My Cat — Now It Draws Her in Any Scene So, yesterday I generated "some cat" Day 1 ended with "I made my DGX…
[Day 1] DGX Spark Came Home — I Made It Draw a Cat
[Day 1] DGX Spark Came Home — I Made It Draw a Cat So... what is "local LLM" again? Honestly, I'm still figuring out what "local LLM" even means. Bu…