How to Tune llama.cpp --n-gpu-layers: A Practical VRAM Guide (2026)
You already know what --n-gpu-layers does. It moves transformer layers onto your GPU. This post is the next step: how to actually pick the number. If …
Latest Web news from Tech News
All topics
AI
agents
ai
api
architecture
automation
aws
beginners
career
claude
database
devchallenge
devops
javascript
learning
linux
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
react
security
showdev
tutorial
typescript
webdev
Fitting WhisperX large-v3 + a 24B LLM on one 3090: a reproducible context-capping recipe
This is the technical, reproducible version of a fix I shipped on my own homelab. If you want the narrative version, that's on Medium. This one is the…
Run Cursor with a Local Model: Privacy-First AI Coding Without a Subscription
This article was originally published on runaihome.com If you write code for a living, your IDE is now an AI agent — Cursor, GitHub Copilot , Claude C…
We pre-registered, ran, and verified the macro ablation: information per joule, measured
Maker disclosure: I build Macrokit (Apache-2.0, fully open). This is the data, not a pitch — links and the raw runs at the end. The multi-model benchm…
[Day 9] A local Japanese sentiment AI (BERT) read 8 years of a LINE chat, and the ups and downs surfaced from numbers alone
Intro Day 9. Today is less about model internals and more of a personal experiment: have a local AI analyze the entire chat history with one LINE frie…
[Day 7] Does Giving an AI More 'Thinking Time' Really Make It Smarter? Training an OpenMythos-Style Mini Model on DGX
[Day 7] Does Giving an AI More "Thinking Time" Really Make It Smarter? Training an OpenMythos-Style Mini Model on DGX Intro Day 7! Reddit kept surfaci…
OpenClaw: 13 Errors, $1.50/Month, and an AI Team That Doesn’t Need the Cloud
I run a team of AI agents on a Mac I bought in 2022. They handle my Slack, run research, draft content, monitor infrastructure, and spawn sub-agents f…
SpeakShift: A Fully Local Desktop App Powered by Whisper.cpp + NLLB + FFmpeg
SpeakShift: Fully Local Whisper.cpp + NLLB Translation + FFmpeg Media Converter Hi DEV Community 👋 Like many of you, I spend a lot of time working wit…
Choosing the Right Local AI Stack for SOC Alert Triage: Model, Engine, and Harness
Choosing the Right Local AI Stack for SOC Alert Triage: Model, Engine, and Harness Practical guidance for cybersecurity engineers who want local AI to…
Localmaxxing isn't theory. Here's what my 3-GPU rig actually does.
Tom Tunguz wrote a post this week called Localmaxxing . His thesis: open-weight models on prosumer hardware now match cloud-tier quality for a sliver …
TextGen vs LM Studio: Picking a Local LLM Runner in 2026
I've been running local LLMs on my workstation for about two years now. Started with llama.cpp raw on the command line, moved to LM Studio when I want…
Local LLMs in 2026: What Actually Works on Consumer Hardware
Local LLMs in 2026 work on three hardware lanes: 32-core CPU with 64GB+ RAM hits 10-25 tokens per second on Qwen 3 14B, an RTX 4090 hits 30-80 tokens …
[Day 3] I Had a Local LLM Analyze a Year of My Credit Card Statements
[Day 3] I Had a Local LLM Analyze a Year of My Credit Card Statements Intro Day 3: I'm going to hand a year of credit card statements over to a local …
[Day 2] I Trained an AI on 22 Photos of My Cat — Now It Draws Her in Any Scene
[Day 2] I Trained an AI on 22 Photos of My Cat — Now It Draws Her in Any Scene So, yesterday I generated "some cat" Day 1 ended with "I made my DGX dr…
[Day 1] DGX Spark Came Home — I Made It Draw a Cat
[Day 1] DGX Spark Came Home — I Made It Draw a Cat So... what is "local LLM" again? Honestly, I'm still figuring out what "local LLM" even means. But …