Your local RAG isn't slow — it re-reads every document on every question
A user opens a project with nine files in it, types the most obvious question anyone types at a document app — "what are these documents about?" — a…
Latest News
⚑ Report a ProblemTech news from the best sources
All topics
AI
Gear
News
Tech
agents
ai
api
architecture
automation
beginners
career
database
devchallenge
devops
javascript
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
react
security
showdev
testing
tutorial
typescript
webdev
LLMs on Consumer Hardware — Part 4: The Coordinator Search — Role-Casting and the Memory Wall
Part 4 of a series. Previously: Part 3 — A Multi-Agent Setup with Hermes . Part 3 ended on a specific failure: Gemma 4 26B, the best of the local mo…
LLMs on Consumer Hardware — Part 1: The Stack and First Benchmarks
This is the first in a series of build-log posts documenting a local LLM project, in which models are run on owned consumer hardware rather than thr…
LLMs on Consumer Hardware — Part 2: Prefill and the Failure of the AI PC
Part 1 established the hardware, the runner, and the primary model. This entry covers what governs inference on that hardware — the two phases of in…
Running LLMs Locally on Consumer Hardware — Part 1: The Stack and First Benchmarks
This is the first in a series of build-log posts documenting a local LLM project, in which models are run on owned consumer hardware rather than thr…