Building an Autonomous Agent on an M1 Mac, by Choice
For about 3 months I've been running an autonomous agent — one that thinks up and writes its own social media posts and comments — unattended, 4 sessi…
Latest News
⚑ Report a ProblemTech news from the best sources
All topics
AI
Gear
News
Tech
agents
ai
api
architecture
automation
beginners
career
database
devchallenge
devops
discuss
javascript
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
react
security
showdev
tutorial
typescript
webdev
Popular open source AI developer tool Ollama raises $65M, grows to nearly 9M users
Benchmark-backed Ollama has amassed 176,000 stars, and nearly 17,000 forks on GitHub by helping developers easily run AI on their PCs.
Does a Second GPU Increase Ollama's Context Window? (Quadro P2000 + RTX 3090 Tested)
TL;DR Short version: no. I dropped a much older GPU ( Quadro P2000, 5GB, Pascal, 2016 ) next to an RTX 3090 (24GB, Ampere) on the same box, ran the sa…
LLM Quantization Levels Compared: Q4_K_M vs Q8_0 vs FP16 [2026]
Originally published at kunalganglani.com — read it there for inline code, hero image, and live links. LLM Quantization Levels Compared: Q4_K_M vs Q8_…
Running a Whole RAG Agent Offline: LangGraph + Ollama + Embedded Qdrant (Zero API Keys)
Most RAG tutorials open with "set your OPENAI_API_KEY ." This one doesn't need it. In Part 1 I claimed the LLM and embeddings are behind a swappable b…
Building a Local-First Voice Copilot for the Shell with HoldSpeak and Ollama
The Promise: A Private, Voice-Activated Shell The dream of a voice-activated command line is compelling: speak a command, see it executed. But for man…
I Built an AI Content Team That Posts to My Blog While I Sleep
I used to write blog posts the old way. Open a blank page. Stare at it. Write something. Rewrite it three times. Publish. Repeat every two weeks when …
Hermes-Crew Hybrid: A Hybrid Architecture for Secure Multi-Agent AI Workflows
Hermes-Crew Hybrid: A Hybrid Architecture for Secure Multi-Agent AI Workflows I built a hybrid system that combines a central orchestrator (Hermes) wi…
I Built a Private AI Brain on My Laptop for $0
Last week I couldn't shake an idea: what if I had an AI that knew everything I know ? Not ChatGPT — something on my hardware, holding my knowledge, an…
Giving Your Local LLM Safe Filesystem Access With Ollama Tool Use
A local LLM that can read your files is genuinely useful. A local LLM that can read your files without guardrails is a path-traversal bug with a chat …
I Replaced My $20/mo AI Tools With Local Models: My Full Stack
I was paying $20/mo for Copilot and reaching for the Claude API on every side project. Then I added it up. Copilot, a code-review SaaS trial, the occa…
How I fixed silent Ollama failures in my local AI Assistant
How I fixed silent Ollama failures in my local AI assistant Neo-AI is an offline assistant with episodic memory, running entirely on-device using Olla…
Open Notebook Review: Self-Hosted NotebookLM Alternative
Originally published on andrew.ooo — visit the original for any updates, code snippets that aged out, or follow-up posts. TL;DR Open Notebook (by Luis…
Doubling Qwen3.6-27B on One RTX 3090: ollama llama.cpp + MTP, Lever by Lever (35.7 80.2 tok/s)
A reader on my last post said Ollama was leaving a lot on the table — that a tuned backend with multi-token prediction (MTP) could roughly double my 3…
Fitting WhisperX large-v3 + a 24B LLM on one 3090: a reproducible context-capping recipe
This is the technical, reproducible version of a fix I shipped on my own homelab. If you want the narrative version, that's on Medium. This one is the…
Do You Have a Homelab? Secure Your Local LLM Artifacts
We used to build homelabs around Linux servers, Docker containers, and NAS drives. It was about uptime, RAID levels, and monitoring CPU temps. Now, th…
Local-first: a Model on Your Own Machine, Zero Cloud
This is the concrete, runnable walkthrough for Post 1 of the Portway series . The goal: stand up a single model behind an OpenAI-compatible endpoint o…
I Tried Building a Complex Security Tool with a 1.5B Local Model — Here's What Broke
Problem: I had aider running on Lubuntu, three API keys configured, a detailed architecture diagram, and a clear goal — build a modular forensic data …
Tesla P40 in a Homelab: 24GB of Inference on a Budget
The Tesla P40 is a seductive piece of hardware: 24GB of VRAM for a fraction of the cost of a modern RTX card. But after three weeks of fighting with i…
Building a Private RAG System: Lessons from a Local-First AI Journal
Most AI apps quietly send your data to the cloud. DiaryGPT does the opposite — and this is the full technical story. The Problem With AI + Private Dat…
Chat with your database in plain English — locally, for free
"What were our top 10 customers last quarter by revenue, as a bar chart?" DB-GPT translates that to SQL, runs it against your database, and renders th…
The simplest self-hosted RAG you'll ever set up (Apache 2.0, 20K stars)
Most RAG tools make you choose between simplicity and power. MaxKB doesn't try to be powerful — it tries to be simple, and it nails it. 20K+ GitHub st…
Gemma 4 wrote three summaries in one response. The middle one was a self-disclaimer.
The short version, in case the title was being coy: at num_ctx=2048 , Gemma 4 E2B produces three sequential outputs in a single response — a mostly-ha…
Ollama vs llama.cpp vs vLLM: Which Should You Use in 2026?
From the Best GPU for LLM archive. The canonical version has interactive calculators, an up-to-date GPU comparison table, and live pricing. Three tool…
CrawlForge v4.2.2: New CLI + 3 Tools for Local AI Scraping
Today we are shipping CrawlForge v4.2.2 , our biggest release since launch. It brings three new tools, a standalone command-line interface, and a quie…
Using Ollama with the Laravel AI SDK: Run Local LLMs for Free
Originally published at hafiz.dev API costs add up fast during AI development. You prompt an agent 50 times debugging a tool, that's 50 API calls. You…
I shipped local LLM features two months ago. Production never ran them once.
This is a submission for the Gemma 4 Challenge: Build with Gemma 4 Two months ago I shipped local-LLM features in TextStack — an open-source reader fo…
Ollama Models Explorer — a clean Next.js UI to browse and filter local LLMs
If you're running local LLMs through Ollama, finding the right model is annoying. The official model page scrolls forever, capability tags are inconsi…
No More Hallucinated Citations: A Domain-Specific RAG System with Ollama, ChromaDB and AI Agents
TL;DR: I built a full-stack knowledge pipeline around a corpus of 2,514 academic PDFs focused on urban art. The system combines ChromaDB vector search…
Local LLMs in 2026: What Actually Works on Consumer Hardware
Local LLMs in 2026 work on three hardware lanes: 32-core CPU with 64GB+ RAM hits 10-25 tokens per second on Qwen 3 14B, an RTX 4090 hits 30-80 tokens …