Do Drafters Work on Small Models? Gemma 4 E2B and E4B on Two Small GPUs
This article provides a step by step guide to serving Gemma 4 E2B and E4B with Google's QAT assistant drafters through llama.cpp's speculative decod…
Architecture
⚑ Сообщить о проблемеПоследние новости Architecture от Tech News
Все темы
agents
ai
api
architecture
automation
aws
backend
beginners
career
database
devchallenge
devops
javascript
llm
machinelearning
mcp
news
opensource
performance
productivity
programming
python
react
security
showdev
softwareengineering
systemdesign
tutorial
typescript
webdev
Kaniko's Performance Gap Narrows: Outdated 2018 Benchmarks Mislead, Recent Updates Close BuildKit Speed Divide
Introduction: Reassessing the Kaniko-BuildKit Performance Gap A 2018 benchmark comparison labeled kaniko as 15 times slower than BuildKit , a result…
Memory efficiency: bytes per key
Part 5 of 7 · ← Latency under load · Next: Operational simplicity → Part 5. The shortest post in the series, and the least arguable number in it — b…
Same Model, 13.3% to 38.3%
Two API settings. Same model. Same benchmark. Same task set. 13.3% to 38.3%, using one sixth the output tokens. OpenAI published that result about G…
I benchmarked 5 managed graph databases — and the "obvious" winner changed depending on what I measured
I benchmarked 5 managed graph databases — and the "obvious" winner changed depending on what I measured The setup I was asked to benchmark CognoDB C…
Last night we entered a memory benchmark against Tencent and Mem0. The score isn't back yet - and I'm publishing it either way.
Last night, my AI partner and I built a memory system from scratch, tested it about forty different ways, deployed it to the edge, and submitted it…
DeepSeek Harness: What "Everything is a Plugin" Actually Means for Agent Frameworks
DeepSeek released Harness into developer preview yesterday — MIT license, source on GitHub, and a claim that "everything is a plugin." I spent some…
Native HTTP Engine for Node: Performance Benchmarks Against uWS, Bun, Fastify, and Hono
Overview A native HTTP engine for Node.js has been developed with the goal of providing a faster, built-in alternative to the standard node:http mod…
Correctness Has a Price: We Benchmarked Fair Leaderboards
Engineering posts often end with: The new design is correct, scalable, and fast. Fast compared with what? When we changed Podium so tied players ran…
Benchmarking Apple's SpeechAnalyzer API vs. Whisper: Performance, Accuracy, and Use Cases
Originally published on tamiz.pro . Introduction With voice interfaces becoming ubiquitous in applications from virtual assistants to transcription…
Google Said It Had Native Function Calling. I Tested It.
Google released Gemma 4 E4B with a specific claim: native function calling. "Enhanced coding and agentic capabilities," the model card said. "Native…
Why I spun my benchmark into its own repo (and why every dev tool with a benchmark should)
This week I shipped a benchmark for code-intelligence MCP servers and posted the results — including the cases where my own tool lost. Within 36 hou…