Open Source
⚑ Report a ProblemLatest Open Source news from Tech News
Building a Distributed GPU Cluster for LLM Inference on Idle Apple Silicon Macs
A single M2 Max Mac Studio can serve 8‑token‑per‑second Llama‑2‑7B inference, yet most developers leave that compute idle overnight. ## Inventory an…
Perseus: A Fail-Slow Detection Framework for Cloud Storage Systems (2023)
Abstract: The newly-emerging “fail-slow” failures plague both software and hardware where the victim components are still functioning yet with degra…
Kafka Partitions and Consumer Groups: How to Prevent Head-of-Line Blocking
Apache Kafka is celebrated for its incredible horizontal throughput, capable of streaming millions of messages per second. Yet, many engineering tea…
Treat Tool Intent as a Deduped Outbox Before Planner Retries Double-Commit
Last Tuesday I sat with a sequence dump that looked successful until I counted the tickets twice. The planner had asked for one incident record, and…
Treat Client Timeout as an In-Doubt Lease Before You Replay Shared Tool Calls
Last Tuesday I sat with a planner log that looked almost boring until I lined up two clocks. The client aborted a tool call at thirty seconds, then…
Squalk: an old-school forum engine built on Nostr (NIP-29 groups, NIP-7D threads)
I miss classic forums: slow, asynchronous threads that stay readable and searchable for years, instead of knowledge dissolving into chat scrollback.…
"The write was acknowledged" means less than you think
I spent years operating databases for payment platforms, where a lost write isn't a bug, it's a regulatory conversation. That environment teaches yo…
Wetask Is Opening Its Task Runtime to External Workers
Wetask's next update brings durable, fenced external workers, atomic batch settlement, and first-party Go, TypeScript, and Python clients. Wetask st…
Edge Computing Middleware: Securing and Scaling Distributed Architectures
Originally published on tamiz.pro . The proliferation of IoT devices, 5G networks, and real-time data processing demands has catalyzed a significant…
Building Resilient Real-Time Systems: A Deep Dive into WebSockets and Redis
Originally published on tamiz.pro . Real-time systems are no longer a luxury but a fundamental expectation in modern web applications, from collabor…
Distributed AI in Action: Deploying and Optimizing Mesh LLM on iroh for Scalable Machine Learning
Originally published on tamiz.pro . The proliferation of Large Language Models (LLMs) has pushed the boundaries of what's possible in AI, yet their…
Designing a Rate Limiter: Token Bucket vs Sliding Window, and Making It Distributed
A rate limiter answers one question on every request: has this client made too many calls, and should I reject this one? It sounds trivial until you…
Ursula: thread-per-core, multi-Raft Rust runtime for HTTP event streams
Hi folks, I just open-sourced Ursula, a self-hosted, multi-node server for HTTP event streams built on ElectricSQL's Durable Streams Protocol. Archi…