Exponential backoff with jitter: 64 of 100 LLM calls still failed
Originally published at tensorust.com . TL;DR: I fired 100 LLM calls at once into a rate limiter that refills 10 requests a second, using the defaul…
Open Source
⚑ Report a ProblemLatest Open Source news from Tech News
All topics
AI
agents
ai
api
architecture
automation
backend
beginners
career
database
devchallenge
devops
discuss
javascript
linux
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
react
security
showdev
testing
tutorial
typescript
webdev
Saku: How I Went From Per-Line KV to 8M Writes/sec in One Week (While Learning C++)
Initial scope was simple: just make it fast. No fsync, no fancy durability. Just raw speed. I was bored. Asked AI "what should I build in C++?" It s…
34.8k Stars Won't Put GTA VI on Your PC. Here's What AnyPS5 Is Actually Doing
Seeing GTA VI run on a PC before the official port would be a spectacular way to end the console exclusivity argument. So a project that promises to…
SLX RadioTwin: industrial radio propagation studies with C++ and Qt
Silicon LogiX introduces SLX RadioTwin , a desktop demonstrator for studying radio propagation in a three-dimensional industrial plant. The project…
[Перевод] Генератор парсеров ISPA
Этот пост написан для тех, кто глубоко погружён в разработку компиляторов или DSL, часто сталкивается с задачами парсинга, строит сложные конфигурац…
The Flush Printed a View After the Owner Died
A green debug run does not prove a view owns its bytes. Release can reuse that stack slot before the flush reads it. I start every split-brain crash…
Build the Patch as a Stranger: A Consumer-Link Gate for C++ Codegen
A packaging job can fail on a Thursday morning while the eval board stays green. In that pattern, the candidate patch repairs normalize() inside one…
UE5 Shader Optimization: Materials, Custom HLSL, and Global Shaders with RDG
When a material graph grows in Unreal Engine 5, it is tempting to ask: would writing HLSL directly make it faster? Would implementing the shader in…
Implementing Strict Priority and Deficit Round Robin Schedulers in NS-3
Stack: NS-3 · C++ · nlohmann/json · Wireshark When a router's outgoing link is slower than the traffic arriving at it, packets wait in a queue, and…
GEONMI-MEMS VLEO: How We Reduced Satellite Launch Weight by 40% Using Aero-Ionic Energy Harvesting and Deterministic C++17
Operating in Very Low Earth Orbit (VLEO, at an altitude of approximately 250 km) offers superior latency and exceptional image clarity, yet it faces…
Porting Cowboy Casino to VileEngine
I am moving Cowboy Casino into VileEngine, the C++ engine I use for retro games. Cowboy Casino is a small role-playing game about walking into a wil…
The rules I build by
New here? Start with the overview . Before the rules, a debt. These are not mine alone; they are the labor of a whole career, and every one of them…
Building a MIL-STD-188-110 HF Modem in Modern C++: An Introduction
A weekly deep dive into a fixed-frequency serial-tone waveform, one block at a time. High-frequency (HF) radio is the communications system that ref…
Building the Capsize Audio Visualizer with C++ and Qt
I keep coming back to the Capsize Audio Visualizer because it is small enough to finish. It is a C++ and Qt desktop application that turns live audi…
Pointers Aren't Arrows. How C and C++ Actually Talk to Hardware.
Ask any software engineer to draw a pointer on a whiteboard. Within three seconds, they will sketch two boxes and a little curved arrow pointing bet…
DSCI pipeline to build c++ project using cmake
📁 Repository layout . ├── .dsci/ │ ├── jobs.yaml # pipeline definition │ └── build_job/ # ── Job 1 – Build & package │ ├── config.yaml # default…
In 2018 I hand-wrote a C++ deep learning framework so I'd never pad a batch. In 2023 LLM serving landed on the same structure.
There's a sentence in the README of a library I wrote that I've been thinking about lately: "To summarize, we believe that Padding-free Dynamic Batc…
Two Locks on a Green Build: Prompt Hashes and RSS Caps for AI C++ Evals
A patch landed with every assertion green. The return values matched the golden file. Then a latency dashboard moved: an inner loop that once touche…
I could not understand Express, so I wrote my own
Middleware chaining made no sense to me, so I rebuilt it in C++. A year later the profile said the slowest thing in my server was a map I rebuilt on…
I built IMFMSynth - 8-op FM x Wavetable Synthesizer
Hi everyone! This is Kaito Sato, an independent developer of IMFMSynth from Japan. I love FM synthesis. I grew up listening to everything from video…
Same nvJPEG2000, different numbers: timer boundaries and frames in flight
This is an excerpt from a longer write-up, Fastvideo JPEG2000 vs nvJPEG2000 on NVIDIA RTX 4090 , which compares two GPU JPEG2000 codecs at the same…
When should a QWidget animation stop its timer?
A decorative animation can sit outside a scroll viewport while its widget still reports isVisible() == true . A timer that only checks that property…
Store Load Reordering: x86 vs ARM64, and the Bug Intel Was Hiding
Here is a bug report that keeps recurring, in different words, every time a team moves to ARM: "the same code works on our Intel CI and on the devel…
C++ Input Doesn't Have to Be Complicated: Word vs. Line Input with EasyIn
If you're learning C++, one surprisingly common source of confusion is input. Why does this: std :: cin >> text ; only read one word? Why does…
Nimmake — The Blazing-Fast Build Tool Built for Embedded Development
🚀 Nimmake — The Blazing-Fast Build Tool Built for Embedded Development Say goodbye to complex Makefiles. Embrace a modern MCU build experience. Nimm…
C++ isn't losing to Rust. The infra it runs is the moat.
Rust wins in any online debate. However, C++ is the one that wins in reality and gets shipped. When I saw ThePrimeagen arguing about Rust versus C++…
Semantic Search in C++ without Python, libtorch or ONNX Runtime
Ask how to run a transformer model from C++ and you get two answers: link libtorch, or convert the model and link ONNX Runtime. Both work. Both are…
The Map Dropped a Key When Two Expiry Times Matched
A C++ map can drop a live cache entry. One <= in a comparator is enough. I forced a timestamp tie and watched a key vanish. Would you have caught…
No one asked, but I've written a C++ header-only library so you don't have to declare the variable again.
In my spare time, I wrote a header-only C++ library that will help you extract variable declarations from the main(...) function of one .cpp file to…
The Compiler as Validator: When a Free Model's Wrong C++ Is Still Cheap
A free model will write wrong C++ template code. That is not a problem when the compiler is the validator. In this experiment, a free model wrote te…