Blackwell MLPerf Dominance, Intel Nova Lake Compute Runtime, & Weston 16 Vulkan HDR
Blackwell MLPerf Dominance, Intel Nova Lake Compute Runtime, & Weston 16 Vulkan HDR Today's Highlights NVIDIA's Blackwell architecture showcased u…
Architecture
⚑ Report a ProblemLatest Architecture news from Tech News
All topics
agents
ai
api
architecture
automation
aws
backend
beginners
career
database
devchallenge
devops
gemma
javascript
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
react
security
showdev
softwareengineering
systemdesign
tutorial
typescript
webdev
Why You Need to Become a Neuro-Punk Right Now
A short essay on why the developer community should invest as much effort as possible into LLMs that are free from corporations and states. ML researc…
nvidia-smi Reports 97% Utilization While the GPU Sits Idle
TL;DR A GPU shows 97% utilization in nvidia-smi , but training throughput is a fraction of what benchmarks promise. The GPU is not computing; it is wa…
CUDA for AMD Lemonade, Intel Arc Pro Linux Gains, XPU Manager 2.0
CUDA for AMD Lemonade, Intel Arc Pro Linux Gains, XPU Manager 2.0 Today's Highlights Today's top GPU news highlights include AMD's Lemonade SDK gainin…
Flash Attention: what it does and why it matters
Flash Attention: what it does and why it matters Your training job is paying for an A100 at $3/hour. The loss is going down, gradients are flowing, an…
Vortex 3.0 RISC-V GPGPU, Pragtical SDL GPU Backend, NVIDIA RTX Spark Launch
Vortex 3.0 RISC-V GPGPU, Pragtical SDL GPU Backend, NVIDIA RTX Spark Launch Today's Highlights Today's top stories highlight significant advancements …
Linux 7.1 Boosts Intel Arc, Flatpak Integrates ROCm, Vintage AMD Driver Refined
Linux 7.1 Boosts Intel Arc, Flatpak Integrates ROCm, Vintage AMD Driver Refined Today's Highlights Recent developments enhance GPU performance and acc…
I Tested 9 Serverless GPU Providers for AI Inference in 2026. Here's What I'd Actually Use
TL;DR If you're shipping AI inference and tired of babysitting GPUs, serverless is the way out. You deploy the model, the platform scales it from zero…
GPU Incident at 3am: eBPF Tracing from Page to Root Cause in 60 Seconds
TL;DR 3am page: GPU training pipeline missed its SLA. Datadog shows 95% GPU utilization. nvidia-smi agrees. Everything looks green, but the job is 3x …
An AMD GPU Beat My Mac on Llama 8B. The Same GPU Lost on Phi-3.
I wrote a post yesterday about why GPUs barely help small text embeddings at batch=1. Different workload, same machines. This time I ran a local LLM i…
64 прямоугольника хватит всем
«Студент-программист реализовал на FPGA полноценную игровую приставку с нуля за полтора месяца, не имея опыта цифрового проектирования». Для меня само…
Where Tensor-Parallel Inference Hits the NVLink Wall
Where tensor-parallel inference hits the NVLink wall 2026-05-31 · GPU / distributed systems Tensor parallelism splits each layer across GPUs, so every…
AMD Linux 7.2 Graphics & SteamOS VRR Drivers, NVIDIA Vera CPU Benchmarks
AMD Linux 7.2 Graphics & SteamOS VRR Drivers, NVIDIA Vera CPU Benchmarks Today's Highlights This week's top stories feature significant driver upd…
How to not Lose $500M via API Bills: Run Private AI for 100 Engineers Under $1 Million
Last week a company nobody can name spent $500 million in a single month on Anthropic's Claude API. Not $500K. Not $5M. Half a billion dollars. In one…
5090 vs 4090 for AI Workloads: Buy, Rent, or Validate in the Cloud?
Originally published at https://blog.runc.ai/5090-vs-4090/ . Key Takeaways RTX 5090 is the stronger flagship on paper, especially when your AI workflo…
CUDA 13.3 Lands, AI Writes Blackwell Kernels, & FP4 VRAM Optimization for LLMs
CUDA 13.3 Lands, AI Writes Blackwell Kernels, & FP4 VRAM Optimization for LLMs Today's Highlights NVIDIA releases CUDA Toolkit 13.3, bringing new …
[Перевод] Масштабирование LLM: от одного чипа до ЦОДа. Глава 3. Траснформеры
Это продолжение цикла статей о масштабировании тренировки и инференса LLM. Предыдущая статья А теперь перейдем к чему-то более практическому, а именно…
20 Years of GPUs in Numbers: How FLOPS & TDP Grew, and Who Led the NVIDIA vs AMD Race (open dataset, 13.5k GPUs)
We run a GPU spec catalog, and over a couple of years it grew into a database of 13,566 GPUs — from the GeForce 256 (1999) all the way to Blackwell an…
[Перевод] Масштабирование LLM: от одного чипа до ЦОДа. Глава 2. Шардинг
Это продолжение цикла статей о масштабировании тренировки и инференса LLM. Предыдущая глава находится по этой ссылке . Итак, с основами разобрались, д…
RTX 5090 Cooling, BeeLlama VRAM Opts, Resizable BAR Performance Gains
RTX 5090 Cooling, BeeLlama VRAM Opts, Resizable BAR Performance Gains Today's Highlights NVIDIA's upcoming RTX 5090 cooling solutions are detailed, wh…
Five Years Later, I Finally Have 96GB VRAM — What It Actually Unlocks for Agent Loops
I bought an RTX PRO 6000 Blackwell Max-Q. 96GB VRAM, Blackwell architecture, pro workstation GPU. Even as a Max-Q variant, this is an absurdly large p…
Turning a 1-Line Idea Into a 40-Second Short with a 10-Beat Local Video Pipeline
TL;DR Gemma 4 31B expands a single-line idea into a 10-beat structure. HiDream generates 11 images at 2048², LTX-2 A2V/I2V renders 11 clips, Irodori-T…
Running LTX-2.3 Alongside TTS on a Single 96GB GPU with a Cold-Start Architecture
When integrating LTX-2.3 (a 22B audio-to-video model) into a voice roleplay product, I ran straight into a VRAM wall. The classic dead-end: running it…
Intel Xe3P Leaks 160GB LPDDR5X; FlashAttention-2 in CuTe & Custom CUDA GPT-2 Engine
Intel Xe3P Leaks 160GB LPDDR5X; FlashAttention-2 in CuTe & Custom CUDA GPT-2 Engine Today's Highlights Intel's Xe3P "Crescent Island" GPU leaks re…
GPU Bottleneck Analyzer, NVIDIA Rubin VRAM Demands, and Qwen VRAM Optimization
GPU Bottleneck Analyzer, NVIDIA Rubin VRAM Demands, and Qwen VRAM Optimization Today's Highlights This week's top GPU news features a new open-source …
What Inference-Platform Benchmark Posts Leave Out
DCGM stops at host-level GPU counters. Kernel-side eBPF adds the per-rank, per-tenant signals platform writeups never publish. TL;DR Cloudflare’s rece…
RTX 5080 Launched, Rust for CUDA, & LLM GPU Scheduling Deep Dive
RTX 5080 Launched, Rust for CUDA, & LLM GPU Scheduling Deep Dive Today's Highlights This week's top GPU news highlights a new GeForce RTX 5080 var…
Which serverless GPU platforms actually have fast cold starts for AI inference — p99, not p50
been testing this properly for a few months because i kept seeing wildly different claims and couldn’t find real data anywhere. specifically for infer…
DeepSeek-V4-Flash Benchmarks, FlashRT CUDA Runtime, & V100 LLM Performance
DeepSeek-V4-Flash Benchmarks, FlashRT CUDA Runtime, & V100 LLM Performance Today's Highlights This week highlights significant advancements in GPU…
AMD MI350P, CUDA WarpReduction, & Adrenalin 26.5.1 Driver Updates
AMD MI350P, CUDA WarpReduction, & Adrenalin 26.5.1 Driver Updates Today's Highlights This week in hardware, AMD unveils the Instinct MI350P accele…