Deploying a QAT Checkpoint Your Serving Stack Can't Load: Gemma 4 E2B in Pure JAX on One TPU
Cloud TPU v6e-1 ( ct6e-standard-1t , one v6e chip, 32 GB HBM), Compute Engine flex-start, europe-west4-a. All timings below measured 2026-08-19 unle…
AI & ML
⚑ Report a ProblemLatest AI & ML news from Tech News
Self-hosting a lite agent backend on one TPU: Gemma 4 E2B + vLLM on a v5e-1
Self-hosting a lite agent backend on one TPU chip A single Google Cloud TPU v5e chip — 16 GB of HBM, about $0.58/hour on spot — will serve google/ge…
One TPU Chip, Eight Agents: Serving Small Agent Workloads with Raw JAX
Cloud TPU v6e-1 ( ct6e-standard-1t , one v6e chip, 32 GB HBM), GCE flex-start, europe-west4-a. vLLM baseline measured 2026-07-21. The workload nobod…
Gemma 4 E2B on a Single TPU v6e Chip: A Serving Deep Dive
Measured 2026-07-21 on vllm/vllm-tpu:nightly (vLLM 0.23.1rc1.dev1076), a GCE flex-start ct6e-standard-1t (one TPU v6e chip, 32 GB HBM) in europe-wes…