Measuring diffusion video performance on a MacBook: one speedup and a large gap
Last month, I published a benchmark showing a 1.125× speedup from block-residual caching on 4-bit FLUX . The main lesson was not the multiplier. It…
Tech news from the best sources
Last month, I published a benchmark showing a 1.125× speedup from block-residual caching on 4-bit FLUX . The main lesson was not the multiplier. It…
this isn't a marketing story. nothing here is dressed up — it's reconstructed from actual session transcripts and actual commit history. every date…
Back in early May, someone on the team said something like "let's just add web search, shouldn't take more than a day." Three months and roughly twe…
I run an automated video pipeline that generates images locally, on my Mac. A 16GB M4. The image model is FLUX, a 12B-parameter thing that keeps ~7G…
Hello, everyone. There are now many ways to run an LLM on a Mac, but exporting a PyTorch model for Apple Silicon and executing it in a lightweight r…
Hello, everyone. Attention becomes expensive very quickly as more text is given to an AI model. Can a Mac GPU make it faster when every token is res…
I Blamed the Model for Months. The Bug Was My Sampler. 40GB In, Word Salad Out Running local LLMs on M1 Max hardware is one of those setups that loo…
I run a team of AI agents on a Mac I bought in 2022. They handle my Slack, run research, draft content, monitor infrastructure, and spawn sub-agents…