Cloudflare Open Sources Decision Models for AI Agents
During its recent “Birthday Week”, Cloudflare announced Clef, a set of open-weight AI models designed to choose between predefined options rather th…
Programming
⚑ Report a ProblemLatest Programming news from Tech News
All topics
AI
agents
ai
api
architecture
automation
backend
beginners
career
database
devchallenge
devops
discuss
javascript
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
react
rust
security
showdev
testing
tutorial
typescript
webdev
Shopify Introduces Gisting: Compressing LLM System Prompts into Learned Tokens
Shopify's engineering introduced gisting, a novel technique for compressing long LLM prompts into a smaller set of learned "gist" tokens, improving…
FreeToken Unlocks Frontier MoE Inference on Consumer Hardware via Dynamic Co-Execution
Researchers from UC Berkeley and MIT have developed FreeToken, an open-source inference engine that enhances the utility of Mixture-of-Experts model…
Presentation: From Fab To Token - The State Of The Market
Jordan Nanos discusses how semiconductor constraints, data center expansion, and networking bottlenecks impact AI software architecture. Drawing fro…
Netflix Details Its In-House LLM Serving Platform with Triton and vLLM
Netflix has described the production lessons behind bringing LLM inference into its internal serving platform, including the challenges of supportin…
Article: Local-First AI Inference: A Cloud Architecture Pattern for Cost-Effective Document Processing
The Local-First AI Inference pattern routes 70–80% of documents to deterministic local extraction at zero API cost, reserving Azure OpenAI calls for…