Comparing INT4 and NVFP4 Palettes on Real Gradient Tensors
Four-bit training quantizes every number to one of 16 values. NVFP4's menu is {0, ±0.5, ±1, ±1.5, ±2, ±3, ±4, ±6} , with one scale factor per block…
Open Source
⚑ Report a ProblemLatest Open Source news from Tech News
All topics
AI
agents
ai
api
architecture
automation
backend
beginners
career
database
devchallenge
devops
discuss
javascript
linux
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
react
security
showdev
testing
tutorial
typescript
webdev
Context window sizing for fine-tuning: how long should your training examples be?
Originally published on Loop & Retry — field notes on building LLM agents that survive production. Most fine-tuning guides answer "how many exam…
Faster AI training by quietly cloning the model
A new paper introduces a method to speed up reward-based fine-tuning by having the model generate a cheap, compressed copy of itself to draft text,…
A 35-billion-parameter agent that punches like a trillion-parameter model
A 35-billion-parameter model called Agents-A1 matches trillion-parameter models on multi-step agent tasks, according to a new paper from Shanghai AI…
LLMs believe false statements even after explicit warnings that they're false
Fine-tuning tests show "bias ... toward confidently representing the claims as true."