Architecture Teardown: How Meta Trains LLMs for Code Generation on 100k GPU Clusters
In Q3 2024, Meta trained a 70B parameter code-specialized LLM on 100,000 Nvidia H100 GPUs, achieving 214 TFLOPS per GPU and 92% cluster utilization – …
Open Source
⚑ Report a ProblemLatest Open Source news from Tech News
All topics
AI
agents
ai
api
architecture
automation
aws
beginners
career
claude
database
devchallenge
devops
discuss
javascript
linux
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
rust
security
showdev
tutorial
typescript
webdev
Did we lose notifications for comment replies?
It would appear that we no longer get a notification in our Lobsters inbox for replies to comments or new comments on stories we submitted. I remember…
Hello World
I have been writing notes for years. Architecture decisions, debugging war stories, things I wish someone told me before I shipped that thing to produ…
Report: Meta will train AI agents by tracking employees' mouse, keyboard use
Move highlights the difficulty of finding high-quality interactive training data.
The Invisible Hand of the State: How Government Coercion is Rewriting the First Amendment in Silicon Valley
The Invisible Hand of the State: How Government Coercion is Rewriting the First Amendment in Silicon Valley Imagine a world where the President of the…
I Got Badges 1, 2, and 4 on DEV.to — Badge #3 Is Currently in Witness Protection
I debug production systems for fun. I've traced memory leaks at 2am. I've stared into the void of a segfault and the void stared back. I once spent 6 …