How Do AI Companies Get Their Training Data?
Originally published at aidata.broker . AI companies get their training data through six channels: they crawl the open web, license content from pub…
Open Source
⚑ Report a ProblemLatest Open Source news from Tech News
All topics
AI
agents
ai
api
architecture
automation
backend
beginners
career
database
devchallenge
devops
discuss
javascript
linux
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
react
security
showdev
testing
tutorial
typescript
webdev
Four checks I run on any number someone quotes at me
Four checks I run on any number someone quotes at me Someone hands you a number with a sentence attached. A brand report. A study abstract. A headli…
Freshness Watermarks Belong on Every Row, Not the README
The most common freshness design I see — in my own old code included — is a single stamp at the top: a README that says "last updated 2026-10-01", a…
Tracing Fraud Rings with a Graph: What I Learned Building with FalkorDB
Banks flag suspicious transactions all day. The hard part isn't the flag—it's seeing what's behind it. Fraud rings can hide in relationships: accoun…
Security Almost Never Separates a Good Agent Skill From an Average One
We scored 628 agent skills on six dimensions. The one everyone argues about turned out to be the one that tells you least about whether a skill is g…
Your Dashboard Says "Live" — Prove It With Freshness Watermarks
I once shipped a monitoring page that said LIVE in confident green letters. It stayed green for eleven days while the ingest job behind it had been…
Pineprompt AI search visibility benchmark 2026
Pineprompt analyzed 18,792 responses to 200 non-branded buyer prompts across 10 categories, run daily on seven AI search engines from September 30 t…
Maryland WARN notices 2026: all 108 layoffs as a list you can sort
Maryland publishes every layoff notice it gets on one web page . It's a table, it's public, it's current, and you can't do anything with it. No sort…
8 Analytics Mistakes That Quietly Lead Teams to the Wrong Decision
It's Monday's leadership review. The dashboard says average order value is up 12% month over month. Everyone nods, the marketing team gets a pat on…
Twelve months of ONS job advert data for 13 graduate roles: software is up 23%, accountancy is down
The Office for National Statistics publishes a monthly count of new online job adverts in the UK, broken down by SOC 2020 occupation code and by reg…
Three Supermarkets Spell One Brand Three Ways, So My Price Comparison Never Happened
Visas pay my bills — I run an agency in Bali. The other half of my week goes into Apify Actors, and one of them reads the three Australian supermark…
Yahoo Finance Historical Data Download Is Now Paid: 7 Alternatives
Yahoo Finance now charges $479/year to download historical data. Here are 7 free and paid alternatives, with prices, history depth and Python code.*…
Booking.com Search Rows Hide 9–16% of the Price in a Field Labelled 21, 22 and 23
I run a visa agency in Bali. The other half of my week goes into scrapers on Apify, and one of them reads Booking.com search pages: destination in,…
Your Scraper's "Success" Metric Is Lying When the Site Sends You an Empty 200
Most collection pipelines count a fetch as a success when the HTTP status starts with 2. That works right up until the day a site hands you a polite…
AI hiring this week: Anduril added 60 net roles, ElevenLabs cut 47 (22,020 open roles tracked)
Every day I scrape the career pages of 276 AI and tech companies and diff the open roles week over week. This is the diff for 2026-10-04 to 2026-10-…
The Saturday Data Run: 457 Matches, Six Exports, Zero Manual Steps
One match day, 457 finished matches across the data set. The daily export landed with 546 standings rows, 200 scorer lines and 198 rows of match sta…
Planet Zoo 2 cohabitation chart: which of the 1,221 animal pairs can actually share an enclosure
Planet Zoo 2 cohabitation chart: which of the 1,221 animal pairs can actually share an enclosure Planet Zoo 2 ships 130 species , which is 8,385 pos…
I Tracked Weather Forecasts for 3 Weeks to See How Wrong They Really Are
The idea Weather apps show a 7-day forecast like it's a fact. But how accurate is day 7, really, compared to tomorrow's forecast? I wanted real numb…
HealthKit to JSONL vs JSON: one snapshot survives a cut sync, the other gives you nothing
Two apps can write the exact same Apple Health records to disk and behave nothing alike the moment a sync gets interrupted. I benchmarked it on 2026…
I Read Pinterest's Trends Page. The Pin Counts Are Two Digits, Not Six.
I Read Pinterest's Trends Page. The Pin Counts Are Two Digits, Not Six. Pinterest publishes a Trends board that rotates, and it looks like the kind…
8,220 Workers: Why the Week of October 28 Is the Heaviest Layoff Week of Fall 2026
8,220 Workers: Why the Week of October 28 Is the Heaviest Layoff Week of Fall 2026 8,220 workers have layoffs scheduled to take effect in the week o…
AIoT in Pharma Manufacturing: It's Mostly a Data Plumbing Problem
If you've ever looked at the systems inside a pharmaceutical plant, the first thing you notice is that there's no shortage of data. Machines log ope…
MLIT Japan Property Prices — Free Data for AI Agents & Real Estate Investors
Japan's Ministry of Land, Infrastructure, Transport and Tourism (MLIT) publishes detailed real estate transaction prices for all 47 prefectures — bu…
I Logged 30 Days of Google AI Overview Answers for One Keyword. Here Is the Dataset.
For the last 30 days I have been recording, once per day, exactly which names Google's AI Overview returns for a single English-language query: "kin…
I Analyzed 2,849 Crawler Requests. Here's What Search Bots Actually Do on New Sites.
I Analyzed 2,849 Crawler Requests. Here's What Search Bots Actually Do on New Sites. I run k1r4.space — a site with 30 HTML tools, a 31-post blog, a…
Ask.com is dead. 197,000 of its questions are still in the archive.
Dated data post · 2026-10-07 · all numbers first-hand, snapshot time-stamped Ask.com closed on May 1, 2026 . The farewell page is blunt: "As IAC con…
Y Combinator isn't in our directory. 622 of our 819 listings were never claimed.
We list companies that never asked to be listed. That is deliberate — and it produced the only number in our directory I find genuinely interesting:…
How to Convert XML to PARQUET?
To Convert XML to PARQUET format can be achieved either through automated enterprise tools or customized ETL scripts: Automated Enterprise Software:…
Best Collaborative Data Modeling Tools: SQLDBM Team Features & Alternatives Compared
Data modeling used to be a solo sport. One architect, one desktop app, one giant ERD file emailed around for review. That world is gone. Modern data…
Ontology, Gates, and a Human Backstop: Three Defenses for Enterprise AI That Don't Spin Empty
Ontology, Gates, and a Human Backstop: Three Defenses for Enterprise AI That Don't Spin Empty 2026-10-05 Enterprise AI usually lands in one of two e…