How to bulk-audit local business websites
If you sell local SEO, web design or lead-gen services, you probably look at a lot of small-business homepages. Checking them one at a time in a bro…
DevOps
⚑ Report a ProblemLatest DevOps news from Tech News
How to track new jobs from Greenhouse, Lever and Ashby (daily alerts, no HTML scraping)
Many startups and tech companies host their careers pages on Greenhouse, Lever or Ashby . All three publish a free, public job-board API : the JSON…
5 Public-Record Checks for KYB Entity Verification
Know Your Business (KYB) starts with a boring question: does this company actually exist, and is it in good standing? Most onboarding flows still tr…
Checking If a Business's Google Profile Actually Matches Its Own Website
If you do local SEO work, you've run into this: a client's Google Business Profile says one phone number, their website footer says another, and nob…
Turning Google Maps Scraper Output into a 0-100 Lead Priority Score (No Scraping, No LLM)
If you've ever built a lead-gen pipeline for a local SEO or web design agency, you know the pattern: scrape a bunch of businesses off Google Maps, t…
I measured what my 11 Actors cost to run. The 96x spread was mostly one config field.
I wrote this article twice. The first version was finished, proofread, and queued to publish. Then someone asked a question about one number in it,…
Two Actors, one agent, and the three ways my chain broke
A client asked a question that sounds simple: which sellers on the marketplaces are risky to buy from? Answering it takes two steps. Find the seller…
My Actors worked fine until an AI agent called them
On 27 July I published a scraper that pulls product cards and specifications from online stores. It was my fourteenth Actor. The others cover compan…
From an $11.1B trade flow to two GST-active supplier candidates: building a sourcing agent with Apify MCP
A supplier search usually starts too small. You type a product into a marketplace, get a page of companies, and start opening tabs. You still do not…
My AI agent found 129 resolving subdomains. The Actor classified 98 as wildcard-likely.
The first version of my report looked excellent: 129 hostnames, 129 DNS resolutions, and a neat table of HTTP status codes and page titles. It was a…
I gave an Apify Actor three GitHub tools. It found 16 dependency advisories without touching the code.
Most dependency-security demos end with an impressive list and an awkward handoff. Someone still has to find the repository, copy the vulnerable ver…
A scraper isn’t a monitor: detecting new Telegram posts with Apify and n8n
My Actor run succeeded. It returned five recent Telegram posts, each with an ID, timestamp, and permalink. Then I asked the question the automation…
Read any BetterStack status page as JSON
Status pages are built for humans: a page per vendor, each with its own markup. If you want the same data as JSON — which components exist, what sta…
Building an Enterprise Football Data Pipeline: Decoding Flashscore's Protocol for xG & Referee Analytics
Most football data scrapers on the market only extract high-level final scores (e.g. 2-1 ). But quantitative sports analysts, data scientists, and p…
Reverse-Engineering YouTube's InnerTube Search API (WEB Client + Continuations)
Reverse-Engineering YouTube's InnerTube Search API (WEB Client + Continuations) YouTube search in a browser loads HTML. YouTube search as a client s…
I shipped a Tokopedia scraper that undercuts the incumbents 5x — here's the boring part
I shipped a Tokopedia scraper that undercuts the incumbents 5x — here's the boring part Indonesia's biggest marketplace has a data problem: everyone…
How We Built a Modular Etsy Research Pipeline with Apify
When people think about scraping Etsy, they often imagine a single script that collects everything in one run. That approach works for small experim…
I Built a Free World Cup 2026 Live Scores API on Apify — Here's How
The World Cup is here and getting clean, structured match data is surprisingly painful. The official FIFA site has no public API. Third-party servic…
Building a Lean, Single-Worker Broken URL Monitor for Data Pipelines
The Technical Problem: Websites Drift, Pipelines Don't Know Long-running scraping pipelines have a structural assumption baked in: the URLs you conf…
Threads Reply Scraper: export the full conversation tree of any public post
Quick answer: Meta's official Threads API is gated behind a developer-account review and refuses third-party conversation reads. To export the full…
Steam Regional Price Data: fetch 60 regions in one run for $1.05/1K
Quick answer: Steam publishes regional prices on the public store.steampowered.com/api/appdetails endpoint — but it returns one currency at a time,…
I shipped 7 production MCP server Actors in two weeks — here's what the docs don't tell you
I shipped 7 production MCP server Actors in two weeks — here's what the docs don't tell you The first Actor took most of a day. The seventh took und…
Reverb Scraper: pull historical sold prices for any musical gear
Quick answer: The Reverb Price Guide is the largest public dataset of used-instrument sale prices on the internet — millions of completed transactio…
LLM API pricing comparison: one schema across all 7 providers for $5.05/1K
Quick answer: There is no unified official API for LLM pricing. OpenAI, Anthropic, Google, Mistral, Groq, Together AI, and DeepSeek each publish the…
Kick Chat Scraper: archive live chat before it disappears forever
Quick answer: Kick.com exposes no API for past chat and no download button. A kick chat scraper connects to Kick's public Pusher WebSocket — the sam…
Bing Search API Replacement: scrape SERP results for $1.05/1K
Quick answer: Microsoft retired the Bing Search API on August 11, 2025. There is no longer an official endpoint. A Bing search scraper hits the same…
ATS Tech Stack Detector: pull company back-end stacks from jobs for $5.05/1K
Quick answer: Greenhouse, Lever, and Ashby each publish a public job-board API that any job aggregator can hit — no auth required. An ATS tech stack…
Google AI Overview Tracker: 8-selector battery + citation drift telemetry
Quick answer: Google publishes no API for AI Overview citations. The only way to get the data programmatically is to render Google SERPs in a real b…
How I built a Bluesky scraper using the AT Protocol API (and published it on Apify)
Bluesky hit 40 million users earlier this year, and unlike Twitter, it runs on an open protocol — the AT Protocol — where public data is genuinely p…
Your recurring scraper is re-downloading data that didn't change. Here's the 15-line fix (conditional GET)
Note: This is a cross-post. Canonical version (full long-form) lives on my blog: https://blog.spinov.online/blog/ethical-scraping-is-a-rate-limit-qu…