A TikTok Shop API for public product data: price, units sold and stock per SKU as JSON
Disclosure: I build TubeText . This post uses our TikTok Shop Actor on Apify. The numbers below are from a run I did today. If you search for a "Tik…
Последние новости Web от Tech News
Все темы
AI
agents
ai
api
architecture
automation
backend
beginners
career
database
devchallenge
devops
discuss
javascript
linux
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
react
security
showdev
testing
tutorial
typescript
webdev
Track new job postings from Naukri, StepStone and Job Bank Canada for a niche role (Python)
Disclosure: I built the Apify Actor used in this tutorial. This post was written with AI assistance. If you are watching the market for one specific…
398 of 692 Products Were Published in One Afternoon. Zero Were Created in 90 Days
I run a visa agency in Bali. The other half of my week goes into Apify Actors, and one of them profiles Shopify stores: you hand it a list of domain…
I logged every status code scraping eBay sold listings. The block is not where you think
Every tutorial for this is the same twelve lines. I ran them today, logged every status code, and the interesting part is not that it failed. It is…
Find best-selling AliExpress products by exact order count with Python
AliExpress search pages round sales into buckets like "10,000+ sold". That hides the difference between a product with 10,100 orders and one with 19…
How to Compare More Than 5 Keywords in Google Trends on One 0-100 Scale
If you've ever tried to chart 12 keywords from Google Trends, you've hit the wall: the compare box takes 5 terms max . The obvious workaround (run t…
8% of My Capterra Reviews Arrived as the Three Characters $62
I run a visa agency in Bali. The half of my week that is not visas goes into Apify Actors, and one of them reads B2B software reviews — Capterra, So…
How to respect robots.txt and Crawl-delay in Python
A polite scraper checks robots.txt before each host, identifies itself, and slows down. This post shows how to do that with Python's standard librar…
Maryland WARN notices 2026: all 108 layoffs as a list you can sort
Maryland publishes every layoff notice it gets on one web page . It's a table, it's public, it's current, and you can't do anything with it. No sort…
UK public procurement notices in one schema: Find a Tender and Contracts Finder
The Actor "UK Public Contracts Lookup" returns UK public procurement notices from Find a Tender and Contracts Finder in one fixed row per notice, ne…
JobSpy doesn't scrape company career sites. Add Greenhouse, Lever and Workday jobs in the same DataFrame
JobSpy (speedyapply/JobSpy on GitHub) is a popular Python library for job search data (about 4,500 GitHub stars): one scrape_jobs() call returns Lin…
Why your Instagram scraper works on your laptop and dies on the server
The most common message in our support inbox is a variation of “it worked yesterday on my machine”. It did, and it will again — on that machine. Ins…
Three Supermarkets Spell One Brand Three Ways, So My Price Comparison Never Happened
Visas pay my bills — I run an agency in Bali. The other half of my week goes into Apify Actors, and one of them reads the three Australian supermark…
Booking.com Search Rows Hide 9–16% of the Price in a Field Labelled 21, 22 and 23
I run a visa agency in Bali. The other half of my week goes into scrapers on Apify, and one of them reads Booking.com search pages: destination in,…
Your Scraper's "Success" Metric Is Lying When the Site Sends You an Empty 200
Most collection pipelines count a fetch as a success when the HTTP status starts with 2. That works right up until the day a site hands you a polite…
How to Scrape Real Estate & Car Listings from OLX Brazil with OLX Brazil Scraper
1. Introduction Extracting market intelligence from Latin America's largest classifieds marketplace— OLX Brazil ( olx.com.br ) —can be a technical n…
How to bulk-audit local business websites
If you sell local SEO, web design or lead-gen services, you probably look at a lot of small-business homepages. Checking them one at a time in a bro…
Why youtube-transcript-api gets blocked on your server (and 3 ways to fix it)
If you've used youtube-transcript-api , you know the feeling: it works perfectly on your laptop, you deploy it to a server, and every request fails…
Scrapy vs BeautifulSoup for Public-Data Collection: Where Each One Starts Costing You
Scrapy vs BeautifulSoup for Public-Data Collection: Where Each One Starts Costing You Every scraping tutorial starts with pip install scrapy or pip…
HikerAPI
I've only used HikerAPI as the data backend for a self-hosted OSINT tool, and so far just for setup and testing, so this is an early look rather tha…
How to track new jobs from Greenhouse, Lever and Ashby (daily alerts, no HTML scraping)
Many startups and tech companies host their careers pages on Greenhouse, Lever or Ashby . All three publish a free, public job-board API : the JSON…
I built a <1ms API to extract B2B leads from dirty HTML
Hey everyone, I do a lot of web scraping and lead generation, and I was getting frustrated with how slow and expensive it is to use AI just to extra…
pdf.js split my numbers: rebuilding "CHF 15,000" from text items
We re-read a few hundred fee schedules every week, many of them published as PDFs, and check that a quoted amount is still on the page. One bank's p…
If Claude and Codex Can Scrape the Web, Why Do We Still Need Web Scraping Tools?
If Claude and Codex Can Scrape the Web, Why Do We Still Need Web Scraping Tools? This question has been on my mind lately. Tools like Claude and Cod…
How to Monitor Your Competitors' Ads Automatically (Google, LinkedIn and Bing) with Apify
When a competitor launches a new offer, you usually see it in their ads first: a new headline, a new landing page, a new video, a webinar promo. You…
How to Scrape Job Listings from Workday Career Sites (Without Writing a Scraper)
A lot of large companies run their careers page on Workday. If you've ever tried to track openings across several of them, you know the pain: every…
Proxy format: IP, port, username and password, every form
Originally published on proxymint . Read and write proxy strings: host:port:user:pass, user:pass@host:port, http:// vs socks5h:// URLs, separate fie…
SOCKS5 vs HTTP proxy: DNS, speed, security, which to use
Originally published on proxymint . SOCKS5 vs HTTP proxy compared: what each carries, where DNS resolves (socks5 vs socks5h), speed, auth, client su…
Cloudflare Is Changing How AI Agents Access the Web in 2026
AI agents are getting better at using the web. They can search for information, read documentation, compare products, research topics, and collect d…
How do I track where my product ranks on Naver Shopping (without a Naver login)?
Short answer: search your keyword on Naver from a phone and count — or let a scheduled scraper do it every day. Naver Shopping Rank Tracker checks t…