How to scrape OLX.pl car listings by make, year and mileage with Python
OLX.pl is where a large share of Poland's used cars get listed, by dealers and private owners alike. The site has good filters, but there is no expo…
Последние новости
⚑ Сообщить о проблемеTech news from the best sources
Все темы
- игры
AI
News
Tech
agents
ai
api
architecture
automation
backend
beginners
career
devchallenge
devops
javascript
llm
machinelearning
mcp
opensource
performance
productivity
programming
python
react
security
showdev
testing
tutorial
typescript
webdev
How to scrape Allegro.pl offers, sellers and prices with Python and pandas
Allegro is the biggest marketplace in Poland, and if you sell there (or compete with people who do) you end up checking prices by hand far too often…
When a dateTo filter silently excludes its own last day — and which government-data APIs actually do this
If an API takes a dateTo parameter, does dateTo: "2026-08-31" include results from the 31st, or exclude them? The honest answer is: it depends on wh…
How to scrape Glassdoor jobs and salaries into Excel or Python (no login, no API key)
Glassdoor is one of the few job boards that shows a salary range next to the job : either the employer's own or a Glassdoor estimate. It also shows…
How to Scrape Telegram Channels and Groups
Key Takeaways Telegram provides a free official API. So, the main challenges lie in following privacy regulations, adapting to MTProto, and managing…
A TikTok Shop API for public product data: price, units sold and stock per SKU as JSON
Disclosure: I build TubeText . This post uses our TikTok Shop Actor on Apify. The numbers below are from a run I did today. If you search for a "Tik…
Track new job postings from Naukri, StepStone and Job Bank Canada for a niche role (Python)
Disclosure: I built the Apify Actor used in this tutorial. This post was written with AI assistance. If you are watching the market for one specific…
398 of 692 Products Were Published in One Afternoon. Zero Were Created in 90 Days
I run a visa agency in Bali. The other half of my week goes into Apify Actors, and one of them profiles Shopify stores: you hand it a list of domain…
I logged every status code scraping eBay sold listings. The block is not where you think
Every tutorial for this is the same twelve lines. I ran them today, logged every status code, and the interesting part is not that it failed. It is…
Find best-selling AliExpress products by exact order count with Python
AliExpress search pages round sales into buckets like "10,000+ sold". That hides the difference between a product with 10,100 orders and one with 19…
How to Compare More Than 5 Keywords in Google Trends on One 0-100 Scale
If you've ever tried to chart 12 keywords from Google Trends, you've hit the wall: the compare box takes 5 terms max . The obvious workaround (run t…
8% of My Capterra Reviews Arrived as the Three Characters $62
I run a visa agency in Bali. The half of my week that is not visas goes into Apify Actors, and one of them reads B2B software reviews — Capterra, So…
How to respect robots.txt and Crawl-delay in Python
A polite scraper checks robots.txt before each host, identifies itself, and slows down. This post shows how to do that with Python's standard librar…
Maryland WARN notices 2026: all 108 layoffs as a list you can sort
Maryland publishes every layoff notice it gets on one web page . It's a table, it's public, it's current, and you can't do anything with it. No sort…
UK public procurement notices in one schema: Find a Tender and Contracts Finder
The Actor "UK Public Contracts Lookup" returns UK public procurement notices from Find a Tender and Contracts Finder in one fixed row per notice, ne…
JobSpy doesn't scrape company career sites. Add Greenhouse, Lever and Workday jobs in the same DataFrame
JobSpy (speedyapply/JobSpy on GitHub) is a popular Python library for job search data (about 4,500 GitHub stars): one scrape_jobs() call returns Lin…
Why your Instagram scraper works on your laptop and dies on the server
The most common message in our support inbox is a variation of “it worked yesterday on my machine”. It did, and it will again — on that machine. Ins…
Three Supermarkets Spell One Brand Three Ways, So My Price Comparison Never Happened
Visas pay my bills — I run an agency in Bali. The other half of my week goes into Apify Actors, and one of them reads the three Australian supermark…
Booking.com Search Rows Hide 9–16% of the Price in a Field Labelled 21, 22 and 23
I run a visa agency in Bali. The other half of my week goes into scrapers on Apify, and one of them reads Booking.com search pages: destination in,…
Your Scraper's "Success" Metric Is Lying When the Site Sends You an Empty 200
Most collection pipelines count a fetch as a success when the HTTP status starts with 2. That works right up until the day a site hands you a polite…
How to Scrape Real Estate & Car Listings from OLX Brazil with OLX Brazil Scraper
1. Introduction Extracting market intelligence from Latin America's largest classifieds marketplace— OLX Brazil ( olx.com.br ) —can be a technical n…
How to bulk-audit local business websites
If you sell local SEO, web design or lead-gen services, you probably look at a lot of small-business homepages. Checking them one at a time in a bro…
Why youtube-transcript-api gets blocked on your server (and 3 ways to fix it)
If you've used youtube-transcript-api , you know the feeling: it works perfectly on your laptop, you deploy it to a server, and every request fails…
Scrapy vs BeautifulSoup for Public-Data Collection: Where Each One Starts Costing You
Scrapy vs BeautifulSoup for Public-Data Collection: Where Each One Starts Costing You Every scraping tutorial starts with pip install scrapy or pip…
HikerAPI
I've only used HikerAPI as the data backend for a self-hosted OSINT tool, and so far just for setup and testing, so this is an early look rather tha…
How to track new jobs from Greenhouse, Lever and Ashby (daily alerts, no HTML scraping)
Many startups and tech companies host their careers pages on Greenhouse, Lever or Ashby . All three publish a free, public job-board API : the JSON…
I built a <1ms API to extract B2B leads from dirty HTML
Hey everyone, I do a lot of web scraping and lead generation, and I was getting frustrated with how slow and expensive it is to use AI just to extra…
pdf.js split my numbers: rebuilding "CHF 15,000" from text items
We re-read a few hundred fee schedules every week, many of them published as PDFs, and check that a quoted amount is still on the page. One bank's p…
If Claude and Codex Can Scrape the Web, Why Do We Still Need Web Scraping Tools?
If Claude and Codex Can Scrape the Web, Why Do We Still Need Web Scraping Tools? This question has been on my mind lately. Tools like Claude and Cod…
How to Monitor Your Competitors' Ads Automatically (Google, LinkedIn and Bing) with Apify
When a competitor launches a new offer, you usually see it in their ads first: a new headline, a new landing page, a new video, a webinar promo. You…