#scrapy

Open Source

Scrapy's New Best Friend: rs-trafilatura Pipeline Tears Through HTML Junk

Scrapy spiders spew raw HTML like a firehose of garbage. rs-trafilatura cleans it up, Rust-fast, right in your pipeline—no more manual parsing hell.

Cloud & Infrastructure

Curl_cffi's 82% Bypass Rate Crushes Requests—2026 Scraping Tool Benchmarks

Hit a Cloudflare wall with requests? Curl_cffi slips through at 82% success, barely slower. This data-driven showdown picks winners for your next scrape.