scrapling-official

Scrape changing and protected sites with less breakage.

web scraping

What it does

Scrapes and crawls websites with adaptive parsing, JavaScript rendering, anti-bot handling, and a spider framework.

When to use it

Use it to scrape, crawl, or extract website data, especially when ordinary fetching fails or anti-bot protection is present.

Give it website URLs and an extraction request; it retrieves the content through a temporary file and returns the result.

What you provide

This skill

websites

Read

Downloads content from websites

scrapling[all]>=0.4.15

Execute

Installs Scrapling with extras

scrapling install --force

Execute

Installs browser dependencies

temporary output file

Write

Uses a temporary output file

Requires Python 3.10 or newer.

Requires Scrapling with all extras at version 0.4.15 or newer.

Browser-based scraping requires the browser dependencies downloaded by Scrapling's installer.