Lightlines
Catalogue
Sign in
By firecrawl

firecrawl-crawl

firecrawl

Extract linked pages from a site in one crawl.

web extraction

What it does

Extracts linked pages in bulk from a website or site section.

When to use it

Use for crawls, documentation sections, or content spread across linked pages.

How to use it

Give it a website URL; it crawls linked pages and saves the extracted content under .firecrawl/.

What you provide

  • a website URL

Uses


Access · 2

This skill

Firecrawl crawl job

Execute

Starts a credit-consuming crawl (irreversible)

Read

Checks the crawl status

website pages

Read

Reads linked website pages

Good to know

  • cannot be undone: Firecrawl crawl job

What you need · 2

The firecrawl CLI must be available to run crawl commands.

Crawling requires authentication; without credentials, the CLI prompts for an interactive login.


About this skill

Visibility
Public
Repository
firecrawl/cli
Created
Oct 8, 2026
Updated
Oct 8, 2026
Files
1