Lightlines
By tavily-ai

tavily-crawl

tavily-ai15.8k installs

Get content from a whole website, not one page.

What it does

Extracts content from multiple website pages for use as context or local Markdown files.

When to use it

Use when you need content from many pages on a site or want documentation for offline use.

How to use it

Give it a website URL; it returns extracted page content, with an option to save pages as local Markdown files.

What you provide

  • a website URL

Uses

Latest review

What you need · 2

Requires the Tavily CLI, authenticated before crawling; the linked setup instructions cover a missing CLI.

Requires authenticated Tavily access through browser sign-in or a securely provided API key.


Access · 2

This skill

Tavily

Write

Sends crawl requests to Tavily

websites

Read

Reads multiple website pages