Lightlines
By brettdavies

crawl4ai

brettdavies1.1k installs

Turn JavaScript-heavy pages into clean data.

What it does

Extracts readable markdown and structured data from JavaScript-heavy websites using Crawl4AI.

When to use it

Use for JavaScript-rendered pages, authenticated content, infinite scrolling, concurrent crawling, or repeatable schema-based extraction when static fetching cannot reach the content.

How to use it

Give it a URL; it returns rendered markdown by default and routes more specific requests to extraction, batch, authentication, rendering, or discovery workflows.

Uses

Good to know

  • cannot be undone: OpenAI
  • may misreport its own work
  • sends a credential to a server: login credentials

Latest review

What you need · 4

The bundled Python scripts require Python 3.10 or newer.

The Crawl4AI Python library must be installed in the runtime the agent uses.


Access · 4

This skill

OpenAI

Write

Sends pages to OpenAI (irreversible)

login pages

Write

Submits website login forms