crawllm v0.0.4

Crawllm

Crawl any website or docs for usage with LLMs. Get a single markdown file with all website content.

Usage

# Crawl a website and convert to markdown
npx crawllm https://www.better-auth.com

# Specify custom output file (default is output.md)
npx crawllm https://www.better-auth.com docs.md

Features

• Converts entire websites into a single markdown file
• Preserves content hierarchy
• Optimized for LLM context
• Simple command-line interface