About aicrawlable

aicrawlable is a free tool that generates llms.txt and llms-full.txt files for any website. Paste a URL, we crawl the site on the edge, extract its structure, and produce clean, spec-compliant files you can edit and export.

We built it because most existing generators are either WordPress-only, locked behind a paywall, or treat llms.txt like a sitemap dump. llms.txt is about priority, not coverage — so aicrawlable lets you exclude pages, fix descriptions, and group by section before you publish.

It's completely free, requires no signup, and stores nothing. Your crawl runs and the result is yours.

Contact

Questions or feedback? Email support@aicrawlable.com.