seo

4 tools tagged "seo".

Cloudflare Pages robots.txt Generator

Generate a robots.txt for a production Cloudflare Pages domain (allow + sitemap) or a pages.dev staging subdomain (disallow all).

Cloudflare Staging Domain Blocker

Generate the combined robots.txt + _headers + _redirects to stop a pages.dev staging subdomain from being indexed.

pages.dev Duplicate Content Checker

Enter your production domain and pages.dev project name to get a duplicate-content risk report and the exact fixes.

AI Crawler Policy Generator

Paste your robots.txt, classify AI vs search crawlers, and get a suggested allow/block policy plus an llms.txt skeleton.