# https://www.robotstxt.org/robotstxt.html # Alpha Bench robots.txt — plan §5.3 crawl directives User-agent: * Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /account/ Disallow: /login Disallow: /register Disallow: /internal/ Disallow: /preview/ Sitemap: https://alpha-bench.com/sitemap.xml