robots.txt
User-agent: * Allow: / Allow: /category/ Allow: /guides/ Allow: /sitemap Allow: /robots Disallow: /admin Disallow: /login Disallow: /checkout Disallow: /dashboard Disallow: /account Sitemap: https://example.com/sitemap.xml # GTBuy Spreadsheet - Crawl-friendly # Updated: 2026-06-01
This robots.txt file allows all search engines to crawl the site while providing the sitemap location. The sitemap helps search engines discover all pages on the GTBuy Spreadsheet website.