# Cranbrook Cars — robots.txt # Allows search and AI retrieval crawlers while blocking noindex utility pages. User-agent: * Allow: / Disallow: /thank-you Disallow: /message-failed Disallow: /mailer.php User-agent: OAI-SearchBot Allow: / Disallow: /thank-you Disallow: /message-failed Disallow: /mailer.php User-agent: ChatGPT-User Allow: / Disallow: /thank-you Disallow: /message-failed Disallow: /mailer.php User-agent: PerplexityBot Allow: / Disallow: /thank-you Disallow: /message-failed Disallow: /mailer.php User-agent: Perplexity-User Allow: / Disallow: /thank-you Disallow: /message-failed Disallow: /mailer.php User-agent: Claude-SearchBot Allow: / Disallow: /thank-you Disallow: /message-failed Disallow: /mailer.php User-agent: Claude-User Allow: / Disallow: /thank-you Disallow: /message-failed Disallow: /mailer.php Sitemap: https://cranbrookcars.co.uk/sitemap.xml