User-Agent: * Allow: / Disallow: /api/ Disallow: /home/ Disallow: /admin/ Disallow: /auth/ Disallow: /staff/ Disallow: /static/ Disallow: *.json User-Agent: Googlebot Allow: / Disallow: /api/ Disallow: /home/ Disallow: /admin/ Disallow: /auth/ Disallow: /staff/ User-Agent: Bingbot Allow: / Disallow: /api/ Disallow: /home/ Disallow: /admin/ Disallow: /auth/ Disallow: /staff/ User-Agent: GPTBot Allow: / Disallow: /api/ Disallow: /home/ Disallow: /admin/ Disallow: /auth/ Disallow: /staff/ User-Agent: OAI-SearchBot User-Agent: ChatGPT-User User-Agent: ClaudeBot User-Agent: Claude-SearchBot User-Agent: Claude-User User-Agent: Claude-Web User-Agent: PerplexityBot User-Agent: Perplexity-User Allow: / Disallow: /api/ Disallow: /home/ Disallow: /admin/ Disallow: /auth/ Disallow: /staff/ User-Agent: AhrefsBot Allow: / Disallow: /api/ Disallow: /home/ Disallow: /admin/ Disallow: /auth/ Disallow: /staff/ User-Agent: SemrushBot Disallow: / Host: https://www.preferreddata.com Sitemap: https://www.preferreddata.com/sitemap.xml