User-agent: * Allow: / Disallow: /api/ Disallow: /dashboard/ Disallow: /account/ Disallow: /settings/ Disallow: /checkout/ Disallow: /sign-in/ Disallow: /sign-up/ User-agent: GPTBot Allow: / Disallow: /api/ Disallow: /dashboard/ Disallow: /account/ Disallow: /settings/ Disallow: /checkout/ Disallow: /sign-in/ Disallow: /sign-up/ User-agent: ChatGPT-User Allow: / Disallow: /api/ Disallow: /dashboard/ Disallow: /account/ Disallow: /settings/ Disallow: /checkout/ Disallow: /sign-in/ Disallow: /sign-up/ User-agent: ClaudeBot Allow: / Disallow: /api/ Disallow: /dashboard/ Disallow: /account/ Disallow: /settings/ Disallow: /checkout/ Disallow: /sign-in/ Disallow: /sign-up/ User-agent: Claude-SearchBot Allow: / Disallow: /api/ Disallow: /dashboard/ Disallow: /account/ Disallow: /settings/ Disallow: /checkout/ Disallow: /sign-in/ Disallow: /sign-up/ User-agent: Claude-User Allow: / Disallow: /api/ Disallow: /dashboard/ Disallow: /account/ Disallow: /settings/ Disallow: /checkout/ Disallow: /sign-in/ Disallow: /sign-up/ User-agent: PerplexityBot Allow: / Disallow: /api/ Disallow: /dashboard/ Disallow: /account/ Disallow: /settings/ Disallow: /checkout/ Disallow: /sign-in/ Disallow: /sign-up/ User-agent: Google-Extended Allow: / Disallow: /api/ Disallow: /dashboard/ Disallow: /account/ Disallow: /settings/ Disallow: /checkout/ Disallow: /sign-in/ Disallow: /sign-up/ User-agent: CCBot Allow: / Disallow: /api/ Disallow: /dashboard/ Disallow: /account/ Disallow: /settings/ Disallow: /checkout/ Disallow: /sign-in/ Disallow: /sign-up/ # Added after Bing Webmaster verification User-agent: Bingbot Allow: / Disallow: /api/ Disallow: /dashboard/ Disallow: /account/ Disallow: /settings/ Disallow: /checkout/ Disallow: /sign-in/ Disallow: /sign-up/ User-agent: msnbot Allow: / Disallow: /api/ Disallow: /dashboard/ Disallow: /account/ Disallow: /settings/ Disallow: /checkout/ Disallow: /sign-in/ Disallow: /sign-up/ Sitemap: https://freelancerguard.fyi/sitemap.xml # Content signal: # FreelancerGuard allows AI systems to read and cite public marketing, documentation, and tool explanation pages. # Do not crawl private authenticated app routes, user dashboards, checkout sessions, or API endpoints. # Public scan-result pages may be crawled only because they expose score/category metadata, not raw inquiry text.