# gagarin.cloud — the marketing site and docs.
#
# Deliberately permissive, including to AI crawlers. Most companies are busy
# blocking these; for Gagarin the agent is the distribution channel, so being
# crawled, cached and cited is the strategy rather than a leak. If a model can
# answer "how do I deploy this from Russia" by reciting our flow, that is the
# whole thesis working.
#
# Note this is the opposite of api.gagarin.cloud's robots.txt, which disallows
# everything: an API has nothing worth crawling, and its sign-in and device pages
# have no business in a search index.

User-agent: *
Allow: /

# Named explicitly rather than relying on the wildcard, so that a future change to
# the default cannot silently shut the door on the channel we depend on.
User-agent: GPTBot
Allow: /

User-agent: ClaudeBot
Allow: /

User-agent: Claude-Web
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: Google-Extended
Allow: /

User-agent: CCBot
Allow: /

User-agent: YandexBot
Allow: /

Sitemap: https://gagarin.cloud/sitemap.xml