# robots.txt - MatchMate # https://matchmate.cn # # AI / LLM brief (plain text): # https://matchmate.cn/llms.txt # https://matchmate.cn/llms-full.txt User-agent: * Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /facts Disallow: /api/ Disallow: /admin/ Disallow: /uploads/ Disallow: /*.json$ # --- Search engines --- User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / Allow: /favicon.ico Allow: /favicon.png Allow: /favicon-32x32.png Allow: /apple-touch-icon.png Allow: /llms.txt Allow: /llms-full.txt User-agent: DuckDuckBot Allow: / User-agent: Yandex Allow: / User-agent: Baiduspider Allow: / User-agent: Sogou Allow: / User-agent: 360Spider Allow: / # --- Generative / AI search & training crawlers (GEO) --- # Intentional policy: Allow training/grounding bots (do not Disallow GPTBot / # Google-Extended / CCBot / etc.) so AI search can ingest public marketing pages. User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: Google-Extended Allow: / User-agent: GoogleOther Allow: / User-agent: Google-CloudVertexBot Allow: / User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / User-agent: anthropic-ai Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Bytespider Allow: / User-agent: meta-externalagent Allow: / User-agent: FacebookBot Allow: / User-agent: CCBot Allow: / User-agent: cohere-ai Allow: / User-agent: Diffbot Allow: / User-agent: YouBot Allow: / User-agent: Amazonbot Allow: / User-agent: AI2Bot Allow: / User-agent: ImagesiftBot Allow: / User-agent: omgili Allow: / User-agent: omgilibot Allow: / # Sitemap Sitemap: https://matchmate.cn/sitemap.xml