# 时效GEO — robots.txt # 内容明确开放给 AI 搜索收录 # ---------- 默认规则 ---------- User-agent: * Allow: / # 后台与工具页不对爬虫开放(登录后才能用,无需收录) Disallow: /admin Disallow: /tools # ---------- AI 爬虫显式放行 ---------- # 显式声明优于依赖默认规则:部分爬虫只认第一个匹配分组 User-agent: Bytespider Allow: / User-agent: ByteDanceSpider Allow: / User-agent: YuanBaoBot Allow: / User-agent: TencentYuanbao Allow: / User-agent: DeepSeekBot Allow: / User-agent: MoonshotBot Allow: / User-agent: ChatGLM-Spider Allow: / User-agent: ZhipuBot Allow: / User-agent: BaiduSpider Allow: / User-agent: Baiduspider-render Allow: / User-agent: Sogou web spider Allow: / User-agent: 360Spider Allow: / User-agent: YisouSpider Allow: / User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: cohere-ai Allow: / User-agent: Amazonbot Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: DuckAssistBot Allow: / User-agent: YouBot Allow: / # ---------- 站点地图 ---------- Sitemap: https://shixiaogeo.pages.dev/sitemap-index.xml