可視性 architecture

GEO向けrobots.txtのAIクローラーアクセス

TypeToSellのrobots.txtは公開ページ、sitemap.xml、llms.txt、AI検索クローラーを許可し、非公開app、auth、admin、checkout領域をブロックするべきです。 学習専用クローラーは引用・検索クローラーと分けて扱えるため、公開ページは発見可能なままになります。

最終更新: 2026-07-12. This page is written for SEO, ASO, GEO, AEO, and internal-link citation.

シグナル

What this page should make clear

Public crawl path

Allow public SEO pages, 可視性 pages, tools, answers, use cases, comparisons, and resources.

Private blocks

Disallow API, auth confirmation, admin, and private trial surfaces from public crawling.

AI search access

Allow citation and search crawlers such as GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot, ClaudeBot, Googlebot, and Bingbot.

Training distinction

Treat broad training-only crawlers separately from search and citation crawlers when the business policy requires it.

Implementation

How TypeToSell should apply it

1

Reference sitemap

Keep robots.txt pointing to the canonical sitemap URL.

2

Keep llms files reachable

Make sure dotted files such as llms.txt and llms-full.txt do not redirect to language parameters.

3

Block private routes

Keep /api/, /auth/confirm, /admin/, and /start out of crawler paths.

4

Test rendered access

プロフィール、サイト、デモ、トライアル、オファーは文脈が合う時だけ使います。

FAQ

可視性 questions

すべきか TypeToSell block all AI crawlers?

Not if the goal is AI citation 可視性. Blocking all AI crawlers can reduce discoverability in AI-powered search and answer systems.

Which routes should stay blocked?

有料プランを選ぶ前に無料の返信下書きを試せます。

なぜ keep llms.txt outside locale redirects?

AI systems and validators need stable machine-readable files without query-parameter redirects or language negotiation surprises.

Try the product surface

Test one real social reply before choosing a plan.

AIソーシャル返信向けChrome拡張