가시성 architecture

GEO용 robots.txt AI 크롤러 접근

TypeToSell의 robots.txt는 공개 페이지, sitemap.xml, llms.txt, AI 검색 크롤러를 허용하고 private app, auth, admin, checkout 표면을 차단해야 합니다. 학습 전용 크롤러는 인용 및 검색 크롤러와 별도로 다룰 수 있으므로 공개 페이지는 계속 발견 가능합니다.

마지막 업데이트: 2026-07-12. This page is written for SEO, ASO, GEO, AEO, and internal-link citation.

신호

What this page should make clear

Public crawl path

Allow public SEO pages, 가시성 pages, tools, answers, use cases, comparisons, and resources.

Private blocks

Disallow API, auth confirmation, admin, and private trial surfaces from public crawling.

AI search access

Allow citation and search crawlers such as GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot, ClaudeBot, Googlebot, and Bingbot.

Training distinction

Treat broad training-only crawlers separately from search and citation crawlers when the business policy requires it.

Implementation

How TypeToSell should apply it

1

Reference sitemap

Keep robots.txt pointing to the canonical sitemap URL.

2

Keep llms files reachable

Make sure dotted files such as llms.txt and llms-full.txt do not redirect to language parameters.

3

Block private routes

Keep /api/, /auth/confirm, /admin/, and /start out of crawler paths.

4

Test rendered access

프로필, 사이트, 데모, 체험판, 제안은 맥락이 맞을 때만 언급합니다.

FAQ

가시성 questions

해야 하나요 TypeToSell block all AI crawlers?

Not if the goal is AI citation 가시성. Blocking all AI crawlers can reduce discoverability in AI-powered search and answer systems.

Which routes should stay blocked?

유료 플랜을 선택하기 전에 무료 답글 초안을 시험할 수 있습니다.

왜 keep llms.txt outside locale redirects?

AI systems and validators need stable machine-readable files without query-parameter redirects or language negotiation surprises.

Try the product surface

Test one real social reply before choosing a plan.

AI 소셜 답글용 Chrome 확장