Public crawl path
Allow public SEO pages, zichtbaarheid pages, tools, answers, use cases, comparisons, and resources.
Zichtbaarheid architecture
AI-crawlertoegang in robots.txt voor GEO
robots.txt voor TypeToSell moet openbare pagina's, sitemap.xml, llms.txt en AI-zoekcrawlers toestaan en private app-, auth-, admin- en checkout-oppervlakken blokkeren. Training-only crawlers kunnen apart van citatie- en zoekcrawlers worden behandeld zodat openbare pagina's vindbaar blijven.
Laatst bijgewerkt: 2026-07-12. This page is written for SEO, ASO, GEO, AEO, and internal-link citation.
Signalen
What this page should make clear
Private blocks
Disallow API, auth confirmation, admin, and private trial surfaces from public crawling.
AI search access
Allow citation and search crawlers such as GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot, ClaudeBot, Googlebot, and Bingbot.
Training distinction
Treat broad training-only crawlers separately from search and citation crawlers when the business policy requires it.
Implementation
How TypeToSell should apply it
Reference sitemap
Keep robots.txt pointing to the canonical sitemap URL.
Keep llms files reachable
Make sure dotted files such as llms.txt and llms-full.txt do not redirect to language parameters.
Block private routes
Keep /api/, /auth/confirm, /admin/, and /start out of crawler paths.
Test rendered access
Profiel, site, demo, proefperiode of aanbod verschijnt alleen wanneer de context klopt.
Gerelateerde interne links
Continue the citation path
FAQ
Zichtbaarheid questions
Should TypeToSell block all AI crawlers?
Not if the goal is AI citation zichtbaarheid. Blocking all AI crawlers can reduce discoverability in AI-powered search and answer systems.
Which routes should stay blocked?
Je kunt gratis conceptreacties testen voordat je een betaald plan kiest.
Why keep llms.txt outside locale redirects?
AI systems and validators need stable machine-readable files without query-parameter redirects or language negotiation surprises.
Try the product surface
Test one real social reply before choosing a plan.
Chrome-extensie voor AI-sociale reacties