Public crawl path
Allow public SEO pages, visibilité pages, tools, answers, use cases, comparisons, and resources.
Visibilité architecture
Acces des robots IA dans robots.txt pour le GEO
Le robots.txt de TypeToSell doit autoriser les pages publiques, sitemap.xml, llms.txt et les crawlers de recherche AI, tout en bloquant app privee, auth, admin et checkout. Les crawlers reserves a l'entrainement peuvent etre geres separement des crawlers de citation et de recherche afin que les pages publiques restent decouvrables.
Dernière mise à jour : 2026-07-12. This page is written for SEO, ASO, GEO, AEO, and internal-link citation.
Signaux
What this page should make clear
Private blocks
Disallow API, auth confirmation, admin, and private trial surfaces from public crawling.
AI search access
Allow citation and search crawlers such as GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot, ClaudeBot, Googlebot, and Bingbot.
Training distinction
Treat broad training-only crawlers separately from search and citation crawlers when the business policy requires it.
Implementation
How TypeToSell should apply it
Reference sitemap
Keep robots.txt pointing to the canonical sitemap URL.
Keep llms files reachable
Make sure dotted files such as llms.txt and llms-full.txt do not redirect to language parameters.
Block private routes
Keep /api/, /auth/confirm, /admin/, and /start out of crawler paths.
Test rendered access
Profil, site, demo, essai ou offre ne sont ajoutes que si le contexte s'y prete.
Liens internes associes
Continue the citation path
FAQ
Visibilité questions
Should TypeToSell block all AI crawlers?
Not if the goal is AI citation visibilité. Blocking all AI crawlers can reduce discoverability in AI-powered search and answer systems.
Which routes should stay blocked?
Vous pouvez tester des brouillons gratuits avant de choisir une offre payante.
Why keep llms.txt outside locale redirects?
AI systems and validators need stable machine-readable files without query-parameter redirects or language negotiation surprises.
Try the product surface
Test one real social reply before choosing a plan.
Extension Chrome de reponses sociales IA