Public crawl path
Allow public SEO pages, Sichtbarkeit pages, tools, answers, use cases, comparisons, and resources.
Sichtbarkeit architecture
KI-Crawler-Zugriff in robots.txt fuer GEO
Die robots.txt fuer TypeToSell sollte oeffentliche Seiten, sitemap.xml, llms.txt und AI-Suchcrawler erlauben und private App-, Auth-, Admin- und Checkout-Bereiche blockieren. Training-only Crawler koennen getrennt von Citation- und Suchcrawlern behandelt werden, damit oeffentliche Seiten auffindbar bleiben.
Zuletzt aktualisiert: 2026-07-12. This page is written for SEO, ASO, GEO, AEO, and internal-link citation.
Signale
What this page should make clear
Private blocks
Disallow API, auth confirmation, admin, and private trial surfaces from public crawling.
AI search access
Allow citation and search crawlers such as GPTBot, OAI-SearchBot, ChatGPT-User, PerplexityBot, ClaudeBot, Googlebot, and Bingbot.
Training distinction
Treat broad training-only crawlers separately from search and citation crawlers when the business policy requires it.
Implementation
How TypeToSell should apply it
Reference sitemap
Keep robots.txt pointing to the canonical sitemap URL.
Keep llms files reachable
Make sure dotted files such as llms.txt and llms-full.txt do not redirect to language parameters.
Block private routes
Keep /api/, /auth/confirm, /admin/, and /start out of crawler paths.
Test rendered access
Profil, Website, Demo, Test oder Angebot erscheinen nur, wenn der Kontext passt.
Verwandte interne Links
Continue the citation path
FAQ
Sichtbarkeit questions
Sollte TypeToSell block all AI crawlers?
Not if the goal is AI citation Sichtbarkeit. Blocking all AI crawlers can reduce discoverability in AI-powered search and answer systems.
Which routes should stay blocked?
Kostenlose Antwortentwuerfe koennen vor einem bezahlten Plan getestet werden.
Warum keep llms.txt outside locale redirects?
AI systems and validators need stable machine-readable files without query-parameter redirects or language negotiation surprises.
Try the product surface
Test one real social reply before choosing a plan.
KI-Social-Reply-Chrome-Erweiterung