User-agent: * Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ # AI search, answer and agent crawlers — welcome User-agent: OAI-SearchBot Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: ChatGPT-User Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: GPTBot Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: Claude-SearchBot Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: Claude-User Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: ClaudeBot Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: PerplexityBot Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: Perplexity-User Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: Google-Extended Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: Applebot Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: Applebot-Extended Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: Amazonbot Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: Meta-ExternalAgent Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: MistralAI-User Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: DuckAssistBot Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: CCBot Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: cohere-ai Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ User-agent: YouBot Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ # SEO tool crawlers — rate-limited User-agent: AhrefsBot Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ Crawl-delay: 10 User-agent: SemrushBot Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ Crawl-delay: 10 User-agent: SiteAuditBot Allow: / Disallow: /parts/*.pdf Disallow: /api/ Disallow: /health/ Disallow: /mastra/ Disallow: /login/ Disallow: /beta/ Disallow: /workflow Disallow: /bubble Disallow: /command-center Disallow: /admin Disallow: /dev-login Disallow: /dev-login-pro Disallow: /rfq-auto Disallow: /design-system Disallow: /settings Disallow: /triage Disallow: /warehouse Disallow: /import/ Crawl-delay: 10 # A2A Agent Discovery # Agent Card: /.well-known/agent-card.json # MCP server (streamable HTTP): /mcp # LLM Info: /llms.txt Sitemap: https://partstable.com/sitemap.xml Sitemap: https://partstable.com/sitemap-machines.xml