# KNOW IT SOLUTION — robots.txt # AI usage preferences via Content-Signal HTTP header (contentsignals.org) # Do not put Content-Signal / LLMs-Txt in the robots body — unknown directives fail SEO audits. User-agent: facebookexternalhit Allow: /og/ Allow: / Disallow: /api/ User-agent: Facebot Allow: /og/ Allow: / Disallow: /api/ User-agent: Meta-ExternalAgent Allow: /og/ Allow: / Disallow: /api/ User-agent: Twitterbot Allow: /og/ Allow: / Disallow: /api/ User-agent: LinkedInBot Allow: /og/ Allow: / Disallow: /api/ User-agent: Slackbot Allow: /og/ Allow: / Disallow: /api/ User-agent: Discordbot Allow: /og/ Allow: / Disallow: /api/ User-agent: WhatsApp Allow: /og/ Allow: / Disallow: /api/ User-agent: TelegramBot Allow: /og/ Allow: / Disallow: /api/ User-agent: GPTBot Allow: / Disallow: /api/ User-agent: ChatGPT-User Allow: / Disallow: /api/ User-agent: Google-Extended Allow: / Disallow: /api/ User-agent: ClaudeBot Allow: / Disallow: /api/ User-agent: anthropic-ai Allow: / Disallow: /api/ User-agent: Applebot-Extended Allow: / Disallow: /api/ User-agent: Bytespider Allow: / Disallow: /api/ User-agent: CCBot Allow: / Disallow: /api/ User-agent: PerplexityBot Allow: / Disallow: /api/ User-agent: Amazonbot Allow: / Disallow: /api/ User-agent: meta-externalagent Allow: / Disallow: /api/ User-agent: * Allow: / Disallow: /api/ Sitemap: https://www.knowitsolution.com/sitemap.xml # LLMs index: https://www.knowitsolution.com/llms.txt