# Robots.txt for DigitFlow Analysis Tool Pro User-agent: * Allow: / Allow: /login Allow: /analyzer # Block sensitive directories only Disallow: /api/ Disallow: /_next/static/ Disallow: /admin/ # Prioritize Google and Bing User-agent: Googlebot Allow: / Crawl-delay: 0 User-agent: Bingbot Allow: / Crawl-delay: 0 # Allow social media crawlers for link previews User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: TelegramBot Allow: / # Sitemap location Sitemap: https://digitflowanalysistoolpro.com/sitemap.xml