# https://www.robotstxt.org/robotstxt.html User-agent: * Allow: / # Disallow private/internal areas Disallow: /admin Disallow: /admin/* Disallow: /api/ Disallow: /auth/ Disallow: /_next/ Disallow: /tender-details/ Disallow: /result-details/ # Sitemap location (tells crawlers where to find all your pages) Sitemap: https://tenderprocure.com/sitemap.xml