SEO
Robots.txt
A text file at a site's root that tells search-engine crawlers which URLs they can access.
In practice
Robots.txt appears across seo workflows. Practitioners encounter it when planning campaigns, evaluating performance, or briefing collaborators. The most common pitfall is treating it as a vanity number rather than a decision-supporting signal.
Related in SEO