Technical SEO

Robots.txt

A text file at your domain's root that instructs crawlers which paths they may or may not access. It controls crawl budget but does not guarantee deindexing.

Related Terms

See these concepts in action

Hive Rank tracks how domains perform across AI search — rankings, trends, and competitive intelligence powered by crowdsourced data.