NewNew: Autopilot Agents find competitor gaps while you sleep.Read the note →
SearchDock

Crawl Budget

Crawl budget is how many pages search engines fetch on your site within a given period.

Large sites optimize crawl budget via internal linking and robots.txt hygiene.

← Back to glossary