AhrefsBot
SEO / marketing analytics crawler
Identification
- User-Agent token
- AhrefsBot
- Published IP ranges
- 81
Requests claiming this User-Agent are verified against the operator's published ranges.
robots.txt behaviour
- Honours robots.txt
- Yes
- Honours crawl-delay
- Yes
- Honours Allow rules
- Yes
- Reads Sitemap directives
- Yes
Observed activity
- Distinct IPs observed
- 871
- TLS fingerprints observed
- 16
- First seen
- 2026-05-29
- Last seen
- 2026-10-16
Aggregated across traffic monitored by urlcap. Updated continuously.
Where it crawls from
Top countries (by distinct IPs)
GB
483
FR
211
US
121
CA
47
DE
4
IN
2
FI
1
MX
1
BR
1
Top networks
Unknown network
871
Verify AhrefsBot on your own traffic
One API call checks a visitor's IP against published ranges, reverse DNS and TLS fingerprints — so spoofed User-Agents don't fool you.