User-triggered fetchers
User-initiated fetcher
Identification
- User-Agent token
- —
- Published IP ranges
- 1,068
Requests claiming this User-Agent are verified against the operator's published ranges.
robots.txt behaviour
- Honours robots.txt
- Yes
- Honours crawl-delay
- No
- Honours Allow rules
- Yes
- Reads Sitemap directives
- Yes
Observed activity
- Distinct IPs observed
- 375
- TLS fingerprints observed
- 1
- First seen
- 2026-06-02
- Last seen
- 2026-10-17
Aggregated across traffic monitored by urlcap. Updated continuously.
Where it crawls from
Top countries (by distinct IPs)
US
375
Top networks
Unknown network
375
Verify User-triggered fetchers on your own traffic
One API call checks a visitor's IP against published ranges, reverse DNS and TLS fingerprints — so spoofed User-Agents don't fool you.