About the iGamingDetect bot
Last updated
If you found this page from a server log, this is the crawler that visited you. It exists for one narrow job: finding out where an affiliate tracking link ends up.
What the bot does
iGamingDetect is a Chrome extension that helps marketing teams see which operators are listed on affiliate pages. Affiliate links are usually cloaked behind tracker URLs (for example /go/brand-name or a third-party redirector). Our extension never follows those links from a user's browser — doing so would register a fake click against the operator.
Instead, when a link cannot be identified from its pattern alone, our server fetches it once, follows the redirect chain to its final hostname, caches the result, and never fetches that URL again unless the cached answer is stale. The bot does not index content, render pages, execute JavaScript, or store page bodies. It records only the hop chain (URLs and HTTP status codes).
How to identify it
Requests carry an honest, stable user agent that links back to this page:
iGamingDetectBot/1.0 (+https://igamingdetect.com/bot)The bot never spoofs a browser user agent and never solves anti-bot challenges. If a redirector answers with a challenge page, we record the link as unresolvable and move on.
Crawl behaviour
- One request per unique URL. Results are cached; re-checks happen no sooner than 90 days later.
- Rate limited per domain. One connection at a time per hostname, with at least two seconds between requests.
- Redirects only. Follows HTTP 3xx, meta-refresh and simple JavaScript location redirects, up to five hops, then stops.
- robots.txt. Checked on the first hop of every chain and honoured.
- No cookies, no forms, no clicks. Cookies are stripped between hops. The bot never submits forms or interacts with the page.
- Public URLs only. Private, loopback and link-local addresses are refused at every hop.
How to block it
Add the following to your robots.txt. The bot checks it before the first hop and will not fetch disallowed paths.
User-agent: iGamingDetectBot
Disallow: /You can also block the user agent at the edge (firewall, CDN rules). Either way, no further requests will be made to your host, and links pointing at you will simply show as unresolved in our product.
Contact
Questions about crawl traffic, or a request to have your domain excluded permanently: bot@igamingdetect.com. Include the hostname and, if you have it, a log line with the timestamp.