Verified Bots with Cloudflare
Cloudflare recognizes Osano's signed scan requests as verified bots through Web Bot Auth.
Configure access
Follow Cloudflare's Super Bot Fight Mode guide and enable Verified bots. This setting allows all bots that Cloudflare verifies.
If another firewall rule blocks the scan, use Cloudflare's custom rule instructions and Skip action guide to create an exception for your monitored hostnames. The cf.client.bot field matches Cloudflare's known good bots.
Configure robots.txt for the pages you want Osano to scan. You can also add Custom Headers for a header-based exception.
Check the result
Run a new compliance check and record its time. In Cloudflare Security Analytics, filter the requests by:
| Filter | Value |
|---|---|
| Host | Your monitored hostname |
| Source user agent | Contains OsanoBot |
| Time range | The time of the scan |
On the Bot analysis tab, check that Traffic Distribution shows the matching requests as Verified Bot. The User-Agent filter locates the requests, while Cloudflare's classification confirms recognition.
Confirm that the expected pages loaded. If the scan is still blocked, use the matched firewall events and support details to investigate.