Cloudflare maintains a list of "Verified" bots.
Verified bots, such as the ones from search engines, are usually transparent about who they are. Cloudflare manually approves well-behaved services that honor robots.txt.
Cloudflare maintains a list of "Verified" bots.
Verified bots, such as the ones from search engines, are usually transparent about who they are. Cloudflare manually approves well-behaved services that honor robots.txt.