What are the crawlers’ user agent and IP addresses?

15 May, 2026 FAQ

In some cases, the crawler may be blocked from indexing your website. To fix this, you may need to whitelist our IP address and/or add the user agent to allow the crawler to access the site.

Our crawler’s user agent is: 

Mozilla/5.0 (Windows NT 10.0; cludo.com bot) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/148.0.7778.98 Safari/537.36

We recommend referring to our crawler’s user agent simply as cludo to avoid sensitivity to changes in the full user agent string:

User-agent: cludo
Allow: *

Our crawler’s IP addresses are:

  • EU: 52.57.207.129
  • US: 52.6.240.133

These are the IPs of the proxy that all of Cludo’s internal services use whenever they need to communicate with the outside, including crawlers. We are requesting via standard ports by default: 80 for http, 443 for https.

You only need to whitelist the IP address for the cluster your account is on, EU or US. If you’re in doubt whether you’re account is located on our EU or US cluster, don’t hesitate to contact support.

Tags:  ,

Related Posts