How to delete a crawler
For security reasons, crawlers can only be deleted by Cludo staff. If you need to delete a crawler, please contact support and let us know the ID(s) of the crawler(s) you would like to delete.
For security reasons, crawlers can only be deleted by Cludo staff. If you need to delete a crawler, please contact support and let us know the ID(s) of the crawler(s) you would like to delete.
For security reasons, engines can only be deleted by Cludo staff. If you need to delete an engine, please contact support and let us know the ID(s) of the engine(s) you would like to delete.
The indexability of a file is not defined by its extension (e.g. “.pdf”), but rather by the content type, as returned in the HTTP headers. In the list below, we have added extensions as examples. Supported file types
Our crawler will always attempt to make as many requests as possible, often requesting multiple pages per second, but the actual frequency of requests depends on the server response from the website. Some websites might also have a crawl delay set in their robots.txt, which can impact how many requests . . . Read more
Stop words are fill words that don’t provide any context and they will be ignored in the search query, thereby increasing relevancy in search. There is a list of stop words for every language that is supported by Cludo. Below you can find the stop words for a few languages: . . . Read more
The MyCludo interface is designed for desktop first but responsive support, which means it will resize and adjust to individual screens sizes including mobile devices. Compatible MyCludo browsers Compatible Template browsers The overlay and inline templates and any custom implementations by Cludo are compatible on all platforms (Desktop, Mobile, Tablet) . . . Read more
Lemmatization is the process of grouping together the inflected forms of a word so they can be analyzed as a single item, identified by the word’s lemma, or dictionary form. Unlike stemming, lemmatization depends on correctly identifying the intended part of speech and meaning of a word in a sentence, . . . Read more
The way Intelligent 404 referral URLs are registered is different from referred page URLs for searches (search origin pages). For searches, the referral information is added to the URL. When the visitor lands on the search results page, Cludo will grab the referralURL from the query parameters passed to the . . . Read more
When a visitor searches, it triggers CludoJS. CludoJS sends the analytics to Google Analytics and to Cludo. If the user has any adblockers activated on their browser, all requests to Google Analytics will likely be blocked, which can cause differences in the analytics, Additionally, if for any reason a request . . . Read more
Cludo does not currently support MFA (multi-factor authentication) or 2FA (two-factor authentication) for the MyCludo interface. However, it is currently planned to release an email-based 2FA system in May 2023. Aside from this release, further channels are being investigated, which could allow for an even more secure multi-factor authentication setup. . . . Read more