How to test a crawler

In order to test the crawler configuration, it is possible to make crawl against a specific URL to see which data will be indexed for the page.

  1. In the navigation, select Configuration › Crawlers
  2. Select the crawler you wish to test
  3. Click the flask icon next to the Save crawler button
  4. In the test crawler modal, insert the URL of a page to crawl in the Insert test URL field
  5. Hit Enter
  6. Verify the Field values table has the expected value for each field
A test crawl on a cludo.com page.
Tags: