Start Free TrialFree Trial

Crawling Your Store

A slow crawl, a store that blocks our crawler, product counts that look doubled and collections that seem to be missing.

  1. The Crawl Is Slow Or Looks Stuck

    Why crawling a store takes time, how to tell a slow crawl from a stopped one, and what you can do while it runs.

    Last Checked

  2. It Says Your Store Blocked Our Crawler

    What a blocked crawl means, why we stop instead of working around it, and how to let our crawler in through robots.txt or a bot protection app.

    Last Checked

  3. The Crawl Found More Products Than My Store Has

    Why Products Found can be two or three times your catalog: one product answering at several addresses. How we join them, and why the count can still look high.

    Last Checked

  4. A Collection Is Missing, Or It Found No Collections At All

    How we find collections, the reasons one can be left out, what to do when the crawl finds none, and how to change the store address if you typed the wrong one.

    Last Checked

  5. What Does "Loaded In A Browser" Mean On The Crawl Screen?

    Why we fetch some pages twice, what it means when scripts add product cards or text after a page loads, and why that text does not count toward your score.

    Last Checked

All Help Sections