A Collection Is Missing, Or It Found No Collections At All
How we find collections, the reasons one can be left out, what to do when the crawl finds none, and how to change the store address if you typed the wrong one.
Short Answer
We find collections through your sitemap, your store's own listings and the links between pages. A collection that is hidden, not linked anywhere, or kept out by robots.txt can be missed. Check the We skipped list on the crawl screen, make sure the collection is public and linked from your menu or sitemap, then crawl again. If the address itself was wrong, use Change Store.
Collections Found on the crawl screen counts every collection page we found. If one you expected is not in Pick What To Track, start with the "We skipped" list beside the counts. Each line gives a count and a reason.
Common Reasons A Collection Is Missed
- Nothing links to it. We look in your sitemaps, in your store's own collection listings and in the links between pages, including your menu. A collection with no link and no sitemap entry is very hard for any crawler to find.
- Robots.txt keeps crawlers out of it. Those addresses are skipped and counted, never opened.
- It is not public. A collection that is unpublished or only for some sales channels does not answer to a visitor, so it does not answer to us.
- It answered with an error. The skipped list says "These pages answered as not found" or "These pages took too long to answer," for example.
A very long collection has a different limit: we follow its pages up to a set number. Past that, the skipped list says "These collection pages came after the most we follow for one collection." The collection itself is still found.
When The Crawl Finds None
Pick What To Track then says We found no collections on this store. Usually the address points somewhere other than the store's own pages, such as a landing page on another domain. Check that:
- the address is your store's own web address, the one shoppers use
- your collection pages are public, and linked from the menu or the sitemap
Then press Crawl My Store Again.
If You Typed The Wrong Address
On Enter Your Store, open Change Store, type the right address, tick the box, and press Crawl This Store Instead. We stop crawling the old store, remove what we crawled of it, and crawl the new one. Only an owner or admin can do this.
Change Store is there only while nothing is tracked. Otherwise the step says "To change the store, stop tracking every collection and product first." That keeps tracked scores and tasks from pointing at a store that is gone.
One Page We Did Not Find
If you only need one page measured, you can skip the crawl's list. On All Collections, Add By Link takes any page by its address.
Still Stuck?
When a screen in the app shows Tell Us What Went Wrong, use it: the note it opens carries the page you were on, so we can look at the same thing. Otherwise, write to us at help@collectionoptimizer.com, and say which screen you were on and what it said.