The Crawl Found More Products Than My Store Has
Why Products Found can be two or three times your catalog: one product answering at several addresses. How we join them, and why the count can still look high.
Short Answer
Your store answers the same product at more than one address, for example /products/blue-pot and /collections/pots/products/blue-pot. We check a few of each pattern and, when they are the same page, count them as one product. Counts on a crawl from before this check change on your next crawl. Site Fixes then lists the pairs and how to fix them.
Products Found counts product pages, and a store can make several pages for one product. The most common causes on Shopify:
- a product linked inside a collection's address, such as
/collections/pots/products/blue-pot, as well as at/products/blue-pot - the same address with and without a slash at the end
- the sitemap listing one form while collection pages link another
To a crawler each of these is a separate page until something says they are the same.
How We Join Them
At the end of Crawling Collections we group the addresses that look like one product. For a few pairs of each pattern we crawl both forms. A pair counts as one product when a canonical tag on either names the other, when one redirects to the other, or when both have the same title tag, main heading and description. When a pattern's sample pairs agree, every pair of that pattern is joined without crawling both.
After that, every count on the crawl screen counts products, not addresses. We keep the other addresses so a card that links to one still finds its product.
Why Your Count Can Still Be Higher
- The crawl ran before the check. Counts update on your next crawl.
- The sample pairs disagreed. If two forms of an address answered with different content, we leave that pattern apart. We would rather show a high count than join two different products.
- Your store has public products you forgot about. A product you no longer sell can still answer at its address. If your sitemap or a page links to it, we find it and count it.
Filter and sort versions of a collection are a separate thing. They are counted with their collection and listed under "We skipped": "These are filter and sort versions of a collection, so we count them with that collection."
Fixing It At The Source
Joining the addresses fixes our counts, not your store. Search engines still find the extra addresses. Site Fixes lists them under Canonical And Indexing, with example pairs and the change to make. A Product Page Answers At Two Addresses walks through it.
Still Stuck?
When a screen in the app shows Tell Us What Went Wrong, use it: the note it opens carries the page you were on, so we can look at the same thing. Otherwise, write to us at help@collectionoptimizer.com, and say which screen you were on and what it said.