Start Free TrialFree Trial

Which Pages Am I Compared With, And Why Does One Say Could Not Crawl?

How the competing pages behind your score are chosen, what Used In The Averages and Could Not Crawl mean, and what to do when we need more store pages to compare.

In Your Score And Results ยท Last Checked

Short Answer

Your page is compared only with competing store pages for its term, never with guides or articles. A page we could not crawl, because it blocked us, was too large or needed a browser we could not use that day, is listed with the reason and left out of the averages. If fewer than 4 store pages are left, nothing is scored, and the screen offers ways to add more.

Press How Your Page Compares at the top of a collection page. Near the bottom, The Competing Pages You Are Compared With lists the competing pages we found, each with its type and how we crawled it. A tick and Used In The Averages mark the pages your score is measured against. The rest say Not Averaged.

Why A Page Is Not Averaged

  • It is not a store page like yours. Guides, videos and articles show up for a search too, but comparing a collection with an article would be unfair, so only store pages count.
  • Could Not Crawl: Blocked. The site refused our crawler. We do not get around a block on someone else's site any more than on yours.
  • Could Not Crawl: Too Large. The page was bigger than we crawl.
  • Could Not Crawl: Grid Needs Rendering. Its product grid only appears after scripts run, and we could not load it in a browser that day.
  • Too Little To Compare. We crawled it, but it had almost no text.

A page we could not crawl is never guessed at or averaged as if it were empty.

When There Are Too Few

We need at least 4 store pages to compare fairly. With fewer, the collection shows We Need More Store Pages To Compare, with the sentence "Nothing was scored in this run," a list of Pages We Could Not Use with the reason for each, and what you can do:

  1. Add a competing store page you know of. On the collection page, under Add A Competing Page, paste the address of a store page that sells what you sell and press Add This Page. We take tracking parameters off it and crawl it when you measure again.
  2. Try a related search term, where we may find more competing store pages.
  3. Measure again later, when more of these pages may let our crawler in.

With 4 or 5 store pages, you get a score with the caution "Few pages to compare."

Names We Did Not Ask You To Use

Competing pages often use words that belong to them: another store's name, a marketplace's name, a date. They appear under Names We Did Not Ask You To Use. The plan never asks your page to use them, and they are left out of every count.

Still Stuck?

When a screen in the app shows Tell Us What Went Wrong, use it: the note it opens carries the page you were on, so we can look at the same thing. Otherwise, write to us at help@collectionoptimizer.com, and say which screen you were on and what it said.