We started working with a US-based Shopify website a few months ago. It's small - at most 25 products, tiny compared to most of the e-commerce sites we work on. But a technical SEO audit turned up a big bottleneck: more than 5.5K URLs sitting in Google Search Console's "Crawled - currently not indexed" bucket.
That's not a normal amount of noise for a store this size. Something was eating the crawl budget.
The problem
Shopify generates a lot of parameter URLs behind the scenes - filtered collection views, sort orders, session variants - and on this store, Google was crawling all of them. Every one of those parameter URLs competed for the same crawl budget as the actual product and category pages that mattered. With only 340 pages indexed against a catalogue this size, the real pages were losing that competition.
The fix
We didn't rebuild anything. We updated the robots.txt file to block the Shopify-generated parameter URLs, freeing up crawl budget for the pages worth indexing. One file, a short discussion with the developer, and it shipped the same week.
What happened next
Three weeks later, the crawl and indexing numbers had moved in the right direction across the board: crawled-but-not-indexed URLs dropped from 5.5K to under 3.5K. Indexed pages went from 340 to over 1K, almost 200% up. Total impressions went from 1.7K daily to 4.5K, about 160% up. Total clicks were up by more than 150%.



What we won't claim
It's early days for this client, and we're not going to dress this up as more than it is. Three weeks isn't a full quarter, and topline numbers like these usually settle somewhat once the initial re-crawl wave passes. What we do know is the theory held: a store this size and this clean shouldn't have thousands of URLs stuck in indexing limbo, and a two-line change to robots.txt was enough to clear it. Whether the gains hold at this rate over the next few months is the part we're watching, not claiming yet.
If your crawl stats look out of proportion to your catalogue size, a technical SEO audit usually finds it in a day. We do the same work across e-commerce builds more broadly.

Jinnat Ul Hasan
Founder & CEO, Whizz People




