Recently, I started working for a US-based Shopify website. I found Crawled but not indexed URLs to be a huge bottleneck. The website is tiny compared to some of the e-commerce websites I have worked on – it has at most 25 products!
However, it had more than 5.5K URLs in the “Not Indexed” section.
During my technical SEO audit, I noticed the Shopify-generated URLs were clogging up the crawl budget. After a short discussion, the developer and I updated the robots.txt file to block the parameter URLs.
In just two to three weeks, we got a massive boost in indexing and traffic:
- Crawled – currently not indexed dropped from 5.5K to less than 3.5K
- Indexed pages are up from just 340 to more than 1K – almost 200% up
- Total Impressions are up from 1.7 K daily to 4.5K – about 160% up!
- Total clicks up by more than 150%
It’s an early day for the client and me, but I am happy to show that a tiny change can bring excellent results!



—
📩 Contact me if you need help with your Shopify or e-commerce website. I promise I won’t bite!