Custom Extraction Using an SEO Crawler for CRO and UX Insights
From e-commerce to listings websites to realty and myriad verticals beyond, the information you can harness utilizing custom extraction via spider tools is worth its weight in profits. With a greater granularity of data at your fingertips, you can reveal CRO and user experience insights that can inform your optimizations and transform your client experience.

What is customized extraction?
Let's get started. What is customized extraction? Well, as I type of simply alluded to, it allows you, when you're crawling using like Screaming Frog, for example, or DeepCrawl or whatever it is you want to utilize, it enables you to grab and extract particular parts of the HTML and export it to a file, a CSV, in Excel, or whatever you prefer
.
As a principle, all right, great, but I'm going to provide you some actually great examples of how you can actually utilize that. E-commerce, right here we have actually got a product page that I've beautifully drawn, and whatever in red is something that you can potentially draw out.
Product info + page performance.
Think of this for a moment. You're an e-commerce site, you're a listing site, and obviously you have listing pages, you have product pages. Would not it be fantastic if you could very rapidly, at scale, understand all of your products' rates, whether you've got stock, whether it's got an image, whether it's got a description, the number of evaluations it has, and of the evaluations, what's the aggregate rating, whether it's 4 stars, five stars, whatever it is?
That's actually effective since you can then begin to understand how excellent pages perform based upon the info that they have actually, based upon traffic, conversion, consumer feedback, and all sorts of terrific things, all using customized extraction and spitting it out on say a CSV or an Excel spreadsheet file.
Competitive insights.
Where it gets super powerful and you get a lot of insight from is when you start to turn the lens to your competitors and you believe about methods in which you can get those truly great insights. You might have three rivals. You may have some aspirational rivals. You might have a website that you don't always compete with, but you use them on a day-to-day basis or you admire how easy their site was to utilize, and you can disappear and do that.
You can fire up a crawl, and there's no reason why you couldn't extract that very same info from other rivals and see what's going on, to see what rates your competitors are selling an item at, do they have that in stock or not, what are the evaluations like, what Frequently asked questions do individuals have, can you then leverage that in your own material.
Examples of how to obtain insights from custom extraction in e-commerce.
Example 1: Price increases for items rivals do not stock.
Let me offer you a perfect example of how I've managed to utilize this.I have actually managed to recognize that a competitor does not have a specific product in stock, and, as a result of that, I've had the ability to increase our rates due to the fact that they didn't offer it. We did at seo that specific time, and we might recognize the cost point, the fact that they didn't have any stock, and it was amazing. Think about that. Really effective insights at enormous amounts of scale.
Example 2: Improving elements and filters on classification pages.
Another example I wished to speak with you about. Classification pages, again exceptionally gorgeous illustrations. So category pages, we have filters, we have a category page, and just to switch things up a little bit I've likewise got like a listings page also, so whether it's, as I stated, property, jobs, or anything in that environment.
If you consider the competition once again for a 2nd, there is no reason why you wouldn't have the ability to extract through custom extraction the best filters that people use, the leading filters, the top facets that people like to pick and understand. You can then see whether you're utilizing the very same kind of combinations of functions and aspects on your website and possibly enhance that.
Equally, you can then start to understand what particular functions associate to sales and efficiency and effects and actually begin to improve the performance of how your site performs and acts for your customers. The very same thing applies to both environments here.
If you are a listing site and you list jobs or you list items or classified advertisements, is it place filters that they have at the top? You can crawl a number of your competitors throughout a number of locations and determine whether there's a pattern, see a style, and then see whether you can utilize and much better that and take benefit of that. That's an excellent way in which you can utilize it.
Example 3: Suggestions, recommendations, and optimization.
However on top of that and the one that I am most captivated with is without a doubt recommendations.In the MozCon talk I did earlier I had a fact, and I believe I can recall it. It was 35% of what individuals purchase on Amazon originates from recommendations, and 75% of what individuals see on Netflix originates from ideas, from recommendations.
Think of how powerful that is. You can crawl your own site, comprehend your own recommendations at scale, identify the stock of those suggestions, the price, whether they have images, in what order they are, and you can start to build a really vivid photo as to what items people relate to your products. You can do that on a worldwide scale. You can crawl the entire of your product portfolio or your listing portfolio and get that
.
Again, back to effective intelligence, your rivals, especially when you have rivals that may have multivariable facets or multivariable recommendations. What I suggest by that is we've all seen websites where you've got several carousels. So you have actually got Recommended for You.


You might have People Also Bought, alternative recommendations. The more different kinds of recommendations you have, the more information you have, the more intelligence you have, the more insight you have. Returning to state a property example, you might be looking at a home here. It's at this price. What is your primary aspirational real estate competitor recommending to you that you may not be aware of?
Then you can consider whether the focus is on area, whether it's on rate, whether it's on number of bedrooms, and so on, and you can start to understand and act how that can work and get some truly effective insights from that.
Customized extraction is all about granular data at scale.
To sum up and bring everything to a close, custom-made extraction is everything about terrific granular information at scale. The really powerful thing about it is you can do all of this yourself, so there's no need to have to have meetings, send out intricate emails, get authorization from somebody.