Custom extraction for SEO: 8 things to pull from every page
Use CSS selectors and regex to extract prices, authors, dates, analytics tags and schema fields from every page, then flag pages with custom rules.
Blog
Audit walkthroughs, how-tos and what’s new in Crawlens. Written for people who fix sites, not just report on them. Page 9 of 13.
Use CSS selectors and regex to extract prices, authors, dates, analytics tags and schema fields from every page, then flag pages with custom rules.
The technical SEO problems specific to online stores (facets, pagination, variants, product data, stock changes) and how to audit a large catalogue.
Why filter and sort URLs cause overcrawling and duplicates, how Google recommends handling them, and how to choose which filtered pages to index.
Find every broken internal link, external link and 404 page on a site with one crawl, decide which ones matter, and fix them at the source.
Exact and near-duplicate pages, duplicate titles and descriptions. How to find them across a site and when to redirect, canonicalise or rewrite.
What Google says decides which pages AI Overviews and AI Mode cite, what makes a page eligible, which AEO and GEO tactics you can ignore, and how to measure it.
What each Search Console report tells you, the limits of its data, and five SEO workflows: quick wins, low CTR, traffic drops, cannibalization and decay.
Invalid codes, missing return links, non-indexable alternates, no self-reference, no x-default. How to find and fix the hreflang errors that break SEO.
Pages still on HTTP, HTTP that doesn't redirect, and images or scripts loaded insecurely on HTTPS pages. How to find them across a site and fix them.
Crawl, audit 70 checks, and line them up with Search Console and Core Web Vitals data.
Download free for Windows