CrawlensDownload
NewAsk Claude, Cursor or Codex about your audits

The desktop crawler that turns technical SEO audits into a clear fix list

Crawlens crawls your site the way a search engine does, runs 70 checks, and lines every issue up with Search Console, Analytics and Core Web Vitals data. So you know what to fix first, and why.

Download free for WindowsSee what it checks

Free · Windows · Up to 100,000 URLs per crawl · v0.20.1, 113.7 MB

Crawlens
example-store.comCrawl #14 · 2 Oct 2026 · Start URL mode · JS rendering on
Start crawl
Health score78/100 Fair
URLs crawled4,812+126 since last crawl
Issues found23
IssueSeverityURLs
Pages link to broken internal URLsCritical37
Canonical points to a non-200 URLCritical12
Pages with search traffic are not indexableWarning8
Redirect chains (2+ hops)Warning148
Poor LCP for real usersWarning41
Duplicate page titlesWarning96
Pages ranking just below page one (positions 11–20)Notice63
70built-in audit rules
JSrendering, raw vs rendered
CWVfield and lab data
GSC + GA4joined to every URL
Logswhat Googlebot really crawls
MCPfor Claude & AI tools

How it works

Everything a technical audit needs, in one place on your PC

Crawl data, audit results and Google data live in a folder you choose. No uploads, no waiting on a server queue.

01 · Crawl

Crawl it the way Google sees it

Start from a URL, a sitemap, or a list you paste in. Turn on JavaScript rendering and Crawlens compares the raw HTML with what the browser builds, so you catch titles, canonicals and links that only exist after JS runs.

  • Start URL, sitemap and list modes
  • Respects robots.txt and follows redirect chains to the end
  • Close the app mid-crawl and pick up where you left off
02 · Audit

70 checks, each with why it matters and how to fix it

Every issue comes with a plain-English explanation and a concrete fix, so you can hand it straight to a developer or a client. Severity rolls up into a single health score you can track crawl after crawl.

  • Status codes, redirects, canonicals, indexability
  • Titles, meta, headings, thin and near-duplicate content
  • Hreflang, structured data, mixed content, internal linking
03 · Prioritise

See which problems cost you traffic

Connect Google Search Console and GA4, and pull Core Web Vitals from PageSpeed Insights. Clicks, impressions, sessions and LCP sit next to every URL, and the audit flags the pages where it really hurts: errors on pages people land on, indexable pages with no impressions, page-two rankings within reach.

  • Search Console, GA4 and CrUX history per URL
  • Core Web Vitals for real users plus Lighthouse lab scores
  • Server log analysis: what Googlebot crawls, and what it misses
04 · Explain & fix

Ask your AI assistant about your actual audit

Crawlens includes an MCP server. Claude Desktop, Claude Code, Codex, Cursor and VS Code can read your crawls and audits, then summarise them, prioritise fixes, rewrite titles or explain an issue to your developer. It uses the AI subscription you already have. No API key needed.

  • Read-only and local: nothing is uploaded by Crawlens, no network port is opened
  • You choose which projects AI tools can see, and can hide Search Console and Analytics data
  • One click to add to Claude Desktop, copy-paste setup for the rest
How to connect Crawlens to your AI tools

And the rest of the toolkit

Built for the audit, and everything after it

Compare crawls

See what changed between two crawls: new issues, fixed issues, URLs added, removed or changed.

White-label PDF reports

Client-ready reports with your logo and colours, generated from the audit in one click.

Custom extraction & rules

Pull prices, authors, tracking IDs or schema fields with CSS selectors or regex, then write your own audit rules on top.

Scheduled crawls & alerts

Crawl daily, weekly or monthly in the background and get an email when the health score drops or new critical issues appear.

Log file analysis

Import server logs, verify real Googlebot hits, and find the pages Google ignores or the ones it crawls that you didn't know about.

Import & export

Bring in crawl data from Screaming Frog and other tools. Export tables to CSV and the full audit to Excel.

A typical audit

From first crawl to signed-off fixes

  1. 1

    Crawl

    Point Crawlens at a site, sitemap or URL list. Render JavaScript if the site needs it.

  2. 2

    Audit

    70 rules run automatically. Issues are grouped by severity with a health score on top.

  3. 3

    Prioritise

    Layer on Search Console, GA4, Core Web Vitals and logs to see which issues hit traffic.

  4. 4

    Hand off

    Send a branded PDF, export the URLs, or let your AI assistant write the tickets.

FAQ

Questions, answered

Can't find what you need? The docs cover setup in detail.

Is Crawlens free?

Yes. Crawlens is a free desktop app for Windows. AI features use the AI app you already have, so there is no API key or extra subscription to pay for.

How many URLs can Crawlens crawl?

Up to 100,000 URLs per crawl, from a start URL, a sitemap or a list of URLs you paste in.

Does Crawlens work on Mac or Linux?

Not yet. Crawlens currently runs on Windows. Mac and Linux versions are planned, and this page will be updated when they are available.

What does Crawlens check?

70 built-in rules covering response codes, redirects, canonicals, indexability, titles and meta descriptions, headings, duplicate content, hreflang, structured data, internal links, images, HTTPS, JavaScript rendering, Core Web Vitals, server logs, and Search Console and GA4 data. Each issue explains why it matters and how to fix it.

Does Crawlens render JavaScript?

Yes. Turn on Render JavaScript and Crawlens loads each HTML page in Chromium, compares the raw and rendered HTML, and flags SEO tags, links and content that only exist after JavaScript runs.

Is my crawl data uploaded anywhere?

No. Crawls, audits and Google data are stored in a folder you choose on your computer. Crawlens only contacts Google when you connect Search Console, GA4 or PageSpeed Insights.

Can I use Crawlens with Claude or other AI tools?

Yes. Crawlens includes an MCP server, so Claude Desktop, Claude Code, Codex, Cursor and VS Code can read your audits, prioritise fixes and explain issues using your existing AI subscription.

How is Crawlens different from Screaming Frog?

Both are desktop SEO crawlers. Screaming Frog's free version is limited to 500 URLs; Crawlens is free for crawls of up to 100,000 URLs and includes Search Console, GA4, Core Web Vitals, log file analysis and an MCP server for AI tools.

From the blog

Technical SEO, in practice

All posts

Changelog

What's new

Current version: 0.20.1

  1. v0.20.0MCP server: connect your audits to Claude and other AI tools
  2. v0.19.0Server log file analysis
  3. v0.18.0Scheduled crawls and email alerts
  4. v0.17.0Google Analytics 4 and CrUX history
  5. v0.16.0Google Search Console integration
  6. v0.15.0Import crawl data from other tools

Run your next audit with Crawlens

Install it, point it at a site, and have a prioritised fix list before your coffee goes cold.

Download free for Windows

Free · Windows · v0.20.1, 113.7 MB