Connect Crawlens to Claude & other AI tools

Crawlens includes an MCP server. Once it's connected, the AI app you already use can read your crawls and audits, then explain issues, prioritise fixes and write the tickets. It uses your own AI subscription, so there's no API key to set up.

Works withClaude DesktopClaude CodeCodexCursorVS Codeand other MCP apps

What it does

MCP (Model Context Protocol) is the standard way for AI apps to use outside tools. When your AI app needs Crawlens data, it starts Crawlens's MCP server on your computer. The server reads your saved crawls and audits and hands back compact, paginated results.

1. Turn it on in Crawlens

Sharing is off by default. Nothing is visible to AI tools until you switch it on.

  1. Open Crawlens and go to Settings → Integrations → AI tools (MCP).
  2. Turn on Share audits with AI tools.
  3. Under Projects AI tools can read, keep All projects or pick Only these projects.
  4. Optional: turn on Hide Search Console and Analytics data to keep clicks, impressions, sessions and URL Inspection results out of what AI tools see.

You need at least one project with an audited crawl. If you haven't crawled anything yet, do that first. The AI has nothing to read until then.

2. Connect your AI tool

The same settings card has a Copy setup for button for each app. Use it: it fills in the exact paths for your installation. The snippets below show what that setup looks like, with placeholder paths.

Claude Desktop

  1. Click Add to Claude Desktop.
  2. Quit and reopen Claude Desktop. Closing the window isn't enough: quit it from the system tray.
  3. In a new chat, open the tools menu. You should see crawlens listed.

Crawlens adds itself to claude_desktop_config.json and keeps your other MCP servers. If the file already exists, it saves a dated backup next to it first. Both the regular and the Microsoft Store versions of Claude Desktop are supported.

Prefer to edit the config yourself?

Add this to %APPDATA%\Claude\claude_desktop_config.json, merging with any mcpServers already there:

{
  "mcpServers": {
    "crawlens": {
      "command": "C:\\path\\to\\Crawlens.exe",
      "args": ["C:\\path\\to\\resources\\mcp\\server.mjs", "--user-data", "C:\\Users\\you\\AppData\\Roaming\\Crawlens"],
      "env": { "ELECTRON_RUN_AS_NODE": "1" }
    }
  }
}

Claude Code

  1. Click Copy setup for → Claude Code.
  2. Paste the command into a terminal and run it.
  3. Start claude and run /mcp to check that crawlens is connected.

The command registers Crawlens for your user account (--scope user), so it's available in every project:

claude mcp add crawlens --scope user --env ELECTRON_RUN_AS_NODE=1 -- "C:\path\to\Crawlens.exe" "C:\path\to\resources\mcp\server.mjs" --user-data "C:\Users\you\AppData\Roaming\Crawlens"

Codex

One setup covers the Codex CLI, the IDE extension and the app.

  1. Click Copy setup for → Codex.
  2. Paste it at the end of ~/.codex/config.toml (create the file if it doesn't exist).
  3. Restart Codex.
[mcp_servers.crawlens]
command = 'C:\path\to\Crawlens.exe'
args = ['C:\path\to\resources\mcp\server.mjs', '--user-data', 'C:\Users\you\AppData\Roaming\Crawlens']

[mcp_servers.crawlens.env]
ELECTRON_RUN_AS_NODE = '1'

The copied setup also includes the equivalent codex mcp add … command as a comment, if you'd rather run that.

Cursor

  1. Click Copy setup for → Cursor.
  2. Open ~/.cursor/mcp.json and paste it in. If the file already has servers, add the crawlens entry inside the existing mcpServers.
  3. Check Cursor Settings → MCP: crawlens should show as enabled.
{
  "mcpServers": {
    "crawlens": {
      "command": "C:\\path\\to\\Crawlens.exe",
      "args": ["C:\\path\\to\\resources\\mcp\\server.mjs", "--user-data", "C:\\Users\\you\\AppData\\Roaming\\Crawlens"],
      "env": { "ELECTRON_RUN_AS_NODE": "1" }
    }
  }
}

VS Code

  1. Click Copy setup for → VS Code.
  2. Paste it into .vscode/mcp.json in your workspace. Alternatively, run MCP: Add Server from the Command Palette.
  3. Open Copilot Chat in agent mode and check the tools list for crawlens.
{
  "servers": {
    "crawlens": {
      "type": "stdio",
      "command": "C:\\path\\to\\Crawlens.exe",
      "args": ["C:\\path\\to\\resources\\mcp\\server.mjs", "--user-data", "C:\\Users\\you\\AppData\\Roaming\\Crawlens"],
      "env": { "ELECTRON_RUN_AS_NODE": "1" }
    }
  }
}

Other MCP apps: anything that supports stdio MCP servers works. Use the same command, arguments and ELECTRON_RUN_AS_NODE=1 environment variable as above.

3. Test the connection

Back in Crawlens, click Test connection. Crawlens starts the server exactly the way your AI app will and reports what it found, for example:

Working: 8 tools, 3 prompts · 2 projects shared

If that works but your AI app doesn't show Crawlens, the problem is on the app's side. Restart the app, and see Troubleshooting.

What to ask

Refer to your project by its name or domain. A few prompts that work well:

Summarise the latest Crawlens audit of example.com and give me a prioritised fix list.
Write new titles for the pages with missing titles.
Explain the redirect chains to our developer.
What got worse since the previous crawl?
Which pages get search clicks but return errors or are noindex?
Find indexable pages in positions 11–20 and suggest how to push them onto page one.

Tools & prompts

These are what your AI app sees. Results are paginated (50 rows by default) so large sites don't flood the conversation.

ToolWhat it returns
list_projectsProjects shared from Crawlens, with their latest crawl.
list_crawlsCrawls of a project, newest first, with health score and issue counts.
get_overviewSummary of an audited crawl: health score, issues by severity, top issues, response codes, indexability, Core Web Vitals, and Search Console, Analytics and server-log totals when available.
list_issuesEvery check with issues: what it means, how to fix it, and how many URLs are affected (most severe first).
get_issue_urlsThe URLs affected by one issue, with the details for each URL.
query_urlsFilter, sort and page through crawled URLs like the URLs table, including Search Console, GA4 and custom extraction columns.
get_url_detailsEverything about one URL: SEO fields, issues, links, redirects, headers, structured data, raw vs rendered HTML, Core Web Vitals and search data.
compare_crawlsWhat changed between two crawls: health score, new and fixed issues per check, and URL changes.

Ready-made prompts appear in your AI app's prompt or slash-command menu, where supported:

PromptWhat it does
Summarise the audit & prioritise fixesExecutive summary of the latest audit and a fix plan ordered by impact vs effort, with who should fix each item and example URLs.
Rewrite titles & meta descriptionsNew titles (30–60 characters) and descriptions (70–160) for pages with title or description issues, in each page's own language.
Explain an issue for developersOne issue explained with this site's actual URLs and values: cause, how to verify, how to fix, and a checklist.

Privacy & safety

Crawlens doesn't upload anything, but your AI app sends what it reads to its own AI service as part of the conversation. That follows the AI app's privacy terms, so check them before sharing client data.

Troubleshooting

Crawlens doesn't appear in my AI app
Fully restart the app after adding the setup. Claude Desktop keeps running in the system tray, so quit it from there. For Cursor and VS Code, check the JSON is still valid after pasting: a missing comma breaks the whole file.
“Sharing audits with AI tools is turned off”
Turn on Share audits with AI tools in Settings → Integrations → AI tools (MCP).
“No shared project matches …”
The project isn't in the list AI tools may read, or the name doesn't match. The error lists the projects that are available. Add the project under Projects AI tools can read, or ask using one of those names.
“This project has no audited crawl yet”
Run a crawl of the site in Crawlens first. The AI reads audits, so it needs at least one finished, audited crawl.
“This data was saved by an older Crawlens”
Open the project in Crawlens once. That updates its data, and the AI app can read it again.
It stopped working after I moved or reinstalled Crawlens
The setup contains the path to Crawlens.exe. Copy the setup again from Crawlens (or click Add to Claude Desktop again) so the paths are current. Moving the data folder inside Crawlens is fine: the server follows it automatically.
“… is not valid JSON, so Crawlens left it untouched”
Your claude_desktop_config.json already had a syntax error, so Crawlens didn't change it. Fix or remove the file, then click Add to Claude Desktop again.

Don't have Crawlens yet?

Download it, crawl a site, then come back here to connect your AI tools.

Download free for Windows