New researchTechnical SEO & AI Search · 2027Explore the framework

Technical SEO glossary: 70+ audit terms explained

Plain-English definitions of the technical SEO terms in an audit, from canonical and crawl budget to INP, hreflang and soft 404, with links to full guides.

Technical SEO has a vocabulary problem: half the terms sound alike (noindex and nofollow, canonical and canonicalised, crawled and indexed), and the other half are acronyms. This glossary defines the terms you'll meet in a technical SEO audit, grouped by topic, with the threshold where one applies and a link to the full guide.

For how the pieces fit into an audit, start with the technical SEO audit guide.

Crawling

Crawling
A search engine's bot downloading a page. Pages that can't be crawled can't be read. See crawling and indexing.
Crawler / bot / user agent
The program that crawls (Googlebot, Bingbot, OAI-SearchBot) and the name it sends with each request. robots.txt rules are matched against it.
robots.txt
A text file at the root of a host that tells crawlers which URLs they may request. It controls crawling, not indexing. See robots.txt for SEO.
Disallow / Allow
Robots.txt rules blocking or permitting paths. The longest matching rule wins.
Crawl budget
The set of URLs a search engine can and wants to crawl on a site. It matters mainly for large or fast-changing sites. See crawl budget.
Crawl Stats report
Search Console's view of Googlebot request trends, host availability and response breakdowns. It is not a list of indexed pages or a complete URL-level crawl history. See how to read Crawl Stats.
Crawl depth / click depth
How many clicks a page is from the start page. Crawlens flags pages more than 4 clicks deep. See the internal linking audit.
Discovery
How a search engine learns a URL exists: links, sitemaps or submissions.
Indexing API
Google's notification API for qualifying job posting and livestream pages, not a shortcut for indexing ordinary articles or products. See Google Indexing API.
Faceted navigation
Filters (size, colour, price) that change the URL, often creating huge numbers of crawlable combinations. See faceted navigation SEO.
Category page
A collection page that groups related products and links shoppers and crawlers to narrower collections or individual products. See ecommerce category page SEO.
Internal site search page
The results shown after someone searches within a website. Most arbitrary query URLs are better kept out of search results; recurring useful demand may become a curated category. See internal site search SEO.
URL parameters
Key-value pairs after ? in a URL, used for tracking, sorting, filtering or pagination. Whether to crawl and index a variant depends on what its content changes. See URL parameters and SEO.
Log file analysis
Reading server access logs to see what crawlers actually requested. See log file analysis.
Orphan page
A page no internal link points to, found only through sitemaps or external links. See orphan pages.

Indexing

Indexing
A search engine analysing a page and storing it so it can appear in results. Indexing isn't guaranteed.
Indexable
A page that returns 200, isn't blocked or noindexed, and has a self-referencing (or no) canonical.
noindex
A robots directive, in a meta tag or the X-Robots-Tag header, that keeps a page out of the index. The page must stay crawlable for it to be seen. See noindex vs robots.txt.
X-Robots-Tag
An HTTP header that carries robots directives, useful for non-HTML files like PDFs.
Canonical (rel="canonical")
A tag naming the preferred URL among duplicates. It's a strong signal, not a command. See canonical tag errors.
Canonicalised page
A page whose canonical points to a different URL, so it isn't the version meant to be indexed.
Self-referencing canonical
A canonical pointing to the page's own URL.
Duplicate / near-duplicate content
Pages with identical or almost identical text, competing to be the indexed version. See duplicate content.
Thin content
Pages with little of value; Crawlens flags indexable pages under 200 words as candidates. See thin content.
Crawled - currently not indexed / Discovered - currently not indexed
Search Console statuses for pages Google fetched but didn't index, or found but hasn't fetched. See crawled - currently not indexed.
Soft 404
A page that returns 200 but looks like an error or is nearly empty; Google treats it as missing. See soft 404 errors.

Status codes and redirects

Status code
The server's three-digit response to a request: 2xx success, 3xx redirect, 4xx client error, 5xx server error.
200 OK
The page loaded successfully. Indexable pages need it.
404 / 410
Not found / gone. Fine for pages removed with no replacement. See broken links.
5xx
Server errors. Persistent ones get pages dropped and slow down crawling.
301 / 308
Permanent redirects. Search engines treat the target as the canonical.
302 / 307
Temporary redirects. They don't pass the canonical signal; use them only for genuinely temporary moves.
Redirect chain
Several redirects in a row before the final URL. Crawlens flags chains of 2 or more hops. See redirect chains.
Redirect loop
Redirects that eventually point back to themselves and never resolve.
Redirect map
The list of old URLs and their new targets in a migration. See redirect mapping.

On-page elements

Title tag
The page's <title>, usually the headline of its search result. Crawlens flags titles over 60 or under 30 characters. See the title and meta audit.
Meta description
A summary Google may use as the snippet. Crawlens flags lengths outside 70–160 characters.
H1
The main heading of a page; one clear H1 per page is the norm.
Snippet
The text under a search result's title. nosnippet, max-snippet and data-nosnippet limit it, including in AI features.
Alt text
Text describing an image, read by screen readers and used by search engines. See the image SEO audit.
Mixed content
HTTP resources loaded on an HTTPS page. See HTTPS and mixed content.
Anchor text
The visible, clickable text of a link.
nofollow
A link attribute asking search engines not to pass signals through the link. Rarely needed internally.
XML sitemap
A file listing the URLs you want crawled, ideally only indexable 200 pages. See the XML sitemap audit.
Sitemap index
An XML file listing separate sitemap files, useful when a site's URL inventory exceeds one sitemap's limits. See sitemap index SEO.
lastmod
The date a sitemap URL's content last changed; it should be accurate, not the sitemap's build time.
IndexNow
A protocol for notifying participating search engines of added, updated or deleted URLs. See Bing and Copilot SEO.

Rendering and JavaScript

Rendering
Running a page's JavaScript in a browser to produce the final content.
Raw HTML vs rendered HTML
What the server sends versus what exists after scripts run. Most AI crawlers only see the raw HTML. See JavaScript SEO.
Client-side rendering (CSR) / server-side rendering (SSR)
Building the page in the browser versus on the server. SSR puts content in the raw HTML.
Lazy loading
Delaying images or content until needed. Content that requires a click or manual scroll to appear may be missed by search crawlers. See lazy loading SEO.
Single-page app (SPA) navigation
Changing views in the browser without a full page load. Important routes still need crawlable <a href> links and URLs that work when loaded directly. See SPA navigation SEO.
Mobile-first indexing
Google primarily uses the mobile version of a page's content for indexing and ranking. Compare mobile and desktop content, links and page signals in a mobile-first indexing audit.

Performance

Core Web Vitals
Google's three real-user experience metrics, judged at the 75th percentile. See Core Web Vitals.
Image optimization
Serving suitable image sizes, loading important images early and reserving space before they arrive. See image optimization for Core Web Vitals.
Third-party scripts
Vendor-supplied code for analytics, ads, chat or embeds that can add network and main-thread work. See the third-party script audit.
Render-blocking resource
A stylesheet or synchronous script that delays the browser's initial rendering path. See render-blocking resources and LCP.
First-party JavaScript
Code the site ships itself, including app bundles, hydration and interaction handlers. It can cause long tasks even after third-party tags are removed. See first-party JavaScript performance.
Mobile page speed
Loading and responsiveness experienced on phones. Compare mobile field measurements with lab diagnostics rather than treating a single score as the whole result. See mobile page speed.
LCP (Largest Contentful Paint)
When the main content renders. Good: 2.5 s or less. See LCP.
INP (Interaction to Next Paint)
How quickly the page responds to clicks, taps and keys. Good: 200 ms or less. See INP.
Long Animation Frame (LoAF)
A browser frame delayed beyond 50 ms whose timing and available script attribution can help diagnose a slow interaction. See Long Animation Frames and INP.
CLS (Cumulative Layout Shift)
How much the layout moves unexpectedly. Good: 0.1 or less. See CLS.
TTFB (Time to First Byte)
Time until the first byte of the response arrives. Good: 0.8 s or less; not a Core Web Vital. See TTFB.
TBT (Total Blocking Time)
A lab metric for how long the main thread was blocked during load; the lab stand-in for INP.
Field data / lab data
Real-user measurements (the Chrome UX Report) versus a single simulated test (Lighthouse). See the Core Web Vitals audit.
CrUX (Chrome UX Report)
Google's dataset of real Chrome users' experience, over a rolling 28 days, by URL or origin.

Structured data

Structured data / schema markup
Machine-readable information about a page, usually JSON-LD using schema.org types. See structured data errors.
JSON-LD
The script-based format Google recommends for structured data.
Rich result
A search result enhanced by structured data, such as product prices, ratings or breadcrumbs.
Merchant listing / product snippet
Google's two uses of Product markup, for pages where people can buy versus review-style pages. See product structured data.
ProductGroup
The schema type that groups product variants. See product variants.
Merchant Center feed
A store's submitted product data, including price and availability; its values should agree with the landing page and structured data. See feed vs structured data.
Merchant shipping and returns
Delivery costs, timing and return terms supplied on the site and in merchant data; the values should reflect the same real policy. See shipping and returns SEO.
Product review markup
Structured ratings and reviews for the actual product shown on a page, backed by visible review content. See product reviews SEO.

International

hreflang
Annotations linking language or regional versions of a page. They must be reciprocal and use valid codes. See hreflang errors.
x-default
The hreflang value for the fallback version shown when no language matches.
ccTLD
A country-code top-level domain such as .de or .fr. Moving regional content to a shared domain changes URLs and requires a redirect and hreflang plan. See ccTLD SEO migration.

Search Console and data

Impressions / clicks / CTR / average position
How often your result was shown, clicked, the ratio of the two, and the average topmost position. See Search Console for SEO.
GA4 landing page
The first page of a website session in Google Analytics 4. Filter to organic search sessions to compare visits, engagement and key events by entry page. See GA4 landing page analysis.
Striking distance
Pages averaging positions 11–20, just off page one. See striking distance keywords.
Keyword cannibalization
Several of your pages competing for the same query and intent. See keyword cannibalization.
Content decay
A page's gradual loss of search traffic over time. See content decay.
URL Inspection
Search Console's tool showing how Google sees one URL, including its Google-selected canonical.
Search Console Insights
A simplified view of content and search trends. Confirm its leads in the Performance report before acting. See Search Console Insights.
Query groups
Search Console Insights cards that combine similar queries into a theme for eligible properties. The card's name is a representative query, not a separate ranking signal. See query groups.
Search Console bulk export
Daily Search performance data sent to BigQuery for larger or repeatable analyses; anonymized queries remain excluded. See BigQuery export.
Change of Address
The Search Console tool for moving to a new domain. See changing your domain.

AI search

AI Overviews / AI Mode
Google's generative AI search features, which cite indexed pages. See how to appear in AI Overviews.
Query fan-out
AI search issuing several related searches to answer one question.
Search vs training crawlers
AI companies run separate bots to cite pages (OAI-SearchBot, Claude-SearchBot) and to collect training data (GPTBot, ClaudeBot). See how to block AI crawlers.
PerplexityBot / Perplexity-User
Perplexity's search crawler and separate user-triggered page fetcher. See Perplexity search SEO.
Google-Extended
A robots.txt token controlling use of content for Gemini training; it doesn't affect Google Search.
llms.txt
A proposed Markdown file guiding AI agents to a site's key pages; Google Search ignores it. See llms.txt.
GEO / AEO
Generative and answer engine optimization. Google's view: optimizing for generative AI search "is optimizing for the search experience, and thus still SEO." See the AI search readiness checklist.

Audit terms

Health score
Crawlens's 0–100 summary of a crawl, based on the share of URLs with a critical issue (full weight) or a warning (half weight); notices don't count. See the audit rules reference.
Severity (critical, warning, notice)
How much an issue affects crawling, indexing or results; a starting point for priority, not the priority itself. See technical SEO audit reports.
Google Search Essentials
Google's technical requirements, spam policies and key best practices for Search. Eligibility is not a promise of indexing or ranking. See the Search Essentials audit.
Manual action
A human-reviewed Google spam-policy finding shown in Search Console, distinct from an algorithmic or technical traffic drop. See manual actions SEO.
Custom extraction
Pulling any value (price, author, tracking ID) from every crawled page into a column. See custom extraction.
Site migration
A change of domain, platform, URL structure or protocol that affects many URLs. See the site migration checklist.
HTTP-to-HTTPS migration
A site move that permanently redirects each HTTP URL to its corresponding HTTPS destination. See the HTTP to HTTPS migration checklist.
Staging site
A prelaunch environment for testing changes; protect private previews and verify its noindex or robots controls do not reach production. See staging site SEO.
Subdomain-to-subfolder migration
Moving pages such as blog.example.com/post/ to example.com/blog/post/. Each old URL needs a relevant destination and a tested permanent redirect. See the subdomain-to-subfolder SEO migration guide.

Find these issues on your own site

Crawlens crawls your site and checks for most of the problems in this glossary.

Download free for Windows