New researchTechnical SEO & AI Search · 2027Explore the framework

Bing and Copilot SEO: sitemaps, IndexNow and AI answer controls

What Bing recommends for its search and AI-powered answers: accurate sitemaps and lastmod, IndexNow for fast updates, and controls for AI answers.

Part of the AI Search series. For the full picture, start with Technical SEO and AI search readiness: the complete audit checklist.

Microsoft’s AI answers, from Bing Chat to what’s now Copilot, build on Bing’s search index. That makes Bing’s own guidance the best guide to visibility there, and it’s more specific than most: accurate sitemaps, real lastmod dates and IndexNow.

Bing’s webmaster team wrote about this in Keeping Content Discoverable with Sitemaps in AI Powered Search:

  • “Sitemaps remain a foundational signal for ensuring comprehensive URL coverage across your site.”
  • Use “standard ISO 8601 date formatting for lastmod values, including both the date and time.”
  • lastmod “should reflect the true last modification time of the page content, not the sitemap file itself.”
  • “changefreq and priority are ignored by Bing and do not influence how your content is crawled or ranked.”
  • Pair sitemaps with IndexNow: “sitemaps for comprehensive site coverage with IndexNow for fast, URL-level submission.”

The most common mistake is a generator that stamps every URL with the time the sitemap was built. That tells Bing everything changed every day, which is the same as telling it nothing.

What is IndexNow?

IndexNow lets you notify search engines when content is “added, updated, or deleted”, and “submitted URLs will be automatically shared with all other participating search engines.” To use it:

  1. Host a key file ({your-key}.txt) at your site’s root.
  2. Submit single URLs with a GET request, or up to 10,000 URLs in one JSON POST.
  3. Submit when pages are published, changed or removed.

A successful response “only indicates that the search engine has received your URL”; it isn’t a promise to crawl or index. Many CMSs and hosting platforms have IndexNow integrations, which is easier than building your own.

How do you control use in Bing’s AI answers?

Bing announced two page-level controls in September 2023, for what was then Bing Chat:

Tag In AI answers For AI training In Bing search
NOCACHE “May be included”, showing only URL, snippet and title “Only URLs, Titles and Snippets may be used” Still shown
NOARCHIVE “Will not be included in Bing Chat answers” Not used Still shown

For crawler-level choices across AI companies, see how to block AI crawlers.

What should you check?

  • Sitemap quality. Crawl your sitemaps in Crawlens’s Sitemap mode: Non-indexable URLs in sitemaps and Sitemaps that could not be read show what Bing would be sent to. Check lastmod values yourself: Crawlens doesn’t validate them. See the XML sitemap audit.
  • Bingbot access. Crawl with the Bingbot user agent preset to see what Bingbot’s robots.txt group allows.
  • Real Bingbot activity. Import server logs: Crawlens can verify Bingbot with reverse and forward DNS lookups and shows its daily requests next to Googlebot’s.
  • Bing Webmaster Tools. Submit your sitemap there as well as in Google Search Console.

Checklist

  • XML sitemap lists only indexable 200 URLs and is submitted in Bing Webmaster Tools
  • lastmod reflects real content changes, in ISO 8601 with date and time
  • IndexNow set up, directly or through your CMS or host
  • Bingbot allowed by robots.txt and not blocked by the CDN
  • NOCACHE / NOARCHIVE used only where you mean them
  • Bingbot activity checked in server logs

Frequently asked questions

What is IndexNow?

IndexNow is a protocol for telling participating search engines that URLs were added, updated or deleted. You host a key file at your site's root and submit single URLs or batches of up to 10,000. Submission only confirms receipt; it doesn't guarantee crawling or indexing.

Does lastmod matter for Bing?

Yes. Bing's webmaster team says lastmod should reflect the true last modification time of the page content, in ISO 8601 format, and that it helps Bing decide what to recrawl. It ignores changefreq and priority.

How do I control whether my content appears in Bing's AI answers?

Bing announced in 2023 that NOCACHE limits its AI chat answers to the URL, snippet and title, and NOARCHIVE keeps content out of those answers and out of training Microsoft's generative AI models. Both keep the content in Bing search results.

· Founder, Crawlens

Dien builds Crawlens, a desktop crawler for technical SEO audits, and writes about the checks it runs: crawling, indexing, rendering and Search Console data.

Audit your own site with Crawlens

Crawl, run 70 checks, and see them next to Search Console and Core Web Vitals data.

Download free for Windows