What does noindex mean?

Noindex is a directive that tells search engines not to show a page in their results. The crawler can still fetch the page and follow its links, but the URL is dropped from the index once the directive has been read.

How long does noindex take to work?

Noindex takes effect the next time a search engine crawls the page, which depends on how often that URL is crawled. In Google Search Console, requesting indexing through URL Inspection prompts a fresh crawl, so the directive is read sooner.

What is the difference between noindex and nofollow?

Noindex keeps a page out of search results, while nofollow tells search engines not to follow the links on it. noindex, follow removes the page but lets its links be crawled, though Google has said it eventually treats a long-term noindexed page's links as nofollow.

Should I use noindex or robots.txt?

Use noindex to keep a page out of search results and robots.txt to stop it being crawled. robots.txt does not remove a page from the index, and a page it blocks can never have its noindex read.

What is the X-Robots-Tag header?

The X-Robots-Tag is an HTTP response header that carries the same directives as the robots meta tag, such as noindex. It also works for files with no HTML, like PDFs, and you can see it with curl -sI https://example.com/page.

How do I noindex a page in WordPress?

In WordPress, an SEO plugin such as Yoast or Rank Math adds a setting on each page to hide it from search results, which writes the noindex meta tag. Also check Settings, then Reading: Discourage search engines from indexing this site applies noindex to the whole site.

Is this noindex checker free?

Yes, the Noindex Checker is free and needs no browser extension. Paste a URL and it checks both the robots meta tag and the X-Robots-Tag header in one request.

How do I remove a noindex tag?

Remove the noindex from the template, plugin setting or server rule that adds it, then check the page again here to confirm both signals are clear. Afterwards, request indexing with URL Inspection in Google Search Console so the page is crawled again sooner.

Free tool

Noindex Checker

Whether a page is set to noindex, checking the header and the meta tag both.

How it works

What is the Noindex Checker?

The Noindex Checker is a free tool that tells you whether a page asks search engines not to index it. It fetches the URL and checks both places a noindex can live, the <meta name="robots"> tag in the HTML and the X-Robots-Tag HTTP header, then reports the page as indexable or not and names which signal it found.

How to use the Noindex Checker

Paste the full URL of the page you want to check. The tool reads that exact page and follows any redirects to the final one.
Press Check noindex.
Read the verdict: Page is Indexable, or Page is Not Indexable.
Check the two lines under it, Noindex in HTML meta tag and Noindex in HTTP headers, to see which one to fix.

How do you check if a page is noindex?

Check two places: the robots meta tag in the page's HTML and the X-Robots-Tag response header. Either one keeps the page out of the index, and Google and Bing honour both.

The header does not appear in view-source or in most CMS screens, which is why an accidental noindex so often lives there: a staging setting that reached production, or a CDN or proxy rule copied from another site. This checker reports each signal separately, so a page with clean HTML still fails when the header is the problem.

Why is my page not indexed when it has no noindex?

Because noindex is only one reason a page stays out of the index. A robots.txt rule can stop the page being crawled, a canonical tag can point search engines to another URL, and a page that returns an error status is not indexed at all.

Check the rules with the Robots.txt Checker and the canonical with the Canonical Tag Scanner. For Google's own view of a URL, including whether it has been crawled yet, use URL Inspection in Search Console.

Does noindex work if robots.txt blocks the page?

No. If robots.txt disallows a URL, the crawler never fetches the page, so it never reads the noindex. The URL can stay in the index as a bare link with no description.

To remove a page, allow crawling, serve the noindex, wait for the page to be crawled again, and only then block it in robots.txt if you still need to.

How do you check for noindex manually?

Open the page, view its source, and search for noindex; then request the headers with curl -sI https://example.com/page and look for an X-Robots-Tag line. Those two checks cover both places a noindex can live.

In a browser, the Network tab in developer tools shows the response headers for the page request, and the Elements panel shows the robots meta tag. Browser extensions that flag noindex work the same way, but they read the page as your browser loaded it. This checker reads the response the server sends to a fresh request, with no cookies, logins or extensions involved, which is closer to what a crawler gets.

Redirects matter here too. When a URL redirects, the directives that count are the ones on the page it lands on, and this checker follows redirects and reports the headers and HTML of that final page. If the old URL and the new one disagree, the final page is the one search engines index or drop. Check the exact URL you link to and list in your sitemap, not a shortened or tracking version of it.

Which pages should be noindex?

Noindex suits pages that are useful to visitors but useless as a search result: thank-you and order confirmation pages, internal search results, login and account pages, cart and checkout steps, and thin archives such as tag pages with one or two posts. Staging and test sites should be noindexed, or better, put behind a password.

Pages you want found should never carry it. Before a launch or a migration, run your key templates through this checker, such as the homepage, a product page, a category page and a blog post, since a noindex usually comes from a template or a setting and affects every page built on it.

For duplicates, noindex is often the wrong tool. Filtered or sorted category URLs, tracking parameters and print versions are better handled with a canonical tag pointing at the main version, which tells search engines which URL to show and keeps the signals on one page. Noindex simply drops the URL. For files with no HTML, such as PDFs you do not want in results, the X-Robots-Tag: noindex header is the only way to apply the directive, and it can be set for a whole folder in the server configuration.

What are the most common noindex mistakes?

The most common mistake is a staging noindex that goes live with the site. A site-wide setting, a robots meta tag in a shared header, or an X-Robots-Tag rule on the staging server is copied to production, and pages start leaving the index over the following weeks.

Other frequent ones: a noindex page that is also blocked in robots.txt, so the directive is never read; a noindex page listed in the XML sitemap, which sends search engines conflicting signals, so check the sitemap with the XML Sitemap Validator; and a canonical tag pointing at a page that is itself noindexed. Google's Search Console Page indexing report lists affected URLs under Excluded by 'noindex' tag, which is the quickest way to see whether the problem is one page or a whole section. Once a fix is live, the Google Index Checker shows whether the page has made it back into the index.

What does this noindex checker not detect?

It reads the page's raw HTML and the response headers, and it looks for the word noindex in the X-Robots-Tag header and in the first <meta name="robots"> tag. A few signals sit outside that.

A tag aimed at one crawler, such as <meta name="googlebot" content="noindex">, is not read, and neither is the none value, which means the same as noindex, nofollow. A noindex added by JavaScript after the page loads is not in the raw HTML either. Google does render JavaScript, but it says that when the original HTML already carries noindex it may skip rendering, so a script that removes a noindex should not be relied on. The header check also matches noindex for any crawler, so X-Robots-Tag: googlebot: noindex is reported as not indexable even though it only applies to Google.

The request is also sent as a regular browser, not as Googlebot. A server, CDN or security rule that sends different headers or HTML to crawlers than to visitors will not show that difference here. To see exactly what Google receives, run the live test in URL Inspection in Search Console, which fetches the page as Googlebot and reports whether indexing is allowed.

Questions

What does noindex mean?: Noindex is a directive that tells search engines not to show a page in their results. The crawler can still fetch the page and follow its links, but the URL is dropped from the index once the directive has been read.
How long does noindex take to work?: Noindex takes effect the next time a search engine crawls the page, which depends on how often that URL is crawled. In Google Search Console, requesting indexing through URL Inspection prompts a fresh crawl, so the directive is read sooner.
What is the difference between noindex and nofollow?: Noindex keeps a page out of search results, while nofollow tells search engines not to follow the links on it. noindex, follow removes the page but lets its links be crawled, though Google has said it eventually treats a long-term noindexed page's links as nofollow.
Should I use noindex or robots.txt?: Use noindex to keep a page out of search results and robots.txt to stop it being crawled. robots.txt does not remove a page from the index, and a page it blocks can never have its noindex read.
What is the X-Robots-Tag header?: The X-Robots-Tag is an HTTP response header that carries the same directives as the robots meta tag, such as noindex. It also works for files with no HTML, like PDFs, and you can see it with curl -sI https://example.com/page.
How do I noindex a page in WordPress?: In WordPress, an SEO plugin such as Yoast or Rank Math adds a setting on each page to hide it from search results, which writes the noindex meta tag. Also check Settings, then Reading: Discourage search engines from indexing this site applies noindex to the whole site.
Is this noindex checker free?: Yes, the Noindex Checker is free and needs no browser extension. Paste a URL and it checks both the robots meta tag and the X-Robots-Tag header in one request.
How do I remove a noindex tag?: Remove the noindex from the template, plugin setting or server rule that adds it, then check the page again here to confirm both signals are clear. Afterwards, request indexing with URL Inspection in Google Search Console so the page is crawled again sooner.

Technical SEO Tools

Before your next buyer asks AI about you, ask AI about yourself

One check, four engines, about twenty seconds. We show you the answers before we ask for anything.

Check your brand free All free tools