# Indexability Checker: Find Out Why Google Can’t Index a Page

> Free indexability checker: test status code, robots.txt, meta robots, X-Robots-Tag, canonical and sitemap in one view and see what blocks Google. No signup.

Enter a URL and get a clear yes or no, with the exact rule, tag or header that blocks indexing highlighted.

- Use it free (no signup): https://yes-seo.com/indexability-checker
- API: `GET https://yes-seo.com/api/v1/indexability-checker?url=https://example.com`
- What it does: Indexability checker: answers "can Google index this page?" in one view: HTTP status, robots.txt rule, meta robots and X-Robots-Tag, canonical target, sitemap presence, redirect, nosnippet — with the blocking reason highlighted.

A page can only appear in Google if it can be crawled, is allowed to be indexed and is the version Google treats as canonical. One blocker is enough to keep it out: a robots.txt rule, a noindex tag, a header added by the server, a canonical pointing elsewhere. Each lives in a different place, which is why they are so easy to miss.

This indexability checker looks at all of them in one view: HTTP status, the robots.txt rule that applies, meta robots and X-Robots-Tag, the canonical target, whether the URL is in your sitemap, redirects and snippet controls such as nosnippet. If something blocks indexing, the reason is highlighted at the top.

## How to check if a page can be indexed

1. **Enter the URL** — Paste the exact address you want in Google, including https and www if your site uses them.
2. **Read the verdict** — You get a clear result plus each check: status, robots.txt, meta robots, X-Robots-Tag, canonical, sitemap and redirects.
3. **Remove the blocker** — Fix the highlighted rule, tag or header, then ask Google to recrawl with URL Inspection in Search Console.

## Crawlable, indexable, indexed: three different things

**Crawlable** means robots.txt lets search engines fetch the URL. **Indexable** means nothing on the page or in its headers forbids indexing and it is its own canonical. **Indexed** means Google actually chose to store it, a quality decision no tool can make on Google’s behalf.

The classic trap is combining robots.txt with [noindex](https://yes-seo.com/glossary/noindex). If robots.txt blocks a URL, Googlebot never fetches it and never sees the noindex tag, so the URL can still be indexed from links alone and shows up as “Indexed, though blocked by robots.txt”. To take a page out of search, allow crawling and use noindex ([Google: Block indexing with noindex](https://developers.google.com/search/docs/crawling-indexing/block-indexing)).

## Every place a noindex can hide

```

X-Robots-Tag: noindex
X-Robots-Tag: googlebot: noindex
```

The first two lines live in the HTML; the last two in the HTTP response, where they never show up in the page source (see [X-Robots-Tag](https://yes-seo.com/glossary/x-robots-tag)). The usual culprits:

- WordPress’s *Discourage search engines from indexing this site* box under Settings → Reading, still ticked after launch.
- A staging server rule copied to production.
- An SEO plugin’s noindex setting applied to a whole post type, category archive or product listing by mistake.
- A CDN or security rule that adds headers to certain paths.
- Password protection or a login wall that answers [401](https://yes-seo.com/http-status-codes/401) or 403.

## Snippets, AI Overviews and nosnippet

Being indexed is not the whole story. Google says a page must be indexed and eligible to be shown with a snippet to appear as a source in AI Overviews and AI Mode, and that no special markup is needed ([Google: AI features and your website](https://developers.google.com/search/docs/appearance/ai-features)). `nosnippet` and `max-snippet:0` remove the text snippet and keep the page out of those features too. To hide only part of a page, use the `data-nosnippet` attribute on that element instead:

```
Member-only discount codes
```

The [AI SEO checker](https://yes-seo.com/ai-seo-checker) goes deeper into AI search visibility.

## After you remove the blocker

- Confirm the fix here: status 200, no noindex, crawlable, self-canonical.
- Make sure the page is linked from at least one indexed page and listed in your sitemap.
- In Search Console, open URL Inspection, run *Test live URL*, then click *Request indexing*.

If the page is indexable but still missing weeks later, the reason is usually quality or duplication, reported as “Crawled – currently not indexed” or as a duplicate where Google chose a different canonical. Our guide to [why a website isn’t showing on Google](https://yes-seo.com/blog/website-not-showing-on-google) walks through those cases.

## Tips for staying indexable

- Check your most important pages after every deploy, theme update or plugin update.
- Use noindex for pages you want out of search and robots.txt only to save crawling on large URL spaces; never both on the same URL.
- Keep noindex pages out of your XML sitemap, where they send a contradictory signal.
- Watch the Page indexing report in Search Console for sudden jumps in “Excluded by noindex tag”.
- To hide a page quickly while noindex takes effect, use the Removals tool in Search Console, which hides a URL for about six months.

## Limits to keep in mind

We check what the server returns to a crawler, without running JavaScript. Google may skip rendering a page whose initial HTML says noindex, so removing noindex with JavaScript isn’t reliable: fix it in the HTML. This tool tells you whether a page *can* be indexed, not whether Google has indexed it or will judge it worth indexing; for that, use URL Inspection in Google Search Console. To test robots.txt rules against other bots, use the [robots.txt tester](https://yes-seo.com/robots-txt-tester).


## Frequently asked questions

### My page is indexable, so why isn’t it in Google?

Indexable only means nothing blocks it. Google may not have found the page yet, may see it as a duplicate of another URL, or may judge it not useful enough. Link to it internally, list it in your sitemap and check its status with URL Inspection.

### What is the difference between robots.txt and noindex?

robots.txt controls crawling: whether bots may fetch a URL. noindex controls indexing: whether a fetched page may appear in results. A page blocked by robots.txt can still be indexed from links, because Google never sees its noindex tag.

### How long does indexing take after I fix a page?

Anywhere from a few hours to several weeks, depending on how often Google crawls your site. Requesting indexing in Search Console and linking the page from a frequently crawled page usually speeds it up.

### Does nosnippet keep my page out of AI Overviews?

Yes. Google applies nosnippet and max-snippet:0 to AI Overviews and AI Mode as well as to regular snippets. Use data-nosnippet on specific sections if you only want to hide part of a page.

### Does a page need to be in my sitemap to be indexed?

No. Google finds most pages through links. A sitemap helps discovery, especially for new or deep pages, but it can’t make a blocked page indexable.

### How can I remove a page from Google quickly?

Add noindex or return 404 or 410, then use the Removals tool in Search Console to hide the URL for about six months while Google recrawls it. Don’t block the URL in robots.txt, or Google can’t see the change.