Mayfly Internet Marketing
  • AboutAbout
    • About
    • Vacancies
  • ServicesServices
    • Services
    • SEO
    • Web Design
    • PPC
    • Branding
    • Email Marketing
    • Social Media
  • SectorsSectors
    • Sectors
    • Small Businesses
    • Hospitality
    • B2Bs
    • Franchises
    • Solicitors
  • Case Studies
  • Resources
Get in touch
  1. Mayfly
  2. Blog
  3. Why Your Pages Are Not Being Indexed and How to Fix It

Why Your Pages Are Not Being Indexed and How to Fix It

By Chris Evans. Posted 29/06/26 (updated: 24/06/26)

One of the most frustrating SEO problems I see is a page that should perform well, but it has not been indexed.

If Google isn’t indexing your pages, they’re unlikely to bring in any organic traffic, no matter how good the content is.

Maybe you’ve built a helpful service page, written a blog post that answers a common question, or added a new section to your site, only to find that Google hasn’t picked it up or has decided not to index it.

The tricky thing is that indexing problems don’t always have a single clear cause. Sometimes it’s a technical issue, like a noindex tag, a robots.txt rule, a wrong canonical tag, a crawl problem, or weak internal links. Other times, we can see Google has found the page but just hasn’t indexed it yet.

People often miss that second point. Indexing isn’t exclusively about getting Google to find your URL. The page also needs to be easy to access, helpful, supported by internal links, and have a clear purpose. If it’s thin, duplicated, hard to find, or doesn’t add much value, just asking for indexing in Search Console probably won’t fix the problem.

In this guide, I’ll go over the common reasons pages don’t get indexed, how to check what’s going on, and what strategies I use when trying to get important pages into Google’s index.

Why Your Pages Are Not Being Indexed and How to Fix It

What Does Indexing Mean in SEO?

Indexing is the process Google uses to store and organise pages it has discovered, so they can be considered for search results. Google only presents search results using pages (or versions of pages) it has recorded in its index.

It is important to distinguish indexing from crawling and ranking. Crawling is when Google finds and accesses a page. Indexing is the process by which Google decides whether a page should be added to its index. Ranking is what happens after that, when Google decides if, where and when the page should appear for a search query.

This means a page can be crawled without being indexed. I see this quite often when Google has found a URL, but does not think the page is strong, useful or distinct enough to include in search results.

That is why indexing issues should not be treated as a simple “press request indexing” problem. Before trying to force Google to revisit a page, it is better to understand whether the issue is technical, content-related, or due to how the page fits within the wider website.

How to Check If a Page Is Indexed

The first place I would check is Google Search Console.

The URL Inspection tool gives you the clearest page-level view of what Google knows about a URL. It can show whether the page is indexed, whether it is eligible for indexing, when it was last crawled, which canonical URL Google has selected, and whether there are any obvious issues preventing the page from appearing in search.

For wider checks, the Page Indexing report is useful because it shows groups of indexed and non-indexed URLs across the site. This can help you spot patterns, such as many pages marked as “Crawled – currently not indexed”, “Discovered – currently not indexed”, blocked by robots.txt, excluded by noindex, or affected by redirects.

A site: search can also give you a quick sense of whether a URL appears in Google, but I would not rely on it as the main diagnostic tool. Search Console is the better source because it shows what Google is actually reporting for that specific property.

The key is not just to check whether the page is indexed, but to understand why Google is treating it that way. Once you know the reason, you can decide whether the fix is technical, content-led, internal-linking-related, or simply a case of giving Google more time after recent changes.

Common Reasons Google Is Not Indexing Your Pages

When I am looking into indexing issues, I generally start by separating them into two areas: technical access and page quality. In simple terms, can Google access the page, and is the page worth indexing?

The Page is Blocked by Robots.txt

Robots.txt is used to control crawling. If an important page is blocked, Google may not be able to crawl the content properly, which can stop it from understanding and indexing the page.

This is usually accidental and often happens after staging sites, development work, content migrations, or plugin changes have taken effect.

The Page Has a Noindex Tag

A noindex tag tells Google not to include the page in search results.

This is one of the first things I would check because it is common for pages to be set to noindex by mistake, especially through CMS settings, SEO plugins, page templates, or HTTP headers. It’s also very straightforward to rectify.

Google Has Chosen a Different Canonical URL

If a page has a canonical tag pointing to another URL, or Google decides another version is the better representative page, your chosen URL may not be indexed.

This can happen with duplicate pages, similar service pages, product variants, filter URLs, pagination, or pages copied too closely from another section of the site.

The Page Has Weak Internal Links

Google uses links to discover pages and understand how they fit within a website.

If a page is linked only from a sitemap, is buried several clicks deep, or is not linked from any relevant pages, it may be treated as less important. Internal links are not just for users. They also help Google understand which pages matter and how the content on pages might relate to each other.

The Content is Thin, Duplicated or Not Useful Enough

Not every accessible page deserves to be indexed.

If the content is too short, too similar to another page, overly generic, or created mainly to target a keyword rather than help the user, Google may crawl it but decide not to index it. This often happens when sites rely too heavily on boilerplate content and “informational blocks” on landing pages.

This is where helpful content matters. A page should have a clear purpose, answer the query properly, and offer something useful that is not already covered elsewhere on the site.

The Page Has Technical or Rendering Issues

Sometimes the content exists, but Google cannot process it properly. This can be caused by server errors, redirect issues, blocked resources, JavaScript rendering problems, incorrect status codes, or pages that behave differently between users and Googlebot.

Before rewriting content, it is worth checking whether Google can actually access and render the page as intended.

What “Discovered - Currently Not Indexed” Means

“Discovered – currently not indexed” means Google knows the URL exists, but has not crawled it yet.

This is different from “Crawled – currently not indexed”. With discovered URLs, Google has found the page through a sitemap, an internal link, an external link, or another discovery route, but has not yet fetched the page to assess its content.

Google says this can happen when it expects crawling the URL to overload the site, so the crawl has been rescheduled. In practice, I would also consider whether the page is worth crawling.

The checks I would make here are:

  • Is the page linked from relevant areas of the site?
  • Is it included in the XML sitemap?
  • Is the site generating too many low-value URLs?
  • Are there lots of filter, tag, search or parameter pages wasting crawl attention?
  • Is the page buried too deep in the site structure?
  • Has the page only just been published?

For a small site, this status might only affect a few URLs and resolve naturally. For larger sites, or sites with many thin and duplicate pages, it can indicate a wider crawl efficiency problem.

The fix is not to keep pressing “request indexing”. I would first make sure the page is genuinely important, internally linked, included in the sitemap, technically accessible and worth Google spending time on.

How to Help Google Index Your Pages

Once you know why a page is not being indexed, the next step is to fix the cause rather than repeatedly requesting indexing.

The first thing I would check is whether Google can actually access the page. That means checking the status code, robots.txt rules, noindex tags, redirects, canonical tags and whether the main content can be rendered properly.

After that, I would look at how the page is supported within the site. Important pages should not just sit in an XML sitemap. They should be linked from relevant pages, use clear anchor text, and fit naturally into the website’s broader structure.

The page itself also needs to be worth indexing. If the content is thin, duplicated, too similar to another page, or only exists to target a keyword, technical fixes alone may not be enough. I would improve the page so it has a clear purpose, answers the query effectively, and provides users with something useful.

A simple process would be:

1. Make sure the page returns a clean 200 status code.
2. Remove any accidental noindex tags.
3. Check that robots.txt is not blocking important content.
4. Make sure the canonical tag points to the correct URL.
5. Add the page to the XML sitemap if it is important.
6. Link to it internally from relevant pages.
7. Improve the content if it is thin, duplicated or unclear.
8. Use URL Inspection in Search Console to request indexing once the page is ready.

Requesting indexing should come at the end of the process, not the start. If the page has technical issues, weak internal links or poor content, asking Google to revisit it will not solve the underlying problem.

What Not to Do When a Page Is Not Indexed

When a page is not being indexed, it is easy to jump straight into quick fixes. In most cases, that is the wrong approach.

The main thing I would avoid is repeatedly requesting indexing in Search Console without first fixing the underlying issue. If the page is blocked, canonicalised elsewhere, thin, duplicated or poorly linked, asking Google to revisit it is unlikely to change much.

I would also avoid trying to get every URL indexed. More indexed pages do not always mean better SEO. In fact, allowing many low-value pages into Google’s index can weaken the site overall. This is especially common with tag pages, filter URLs, internal search pages, duplicate product variants and thin location pages.

An additional mistake is using robots.txt when the real aim is to keep a page out of Google. Robots.txt controls crawling. If you need a page removed from the index, a noindex tag is usually the more suitable option.

I would also be careful with mass-producing new pages just to target slight keyword variations. If those pages do not serve a clear purpose or offer anything genuinely useful, they are unlikely to perform well, even if they do get indexed.

Indexing is not a numbers game. The goal is not to force Google to index everything. The goal is to make sure the right pages are accessible, useful, properly linked and deemed worthy of showing in search results.

Final Thoughts On Indexing Issues

If a page is not being indexed, the first step is to find out why.

Sometimes the issue is technical. The page may be blocked, noindexed, canonicalised elsewhere, returning the wrong status code, or difficult for Google to render properly.

Other times, the page is accessible, but Google has decided not to index it. That usually means the page needs more work. It may need stronger internal links, a clearer purpose, better content, or a stronger reason to exist alongside other pages on the site.

The important thing is not to treat indexing as a quick Search Console task. Requesting indexing can be useful after a page has been fixed, but it is not a replacement for good technical SEO, clear site structure and helpful content.

Google does not index every page it finds, and meeting the basic technical requirements does not guarantee a place in the index. The aim should be to make important pages easy to access, easy to understand, and useful enough to deserve to be shown in search results.

Bearded man wearing glasses and a brown T-shirt reading "SAN FRANCISCO California FOLSOM STREET MISSION DISTRICT," smiling slightly while standing before a pale brick wall.

Chris Evans

Chris Evans is SEO Lead at Mayfly, where he leads organic strategy end to end across technical SEO, content planning and performance reporting. He joined in 2025 with over a decade of hands on experience optimising sites in e-commerce, local search and enterprise environments. Chris is comfortable getting into the code when needed, working with HTML, CSS and JavaScript to diagnose and fix issues that hold visibility back. He also uses advanced analytics and practical AI workflows to uncover opportunities and improve user experience.

Contents:

  1. What Does Indexing Mean in SEO?
  2. How to Check If a Page Is Indexed
  3. Common Reasons Google Is Not Indexing Your Pages
  4. What “Discovered - Currently Not Indexed” Means
  5. How to Help Google Index Your Pages
  6. What Not to Do When a Page Is Not Indexed

Interested in working together?

Smiling bearded man showing teeth, wearing a white-and-red striped shirt, facing the camera against a plain light-colored brick wall.
0151 254 1727
info@may-fly.co.uk

Mayfly Internet Marketing

  • Kempston St Works,
    87 Kempston St,
    Liverpool
    L3 8HE
  • info@may-fly.co.uk
  • 0151 254 1727

Pages

  • About
  • Services
  • Case Studies
  • Vacancies
  • Resources
  • Blog

Services

  • SEO Agency Liverpool
  • PPC Agency Liverpool
  • Web Design Agency Liverpool
  • Social Media Marketing Agency Liverpool
  • Facebook Ads Agency Liverpool
  • Instagram Ads Agency Liverpool
  • YouTube Advertising Agency Liverpool
  • Email Marketing Agency Liverpool
  • Branding Agency Liverpool
  • Digital Marketing for Solicitors
  • Digital Marketing for Franchises
  • B2B Digital Marketing Agency
  • Digital Marketing Agency Small Businesses
  • Hospitality Digital Marketing Agency Liverpool
  • Google Ads — overlapping blue rounded bar and yellow slanted bar with a green circle form an abstract "A", text "Google Ads" appears below on a white background.
  • Stylized multicolored letter "G" composed of red, yellow, green, and blue geometric segments forming a circular shape, centered on a plain white background.
  • A teal stylized "b" logo beside the word "Bing" is displayed on a plain white background.
  • Object: blue Meta infinity logo alongside the word "Meta" with "Business Partner" beneath. Action: logo and text are displayed. Context: plain white background. Text transcription: Meta Business Partner.
  • White lowercase "in" (text: "in") sits centered as a bold icon on a rounded blue square background, forming the recognizable LinkedIn app logo used for professional social networking.
  • A white lowercase "f" logo is centered and prominent on a solid blue rounded-square background; visible text: "f".
  • A rounded-square app icon displays a white, simplified camera outline with circular lens and small viewfinder dot centered on a magenta-purple to orange gradient background.
  • Stylized musical-note logo centered on a white square background, black primary shape with cyan and magenta offset shadows creating a neon 3D doubling effect, crisp edges and rounded contours.
©2026 Mayfly Internet Marketing
  • Privacy Policy