What a noindex tag does
The noindex tag appears in two forms:
In the page's HTML : `html `
In the HTTP response header: ` X-Robots-Tag: noindex `
Both have the same effect: Googlebot will crawl the page but exclude it from search results.
How noindex tags get on the wrong pages
Development environment settings carried to production: The most common cause. A staging site correctly uses noindex to prevent Google from indexing the development version. When the site launches, the noindex setting is accidentally retained on the live site. Sometimes this is site-wide ( in the global header template) hiding the entire site from Google.
CMS plugin misconfiguration: WordPress sites with Yoast SEO, RankMath, or similar plugins. A single checkbox in the plugin settings "Search Engine Visibility: Discourage search engines from indexing this site" adds a site-wide noindex. This checkbox is sometimes ticked accidentally.
Category or tag archive pages: E-commerce and blogging platforms often noindex category and tag archive pages by default. This is intentional for generic platforms but may exclude important pages that should rank for your business.
Individual page settings: In most CMSs, individual pages have a "robots" setting. A page set to noindex by a developer who was temporarily hiding it from search results and never changed it back.
Ready to take the next step?
Let Perceptra scope the right approach for your business.
Book a Free Strategy Session ?How to diagnose noindex tag problems
Method 1: Google Search Console Coverage Report Go to Search Console ? Indexing ? Pages ? filter by "Excluded." Look for "Excluded by 'noindex' tag." If important pages appear here, they have a noindex problem.
Method 2: View page source Right-click any page ? View Page Source ? search (Ctrl+F) for "noindex." If it appears in the tag or in the header, the page is excluded from Google's index.
Method 3: Google Search Console URL Inspection Enter a specific URL in the Search Console URL Inspection tool. The result shows "URL is on Google" or "URL is not on Google" and explains why. "Excluded by 'noindex' tag" is clearly indicated.
Method 4: Screaming Frog In a site crawl, filter by "Directives" ? "noindex." Screaming Frog lists every page with a noindex directive, making it easy to identify pages that should not have it.
How to fix noindex tag problems
If it is a site-wide development setting: In WordPress: go to Settings ? Reading ? uncheck "Discourage search engines from indexing this site." In other CMSs: find the global meta robots setting in your SEO plugin or theme settings. In HTML: remove from the global template.
If it is an individual page setting: In WordPress with Yoast: edit the page ? Yoast SEO panel ? Advanced ? "Allow search engines to show this post in search results" ? set to "Yes." In HTML: remove the noindex meta tag from the specific page's .
After fixing: Go to Google Search Console ? URL Inspection ? enter the fixed URL ? Request Indexing. This tells Google to recrawl the page and notice the removal of the noindex tag. Indexing typically occurs within days to weeks of the fix.
Frequently asked questions
How long does it take for Google to re-index a page after removing a noindex tag? After requesting indexing via Search Console, Google typically recrawls and reindexes the page within 1 7 days. For pages on large sites that are not frequently crawled, it may take 2 4 weeks.
Should any pages have a noindex tag? Yes. Pages that should legitimately be noindexed: admin and login pages, duplicate content pages (pagination without canonical strategy, filter combinations on e-commerce sites), thank-you pages after form submission, and internal search result pages.
Can a page rank if it is noindexed? No. A noindexed page cannot appear in Google search results. If Googlebot has already removed it from the index, even backlinks to that page do not help it rank.