Quick answer
Google most often does not index pages because of a `noindex` tag, a block in `robots.txt`, an error in the sitemap file or a lack of internal links. The solution is to check these elements in Search Console, remove the obstacles and request indexing via the URL inspection tool. Indexing can take from a few days to a few weeks.
How to recognize the problem
- Pages do not appear in Google search even after several weeks
- Search Console shows reasons such as indexing disabled or a block due to the `robots.txt` file
- New posts or products are not visible in search
- The site appears under a `site:` query, but individual pages are missing
- The sitemap is submitted, but the number of indexed pages is significantly lower than expected
Most common causes
Noindex tag on the page
The meta tag `<meta name="robots" content="noindex">` or the HTTP header `X-Robots-Tag: noindex` tells Google not to index the page. It often remains by mistake after site development.
Block in robots.txt
If `robots.txt` contains a `Disallow` for part of the site, Google will not be able to access those pages, so they most often will not be indexed. Check whether the block is intentional or left over from before.
Sitemap is not valid or not submitted
An invalid XML sitemap, missing URLs or format errors can make it harder for Google to find pages. The sitemap should be submitted in Search Console.
Lack of internal links
Pages that cannot be reached by clicking through the site will be hard to discover. Google recommends clear navigation and links from relevant pages.
Duplicate content or canonicalization
If multiple URLs show the same content, Google may choose only one. An incorrect `canonical` tag can direct indexing to the wrong page.
Step-by-step fix
- 1
Check whether the page is indexed
In Google search, type
site:your-domain.rsand review the results. For a single page, usesite:your-domain.rs/path. If it is not there, continue with the checks. - 2
Open Search Console and check the indexing report
In Google Search Console, go to
Indexing > Pages. Look at the "Not indexed" list and reasons such as a block due to therobots.txtfile or a noindex tag. These are the most common causes. - 3
Check robots.txt
Open
https://your-domain.rs/robots.txtin a browser. Make sure there is noDisallow: /or a block for the part you want to index. If there is, remove it or adjust the rules. - 4
Remove the noindex tag
Review the page source code (Ctrl+U) and look for
noindex. If it is there, remove it from the template, SEO plugin or server headers. For WordPress, checkSettings > Readingand the SEO plugin. - 5
Check the canonical URL
In the source code, look for
<link rel="canonical">. It should point to one desired, absolute version of the page, for examplehttps://your-domain.rs/page, consistently across the whole site (the same choice forwwwandhttps). An incorrect canonical can lead Google to index a different page instead of the desired one. - 6
Update and submit the sitemap
In Search Console, go to
Indexing > Sitemapsand submithttps://your-domain.rs/sitemap.xmlif it is not already. Check that the sitemap contains all important URLs and has no errors. - 7
Request indexing via URL inspection
In Search Console, paste the page URL into the search bar at the top and press Enter. Click "Request indexing". This speeds up processing, but does not guarantee instant indexing.
- 8
Add internal links
Link the new page from relevant existing pages (for example, from the home page or category). This makes it easier for Google to discover the content. Avoid links that lead to
noindexor blocked pages. - 9
Wait and monitor the results
After changes, indexing can take from a few days to a few weeks. Monitor the
Indexing > Pagesreport in Search Console. Do not send the same request multiple times a day.
If nothing helps: advanced checks
If you have removed noindex and blocks, and pages are still not indexed, check whether the server returns a valid HTTP status (200). Tools such as curl -I https://your-domain.rs/page can show the status and headers. Pay attention to X-Robots-Tag in the header. Also, check whether the site is accessible to Googlebot (do not block it on the server or CDN). In Search Console, use URL inspection to see how Google views the page. If the site is new, be patient; indexing can take time. For sites with thousands of pages, consider an SEO tool for bulk analysis.
How to prevent it
- Regularly check the indexing report in Search Console
- Disable `noindex` and blocks before publishing the site
- Maintain an up-to-date XML sitemap and submit it
- Pay attention to canonical URLs and internal links
When to call a professional
If you have checked all the listed steps and pages are still not indexed, or if you have a large site with many URLs, contact IT support or an SEO expert for a deeper analysis of the server and configuration.
Website development · Fast, SEO-ready, multilingual websitesFAQ
How long does it take Google to index a page?
Usually a few days to a few weeks, depending on site authority and frequency of changes. Requesting indexing in Search Console can speed up the process, but does not guarantee an instant result.
Why is a page indexed but not appearing in search?
Indexing does not automatically mean a high ranking. A page can be indexed but not shown for certain queries due to competition or relevance. Check whether the page meets the search intent.
Is submitting the sitemap enough?
No. The sitemap helps Google find URLs, but if a page has `noindex` or is blocked in `robots.txt`, it will not be indexed. All obstacles need to be removed.