For some websites getting new pages indexed can be a little bit of a problem. Here’s a guide to getting content indexed.
Can Google get to the page?
You need to ensure Google is able to access your page. You may inadvertently block Google, or not give Google a way to get to the page, for example.
- Block with Robots.txt
- noindex,nofollow in the meta robots
- The page returns a incorrect status, e.g. a redirect or a 404 error.
- No links to the page from existing pages
There are a number of tools you can use to check if the Google can get to your page, Fetch as Googlebot in Google Webmaster Tools and Xenu’s Link Sleuth
Speed it up
Once you have proved Google can get to your pages there are a few added extra’s that you can implement to quicken up that process. The methods below are ordered with the most effective at the top.
- Links from external sites to the page (Twitter is good)
- XML sitemap submission with the new page
- Pinger service to the page.
- Link sitewide
If you need Google to come back to the site on a regular occasion e.g. to pick up new products, prices etc then there’s a few method to aid this proccess.
- Keep adding content to the page, even if it’s snippets of blog feeds, or an extra sentence at the end of the page.
- Set a high priority in the XML sitemap for that page.
- Increase the Page Rank on the page, don’t optimise backlinks for relevance go for high PR links. The higher the Page Rank the increase of indexing.
Once you have a site that’s updating often, PR of 3 or above, automatic XML sitemap generation and some links to each new page you should get indexing of pages in less that 5 minutes.