How to get Google to crawl your blog

It’s been weeks, if not months. You’ve worked hard on creating content for your blog but for some reason, Google just isn’t picking you up.

You may have seen submission sites and directories that promise to get you ranked on Google – sometimes for a fee. But why pay, when you can do it for free?

Here is a 3 step guide on how to get crawled by Google.

1. Sign up to Google Webmasters

Google has a service that’s not as widely known as Analytics. It used to be called Webmaster Tools but has now changed its name to Google Webmasters.

This tool will let you submit sitemaps to Google to be indexed and crawled, without Google needing to organically discover you. This feature is fantastic for accelerating your way to the top of the ranks for your blog’s niche.

Once you’re in, you’ll be greeted with a welcome message that will guide you through the process of setting up your website that look something like this.

For this walkthrough, we’re going to implement Google Search Console using the first method on the left.

Enter your domain and click continue. The next screen will tell you to enter a txt record. To do you this, you’ll need to log into your hosting provider and enter the value given to you by Google. I’ve partially painted over mine for security reasons.

Because I’m with SiteGround, I can only show you what it looks like if you were to implement the txt record on this particular hosting provider.

But in theory, you should still be able to follow through since most hosting providers have similar setups in the backend console.

Navigate to the My Accounts tab and select Go to cPanel. Once in, select Advance DNS Zone Editor.

Once you’re in, you can add your txt record, hit the Add Record button, wait a few moments before going back to verify your website with Google. Use your own domain name as the Name.

2. Implement a site map on your blog

You don’t have to do much for this part, except go and download a sitemap generator plugin. The purpose of a sitemap is to list the links on your blog for crawlers to work its way through.

One I’d recommend is Simple Wp Sitemap. This is the one I’m currently using and its been pretty low/no maintenance and works just fine. You can just search up Simple Wp Sitemap and it’ll come up.

Once installed, you can move onto the next step.

3. Submit your site map to the Search Console

Go back to your search console and look down the side. You should see an option called Sitemaps

Once you’re there, all you have to do is submit your sitemap and your blog will be scheduled for indexing by Google. Sometimes this is instant, sometimes it takes a couple of hours.

If you used the plugin I suggested above, the value that comes after the / is sitemap.xml

Most plugins use sitemap.xml as the default, so in theory, using this will also work, regardless of whatever plugin you’ve used to generate your sitemap.

And that’s basically it! The console will give you insight on ranking and search terms that are not readily available through Analytics, in addition to any technical issues your blog may be facing such as speed, duplicate content and broken links.

I am currently embarking on a Prototype Year to experiment my way into a life I want. This space is for documenting that journey.

Leave a Reply

Your email address will not be published. Required fields are marked *