Welcome, Guest: Register On Nairaland / LOGIN! / Trending / Recent / New
Stats: 3,150,465 members, 7,808,655 topics. Date: Thursday, 25 April 2024 at 03:00 PM

Help: Google Is Not Crawling My Blog - Webmasters - Nairaland

Nairaland Forum / Science/Technology / Webmasters / Help: Google Is Not Crawling My Blog (1116 Views)

Google Is Shutting Down Its URL Shortening Service / Crawler Error Any Help Google Ads Showing It / Help! Google Doesn't Crawl And Index My Posts Automatically (2) (3) (4)

(1) (Reply) (Go Down)

Help: Google Is Not Crawling My Blog by Nobody: 10:00am On Feb 16, 2018
hi. webmaster,
i bought a domain and redirect it to my blog and it contains a robot text file now google is not crawling it because of the robot text
i need your help webmasters
Re: Help: Google Is Not Crawling My Blog by dogstyle007(m): 10:22am On Feb 16, 2018
Re edit your robot.txt file and add your new domain remove the old domain also make sure to add a new property of the new domain be it http or https also add your sitemap to the new property do all these in your webmaster console
Re: Help: Google Is Not Crawling My Blog by Nobody: 10:53am On Feb 16, 2018
dogstyle007:
Re edit your robot.txt file and add your new domain remove the old domain also make sure to add a new property of the new domain be it http or https also add your sitemap to the new property do all these in your webmaster console
don't be annoyed can you do it for me
Re: Help: Google Is Not Crawling My Blog by dogstyle007(m): 11:57am On Feb 16, 2018
emmykendo:

don't be annoyed can you do it for me
sure I can but have you tried doing it yourself?
Re: Help: Google Is Not Crawling My Blog by TopYouGo: 1:34pm On Feb 16, 2018
emmykendo:
hi. webmaster,
i bought a domain and redirect it to my blog and it contains a robot text file now google is not crawling it because of the robot text
i need your help webmasters

The rules you define in the Robot.txt file determine whether Google craws your website or not. So to fix the issue you have to edit the file and give Google bots the access to crawl the website. Also, ensure you do the 301 redirect very well.

If you need help, check my signature and contact me.
Re: Help: Google Is Not Crawling My Blog by Nobody: 2:21pm On Feb 16, 2018
TopYouGo:


The rules you define in the Robot.txt file determine whether Google craws your website or not. So to fix the issue you have to edit the file and give Google bots the access to crawl the website. Also, ensure you do the 301 redirect very well.

If you need help, check my signature and contact me.
i need help sir
Re: Help: Google Is Not Crawling My Blog by Nobody: 8:07pm On Feb 16, 2018
dogstyle007:
sure I can but have you tried doing it yourself?
yes sir. the thing is very hard
Re: Help: Google Is Not Crawling My Blog by dogstyle007(m): 9:32pm On Feb 16, 2018
emmykendo:

yes sir. the thing is very hard
lol I can understand... Now let's get started... 1st add the new domain to your webmaster console via add property section; the way you added the previous domain, see if you can do this, if successful let me know.
Re: Help: Google Is Not Crawling My Blog by Nobody: 9:56pm On Feb 16, 2018
dogstyle007:
lol I can understand... Now let's get started... 1st add the new domain to your webmaster console via add property section; the way you added the previous domain, see if you can do this, if successful let me know.
i have done sir
Re: Help: Google Is Not Crawling My Blog by dogstyle007(m): 10:23pm On Feb 16, 2018
emmykendo:

i have done sir
okay now copy your robot.txt file and paste here let me see
Re: Help: Google Is Not Crawling My Blog by Nobody: 10:59pm On Feb 16, 2018
dogstyle007:
okay now copy your robot.txt file and paste here let me see
this is robot text
User-agent: *
Disallow: /search
Allow: /

Sitemap: http://www.kendogist.com.in/atom.xml?redirect=false&start-index=1&max-results=500
Re: Help: Google Is Not Crawling My Blog by chigosman: 11:30pm On Feb 16, 2018
emmykendo:

this is robot text
User-agent: *
Disallow: /search
Allow: /

Sitemap: http://www.kendogist.com.in/atom.xml?redirect=false&start-index=1&max-results=500


there is a problem with ur sitemap

correct it like this:

Sitemap: http://www.kendogist.com/sitemap.xml
Re: Help: Google Is Not Crawling My Blog by Nobody: 11:40pm On Feb 16, 2018
chigosman:



there is a problem with ur sitemap

correct it like this:

Sitemap: http://www.kendogist.com/sitemap.xml
yes but that are the robot text file
Re: Help: Google Is Not Crawling My Blog by dogstyle007(m): 11:45pm On Feb 16, 2018
emmykendo:

this is robot text
User-agent: *
Disallow: /search
Allow: /

Sitemap: http://www.kendogist.com.in/atom.xml?redirect=false&start-index=1&max-results=500

Use this in place of that

For WordPress

User-agent: *
Allow: /
Disallow: /?s=*
Disallow: /wp-admin/
Disallow: /wp-admin/admin-ajax.php
Disallow: /wp-admin/images/
Disallow: /wp-admin/css/
Disallow: /wp-admin/js/

Sitemap: http://www.yoursite.com/sitemap.xml

For blogger

User-agent: Mediapartners-Google

Disallow:

User-agent: *

Disallow: /search

Allow: /

Sitemap: http://www.yoursite.com/atom.xml?redirect=false&start-index=1&max-results=500
Re: Help: Google Is Not Crawling My Blog by dogstyle007(m): 11:48pm On Feb 16, 2018
chigosman:



there is a problem with ur sitemap

correct it like this:

Sitemap: http://www.kendogist.com/sitemap.xml
it's blogger not WordPress wink
Re: Help: Google Is Not Crawling My Blog by Nobody: 8:30am On Feb 17, 2018
dogstyle007:
it's blogger not WordPress wink

To save yourself the hassles, simply revert to the default Blogger robots.txt, and thank me later. cool

1 Like

Re: Help: Google Is Not Crawling My Blog by Nobody: 11:30am On Feb 17, 2018
thank for all your help
my google is now crawling my blog
Re: Help: Google Is Not Crawling My Blog by dogstyle007(m): 12:35pm On Feb 17, 2018
Cool glad it’s now working
Re: Help: Google Is Not Crawling My Blog by Nobody: 1:46pm On Feb 17, 2018
dogstyle007:
Cool glad it’s now working
thanks boss

1 Like

Re: Help: Google Is Not Crawling My Blog by dogstyle007(m): 2:10pm On Feb 17, 2018
emmykendo:

thanks boss
dont mention wink

(1) (Reply)

. / Join a Mind-blowing and Helpful WhatsApp Group Which Improves Bloggers / Is Google Adsense Worth The Effort?

(Go Up)

Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health
religion celebs tv-movies music-radio literature webmasters programming techmarket

Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10)

Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 19
Disclaimer: Every Nairaland member is solely responsible for anything that he/she posts or uploads on Nairaland.