Welcome, Guest: Register On Nairaland / LOGIN! / Trending / Recent / NewStats: 3,195,586 members, 7,958,815 topics. Date: Thursday, 26 September 2024 at 03:01 AM |
Nairaland Forum / Science/Technology / Webmasters / The Best Custom Robots.txt & Sitemap Code For Bloggers (2368 Views)
How To Setup Custom Robots To Improve Your Blogger Blog For Seo / How To Add A Custom Robots.txt File In Blogger Blog / A Thread For Bloggers (2) (3) (4)
The Best Custom Robots.txt & Sitemap Code For Bloggers by Catalyst007(m): 6:57am On Jul 03, 2015 |
Having a functional Custom Robots.txt file and submitting your Sitemap to google is one of the most important things every blogger should do if they want their site to be indexed in real time. With each post you publish, the Sitemap code I’m about to hand to you will ensure your first 500 posts are indexed very fast by Google bots (spiders). The custom robots.txt file and sitemap starts now: User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Allow: / Sitemap: http://yourblog..com/atom.xml?redirect=false&start-index=1&max-results=500 NOTE: Replace the “yourblog” with your own domain name. For example, http://top-epaymentsystems..com/atom.xml?redirect=false&start-index=1&max-results=500 NEXT STEP: Even though your Custom Robots.txt file has your sitemap in it, you have to directly submit it to Google or Bing/Yahoo via their Webmasters Tools. This is to inform their spiders you now have a Sitemap and for the bots to immediately start indexing your Site. When you enter your Google Webmasters Tool account (same as your normal Google account), on the Left column, click “Crawl”, then click “Sitemap”. The only code you should enter in the box there is: atom.xml?redirect=false&start-index=1&max-results=500 Shoutout to @Whizzcute.... 2 Likes 1 Share |
Re: The Best Custom Robots.txt & Sitemap Code For Bloggers by Whizzcute(m): 7:29am On Jul 03, 2015 |
Yes , i did mine yesterday after veryfing my google webmaster tools account. It's really effective |
Re: The Best Custom Robots.txt & Sitemap Code For Bloggers by Catalyst007(m): 8:31am On Jul 03, 2015 |
@Whizzcute. It's really effective. Thanks for your comment... |
Re: The Best Custom Robots.txt & Sitemap Code For Bloggers by Whizzcute(m): 8:55am On Jul 03, 2015 |
(1) (Reply)
Paypal Vcc | Virtual Bank Account | BOA VBA |avs Vcc For Paypal|wellfrago Vba / I buy any Nigerian Verified Non Hosted Adsense Account / How To Pay For Hostgator Web Hosting And Get Verified
(Go Up)
Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health religion celebs tv-movies music-radio literature webmasters programming techmarket Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10) Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 9 |