Robot Txt. Issues(search engine crawling) - Webmasters - Nairaland
Nairaland Forum / Science/Technology / Webmasters / Robot Txt. Issues(search engine crawling) (399 Views)
Remove Robot.txt And Increase Search Engine Visibility. / Please Some One Should Help Me With Robot Txt Code / Google Changes Search Engine Logo (2) (3) (4)
(1) (Reply)
| Robot Txt. Issues(search engine crawling) by nerfetiti: 3:56pm On Apr 08, 2015 |
webmasters in the house...i want to clarify something which has been bothering me for some time....if you run your blog on a blogger platform is it advisable to include this - Disallow: /search....in your robot txt. as in should you have your robot txt like this: User-agent: * Disallow: /search Allow: / or like this User-agent: * Allow: / i read online that the Disallow: /search makes it difficult for search engines to crawl your site. so which is the best? |
| Re: Robot Txt. Issues(search engine crawling) by Grime: 6:27pm On Apr 08, 2015 |
It is a good idea to block your search pages from being indexed, since it contains no content. |
(1) (Reply)
Tips On How To Make Visitors Stay Longer On Your Blog / Unlimited Web Hosting, Resellers And Servers From VBHOSTNET / Domain, Hosting & Blog For Sale(sultangist.com) 5k only
(Go Up)
| Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health religion celebs tv-movies music-radio literature webmasters programming techmarket Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10) Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 7 |