Bing Robot Wahala - Webmasters - Nairaland
Nairaland Forum / Science/Technology / Webmasters / Bing Robot Wahala (659 Views)
Rocket Your Website To Top Position On Google, Bing, Alexa, And Yahoo In 30 Days / How To Submit Your Website/blog To Google, Bing & Yahoo / How To Submit Blogger Sitemap To Bing And Yahoo (2) (3) (4)
(1) (Reply)
| Bing Robot Wahala by deco2come: 3:14am On Sep 11, 2011 |
Can someone tell me how to prevent bing robot/spider from visiting 404 error page. Despite specifying the pages not to be visited in my robots.txt file, I keep noticing that bing spider visits the 404 error at least 10 times in a day. Does anyone has a method of preventing such thing. I do not want to ban bing because it is a microsoft spider, but when shouldn't it respect my robots.txt file? |
(1) (Reply)
I Need Help On Online Business / Review This Javascript Effect On / Senior Technical Partner Position (web & Software Solutions)
(Go Up)
| Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health religion celebs tv-movies music-radio literature webmasters programming techmarket Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10) Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 31 |