Earn up to $7500 for one sale!
Welcome to 360votes Q&A, where you can ask questions and receive answers from other members of the community.
Buy Reseller Club Hosting The hassle-free way to register your domains Wordpress Hosting Get a 15 Day Free Trial at 3DCart.com

What does "Download of Robots.txt Failed" mean?

+1 vote
asked Oct 12 in Computers & Internet by haripcexpert (3,130 points)

1 Answer

+1 vote
 
Best answer

When the result of a fetch reads “Download of Robots.txt Failed”, then Bingbot was not able get a proper server response when trying to access your site’s robots.txt. This usually means that your site’s server is configured to refuse Bingbot or the IP addresses from which Bingbot operates a proper connection or simply denies access to this URL. This is a problem, since Bingbot now cannot tell whether or not a robots.txt file actually exists nor read any directives in the robots.txt file should it exist. You should investigate (or ask your ISP to investigate) whether such a configuration is in place.

answered Oct 12 by admin (5,100 points)
selected Oct 12 by haripcexpert
...