Googlebot keeps getting your main page and robots.txt? Find out how long you have to wait for Googlebot to do a full crawl of your site.

This waiting time varies based upon the number and the Page Rank of the inbound links pointing to your site.

For new sites without good inbound links, three weeks is a good rule of thumb.

blog comments powered by Disqus

Discuss Googlebot keeps getting your main page and robots.txt? Find out how long you have to wait for Googlebot to do a full crawl of your site. in the forums.

 
(0 - user rating)