百度爬蟲無法抓取GitHub Pages

原文地址

之前瞎BB了那麼多GitHub Pages的SEO優化,後來發現GitHub Pages拒絕百度爬蟲爬取。orz

Hi Jerry,

Sorry for the trouble with this. We are currently blocking the Baidu user agent from crawling GitHub Pages sites in response to this user agent being responsible for an excessive amount of requests, which was causing availability issues for other GitHub customers.

This is unlikely to change any time soon, so if you need the Baidu user agent to be able to crawl your site you will need to host it elsewhere.

Apologies again for the inconvenience.

Cheers,Alex

引用自:http://www.chinaz.com/web/2015/0610/413172.shtml

無所謂,Google搜索正常就行了,不折騰。

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章