Saturday, January 26, 2013

Really weird website traffic from Baiduspider

In the past couple of days, my website got some really traffic from the Baiduspider.
This was all for pages that my website does not have which even included Yahoo news articles. My website currently only has one single news page and not a three level deep structure.
What became even more odd is this search for sign_up, signup, link-resources, register, join, member, membership and other files and folders like that. Not a single one of these requests was actually for a page on my website since I had everything else renamed for logging reasons.

The user agent of one of these page not found cases is:
Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)