百度来了!来的迅猛而急促,致使Feedsky服务器突然变慢。
查看日志才知,既然是Spider,但为什么不携带”ETag”和”If Modify Since”一起来?
孟岩在近日思考四则里指责Feedsky没有携带”ETag”和”If Modify Since”,Feedsky已经改正,那么百度什么时候会改正?
61.135.146.199 – - [27/Apr/2006:15:04:09 +0000] “GET /anyp/2743278 HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
61.135.146.199 – - [27/Apr/2006:15:04:17 +0000] “GET /anyp/466874408 HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
218.0.42.220 – - [27/Apr/2006:15:04:23 +0000] “GET /anyp/hnwzhw HTTP/1.1″ 200 6286 “http://image.baidu.com/i?ct=503316480&z=540318950&tn=baiduimagedetail&word=\xc3\xf7\xd0\xc7\xd7\xdf\xb9\xe2&in=43” “Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)”
61.135.146.199 – - [27/Apr/2006:15:04:34 +0000] “GET /anyp/2732717 HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
61.135.146.199 – - [27/Apr/2006:15:04:40 +0000] “GET /anyp/2497693 HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
61.135.146.199 – - [27/Apr/2006:15:04:45 +0000] “GET /anyp/2769746 HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
61.135.146.199 – - [27/Apr/2006:15:04:46 +0000] “GET /anyp/2766496 HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
61.135.146.199 – - [27/Apr/2006:15:04:52 +0000] “GET /anyp/lsh303 HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
61.135.146.199 – - [27/Apr/2006:15:04:58 +0000] “GET /anyp/2613258 HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
61.135.146.199 – - [27/Apr/2006:15:04:59 +0000] “GET /anyp/candy-lucy HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
61.135.146.199 – - [27/Apr/2006:15:05:12 +0000] “GET /anyp/2757986 HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
61.135.146.199 – - [27/Apr/2006:15:05:12 +0000] “GET /anyp/2722097 HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
61.135.146.199 – - [27/Apr/2006:15:05:13 +0000] “GET /anyp/yumunaodai HTTP/1.1″ 200 7155 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
61.135.146.199 – - [27/Apr/2006:15:05:53 +0000] “GET /anyp/2744951 HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
61.135.146.199 – - [27/Apr/2006:15:05:59 +0000] “GET /anyp/2725557 HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”
61.135.146.199 – - [27/Apr/2006:15:06:13 +0000] “GET /anyp/2772936 HTTP/1.1″ 302 5 “-” “Baiduspider+(+http://www.baidu.com/search/spider.htm)”