大佬们，亚马逊爬虫（Amazonbot）是干嘛的？
2024/10/15 08:33:12
今天发现亚马逊的爬虫疯狂的爬站，亚马逊不是个购物网站吗，他要爬虫干嘛的？
[14/Oct/2024:21:02:07 +0800] ＂GET /tag/xuexi.html HTTP/1.1＂ 200 8191 ＂-＂ ＂Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)＂
[14/Oct/2024:21:01:59 +0800] ＂GET /go/3_69.html HTTP/1.1＂ 302 5 ＂-＂ ＂Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)＂
[14/Oct/2024:21:01:58 +0800] ＂GET /tag/juanzi.html HTTP/1.1＂ 200 7889 ＂-＂ ＂Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)＂
[14/Oct/2024:21:01:43 +0800] ＂GET /tag/kexue.html HTTP/1.1＂ 200 7836 ＂-＂ ＂Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)＂
[14/Oct/2024:21:02:07 +0800] ＂GET /tag/xuexi.html HTTP/1.1＂ 200 8191 ＂-＂ ＂Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)＂
[14/Oct/2024:21:01:59 +0800] ＂GET /go/3_69.html HTTP/1.1＂ 302 5 ＂-＂ ＂Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)＂
[14/Oct/2024:21:01:58 +0800] ＂GET /tag/juanzi.html HTTP/1.1＂ 200 7889 ＂-＂ ＂Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)＂
[14/Oct/2024:21:01:43 +0800] ＂GET /tag/kexue.html HTTP/1.1＂ 200 7836 ＂-＂ ＂Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)＂