网站日志显示百度蜘蛛抓取链接为空是什么情况?
wp子比主题搭建的网站,上线2天收录了不带www的主域名,后续将不带www的主域名重定向到到www的域名,网站一个月都没有收录了,内容是伪原创的。
导出wwwlog日志显示很多抓取该出现链接的地方都是"-",具体情况如下:
(是不是设置错误把百度蜘蛛屏蔽了,百度站长后台抓取一直为零。)
220.181.108.158 - - [19/Oct/2023:12:03:18 +0800] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
220.181.108.169 - - [19/Oct/2023:12:03:19 +0800] "GET / HTTP/1.1" 200 19593 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
116.179.37.11 - - [19/Oct/2023:12:03:19 +0800] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html)"
116.179.37.75 - - [19/Oct/2023:12:03:19 +0800] "GET / HTTP/1.1" 200 19682 "-" "Mozilla/5.0 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html)"223.106.130.20 - - [19/Oct/2023:13:13:33 +0800] "GET / HTTP/1.1" 200 20087 "-" "-"
223.106.130.20 - - [19/Oct/2023:13:13:33 +0800] "GET / HTTP/1.1" 200 20128 "-" "-"
8.137.118.9 - - [19/Oct/2023:13:27:16 +0800] "POST /wp-cron.php?doing_wp_cron=1697693236.1269600391387939453125 HTTP/1.1" 200 31 "-" "WordPress/6.3.2; https://www.xxxx.com"
121.229.162.201 - - [19/Oct/2023:13:27:16 +0800] "GET / HTTP/1.1" 200 20238 "-" "-"
121.229.162.201 - - [19/Oct/2023:13:27:16 +0800] "GET / HTTP/1.1" 200 20119 "-" "-"
8.137.118.9 - - [19/Oct/2023:13:36:30 +0800] "POST /wp-cron.php?doing_wp_cron=1697693790.9287199974060058593750 HTTP/1.1" 200 31 "-" "WordPress/6.3.2; https://www.xxxx.com"
117.85.38.96 - - [19/Oct/2023:13:36:31 +0800] "GET / HTTP/1.1" 200 19982 "-" "-"
117.85.38.96 - - [19/Oct/2023:13:36:31 +0800] "GET / HTTP/1.1" 200 19878 "-" "-"
8.137.118.9 - - [19/Oct/2023:13:40:59 +0800] "POST /wp-cron.php?doing_wp_cron=1697694059.5014340877532958984375 HTTP/1.1" 200 31 "-" "WordPress/6.3.2; https://www.xxxx.com"
39.128.109.127 - - [19/Oct/2023:13:40:59 +0800] "GET / HTTP/1.1" 200 20042 "-" "-"
39.128.109.127 - - [19/Oct/2023:13:41:00 +0800] "GET / HTTP/1.1" 200 19991 "-" "-"
49.83.159.82 - - [19/Oct/2023:13:42:20 +0800] "GET / HTTP/1.1" 200 20178 "-" "-"
49.83.159.82 - - [19/Oct/2023:13:42:20 +0800] "GET / HTTP/1.1" 200 19891 "-" "-"
导出wwwlog日志显示很多抓取该出现链接的地方都是"-",具体情况如下:
(是不是设置错误把百度蜘蛛屏蔽了,百度站长后台抓取一直为零。)
220.181.108.158 - - [19/Oct/2023:12:03:18 +0800] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
220.181.108.169 - - [19/Oct/2023:12:03:19 +0800] "GET / HTTP/1.1" 200 19593 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
116.179.37.11 - - [19/Oct/2023:12:03:19 +0800] "GET / HTTP/1.1" 301 162 "-" "Mozilla/5.0 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html)"
116.179.37.75 - - [19/Oct/2023:12:03:19 +0800] "GET / HTTP/1.1" 200 19682 "-" "Mozilla/5.0 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html)"223.106.130.20 - - [19/Oct/2023:13:13:33 +0800] "GET / HTTP/1.1" 200 20087 "-" "-"
223.106.130.20 - - [19/Oct/2023:13:13:33 +0800] "GET / HTTP/1.1" 200 20128 "-" "-"
8.137.118.9 - - [19/Oct/2023:13:27:16 +0800] "POST /wp-cron.php?doing_wp_cron=1697693236.1269600391387939453125 HTTP/1.1" 200 31 "-" "WordPress/6.3.2; https://www.xxxx.com"
121.229.162.201 - - [19/Oct/2023:13:27:16 +0800] "GET / HTTP/1.1" 200 20238 "-" "-"
121.229.162.201 - - [19/Oct/2023:13:27:16 +0800] "GET / HTTP/1.1" 200 20119 "-" "-"
8.137.118.9 - - [19/Oct/2023:13:36:30 +0800] "POST /wp-cron.php?doing_wp_cron=1697693790.9287199974060058593750 HTTP/1.1" 200 31 "-" "WordPress/6.3.2; https://www.xxxx.com"
117.85.38.96 - - [19/Oct/2023:13:36:31 +0800] "GET / HTTP/1.1" 200 19982 "-" "-"
117.85.38.96 - - [19/Oct/2023:13:36:31 +0800] "GET / HTTP/1.1" 200 19878 "-" "-"
8.137.118.9 - - [19/Oct/2023:13:40:59 +0800] "POST /wp-cron.php?doing_wp_cron=1697694059.5014340877532958984375 HTTP/1.1" 200 31 "-" "WordPress/6.3.2; https://www.xxxx.com"
39.128.109.127 - - [19/Oct/2023:13:40:59 +0800] "GET / HTTP/1.1" 200 20042 "-" "-"
39.128.109.127 - - [19/Oct/2023:13:41:00 +0800] "GET / HTTP/1.1" 200 19991 "-" "-"
49.83.159.82 - - [19/Oct/2023:13:42:20 +0800] "GET / HTTP/1.1" 200 20178 "-" "-"
49.83.159.82 - - [19/Oct/2023:13:42:20 +0800] "GET / HTTP/1.1" 200 19891 "-" "-"