去评论
dz插件网

分享一些恶意爬虫的UA特征(仅供参考,宝塔Nginx防火墙)

饾暦饾枎饾枒饾枏饾枂饾枅饾枑
2024/09/04 21:22:25
使用宝塔面板的可以在Nginx防火墙里面的UA黑名单导入(自己整理,仅供参考)

AhrefsBot
AwarioBot
BLEXBot
Barkrowler
CensysInspect
Criteo
DataForSeoBot
DigExt
DnyzBot
DotBot
ExtLinksBot
Ezooms
FlightDeckReports
Go-http-client
Grapeshot
Heritrix
HttpClient
HubSpot
InternetMeasurement
Knowledge AI
Linguee Bot
MJ12bot
MauiBot
MegaIndex
RepoLookoutBot
SemrushBot
SurdotlyBot
Web-Crawler
WellKnownBot
Yellowbrandprotectionbot
ZoominfoBot
axios
fasthttp
github
libcurl
paloaltonetworks
python
seokicks
serpstatbot
webprosbot