this post was submitted on 24 Aug 2025
6 points (87.5% liked)

AI Infosec

894 readers
1 users here now

Infosec news and articles related to AI.

founded 2 years ago
MODERATORS
 

Hi

Any recommandations for an actively maintained AI user-agent list please ?

This is not perfect but I use that trick to block or slow down some of them... If you have a better way I'm all ears.

top 3 comments
sorted by: hot top controversial new old
[–] gravitywell@sh.itjust.works 3 points 3 weeks ago

I just came up with a list on my own from looking at nginx logs

Amazonbot
Amazon-Bot
Claudebot
SemrushBot
AhrefsBot
MJ12bot
DotBot
BLEXBot
bingbot
GPTBot
meta-externalagent

[–] slazer2au@lemmy.world 2 points 3 weeks ago (1 children)

Anubis?

Does user agents even matter when most don't even say what they are.

[–] m33@lemmy.zip 3 points 3 weeks ago

Thanks for the link, I will compare the user-agent regex they use like this one for Claude and the list I've build over time.

They match IP range too, it may be a nice addition too.