Lemmyverse

6 readers

1 users here now

Announcements and stuff for Lemmyverse.net.

founded 2 years ago

MODERATORS

tgxn@lemmy.tgxn.net

how does the lemmyverse crawler get data from slrpnk.net, which has anti-bot tech? (slrpnk.net)

submitted 2 weeks ago by activistPnk@slrpnk.net to c/lemmyverse@lemmy.tgxn.net

0 comments fedilink hide all child comments

I noticed when visiting slrpnk.net there is an anti-bot mechanism saying “making sure you’re not a bot”, which takes a few seconds. I suppose there is some javascript calculations or something.

Yet most slrpnk.net communities manage to get scraped into the lemmyverse DB anyway. Did slrpnk have to make some kind of exception for that?

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here