Lemmyverse

6 readers
1 users here now

Announcements and stuff for Lemmyverse.net.

founded 2 years ago
MODERATORS
tgxn@lemmy.tgxn.net
listing: all - local
1
1
how does the lemmyverse crawler get data from slrpnk.net, which has anti-bot tech? (slrpnk.net)
submitted 2 weeks ago by activistPnk@slrpnk.net to c/lemmyverse@lemmy.tgxn.net
0 comments fedilink
 
 

I noticed when visiting slrpnk.net there is an anti-bot mechanism saying “making sure you’re not a bot”, which takes a few seconds. I suppose there is some javascript calculations or something.

Yet most slrpnk.net communities manage to get scraped into the lemmyverse DB anyway. Did slrpnk have to make some kind of exception for that?

2
1
slrpnk.net/c/fixing is missing from the DB (slrpnk.net)
submitted 2 weeks ago by activistPnk@slrpnk.net to c/lemmyverse@lemmy.tgxn.net
0 comments fedilink
 
 

I notice other complaints about missing communities. Why does this happen?

Would it make sense for the lemmyverse.net project and the lemmy-federate.com project to exchange data?

3
1
mapping threadiverse relationships (slrpnk.net)
submitted 2 weeks ago by activistPnk@slrpnk.net to c/lemmyverse@lemmy.tgxn.net
0 comments fedilink
 
 

Are there any open datasets that track who is federated / defederated with who? I have the Lemmyverse datasets but it has nothing on node relationships.