this post was submitted on 09 Jun 2023
2 points (100.0% liked)

Lemmy

12524 readers
1 users here now

Everything about Lemmy; bugs, gripes, praises, and advocacy.

For discussion about the lemmy.ml instance, go to !meta@lemmy.ml.

founded 5 years ago
MODERATORS
 

I really like the Lemmy Community Browser at browse.feddit.de for locating communities across instances.

When I first stood up my instance, I guess it was crawled and my community showed up there. Awesome!

I've since rebuilt on a new domain and federated again, and my old instance dropped off (as expected). However, a day or so later, my new instance still isn't showing up there. The new instance is known to join-lemmy.org and fediverse.observer, so it is discoverable.

I'm curious if anyone knows how often it updates and if that tool is based on a project I can clone to spin up another instance. I'm interested in both running a replica of it to act as another entry point as well as using it as a base to develop some quality of life enhancements. e.g. a click to subscribe option that ties into your home instance and does the initial search and subscribe steps.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] wintermute@feddit.de 1 points 2 years ago (1 children)

@ptz@dubvee.org Seems your instance got crawled finally

[โ€“] ptz@dubvee.org 1 points 2 years ago

There it is!

Thanks for checking back.

I want to say the blame lies 100% with me on this one.

When i moved over to the new domain, I forgot to disable my default WAF policy for robots.txt which is set to disallow all. Realized that late yesterday evening and turned that rule off in my load balancer.