Meta (slrpnk.net)

818 readers

5 users here now

Here we can discuss anything about this Lemmy instance/server itself.

Our XMPP support chat: Movim or XMPP client.

founded 3 years ago

MODERATORS

Anti SEO? (slrpnk.net)

submitted 3 weeks ago by sam_uk@slrpnk.net to c/meta@slrpnk.net

8 comments fedilink hide all child comments

I wondered about the robots.txt

I can see the case for it, I could also see the case for allowing at least Google to index the site.

Has there been some discussion about this previously?

you are viewing a single comment's thread
view the rest of the comments

[–] sam_uk@slrpnk.net 2 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

In the bottom

User-agent: *
Disallow: /

Blocks all scrapers and superseeds the text above AFAIK