56
Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives
(blog.cloudflare.com)
c/cybersecurity is a community centered on the cybersecurity and information security profession. You can come here to discuss news, post something interesting, or just chat with others.
THE RULES
Instance Rules
Community Rules
If you ask someone to hack your "friends" socials you're just going to get banned so don't do that.
Learn about hacking
Other security-related communities !databreaches@lemmy.zip !netsec@lemmy.world !securitynews@infosec.pub !cybersecurity@infosec.pub !pulse_of_truth@infosec.pub
Notable mention to !cybersecuritymemes@lemmy.world
No, the point of it is only live interactive browsing.
The closest thing would be lynx, anything less than that should respect robots.txt
Of course as a single user, you don't really hace an impact and no one cares if you decide to ignore it, but once you are talking about automated systems...