Opensource

3656 readers

44 users here now

A community for discussion about open source software! Ask questions, share knowledge, share news, or post interesting stuff related to it!

Credits

Icon base by Lorc under CC BY 3.0 with modifications to add a gradient

⠀

founded 2 years ago

MODERATORS

pylapp@programming.dev

BadWebsiteBlocklist: A blocklist I made that removes spam & misleading websites from search results (github.com)

submitted 7 months ago* (last edited 7 months ago) by popcar2@programming.dev to c/opensource@programming.dev

7 comments fedilink hide all child comments

Much like everyone else, I got fed up with search engines. So I decided to make a giant blocklist that cleans up garbage search results!

I browsed other blocklists and wasn't very satisfied from what exists now; the goal of this one is to be super organized and transparent, explaining why each site was blocked via issues. Contributions welcome!

Even though around 100 domains are blocked so far, I already noticed a big improvement in casual searches. You'd be surprised how some AI generated websites can dominate the #1 page on DuckDuckGo.

top 7 comments

sorted by: hot top controversial new old

[–] Semi_Hemi_Demigod@lemmy.world 8 points 7 months ago (1 children)

I’d love a way to integrate this with Whoogle or SearX

[–] popcar2@programming.dev 8 points 7 months ago* (last edited 7 months ago)

I think both of them would have a way to filter domains if you're self-hosting. The blocklist uses simple regex so you can probably copy-paste the blocklist straight into your filters.

[–] Gullible@sh.itjust.works 6 points 7 months ago

[–] kitnaht@lemmy.world 3 points 7 months ago* (last edited 7 months ago) (1 children)

Will this "infinite scroll" something like Google and inline the results so the result page doesn't end up looking like a single entry for really gnarly searches?

I can imagine searching for something like 'baked bread' and getting more AI fluff than good results, enough where you might have to trod to a second page.

And I'm lazy.

[–] popcar2@programming.dev 6 points 7 months ago (1 children)

I don't think so, it'll just remove the bad results and you'll have to click next page yourself. Technology has its limits.

[–] Lost_My_Mind@lemmy.world 4 points 7 months ago

Click to the next page??? Did you miss the part where he's lazy?

[–] isles@lemmy.world 2 points 6 months ago

Thanks for your work and I appreciate your efforts in transparency on why something is blocked!