Guarding My Git Forge Against AI Scrapers (vulpinecitrus.info)
from tofu@lemmy.nocturnal.garden to selfhosted@lemmy.world on 12 Dec 14:04
https://lemmy.nocturnal.garden/post/407948

Cross posted from: lemmy.nocturnal.garden/post/407947

#selfhosted

threaded - newest

[deleted] on 12 Dec 14:14 next collapse

.

magic_smoke@lemmy.blahaj.zone on 12 Dec 14:42 next collapse

I would like to know how well iocaines spanky new redirection module works compared to Anubis.

If nothing else, to see if throwing Anubis in front of iocaine is still a worthwhile idea.

xyro@lemmy.ca on 12 Dec 18:02 next collapse

Good read, I use crowdsec to block most of the traffic considered as malicious (which tend to overlap with scrappers), but I should look into Locaine to feed garbage to the remaining ones instead of throttling.

possiblylinux127@lemmy.zip on 12 Dec 18:44 next collapse

Honesty we need a POW system built into http.

tofu@lemmy.nocturnal.garden on 12 Dec 21:08 collapse

A what? Not prisoners of war I guess

billhead@sh.itjust.works on 12 Dec 21:56 collapse

I’m guessing Proof of Work.

tofu@lemmy.nocturnal.garden on 12 Dec 23:03 collapse

Oh right. The article author isn’t a fan of that. I guess it’s fine while it works but I’m not too optimistic about how long it does

IanTwenty@piefed.social on 12 Dec 18:45 collapse

Self-hosting anything that is deemed “content” openly on the web in 2025 is a battle of attrition between you and forces who are able to buy tens of thousands of proxies to ruin your service for data they can resell.

This is depressing. Profoundly depressing.

Sigh