Thoughts on crowdsec
from Reannlegge@lemmy.ca to selfhosted@lemmy.world on 14 Jul 00:03
https://lemmy.ca/post/67796189

I have been running crowdsec on my OpenWRT firewall for a bit now, I am just curious as to what others think about it?

Thank you @irmadlad the webui you suggested is showing the logs a lot better than my vibe coded HA plug ins (both my ssh honey pot and my plug in showed nothing) looking over the logs shows so much activity that is happening.

#selfhosted

threaded - newest

irmadlad@lemmy.world on 14 Jul 00:24 next collapse

When I ran Crowdsec, I thought it was a great piece of software, and a very decent free tier. I didn’t have any real complaints other that there was not a way, at the time that I knew of, to have the UI selfhosted. I think now someone has created a selfhostable user front end to it, but I haven’t dabbled in that.

Here we go: corelab.tech/crowdsec-web-ui-setup-guide/

I think this gent posted this a week or so ago.

ZebraGoose@sh.itjust.works on 14 Jul 00:38 next collapse

Wow thanks! Defently gonna check that out!!

Reannlegge@lemmy.ca on 14 Jul 02:32 collapse

I am using HA

Edit: after looking at what you posted I thought I would check it out, and it is a lot better than the HA thing I vibe coded into home assistant.

irmadlad@lemmy.world on 14 Jul 02:44 collapse

Ooops! Well at least the link was helpful to ZebraGoose

Reannlegge@lemmy.ca on 14 Jul 02:57 collapse

I did not mean to through shade onto you this webui is a lot better than my ha vibe code.

irmadlad@lemmy.world on 14 Jul 11:17 collapse

Nah…you’re good.

The_Zen_Cow_Says_Mu@infosec.pub on 14 Jul 00:35 next collapse

i run it on opnsense. When my services were on individual subdomains each with their own certificate, they got hit a lot and crowdsec blocked lots of bots and scripts

I ultimately moved all my services to a wildcard sub-subdomain, and poof all the bots went away and now crowdsec doesn’t do much other than block port scanners which the firewall does anyway.

it’s not worth the hassle to uninstall though.

rimu@piefed.social on 14 Jul 00:46 next collapse

Ahh so bots are finding subdomains by scraping SSL certificates?

RxBrad@infosec.pub on 14 Jul 00:54 next collapse

That was my experience also. Within minutes of spinning up any new subdomain with a dedicated A DNS record, I had bots that scraped it from crt.sh knocking on the door.

With wildcard subdomains and relatively obscure URLs, it’s pretty quiet.

lemmyvore@feddit.nl on 14 Jul 07:20 collapse

Yes, and also by trying common subdomains under the main domain (like jellyfin., home. etc.) (They also scan the entire IPv4 address space, all TCP ports, over and over, but that’s a different discussion.)

If you’re using DDNS you have to also be careful where you put the A and AAAA records. Some people put them on the main domain and then do a wildcard CNAME pointing to it for all the subdomains, or individual subdomain CNAMEs. But since the main domain is known from TLS cert logs it’s trivial for bots to also check to see if there’s A/AAAA records on it.

It’s better to put the A/AAAA on a dedicated subdomain, obfuscate the name beyond trivial guesses (eg. maybe don’t use ip.), and make an individual CNAME for each services that points to the IP subdomain, and obfuscate those service subdomains similarly.

For those who aren’t familiar with DNS, the information in it is publicly available to anybody who can name a [sub]domain and record type explicitly, but they refuse to do “list all the records for all the subdomains of this domain”. So bots are limited to asking for the most commonly used record types on the main domain but can’t get to records on subdomain names unless they can name the subdomain. (For completion, asking for a list of all records is possible, but nowadays due to abuse that function is restricted on all the public servers to just the known IPs of their fellow redundant servers.)

A similar limitation applies to reverse proxies, bots can’t get to a service behind it unless they can correctly name the FQDN that the proxy uses for that service. (But please note that a reverse proxy works independently of DNS. If the proxy has foo.example.com defined to reach a service, it will work even if that domain isn’t in DNS or doesn’t exist.)

Even after taking these measures you have to keep in mind that this is not security, it’s obscurity. It cuts down on bot scans which is great but don’t assume it means nobody knows your service domains. Your ISP probably knows them, there are DNS servers out there that know them, your mobile carrier can see them, and if you ever connect to WiFi when away from home the owners of those WiFi can see them (think hotels, airports, coffee shops etc.) It’s not out of the question for a coffee shop WiFi to have been compromised and to collect URLs and attempt attacks against them. Use VPN or a SSH tunnel to connect to services whenever possible, rather than exposing them publicly, and if you must expose them publicly then use mTLS or at the very least a custom header key.

confusedpuppy@lemmy.dbzer0.com on 14 Jul 04:04 collapse

I also haven’t seen any bot activity after I started using wildcard sub domains. My ISP blocks all incoming on common ports so I also use uncommon ports. I assume the combination of the two makes it too time consuming to find me.

I hid my ssh port with a wireguard connection so I also don’t see any attempts on my ssh port anymore either. My logs, including fail2ban, are quiet and boring.

It’s nice to have a quiet corner of the internet for myself.

irmadlad@lemmy.world on 14 Jul 11:51 collapse

My logs, including fail2ban, are quiet and boring.

Every once in a while, I’ll tail my f2b logs, almost half heartily hoping I find an anomaly. But, no…it’s a snoozefest. pFsense out there on the edge, just doing it’s job.

Mereo@lemmy.ca on 14 Jul 02:50 next collapse

It’s great! I use it on both my home server and my Hetzner server. It blocks connections based on behaviors defined by scenarios. I configured it to block any connections it decides to block via the firewall.

So far, so good. I don’t even know it’s running. It just does its job of blocking bots.

Mio@feddit.nu on 14 Jul 07:17 next collapse

I believe it is a good start with crowdsec but feels like it gives false protection. The blocking only happens after they have done a couple of attempts and not before.

Reannlegge@lemmy.ca on 14 Jul 17:25 collapse

My first baby step into self hosting (years before I realized self hosting was the answer) was pihole. I realized it got most of the ads and I was happy with that, years went by and I realized more ads were getting through, so I learnt about fine tuning my ad list and regex lists. A little while went by and I heard that the google was selling .zip tlds so I learnt a little more about regex, not because I was worried I would unleash something on my LAN but just incase someone else did.

Layers there are layers of things I needed to do to prevent the ads, and than layers of things I needed to do to prevent spam. So I knew there was going to be layers of things I would need to do to protect myself when I got a “real” home lab on the Wild Wild WAN. Home Labbing is like sex, sure it is fun but it can be dangerous if you do not protect yourself and there are layers of protection you should use.

SomeDudeFromSpace@lemmy.ml on 14 Jul 08:27 collapse

I had it running in front of my Matrix server. With the default configuration it gave a lot of false positives, leaving friends out of the server. Also, most of my users use VPNs regularly, so geo-blocking was a hassle too. I tuned it a bit, but kept giving me headaches, so I ended up disabling it. I’ll spend more time tuning it someday.

stratself@lemdro.id on 14 Jul 09:07 next collapse

I don’t think geoblocking would be a great fit for Matrix, since you’d be contacted by servers from all over the world. It’s more suitable for something like a static website

talentedkiwi@sh.itjust.works on 14 Jul 11:10 next collapse

Yeah, I keep getting myself blocked because of something I’m hosting is giving a lot of false positives. I suppose I’ll have to dig into it at some point. For now I just whitelist the IPs I use.

Reannlegge@lemmy.ca on 14 Jul 17:29 collapse

Fine tuning is a great thing to keep in mind, just like a bloated pihole lots of false positives and over looked spots.