Be Your Own Privacy-Respecting Google, Bing & Brave
(%e3%83%9e%e3%83%aa%e3%82%a6%e3%82%b9.com)
from mesamunefire@piefed.social to selfhosted@lemmy.world on 03 Dec 00:01
https://piefed.social/c/selfhosted/p/1531882/be-your-own-privacy-respecting-google-bing-brave
from mesamunefire@piefed.social to selfhosted@lemmy.world on 03 Dec 00:01
https://piefed.social/c/selfhosted/p/1531882/be-your-own-privacy-respecting-google-bing-brave
… by running your own instance of the free and open-source federated metasearch engine SearXNG on OpenBSD!
threaded - newest
I run it in a container on Kubernetes. Definitely recommend.
I still don’t understand how Searx is able to operate for free. Don’t the API calls cost money?
From what I’ve read, I believe it’s a combination of donations. sponsors, volunteer hosting from like minded organizations.
If I had to guess, they probably don’t use the APIs, inside using scrapping of some sort.
My understanding is it scrapes what it can’t meaningfully get out of an API. Public instances run into rate limiting, but private instances don’t really have that problem.
Thanks for posting, both a great reminder to try setting this up on my unraid, and also to add the RSS feed of that site to Feeder.
I just added it too, I had read a few articles of them already
There is also a list of publicly operated SearXNG instances at https://searx.space/. We host the one at https://search.freestater.org/, and there are plenty of other good ones.
<img alt="bVuZT3n0X1rOSXk.jpg" src="https://media.piefed.social/posts/bV/uZ/bVuZT3n0X1rOSXk.jpg">
Who says they are securely operated and don’t store any data??
who says that about any search engine? can you trust them? searXNG is usually run by random people who are less likely to use your data than a larger search company
At least with Google it wont be an individual that can open my data (most likely).
Probably only the AI or whatever can actually read any of it directly.
If you’re using a shared IP, it doesn’t matter.
You are using a VPN or Tor, right?!?
The devs at SearXNG have a bot that regularly scans the public instances for changes to the source code and delists them as a public instance if it’s altered.
If you go to https://searx.space, they show the results of the scans for each instance.
The software is free and open source. You are encouraged to inspect the code yourself to make sure no data is collected!
Here is the source code:
https://github.com/searxng/searxng
Thank you very much for proving what’s correct :)
.
Is metasearch really the best we can do? What about YaCy, or something else more like that?
It’s not federated tho?
What do they mean when they call it that?
look at that domain name! respect
If you’re interested in this, the term you’re looking for is punycode
Usually its a sign of a scam. Looks like a ransomware c2 domain
Brave is a search engine?
That’s news to me.
it’s no kagi, but its ok
Brave have they’re own search engine
I used to self-host searxng for a while, but somehow the search results were always off and mixed with to much non-relevant results :/.
It’s not about searxng itself… Rather how the most relevant info gets drown into AI slope and non-sense bullshit. The best blogposts/info are transmitted from people to people…
I’m kinda sad to admit that stupid AI “solved” this issue and had better results :/
I mean, getting non-relevant results happens with every search engine anymore.
The days of your search results being relevant, and what you want on the first page, are long dead thanks to SEO and other factors.
Yeah you’re right ! However, ages ago, I still remember how you could go to page 20+ and still find some really interesting things !
Here, past page 2 it’s just some random shit…
Most of its just AI generated websites. Search for any topic and you’re likely to get 50 AI generated website that give a similar bulletpoint presentation of what search item X is according to the AI that generated the site.
Yeah that’s what I meant by “random” shit ! 😁
You can self host that too ;)
OpenWebUI + Ollama + SearxNG. OpenWebUI can do llm web search using the engine of your choice (even self hosted SearxNG!). From there it’s easy to set the default prompt to always give you the top (10, 20, whatever) raw results so you’re not confined to ai results. It’s not quite duck.ai slick but I think I can get there with some more tinkering.
Ohoho? That’s interesting. I don’t have the horse power to selfhost an AI, but that’s good to know !
Thanks for the pointer !!!
Is there a guide on how to do this on Linux + 16GB Radeon?
I mean, I could write one! I kind of just pieced it together from guides on the three individuals
Edit: back of the napkin guide below is basically in the OpenWebUI docs already! I use NixOS (btw) but docker/podman should work well.
OpenWebUI + Ollama setup – tl;dr
docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:mainOpenWebUI SearXNG guide – a little more involved, but not difficult.
I don’t know any other search that lets you block urls from results. Blocking stuff like social media and Amazon cleans up the results very well.
Or how about YaCy. It’s self-hostable & you can have your own web index and start your own web-crawler.
It’s peer-to-peer too
I personally love yacy.
This is exactly what I came here to find. Thank you for posting it. If I can be so bold selfhosters should really be leaning this way searxng is great but it still uses big tech.
The other thing we need is a way to identify good crawling agents or *smol agents over corporate bots that just steal content.
If selfhosters can unite and build a good index perhaps searching can go back to the way it was vs a vector to sell you more and collect your data.
You know what else I like ? Fossil
It’s a FOSS alternative to Git itself, their official site itself is a self-hosted instance of Fossil.
How good are the results compared to Google/Duckduckgo?
You make your own index with this one
For anyone wondering xn–gckvb8fzb.com is マリウス.com
Also: Maybe they should get a “normal” domain when you post english articles…
Does the url not resolve on certain browsers or something? I usually just copy/paste or use a firefox plugin to generate posts for lemmy/piefed/fediverse.
It resolves well but punnycode is disabled in some browsers or security enhanced profiles, so that you can easier detect punnycode domains that try to fake other domains.
Im not familiar with punnycode. Interesting.
it’s punycode
The search engines that searxng interact with still track you. For this reason I will always use a public instance to mix up the tracking with everyone else using it.
Explain?
Using a public instance is more private than using a private selfhosted instance.
…a public Lemmy instance? How is that related to the the search engine?
a public SearXNG instance
044en17rl is right I meant a public seaxng instance.
BSD FTW