These corporations are a plague upon this earth. I’ve spent a couple years setting up my own servers running my own services, some of which I wrote myself (search engine), and buying open-source hardware to distance myself from them.
Metasearch engine that strips all identifying information and generates a random user agent for every request. I also have it going through a VPN so that my IP can’t be used for identification.
If you ever want to go independent, since some search engines (namely Google and DuckDuckGo) censor search results, there is always YaCy.
If you do want to give it a try make sure to run it on decent machine (good performing multi-core CPU, at least 8 GB of free RAM and at least 1 TB of storage space).
I actually have been running my own YaCy instance on my homelab Server for a few months now. Currently it has indexed about 13 million web pages. Right when this shit with Ukraine started and I read that DuckDuckGo is now censoring russian search results I had enough. And first thing I did was search for things like “China concentration camps” or “North Korea escape” and blacklisted all the US media that popped up. Like you said:
Yes, YaCy is great, but I currently don’t have a free machine with enough resources. I run most of my services from Single Board Computers because they’re very power efficient and cheap. Most services don’t use anywhere near their capacity, so I have plenty of room to expand. The unfortunate downside is that I can only run resource-intensive programs on my powerful servers that are all currently in use. I am getting some more powerful servers though, and might run YaCy when I do.
These corporations are a plague upon this earth. I’ve spent a couple years setting up my own servers running my own services, some of which I wrote myself (search engine), and buying open-source hardware to distance myself from them.
Well done!
Meta search engine or independent with its own crawler?
Metasearch engine that strips all identifying information and generates a random user agent for every request. I also have it going through a VPN so that my IP can’t be used for identification.
If you ever want to go independent, since some search engines (namely Google and DuckDuckGo) censor search results, there is always YaCy.
If you do want to give it a try make sure to run it on decent machine (good performing multi-core CPU, at least 8 GB of free RAM and at least 1 TB of storage space).
I actually have been running my own YaCy instance on my homelab Server for a few months now. Currently it has indexed about 13 million web pages. Right when this shit with Ukraine started and I read that DuckDuckGo is now censoring russian search results I had enough. And first thing I did was search for things like “China concentration camps” or “North Korea escape” and blacklisted all the US media that popped up. Like you said:
Yes, YaCy is great, but I currently don’t have a free machine with enough resources. I run most of my services from Single Board Computers because they’re very power efficient and cheap. Most services don’t use anywhere near their capacity, so I have plenty of room to expand. The unfortunate downside is that I can only run resource-intensive programs on my powerful servers that are all currently in use. I am getting some more powerful servers though, and might run YaCy when I do.