All the posts about Reddit blocking everyone except Google and Brave got me thinking: What if SearNGX was federated? I.E. when data is retrieved via a providers API, that data is then federated to all other instances.
It would spread the API load out amongst instances, removing the API bottlenecks that come from search providers.
It would allow for more anonymous search, since users could cycle between instances and get the same results.
Geographic bias would be a thing of the past.
Other than ActivityPub overhead and storage, which could be reduced by federating text-only content, I fail to see any downside.
Thoughts?
Like I said documentation is out of date, reading their forums you see quite a few posts about it. The yacy grid sounds perfect for me since it runs a bunch of microservices and I have a cluster of mini PCs. Only problem is the yacy grid is unfortunately lacks the distributed P2P part.