Cool!
Cans has source? I’ve been hacking on a per-instance community scraper (that pulls a list of communities from the community directory page) for !lemmy411!lemmy411@lemmy.ca, in an attempt to have a regularly published community list, but I’m a bit bogged.
I have links to the source for my crawler (written in nodejs with redis task queuing) on https://lemmyverse.net (GitHub link top right) 🤗 It’s a bit messy at the moment but has all the community crawling stuff.
Aha, I am doing the exact same thing 😂 https://lemmyverse.net
It looks really good! When I saw it on my feed my first response was “oh shoot someone beat me” 😂
Hehe they do look quite similar so great minds right 😁 I had the same thourght when I saw yours! I’ll add a link to yours to the list on my about page if you want 😀
that would be great, i’ll make sure you add yours as well 😀
Excuse me, this is a capitalist society. Please compete to the death
I wanna give both of you props for your work on these. It’s pretty cool to see the community jump on things like this. I’ve been half considering an attempt to whip up an android app just for a personalized experience, but I’m worried I’ll be too ambitions lol
Saw yours last night and prefer it. But wow, the communities have gone from 6k to over 10k overnight by your stats. Is that true?
Probably the best one I have found so far.
By the way, do you have any plan to expose an API or daily extract of the data you have?
While those websites are useful for manual searches, I think it would benefit the feddiverse much more if there was a way to integrate all those lists into an app. At least without resorting to web scrapping.
Update: https://data.lemmyverse.net/
Thank you for the information I’ll definitely check that out.
For both of you, wouldn’t it be nice to let me add my home instance so you could provide quick links to subscribe (and open the community in my home instance).
I have a feature planned so you can login and one click subscribe/unsubscribe all on one page. Stretch goal though I’ve gotta patch some bugs first 😁
Potentially dumb question, but I’ve seen lots of people linking to this website:
What’s new/different about https://browse.toast.ooo or https://lemmyverse.net?
Is it because they also show instances, not just communities? Or is it more just a hobby project (nothing wrong with that, I’m 💯 on board with building things for the sheer enjoyment of it - even if it’s already a ‘solved’ problem)
I can only speak for myself, but I started work on mine since the Feddit one is fixed wide mode and the searching/filtering is less than ideal, I wanted to be able to see more details. Feddit one doesn’t show instance stats iirc. There are also other lists, but I didn’t find any of them super user-friendly… If Lemmy is gonna succeed Reddit there needs to be some super friendly tools to assist community discovery.
Nice! I sort of hope these community discovery tools & improvements eventually make their way back ‘upstream’ into Lemmy’s UI over time. Imagine not needing a separate discovery app because Lemmy’s built-in one is already the best one available 😄
I hope so too! The current problem is that new Lemmy instances start with no communities and you have to search to get federation started. If there was an easier way to do a global search within a fresh Lemmy instance that’d be nice!
