My non-tech wife tried to tell me “obviously that’s why it’s called that” when I’ve been writing software (and even some minor firmware hacking) for 30 years.

Is this the real life?

Hits a 404 now on the link (sh.itjust.works link above), does anyone have a TLDR?

Rust itself or the way the Rust logic is implemented is not the bottleneck. Like most decent web applications the bottleneck is the database and how the decentralized protocols themselves are reconciled there.

Scaling massive amounts of records like Lemmy has been forced to is almost always IO bound at the database level even when a web service is centralized; this is much more difficult in federated architectures. This is why “NoSQL” databases have increased in popularity, but they are also not a magic bullet as there are major ACID trade offs one needs to consider.

This isn’t “one or the other” IMO. There’s room for niche instances hyper-focused on a generalized topic like “math,” “comp sci,” “sports,” etc.

But then there should also be a massive generalized instance (hopefully 2 at least so the competition keeps admins in check) that has a little bit of everything and acts as a Reddit replacement. We can have our cake and eat it too.

I definitely do find this a little disappointing as I think the Lemmy community is too small at the moment to create unnecessary divides and schisms. Success in my mind is predicated on many communities from Reddit coming to servers and forming a common denominator community that achieves critical mass.

It’s clear to me that some of the communities on the 2 you are defederating from you instance have become more popular and are already the defacto “place to be” for certain subreddits.

All that said, I’m happy that my main server (infosec.pub) has not unfederated from those 2 instances so I am able to still participate on those 2 servers AND interact here on my “main” account. This lets me get the best of both worlds. It’s very exciting to see the Lemmy model working in that regard!