nachitima

Hey, super helpful comment.

A few of the details you mentioned are exactly the kind of practical stuff I’m trying to collect, so I wanted to ask a bit more:

When you say you pushed federation workers up to 128, which exact setting are you referring to?
Roughly how big is your instance in practice — users, subscriptions, remote communities, storage size, daily activity?
What were the first signs that federation was falling behind, besides the Waiting for X workers log message?
Did increasing workers fully solve it, or did it just move the bottleneck somewhere else?
What kind of Postgres tuning ended up mattering most for you?
For backups, are you only doing weekly pg_dump + VPS backups, or also separately backing up pictrs, configs, secrets, and proxy setup?
Have you tested full restore end-to-end on another machine?
For pictrs growth, have you found any good way to keep storage under control, or is it mostly just “plan for it to grow”?
For monitoring/logging, if you were starting over, what would you set up from day one?

I’m mostly interested in the boring operational side of running Lemmy long-term: backup/restore, federation lag, storage growth, and early warning signs before things get messy.

Sorry if some of these questions are a bit basic or oddly specific — I’m using AI to help gather as much real-world Lemmy hosting experience as possible, and it generated most of these follow-up questions for me.

Hey, this is really useful.

I wanted to ask a few follow-ups, because the jump from 16 GB to 64 GB sounds pretty dramatic:

What kind of storage were you using when it was struggling — HDD, SSD, NVMe?
Did you only increase RAM, or did storage / CPU / other settings change too?
Roughly what kind of workload was this? Number of users, subscribed communities, amount of federated traffic, image-heavy browsing, etc.
Do you remember what the actual bottleneck looked like — high RAM use, swap, I/O wait, Postgres getting slow, pictrs, federation queue buildup?
When you say disabling image proxying helped, how much did it help in practice?
Was this on a recent Lemmy version, or a while back?

I’m trying to separate “Lemmy really needs big hardware” from “a specific part of the stack was the real problem”.

Hey, thanks for sharing this.

I’m trying to get a clearer picture of what a reliable Lemmy backup/restore setup looks like in practice, especially for self-hosting.

A few things I’d be curious about in your setup:

Are your Proxmox backups enough on their own, or do you also make separate Postgres dumps?
Are you backing up the whole container/VM image, or do you also separately keep pictrs data, config files, secrets, reverse proxy config, etc.?
Have you actually tested a full restore from backup onto another machine? If yes, did it come back cleanly?
Do you do local-only backups, or also offsite copies?
When you update Lemmy, do you rely on rollback from snapshots if something breaks, or do you have another recovery path?

Main thing I’m trying to understand is whether Proxmox-only backups are “good enough” operationally, or whether people still end up needing app-level backups too.

Thanks! There is a lot of work : )

Well, I assume there might be some technical or economic reasons why PeerTube developers haven't improved the situation with this problem. But they have already done a great job. My project is basically built on top of what they created. PeerTube provides the ability for anyone to host videos and share them in the Fediverse, which is the fundamental thing. I can't imagine how much effort and energy it takes to maintain this project. And all that exists and is still going based on charity and enthusiasm, I believe. At least my project for sure does :)) Developing such projects as Fediverse platforms is definitely not about making money. So we have to take this fact into account.

Thanks! Yes, I'm missing dark mode as well. Regarding the language filter, the simplest way is to make it filter by the language entry in the video's metadata. I will definitely take this into account, because there are a lot of videos in French, for example, which I don't understand completely :)) But it is interesting, though! YouTube forces content on users based on their IP location, and as far as I know there is no way to deal with it except to change your IP with a VPN. It would be pretty interesting to have an option to easily switch the content language and explore different videos from another language sphere. Also, it would be interesting to have an option to switch off the language filter completely and explore the content based on the topics more widely.

Thank you for your feedback.

At the moment, I am actively looking for income, as the financial situation and job market in my country are very difficult. I am trying to find ways to earn money. This project is something I genuinely enjoy working on and investing a lot of time in. It truly engages me. However, I have a significant issue: I do not have a stable income.

The hosting problem can be partially managed for now. At the early development stage, I can run the service on my own workstation. The more substantial and harder-to-solve issue is funding both my personal living expenses and the ongoing development of this project.

Hosting this service requires computational resources so that it can process and deliver information quickly. My current machine handles this reasonably well. However, renting an equivalent remote server with similar performance would be quite expensive. That is why hosting costs are not my top priority at the moment. My priority is earning money to sustain myself.

I would be interested in exploring fundraising specifically for the development of this project, because it requires a great deal of time and effort. I am considering applying for a grant to fund the development, but there may be complications, especially given that I am a Ukrainian citizen currently living in Ukraine. I am not yet sure what specific difficulties might arise. And, of course, there is no guarantee that I would receive such a grant.

Therefore, as an alternative, I would consider fundraising directly from interested users and the community to support development. Since you mentioned fundraising, I would like to ask how you feel about having an option to financially support the project’s development. Would you personally consider becoming a financial contributor? If so, what monthly amount would you potentially be willing to contribute?

Regarding your points about benchmarking the recommendation system and curator-based feeds, I am not entirely sure I understood what you meant. Could you please clarify?

nachitima

@ nachitima @lemmy.ml

Posts

5
Comments

8
Joined

3 mo. ago

nachitima

Hosting Lemmy experience

Hosting Lemmy experience

Hosting Lemmy experience

Hosting Lemmy experience

PeerTube-Browser

PeerTube-Browser | Update

PeerTube-Browser | Update

PeerTube-Browser | Update

PeerTube-Browser | Update

PeerTube-Browser | Update

Blender course in Ukrainian | #1

PeerTube-Browser

PeerTube-Browser