Yeah mine is a Broadwell i7, 3.1ghz with boost up to 3.4ghz, model number 5557U. The guy I bought it from maxed out the specs at launch and I bought pretty cheap a few years ago. For a ten year old device it runs like a dream and handles pretty much anything short of gaming and video editing with ease
This is very true to be fair, I’ve noticed it hallucinating multiple times. Critical thinking should be taught in schools, I feel like kids growing up with LLMs are taking way too much of it what they say at face-value. Interrogation and reflection is a must. For me, I use it as a shortcut to gain a base-level of knowledge, I only tinker when I’m sure I have the right information and won’t mess anything up.
I should definitely play it relatively safe when it comes to this stuff. But I do think that, in lieu of formal training in networking, LLMs can be useful in the hands of someone who is cautious and responsible. I’m an adult with a full time job and other responsibilities, I don’t have the time or the inclination to take a course on networking.
So, I’m strictly a hobbyist when it comes to this stuff, but I’m also not an idiot who thinks ChatGPT can magically solve any problems I throw at it.
Thanks, yeah my Mac will be a dedicated machine for this setup. Do you think I should keep sonoma on it (obviously that’s an issue as far as my goal of going all-FOSS) or install proxmox/ another Linux distro?
Thank you, I’ll look into VPS, that’s new territory for me.
Re transcoding on Jellyfin. Yes that’s something I have considered. A lot of my media is x265 10-bit 1080p stuff, decent quality but not huge lossless blu-ray rips. I stick to encodes that are about 4-8gb a movie. Clients connecting to the server are a couple of laptops and two smart tvs using the native Jellyfin apps. So far I’ve only run into issue with things like AV1 files or very large 4k rips that won’t play on smart tv, mkvs play fine.
Thanks for the info. Yeah, I was wondering what kind of hardware you’d need to host LLMs locally with decent performance and your post clarifies that. I doubt many people would have the kind of hardware required.
Hi there, I’m thinking about getting into self-hosting. I already have a Jellyfin server set up at home but nothing beyond that really. If you have a few minutes, how can self-hosting help in the context of OPs post? Do you mean hosting LLMs on Ollama?
Does using rdx benefit Reddit at all? I don’t have a Reddit account anymore but I sometimes check it with rdx but I think im ready to cut ties altogether.
Okay thanks. Yeah, the SSDs and 16gb of ram should mitigate speed issues. My main hesitation is the older CPUs in these. They’re not very future-proof and we are going to run windows 11 professional on them. With OS updates i can see them getting sluggish. They should be fine for a few years but can’t see them lasting much longer than 4-5 years. I suppose that’s fine for the price-point though
Yeah, I said they’re “useless as is”, because they’re running an outdated OS, have internet explorer on them, etc. the hardware is obviously far from useless but getting it to a good place in terms of user experience for a younger audience will involve a time investment. So yes, useless as is.
Does turning off subtitles at the settings level avoid this? Like if I turn subs off for all users will it stop it?