Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)N

ntn888

@ ntn888 @lemmy.ml

Posts
12
Comments
57
Joined
1 yr. ago

  • My experience with local LLM

    Jump

  • you can give "unloading some layers to RAM" a try though.. that way you can get your hands on the "usable" 31b models. browse around to find some good 31b ones.. GL

  • My experience with local LLM

    Jump

  • I didn;t try any 7b ones lately, they may be better fit for 16gb I think. I was able to try the 2b ones as I mentioned (on cpu). they are subpar. like mentioned the usable ones were 31b, I think you need atleast 24gb vram for most models though. maybe someone else can suggest better.

  • My experience with local LLM

    Jump

  • My experience with local LLM

    Jump

  • Interesting thanks!

  • My experience with local LLM

    Jump

  • hey, thanks for your response.. yeah that's what I meant, the 2b models aren't usable in today's state, but more practical for everyday use if they work out..

    I actually meant the 31b models are useful for my purpose. I don't do full-on agentic coding, just interactive chat/prompting. Example, I make good use for making linux shell scripts (as I don't know howto myself). Currently I use qwen3.5-flash via cloud. It's as good as the frontier models back then if not better..

  • LocalLLaMA @sh.itjust.works
    ntn888 @lemmy.ml

    My experience with local LLM

  • Bitcoin slips below $71,000 as Trump orders U.S. to join Iran in blockade of Strait of Hormuz

    Jump

  • ofcourse he's not blocking the blockade... he's merely imitating it :D

  • What are your favorite low-footprint self-hosted services?

    Jump

  • just wait till it gets federation.. it'll be the nail in the coffin for github!

  • Blogging @programming.dev
    ntn888 @lemmy.ml

    Networking / reach platform

  • better Mastodon feeds

    Jump

  • hmm I see, I think I'll just try sticking. It must be working, the environment is much nicer than the other social media.. but the thought that I have to read all those posts..

  • better Mastodon feeds

    Jump

  • "more" is not the keyword here.. "condensed" is what I'm looking for. I dont think you understand my point

  • better Mastodon feeds

    Jump

  • Okay I'll give it a look thanks

  • better Mastodon feeds

    Jump

  • it doesn't look like it's federated.. let alone linked to mastodon?

  • better Mastodon feeds

    Jump

  • I searched for nodebb.. it is just forum hosting?

  • better Mastodon feeds

    Jump

  • doesn't that make the situation worse with a busier feed??

  • better Mastodon feeds

    Jump

  • is it global trending or personal feed? thanks

  • Fediverse @lemmy.world
    ntn888 @lemmy.ml

    better Mastodon feeds

  • No Stupid Questions (Developer Edition) @programming.dev
    ntn888 @lemmy.ml

    Income stream from developer sideblog?

  • Blogging @programming.dev
    ntn888 @lemmy.ml

    Income stream from developer sideblog?

  • Electronics @discuss.tchncs.de
    ntn888 @lemmy.ml

    critique for programming guide for cortex-M0 TI MCU

  • lemmy activity volume

    Jump

  • I wasn't even thinking about the interoperable fact, but indeed that is a bonus..

  • lemmy activity volume

    Jump

  • hmm yeah thanks. the interface is also rather inviting.. :)

  • lemmy activity volume

    Jump

  • yeah that comparison makes sense

  • lemmy activity volume

    Jump

  • hey! that thing is for domestic chinese??

  • lemmy activity volume

    Jump

  • yeah sure, but it's gotta be a collective thing.. btw what makes you stick to reddit over lemmy?

  • Fediverse @lemmy.ml
    ntn888 @lemmy.ml

    lemmy activity volume

  • Selfhosted @lemmy.world
    ntn888 @lemmy.ml

    My take on Alpine as a platform for selfhosting

    simplycreate.online /posts/alpine/
  • Ask Electronics @discuss.tchncs.de
    ntn888 @lemmy.ml

    I want to learn designing IOT PCBs (with 2.4Ghz wireless)

  • Selfhosted @lemmy.world
    ntn888 @lemmy.ml

    Home server rebuild automation workflow

  • Lemmy @lemmy.ml
    ntn888 @lemmy.ml

    The minimalism of Jerboa app is unparalleled

  • Selfhosted @lemmy.world
    ntn888 @lemmy.ml

    Ditching the VPN and port forwarding the selfhosted way