Skip Navigation

InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)S
Posts
20
Comments
548
Joined
10 mo. ago

  • I'm curious how stuff like this works. Surely, many people's post histories can't fit into context. So, maybe the LLM keeps some sort of "blackboard" of summaries of posts, and edits it as it goes along? Would be pretty computationally expensive. I suppose another way would be to create embeddings of each post, and do some sort of clustering or something.

  • I think I read the RLHF kind of makes these logprobs completely unusable too.

  • I think it's driven by the investors. In the case of big tech, the large institutional investors are rewarding companies any time they say "AI" and lay off workers. In the case of startups, VCs are almost exclusively investing in startups that use "AI," and have a lean or offshore workforce.

  • I find it hard to believe the true numbers are this low. Every job posting gets many hundreds or even thousands of applicants. It's a shame so much talent is wasted by so many people being unemployed and doing "unproductive" things like spending months applying to jobs.

  • IDK about most. But, I've seen many OS contributors say they're looking for work. Seen one recently saying he won't be contributing much to the project anymore because he's housing-insecure. Seen maintainers for popular projects get laid off and are now looking for work. Seen people with 10+ and 20+ years of experience not being able to find a job after many months.

  • Does Snowflake still work in China? Thought I read they're now able to detect and block it.

  • I think 300KB/s is around the max possible in the current implementation:

    Encryption, latency, and how a tunnel is built makes it quite expensive in CPU time to build a tunnel. This is why a destination is only allowed to have a maximum of 6 IN and 6 OUT tunnels to transport data. With a max of 50 kb/sec per tunnel, a destination could use roughly 300 kb/sec traffic combined ( in reality it could be more if shorter tunnels are used with low or no anonymity available). Used tunnels are discarded every 10 minutes and new ones are built. This change of tunnels, and sometimes clients that shutdown or lose their connection to the network will sometimes break tunnels and connections. An example of this can be seen on the IRC2P Network in loss of connection (ping timeout) or on when using eepget.

    https://geti2p.net/en/about/performance

  • I've used AI by just pasting code, then asking if there's anything wrong with it. It would find things wrong with it, but would also say some things were wrong when it was actually fine.

    I've used it in an agentic-AI (Cursor), and it's not good at debugging any slightly-complex code. It would often get "stuck" on errors that were obvious to me, but making wrong, sometimes nonsensical changes.

  • There's a lot of indication that LLMs are peaking. It's taking exponentially more compute and data to get incremental improvements. A lot of people are saying OpenAI's new model is a regression (I don't know, I haven't really played with the new model much). More foundational breakthroughs need to be made, and these kinds of breakthroughs are often the result of "eureka" moments which can't be manifested by just throwing more money at the problem. It's possible it will take decades before someone discovers a major breakthrough (or it could be tomorrow).

  • China leads the world in scientific publication, even when only taking into account reputable journals and high-impact publications. There's no doubt in my mind the US will decline further with the current attacks on science and education, and anti-intellectualism in general.

  • Seeing how some Lemmy instances are a little too ban-happy, I don't think I'd want centralized moderation. The current closest thing would be Yacy. I've been playing around with Yacy, but the ranking sucks and is slow (I believe the Page Rank algorithm is turned off by default because it would make it even slower).

  • Deleted

    Permanently Deleted

    Jump
  • Which will then cause a panic.And I think that leads to calls for one or more of the following:

    • Redistribution of wealth
    • A hurried UBI implementation
    • A nationwide ban on foreclosures and evictions
    • A law saying you can't use AI employees
    • A law saying you can't fire anyone
    • Etc.

    Is he implying these are a list of bad things? I mean the term "AI employee" is nonsensical, and people should sometimes be fired with-cause if the cause is bad enough, but the rest is OK. No need to worry about any of this happening any time soon though given the populace's politics, media/propaganda consumption, and the people currently in power. In the event of severe economic downturn, we're more likely to see the rich buying up everything on the cheap and trying to implement their fantasies of labor camps, company towns, network states, corporate city-states, or whatever other stupid ideas they have.

    Not sure the downturn will start in a few months, but an economic downturn under this admin is a certainty. I don't think it'll officially be called a recession, and the official economic data will be fake..

  • This image seems right-wing coded. Also, nobody has to invade, it's for sale.

  • In the grand scheme of things, I think AI code generators make people less efficient. Some studies have come out that indicate this. I've tried to use various AI tools, as I do like fields of AI/ML in general, but they would end up hampering my work in various ways.

  • I had it done once when I was still a child, and the issue reoccurred. No issues for more than a decade from the ones I had as an adult though.

  • From a US perspective, some civil rights improved after 1999 (such as gay marriage), though I guess some civil rights were weakened (privacy after 9/11). All improvements are being rapidly rolled back now though. Societally, I think homosexuality is more accepted now; not sure about transgendered people. I think there's less racism now, not sure (I lived in a very rural area back then, and now live in a large city, so IDK). Housing was more affordable. I don't think anti-intellectualism was as widespread. There was less acceptance of authoritarianism. Technology has definitely advanced, but slower than I would have imagined. Climate has changed more rapidly than I would've expected.

  • I almost never have cash or even change now, so that's what I tell them. I used to give them some money if I had it and wasn't immediately going to use it. One of my old friends used to give them a beer out of a pack he bought if there was a person outside the store or on the corner begging on the drive to wherever he was going.

  • "Innovation" really started accelerating when we started using agriculture and had division of labor. An aristocracy (not sure what's the best term here) would form where some people had a lot of free time, and didn't need to spend all their time hunting/gathering/building/migrating. This enabled them to follow intellectual pursuits. All of this was at the expense of everyone else though. It's still kind of like that with wealthy nations extracting wealth/labor from poor nations, allowing the wealthy nations to spend some money funding universities and research.

  • Yeah, I just started messing around with Meshtastic, and it is apparent it's more of a beta project. Has lots of little bugs, no real routing, etc. Seems like the user-base outpaced development. It is pretty cool though, and I hope they fix the glaring issues quickly.