• 9 Posts
  • 809 Comments
Joined 1 year ago
cake
Cake day: March 22nd, 2024

help-circle






  • It’s ironic how conservative the spending actually is.

    Awesome ML papers and ideas come out every week. Low power training/inference optimizations, fundamental changes in the math like bitnet, new attention mechanisms, cool tools to make models more controllable and steerable and grounded. This is all getting funded, right?

    No.

    Universities and such are seeding and putting out all this research, but the big model trainers holding the purse strings/GPU clusters are not using them. They just keep releasing very similar, mostly bog standard transformers models over and over again, bar a tiny expense for a little experiment here and there. In other words, it’s full corporate: tiny, guaranteed incremental improvements without changing much, and no sharing with each other. It’s hilariously inefficient. And it relies on lies and jawboning from people like Sam Altman.

    Deepseek is what happens when a company is smart but resource constrained. An order of magnitude more efficient, and even their architecture was very conservative.





  • brucethemoose@lemmy.worldtoProgrammer Humor@programming.devC++
    link
    fedilink
    arrow-up
    138
    arrow-down
    2
    ·
    edit-2
    3 days ago

    Meanwhile, Rust punches you in the face for the mere suggestion. Again. And again.

    Python happily nods, runs it one page at a time, very slowly, randomly handing things off to a C person standing to the side, then returns a long poem. You wanted a number.

    Assembly does no checking, and reality around you tears from an access violation.

    EDIT: Oh, and the CUDA/PyTorch person is holding a vacuum sucking money from your wallet, with a long hose running to Jensen Huang’s kitchen.



  • The solution is to destroy the engagement feedback system: regulate Facebook, and any engagement based social media, like we should have done a long time ago. Or more specifically, deregulate them, and don’t shield them from liability with the law.

    But it’s way too late for that.

    Anyway, I’m not saying it’s a good solution. But it’s what will naturally arise, just like Trump rose through the Republican party when no oldschool Republicans wanted that. People you know will jump on the bandwagon, and worship liberal Trump. Get ready.