• 1 Post
  • 27 Comments
Joined 2 years ago
cake
Cake day: March 19th, 2024

help-circle

  • The relevance for me personally is whether or not they can be useful for programming, and if they’re accessible to run locally. I’m not interested in feeding my data to a datacentre. My AMD GPU also doesn’t support ROCm so LLMs run slow as fuck for me. So, generally, I avoid them.

    LLMs consistently produce lower quality, less correct, and less secure code than humans. However, they do seem to be getting better. I might be open to using them to generate unit tests if only they would run faster on my PC. I tried deepseek, llama3.1, and codellama; all take like an hour+ to answer a programming question given that they are just using my CPU, as my GPU doesn’t support ROCm. So really not feasible for anything.

    Depending on what you count as AI, I think some of the long-existing predictive ML like autosuggestions based on learning your input patterns are fine and helpful. And maybe if I get a supported GPU I won’t mind using local LLMs for some things. But generally I’m not dying to use them. I can do things myself.












  • Worth considering that there’s less of a need for backwards-compatibility with Linux binaries because most Linux software is open-source, so they can be recompiled or updated for modern Linux by the end user if the maintainer is gone. A lot of legacy Windows software is still in use and the source is unavailable, so Windows has to support it for the businesses that use the legacy software. In other words, it’s a cultural difference too. Linux seems pretty good at supporting things users actually use, like old hardware.

    Not disagreeing with you btw, just my thoughts on why that difference exists.








  • My favourite unusual one is sichuan pepper powder on garlic bread. Originated in me rummaging through my spices for stuff to add to my garlic bread and I really liked this. I now add it to garlic bread, pizzas, that sort of thing.

    Cumin is also a great all purpose spice I put on many things. Cumin+turmeric for curry-flavoured things, but also cumin+salt+pepper+rosemary+garlic granules for anything roasted.