• pycorax@lemmy.world
    link
    fedilink
    English
    arrow-up
    23
    ·
    5 months ago

    Android phone makers are shipping on device LLMs?

    Do people actually want these?

    • GregorGizeh@lemmy.zip
      link
      fedilink
      English
      arrow-up
      33
      ·
      edit-2
      5 months ago

      Yes, in fact that is the only kind of ai i would ever use and entrust my data to. Not the apple one, but an open source model that is running only on my device and answering only to me; using the data I provide only for my interests? That one I would use.

    • Imprudent3449@lemm.ee
      link
      fedilink
      English
      arrow-up
      18
      ·
      5 months ago

      LLM is AI correct? If my phone is going to do AI at all, I prefer it be done on device for sure. For privacy reasons if nothing else. But it’s not anything I’ve really looked into. I have the S24 and the only AI feature I use is the Circle to search… which I don’t consider to be AI.

      • Eiim@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        2
        ·
        5 months ago

        LLM is a form of AI, specifically the text AIs like ChatGPT that have suddenly made “AI” a dinner table term. AI in some form or another is almost definitely being used in your device - even for things like filling in gaps in low-quality voice calls, and probably has been for a while. But the problem is that unlike those “old” AIs, LLMs require some significant power to run, so running them on phones will probably require meaningful trade-offs. But the increased security is also a meaningful benefit.

      • Jakeroxs@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        5 months ago

        They add a kinda nifty “copy subject” option that is supposedly local AI stuff to the samsung gallery, fun to mess with