Like if I type “I have two appl…” for example, often it will suggest “apple” singular instead of plural. Just a small example, but it is really bad at predicting which variant of a word should come after the previous

  • sir_reginald@lemmy.world
    link
    fedilink
    arrow-up
    24
    ·
    edit-2
    1 year ago

    LLMs are orders of magnitude more sophisticated and expensive to run. But don’t worry, I’m sure not so far in the future we will see smaller LLMs being run on device to be used as autocorrect.

    • pacoboyd@lemm.ee
      link
      fedilink
      arrow-up
      5
      ·
      1 year ago

      It would have to be pretty specific and small to work on a phone and I think a side effect would be everyone’s conversations start to sound a lot more homogeneous.

      • sir_reginald@lemmy.world
        link
        fedilink
        arrow-up
        3
        ·
        1 year ago

        you’re not wrong. Google just announced Gemini Nano that will run directly on the Pixel 8. Of course, it’s the first of it’s kind and will probably be slow and it’s not used as autocorrect yet. But just give it one year or two and it will probably be more common.

    • Mr_Blott@lemmy.worldOP
      link
      fedilink
      arrow-up
      4
      arrow-down
      1
      ·
      1 year ago

      Can we have Scottish ones that know what a bawbag is, and when to put an “e” on the end of “shit”?

      Thanks!

      • OpenStars@kbin.social
        link
        fedilink
        arrow-up
        1
        ·
        1 year ago

        Think of it from the LLM’s perspective - in the general pool you have common English, you have less common variations such as this, and then you have whatever the heck people like Kid Rock are doing…

        Bawitdaba, da bang, da dang diggy diggy
        Diggy, said the boogie, said up jump the boogie