Barack Obama: “For elevator music, AI is going to work fine. Music like Bob Dylan or Stevie Wonder, that’s different”::Barack Obama has weighed in on AI’s impact on music creation in a new interview, saying, “For elevator music, AI is going to work fine”.

  • rambaroo@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    7 months ago

    A rolling context window isn’t a real solution and will not produce works that even come close to matching the quality of human writers. That’s like having a writer who can only remember the last 100 pages they wrote.

    The tech is trained on human created data. Are you suggesting LLMs are capable of creativity and imagination? Lmao - and you try to act like I’m the one who’s full of shit.

    • kromem@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      2
      ·
      7 months ago

      That’s like having a writer who can only remember the last 100 pages they wrote.

      That’s why you pair it with RAG.

      The tech is trained on human created data. Are you suggesting LLMs are capable of creativity and imagination?

      They are trained by iterating through network configurations until there’s diminishing returns on how accurately they can complete that human created data.

      But they don’t just memorize the data. They develop the capabilities to extend it.

      So yes, they absolutely are capable of generating original content that’s not in the training set. As has been demonstrated over and over. From explaining jokes not found in the training data, solving riddles not found in it, or combining different concepts to result in a new synthesis not found in the original data.

      What do you think it’s doing? Copy/pasting or something?