it will loose its ability to differentiate between there and their and its and it’s.

  • mannonym@lemmy.world
    link
    fedilink
    arrow-up
    6
    ·
    4 months ago

    Sure it might have some effect, but a big part of ChatGPT besides “raw” training data is RLHF, reinforcement learning from human feedback. Realistically, the bigger problem is training on AI-generated content that might have correct spelling, but hardly makes sense.