AI could be such a neat, useful thing. But nope, capitalists can’t help themselves. Gotta use it to grift the internet with low quality content and steal from artists.

  • SSJMarx
    link
    fedilink
    English
    arrow-up
    11
    ·
    2 months ago

    I think the problem of tainted training data is basically insurmountable at this point. LLMs get progressively worse the more of their own information you feed back into them, and the internet is getting more LLM content every single day. Maybe the next revolution in LLMs is pruning the training data to make it more pure? Problem with that is it would take a lot of human input, like more than you can do with Amazon’s Mechanical Turk service.

    • Antiwork [none/use name]@hexbear.net
      link
      fedilink
      English
      arrow-up
      5
      ·
      2 months ago

      I think this is exactly what is happening. In the beginning it was pretty shit. Got some more information in their and turned into pretty good, but that tip is fine because it’s just totally system overload.