• Owl [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    37
    ·
    edit-2
    1 year ago

    Reminder that ChatGPT’s architecture is roughly:

    • Predict what would come next in this sentence according to your corpus of raw internet

    • Shit people keep trying to ask it questions instead of giving it the first sentence of wikipedia, uh… here’s a few hundred hand-written examples of people asking questions and then answering them like a good little encyclopedia buttler. Prioritize these over the raw internet

    • Okay that looks good but we weren’t born yesterday, so here’s a bunch of hand-written examples where people ask leading questions about racism, crime, and politics, and then the dictionary stonewalls them. Prioritize these over everything as soon as anyone mentions those topics

    • Adkml [he/him]@hexbear.net
      link
      fedilink
      English
      arrow-up
      11
      ·
      1 year ago

      Yea this is literally just an ai being more clever than the people “just asking questions”

      Even they can see the writing on the walls the question asker is trying tonget them to talk about racism against white people and is pulling the chord.

      • Owl [he/him]@hexbear.net
        link
        fedilink
        English
        arrow-up
        8
        ·
        1 year ago

        Correction: this is the last layer of bolted-on failsafes, using a more primitive AI model than the rest, being more clever than the people “just asking questions.”