• EatATaco
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    10
    ·
    6 months ago

    Why is that a criticism? This is how it works for humans too: we study, we learn the stuff, and then try to recall it during tests. We’ve been trained on the data too, for neither a human nor an ai would be able to do well on the test without learning it first.

    This is part of what makes ai so “scary” that it can basically know so much.

    • Soyweiser@awful.systems
      link
      fedilink
      English
      arrow-up
      23
      arrow-down
      1
      ·
      6 months ago

      Dont anthropomorphise. There is quite the difference between a human and an advanced lookuptable.

      • EatATaco
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        10
        ·
        edit-2
        6 months ago

        I absolutely agree. However, if you think the LLMs are just fancy LUTs, then I strongly disagree. Unless, of course, we are also just fancy LUTs.

        • captainlezbian@lemmy.world
          link
          fedilink
          English
          arrow-up
          12
          ·
          6 months ago

          You ever meet an ai researcher with a background in biology? I’ve discussed this stuff with one. She disagrees with Turing about machines thinking including when ai is in the picture. They process information very differently from how biology does

          • EatATaco
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            10
            ·
            6 months ago

            This is a vague non answer, although I agree it’s done very differently because our process is biological and ai is not.

            But as I asked elsewhere, what’s the effective difference?

      • Phoenixz@lemmy.ca
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        13
        ·
        6 months ago

        Well… I do agree with you but human brains are basically big prediction engines that use lookup tables, experience, to navigate around life. Obviously a super simplification, and LLMs are nowhere near humans, but it is quite a step in the direction.

      • EatATaco
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        10
        ·
        6 months ago

        I guess it comes down to a philosophical question as to what “know” actually means.

        But from my perspective is that it certainly knows some things. It knows how to determine what I’m asking, and it clearly knows how to formulate a response by stitching together information. Is it perfect? No. But neither are humans, we mistakenly believe we know things all the time, and miscommunications are quite common.

        But this is why I asked the follow up question…what’s the effective difference? Don’t get me wrong, they clearly have a lot of flaws right now. But my 8 year old had a lot of flaws too, and I assume both will get better with age.

        • froztbyte@awful.systems
          link
          fedilink
          English
          arrow-up
          20
          arrow-down
          1
          ·
          6 months ago

          nearly every word of your post demonstrates a comprehensively thorough lack of understanding of how this shit works

          it also demonstrates why you’re lost about the “effective difference”

          I don’t mean this aggressively, but you really don’t have any concrete idea of wtf you’re talking about, and it shows

          • EatATaco
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            1
            ·
            6 months ago

            it also demonstrates why you’re lost about the “effective difference”

            I would argue that the inability of anyone here to actually defend their position as to why it’s obviously effectively different reveals that, if I don’t have a concrete idea of what’s going on, I’m in good company.

        • YouKnowWhoTheFuckIAM@awful.systems
          link
          fedilink
          English
          arrow-up
          18
          ·
          6 months ago

          Yeah, it’s a philosophical question, which means you need a philosophical answer. Spitballing won’t help you figure shit out a priori because it turns out that learning how to think a priori effectively takes years of hard graft and is called “studying philosophy”. You should be asking people like me what “know” means in this context and what distinguishes memory in human beings from “memory” in an LLM (a great deal, as it happens!)

          • EatATaco
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            6 months ago

            It seems like you’re saying I shouldnt be asking these people because they are uneducated and have no idea what they are talking about. I absolutely concur about the latter.

            But your answers to my queries are conspicuously absent.

        • flere-imsaho@awful.systems
          link
          fedilink
          English
          arrow-up
          19
          arrow-down
          1
          ·
          6 months ago

          i guess it comes down to a philosophical question

          no, it doesn’t, and it’s not a philosophical question (and neither is this a question of philosophy).

          the software simply has no cognitive capabilities.

          • EatATaco
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            8
            ·
            6 months ago

            I’m not sure I agree, but then it goes to my second question:

            What’s the effective difference?

            • flere-imsaho@awful.systems
              link
              fedilink
              English
              arrow-up
              16
              ·
              6 months ago

              (…) perception, attention, thought, imagination, intelligence, comprehension, the formation of knowledge, memory and working memory, judgment and evaluation, reasoning and computation, problem-solving and decision-making (…)

            • braxy29@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              9
              ·
              6 months ago

              don’t know why you got downvoted, an LLM is essentially a chinese room, and whether such a room “knows” is still the question.

              • techMayhem@lemmy.world
                link
                fedilink
                English
                arrow-up
                9
                ·
                6 months ago

                Someone in the chinese room would not know anything about their in- or output. Sure you memorized that a certain set of symbols means your output should contain another set of symbols, but what do you actually “know” about these symbols.

                But you have no idea what it’s about. Is it a greeting? A recipe for some pasta? Instructions to build a bomb? Could be anything.

              • EatATaco
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                1
                ·
                6 months ago

                I’m pretty well steeped in this question, from both a technological and philosophical perspective.

                And it’s funny to see all of these posters, who are upvoting comments that expose a fundamental lack of understanding about how LLMs and ai work, acting like the book is already closed on the answer.

          • Soyweiser@awful.systems
            link
            fedilink
            English
            arrow-up
            13
            ·
            6 months ago

            The dehumanization that happens just because people think LLMs are impressive (they are, just not that impressive) is insane.

            • ebu@awful.systems
              link
              fedilink
              English
              arrow-up
              9
              ·
              6 months ago

              need to be able to think LLM’s are impressive, probably

              surely tech will save us all, right?

    • exanime@lemmy.today
      link
      fedilink
      English
      arrow-up
      11
      ·
      6 months ago

      Because a machine that “forgets” stuff it reads seems rather useless… considering it was a multiple choice style exam and, as a machine, Chat GPT had the book entirely memorized, it should have scored perfect almost all the time.

      • EatATaco
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        6
        ·
        6 months ago

        Chat GPT had the book entirely memorized

        I feel like this exposes a fundamental misunderstanding of how LLMs are trained.

        • TachyonTele
          link
          fedilink
          English
          arrow-up
          12
          arrow-down
          1
          ·
          6 months ago

          They’re auto complete machines. All they fundamentally do is match words together. If it was trained on the answers and still couldn’t reproduce the correct word matches, it failed.

          • EatATaco
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            2
            ·
            6 months ago

            Every person who took that test was trained on the answers. Or at least they should have been, I’m sure some neglected their studies as I was guilty of myself. Are they all failures too?

              • EatATaco
                link
                fedilink
                English
                arrow-up
                2
                arrow-down
                2
                ·
                6 months ago

                Understood and agreed. What does this have to do with the point?

                • TachyonTele
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  arrow-down
                  1
                  ·
                  6 months ago

                  If you’re unable to follow the conversation I’m out of here.

                  • EatATaco
                    link
                    fedilink
                    English
                    arrow-up
                    2
                    arrow-down
                    2
                    ·
                    6 months ago

                    Don’t blame me for your inability to make a point.

          • YIj54yALOJxEsY20eU
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            10
            ·
            edit-2
            6 months ago

            You have the energy to spread misinformation and spam downvotes, how about an intelligent response instead?

          • YIj54yALOJxEsY20eU
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            11
            ·
            edit-2
            6 months ago

            They aren’t auto complete machines, they are neural networks. Why are you trying to explain it when you clearly don’t have the first idea of how things work?

            • self@awful.systems
              link
              fedilink
              English
              arrow-up
              12
              ·
              6 months ago

              the very funny thing is, all of the garden variety free text autocomplete systems I’ve worked with have been implemented using neural nets. it’s not like it’s a particularly new or novel approach. but surely the AI bros coming into this thread know that and they’re not just regurgitating buzzwords, right?

        • YIj54yALOJxEsY20eU
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          10
          ·
          edit-2
          6 months ago

          Don’t worry friend, you are correct.

          Edit: Lets see some intelligent responses rather than downvotes. Bunch off teens majoring in “AI”.

          • EatATaco
            link
            fedilink
            English
            arrow-up
            1
            ·
            6 months ago

            How did you get 3 downvotes so fast on this day old post?