• Deceptichum@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      30
      arrow-down
      4
      ·
      5 months ago

      Except it’s not, because they can’t perfectly recall everything.

      It’s more like reading every book in the world, and someone asking you what comes next after “And I…”.

      • Sterile_Technique@lemmy.world
        link
        fedilink
        English
        arrow-up
        10
        ·
        edit-2
        5 months ago

        I mean you still gotta understand some shit for Ctrl+F to be helpful. If you’ve ever taken an open book quiz without prior study you’ll learn pretty quick that open book does NOT = easy A (depending on the class / prof I guess, but you get the gist).

        So, open book Ctrl-F’able bar exam, I could probably get an okay score just on key word matching, not knowing jack shit about law; but it’d be far from a perfect score. Current state of machine learning appears to be in a comparable boat.

          • froztbyte@awful.systems
            link
            fedilink
            English
            arrow-up
            9
            ·
            5 months ago

            your post shows a serious lack of comprehension. just because so many of the posters in this thread are idiots didn’t mean you have to participate too.

            (CPU time extremely counts, and resource-wise with these things it’s really quite a lot)

            • V0ldek@awful.systems
              link
              fedilink
              English
              arrow-up
              11
              ·
              5 months ago

              Steelmanning what this person said, I think the issue is that your ability to CTRL+F through a book during a time-limited exam is not as strong as even a single computer clocked at GHz doing the same thing. You can CTRL+F through a single book in the same time it takes it to CTRL+F through the entire body of knowledge.

    • bdonvr@thelemmy.club
      link
      fedilink
      English
      arrow-up
      25
      arrow-down
      5
      ·
      edit-2
      5 months ago

      I’m not a big AI guy but it’s really not quite like that, models do NOT contain all the data they were trained on.

      Edit: I have no idea what’s going on down below this comment

        • Jarifax@feddit.nl
          link
          fedilink
          English
          arrow-up
          17
          arrow-down
          10
          ·
          edit-2
          5 months ago

          The guy above you is right though. So what are you on about?

          • self@awful.systems
            link
            fedilink
            English
            arrow-up
            17
            ·
            5 months ago

            what a weird opportunity for someone to burn a throwaway account. not even gonna dig into what you’ve imagined the other guy is right about, given he didn’t post any information of value

            • xantoxis@lemmy.world
              link
              fedilink
              English
              arrow-up
              7
              ·
              5 months ago

              Lemmy is starting to have a huge problem with people creating multiple sockpuppets–probably programmatically generating them, in fact–just to win internet arguments. If this goes on too long you’re going to see a really surprising number of sudden downvotes on everything you’ve said in this conversation, and anyone who agreed with you.

              • froztbyte@awful.systems
                link
                fedilink
                English
                arrow-up
                10
                ·
                edit-2
                5 months ago

                It’ll actually be good if that happens because 1) it could be dealt with here, 2) that could be used to feed something that helps defend against it

                (e: I mean, it’ll be a nuisance, and @self would be driven to drink, but it could still be handled)

              • self@awful.systems
                link
                fedilink
                English
                arrow-up
                8
                ·
                5 months ago

                I truly wish those so inclined good luck with the downvotes and with coordinating their sockpuppets in a way that isn’t extremely fucking obvious

              • froztbyte@awful.systems
                link
                fedilink
                English
                arrow-up
                6
                ·
                5 months ago

                you need to work on your reading comprehension skills, they’re letting you down on your left-field brigading

      • sc_griffith@awful.systems
        link
        fedilink
        English
        arrow-up
        10
        ·
        edit-2
        5 months ago

        that’s a misleading and meaningless way of putting it. if I rip a page out of my textbook and bring it into an exam room, I do not have with me all the data in my textbook. and yet

        • QuaternionsRock@lemmy.world
          link
          fedilink
          English
          arrow-up
          7
          arrow-down
          7
          ·
          5 months ago

          It doesn’t do that, either. LLMs retain the linguistic patterns found in textbooks, nothing more. It’s remarkable that they can do so much with this information alone, but it’s still a far cry from genuine intelligence.

          • zogwarg@awful.systems
            link
            fedilink
            English
            arrow-up
            15
            ·
            edit-2
            5 months ago

            And yet they can spit out copyrighted material verbatim, or near-verbatim, how strange and peculiar.

          • Amoeba_Girl@awful.systems
            link
            fedilink
            English
            arrow-up
            14
            ·
            edit-2
            5 months ago

            Yeah, even setting aside the intelligence claims, I know I’d be feeling a lot more positive about LLMs as a fun theoretical tool if they weren’t being sold as personal assistants or search engine replacements etc, which even the apologists here admit they’re really really bad at.

            (Also I’d argue “linguistic patterns” is pushing it. “Textual patterns” more like, it’s not supposed to have any idea about grammar or even about what “text” is.) (I say “supposed to” because who knows what sort of hacks they’re running under the hood.)

      • froztbyte@awful.systems
        link
        fedilink
        English
        arrow-up
        4
        ·
        5 months ago

        Modified Thursday, May 16th, 2024 at 9:17:13 AM GMT+02:00 Edit: I have no idea what’s going on down below this comment

        lol. at least you’re honest about it