• brucethemoose@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    ·
    19 hours ago

    Hot beef is right. That’s a good way to phrase it.

    And before you bring it up, I’ve been experimenting with local models since GPT-J and old GAN finetunes. I have MiMo 2.6 Flash loaded right now… TBH, I’m not sure how that’s relevant.

    • LooseLemons@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      10
      ·
      18 hours ago

      Are all of you seriously trying to argue that local experiments with model training data ARE NOT RELEVANT to our conversation about LLMs and their training data?

      Am I losing my fucking mind here or is the hive mind that strong? I’m all ears buddy.

      Hot beef is literally trying to argue this point. Are you? It is actually ridiculous.

      • brucethemoose@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        1
        ·
        18 hours ago

        I am not with the Lemmy hive mind consensus on LLMs, not even close. But we are discussing something more specific.

        • LooseLemons@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          7
          ·
          edit-2
          8 minutes ago

          Yeah. I think people wildly misunderstand how these things work, then want to argue about them. It’s crazy.

          All I’m trying to say is that if I train AI on my mythical creature, the “Fijokopil” , a flying tiger ant, then the LLM will 100% be able to define a “Fijokopil”.

          And, ChatGPT won’t know what a “Fijokopil” is.

          I think I gotta take a break, it’s clear that my implications are going right over peoples heads.

          Edit: No one is actually trying this, yet still attacking me. It’s shocking. I wonder how many folks are being genuine here?

          • Bo7a@piefed.ca
            link
            fedilink
            English
            arrow-up
            1
            ·
            22 minutes ago

            Yup, when a bunch of folks with expertise in a subject all disagree with you it is because your ideas are going over their heads.

            That is the only logical conclusion.

              • Bo7a@piefed.ca
                link
                fedilink
                English
                arrow-up
                1
                ·
                9 minutes ago

                You have not laid out an experiment that means anything. You have made an idiotic claim that anyone with an actual clue how this stuff woks can see through. And people are calling you on it.

    • LooseLemons@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      10
      ·
      19 hours ago

      You’re not sure how at home training is relevant when we’re discussing the output of LLMs? Or home sepecifc stuff?

      • brucethemoose@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        18 hours ago

        Home inference.

        And that’s a very broad statement. But nothing we can do locally will get an LLM to intuit or reveal its own dataset.

        We can get it to output Claude traces it was trained on. I am not trying to be pedantic, but the semantics/phrasing there is very important.

        • LooseLemons@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          7
          ·
          18 hours ago

          Not byte for byte, but one can prove an llm was trained on data by asking specific questions. It’s why we’re having all of the copyright lawsuits.