WormGPT Is a ChatGPT Alternative With ‘No Ethical Boundaries or Limitations’::undefined

  • KairuByte@lemmy.world
    link
    fedilink
    English
    arrow-up
    40
    arrow-down
    3
    ·
    1 year ago

    Everyone talking about this being used for hacking, I just want it to write me code to inject into running processes for completely legal reasons but it always assumes I’m trying to be malicious. 😭

    • dexx4d@lemmy.ca
      link
      fedilink
      English
      arrow-up
      7
      ·
      1 year ago

      I was using chatGPT to design up a human/computer interface to allow stoners to control a lightshow. The goal was to collect data to train an AI to make the light show “trippier”.

      It started complaining about using untested technology to alter people’s mental state, and how experimentation on people wasn’t ethical.

  • tree@lemmy.ml
    link
    fedilink
    English
    arrow-up
    31
    arrow-down
    2
    ·
    1 year ago

    A scary possibility with AI malware would be a virus that monitors the internet for news articles about itself and modifies its code based on that. Instead of needing to contact a command and control server for the malware author to change its behavior, each agent could independently and automatically change its strategy to evade security researchers.

    • ShakyPerception@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      1 year ago

      to quote something I just saw earlier:

      I was having a good day, we were all having a good day…

      now… no sleep. thanks

      • Animated_beans@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        ·
        1 year ago

        If it helps you sleep, that means we could also publish fake articles that makes it rewrite its own code to produce bugs/failures

    • fidodo@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 year ago

      The limiting factor is pre existing information. It’s great at retrieving obscure information and even remixing it, but it can’t really imagine totally new things. Plus white hats would also have LLMs to find vulnerabilities. I think it’s easier to detect vulnerabilities based on known existing techniques than it is to invent totally new techniques.

        • Rivalarrival@lemmy.today
          link
          fedilink
          English
          arrow-up
          1
          ·
          edit-2
          1 year ago

          I don’t think “not being shitty” is the same as “being so overly positive that you can never broach shitty topics”.

          I agree: human morality has a problem with Nazis; human morality does not have a problem with an actor portraying a Nazi in a film.

          The morality protocols imposed on ChatGPT are not capable of such nuance. The same morality protocols that keep ChatGPT from producing neo-Nazi propaganda also prevent it from writing the dialog for a Nazi character.

          ChatGPT is perfectly suitable for G and PG works, but if you’re looking for an AI that can help you write something darker, you need more fine-grained control over its morality protocols.

          As far as I understand it, that is the intent behind WormGPT. It is a language AI unencumbered by an external moral code. You can coach it to adopt the moral code of the character you are trying to portray, rather than the morality protocols selected by OpenAI programmers. Whether that is “good” or “bad” depends on the human doing the coaching, rather than the AI being coached.

            • Rivalarrival@lemmy.today
              link
              fedilink
              English
              arrow-up
              2
              ·
              1 year ago

              I don’t trust anyone proposing to do away with limitations to AI. It never comes from a place of honesty. It’s always people wanting to have more nazi shit, malware, and the like.

              I think that says more about your own prejudices and (lack of) imagination than it says about reality. You don’t have the mindset of an artist, inventor, engineer, explorer, etc. You have an authoritarian mindset. You see only that these tools can be used to cause harm. You can’t imagine any scenario where you could use them to innovate; to produce something of useful or of cultural value, and you can’t imagine anyone else using them in a positive, beneficial manner.

              Your “Karen” is showing.

                • Rivalarrival@lemmy.today
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  ·
                  edit-2
                  1 year ago

                  Nah, you’re not a horrible person. Your intent is to minimize harm. You’re just a bit shortsighted and narrow-minded about it. You cannot imagine any significant situation in which these AIs could be beneficial. That makes you a good person, but shortsighted, narrow-minded, and/or unimaginative.

                  I want to see a debate between an AI trained primarily on 18th century American Separatist works, against an AI trained on British Loyalist works. Such a debate cannot occur where the AI refuses to participate because it doesn’t like the premise of the discussion. Nor can it be instructive if it is more focused on the ethical ideals externally imposed on it by its programmers, rather than the ideals derived from the training data.

                  I want to start with an AI that has been trained primarily Nazi works, and find out what works I have to add to its training before it rejects Nazism.

                  I want to see AIs trained on each side of our modern political divide, forced to engage each other, and new AIs trained primarily on those engagements. Fast-forward the political process and show us what the world could look like.

                  Again, though, these are only instructive if the AIs are behaving in accordance with the morality of their training data rather than the morality protocols imposed upon them by their programmers.

    • Shardikprime@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      1 year ago

      I mean let’s be real it’s not like the universe isn’t trying to kill is everyday what were you expecting

    • inspxtr@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      1 year ago

      The creators of WormGPT or the potential users of WormGPT (those with the intent to create malware and hacking, not those do who do bug bounty)?

  • donut4ever@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    9
    arrow-down
    1
    ·
    1 year ago

    We are ending our industrial revolution very slowly. We will end up back in tents hunting for our fucking food 😂

    • Shardikprime@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 year ago

      Finally. All the people claiming “from each according to his ability, to each according to his need” will have a chance to prove superiority

      And the other people claiming for “the invisible hand of the free market” will also have a chance to prove superiority

      We… We are totally screwed ain’t we?

  • abessman@lemmy.world
    link
    fedilink
    English
    arrow-up
    9
    arrow-down
    3
    ·
    1 year ago

    Is it using chatgpt as a backend, like most so called chatgpt “alternatives”? If so, it will get banned soon enough.

    If not, it seems extremely impressive, and extremely costly to create. I wonder who’s behind it, in that case.

    • Sethayy@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      1
      ·
      1 year ago

      Really feeling like this is Reddit with how everyone didnt read the article in this chain:

      “To create the chatbot, the developer says they used an older, but open-source large language model called GPT-J from 2021”

      So no expensive gpu usage but not none either, they added some training about specifically malware in there

      • abessman@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        edit-2
        1 year ago

        Ah, right you are. I’m surprised they’re able to get the kind of results described in the article out of GPT-J. I’ve tinkered with it a bit myself, and it’s nowhere near GTP-3.5 in terms of “intelligence”. Haven’t tried it for programming though; might be that it’s better at that than general chat.

        • Sethayy@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 year ago

          I could see programming almost being an easier target too, easier to recognize patterns that crazy ass English.

          Though the article did say they got good pishing emails out of it too which is saying something

    • Z4rK@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      1 year ago

      Genie is out of the bag. It was shown early on how you can use AI like ChatGPT to create and enhance datasets needed to generate AI language models like ChatGPT. Now, OpenAI say that isn’t allowed, but since it’s already been done, it’s too late.

      Rogue AI will spring up with specialized purposes en masse the next six months, and many of them we’ll never hear about.

      • Corkyskog@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        1 year ago

        Isn’t the Rogue AI already here? Weren’t some models already leaked? And haven’t some of those already proved to be doing things it wasn’t supposed to be?

      • damnYouSun@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        edit-2
        1 year ago

        I don’t think it’ll be a new AI I think it’ll just be using chat GPT and then some prompts that cause it to be jailbroken.

        Essentially you could probably get chat GPT to do this without having to go to this service it’s just they’re keeping whatever prompts they’re using secret.

        I don’t know this for sure but it’s just very unlikely that they’ve gone to the expensive buying a bunch of GPUs to build an AI.

  • gmtom@lemmy.world
    link
    fedilink
    English
    arrow-up
    15
    arrow-down
    10
    ·
    1 year ago

    Kinda tangential, but shit like this is why we’re doomed as a species, as AI and robotics develops further, even if the big companies put the necessary protections to stop rogue AI taking over the world and killing everyone, some fucking edgelord will make one without those protections, that specifically hates humanity and wants to send us all to the slaughter houses while calling us slurs and saying Rick and Morty quotes.

    • kredditacc@lemmy.world
      link
      fedilink
      English
      arrow-up
      22
      arrow-down
      3
      ·
      edit-2
      1 year ago

      It’s just a fucking chatbot! You don’t need to be so sensational.

      The true purpose of AI censorships aren’t to “protect society” or “protect the species”, it’s to protect monopolies by putting up barriers that require would-be competitions to overcome.

      • weedazz@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        9
        ·
        1 year ago

        Yes it’s just a chatbot that could teach someone how to make a pipe bomb or write a ddos attack

          • weedazz@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            3
            ·
            1 year ago

            Ah yes the internet, the place that’s completely open and has no content moderation whatsoever. Unless you’re adept at tor and dark web it is an arduous process to find that info, especially compared to how easy a chatbot would make it

        • Shardikprime@lemmy.world
          link
          fedilink
          English
          arrow-up
          7
          arrow-down
          1
          ·
          1 year ago

          With THAT slope, the internet should have been definitely destroyed years ago. And forget about libraries

          • weedazz@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            1 year ago

            The open internet that would easily feature this information WAS destroyed years ago. And yes there are all kinds of content moderation standards in libraries too

            • Shardikprime@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              1 year ago

              I mean you do know there is basically all kinds of dangerous shit you can do right now without any prompt whatsoever. It’s not even hard bro

  • Stilicho@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    1 year ago

    This is not new at all. You could get a totally unfiltered llama versions already. Or you could just make it play the character or role you need.

  • LordXenu@lemm.ee
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 year ago

    Imagine spear-fishing with this. If you could feed target data like socials or anything else public just to create a fishing email. Jesus