Character.AI, the GenAI site that convinced some children to kill themselves, has gone bankrupt after parents sued them.

we found hordes of chatbots explicitly dedicated to themes of pedophilia, suicide, self-harm, and eating disorder coaching, as well as a thriving community of users creating chatbots designed to simulate school shootings, romanticize real mass shooters, and even impersonate the real child victims of mass shootings.

  • Pratai@piefed.ca
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    10 days ago

    A lot of them will be bringing in trillions once the “free-era” of AI usage is over and everyone is hooked and can’t function without it.

    Then the monthly rates come in. The AI companies will own everything we touch.

      • Pratai@piefed.ca
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        4
        ·
        10 days ago

        They will. Because they won’t be able to function without it. They already can’t think for themselves without asking their AI for help.

        Trust me. They’ll pay.

        • Rothe@piefed.social
          link
          fedilink
          English
          arrow-up
          6
          ·
          10 days ago

          Perhaps for a small group of consumers. Not nearly enough for it to be even close to profitable though. I think you are unaware of the hundreds of billions of dollars of debt these companies are in. And those loans are coming due now and the next years. They will need to pay those debts or else they lose all of the compute, which is literally their entire business. Neither Anthropic or OpenAI owns any datacenters, they are all leased on debt.

          They will need to suddenly be more profitable than Microsoft and Google, while they are currently much much less profitable than even the poorest household you can imagine.

          • Pratai@piefed.ca
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            2
            ·
            10 days ago

            I think you’re underestimating the addiction kids have for their AI. They outsource their own opinions.

            • AbsolutelyNotAVelociraptor@piefed.social
              link
              fedilink
              English
              arrow-up
              3
              ·
              10 days ago

              And I think you’re overestimating the money most families make a month. If they are so in the red that many can’t even afford groceries, do you think they’ll be able to add a hefty AI bill monthly to the amount they already can’t pay? It’s basic maths: If I earn 10 and just to exist I need 12 right now, how will I be able to pay 20 when I add the AI bill if I still earn 10?

        • puz@piefed.social
          link
          fedilink
          English
          arrow-up
          1
          ·
          8 days ago

          The question is not if addicts would pay a high price for AI (they probably would) but if they CAN afford it (they probably can’t).

        • tyler@programming.dev
          link
          fedilink
          English
          arrow-up
          1
          ·
          10 days ago

          Trust me. They’ll pay.

          With what money dude. You’re completely ignoring the cost factor here.

          • Pratai@piefed.ca
            link
            fedilink
            English
            arrow-up
            1
            ·
            9 days ago

            Ever hear of debt?? Credit cards. People have been paying with money they don’t have since the dawn of man.

            • puz@piefed.social
              link
              fedilink
              English
              arrow-up
              1
              ·
              8 days ago

              You make it sound as if I could just quit my job right now and just pay for all my expenses with my credit card. I wonder how long I could pull this off :)

            • tyler@programming.dev
              link
              fedilink
              English
              arrow-up
              1
              ·
              9 days ago

              Which will end the first time they can’t make a payment. It’s like you do not understand basic economics. Without a job you can’t pay for things. It doesn’t matter if you have a credit card or not. Your credit card will be closed because you have no income.

              • Pratai@piefed.ca
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                1
                ·
                9 days ago

                Okay buddy. We’ll see. People have been spending money they don’t have since money began. But you believe whatever helps your point make the most sense to you.

                I honestly don’t care anymore.

        • story@lemmy.zipBanned
          link
          fedilink
          English
          arrow-up
          1
          ·
          9 days ago

          you are familiar with this history of the open-source/proprietary dialectic yeah? at most deepseek stays a few months behind frontier models. your pessimism feels like a Microsoft windows 7 user’s pessimism about operating systems in 2008 (yes, it will get worse for you specifically because paying for the new model is easier than finding a good free one). If i were you i would probably be pessimistic too, but we would need to ban the open weight models and then VPNs too, and then effectively enforce these bans in order to get the future you predict. I’m not seeing it. And these LLMs aren’t very smart. Ask them about free alternatives and they’ll tell you.

    • Eheran@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      10 days ago

      Except that we can already run crazy good models locally with one good GPU and 64 GB RAM.

    • ShadowRam@fedia.io
      link
      fedilink
      arrow-up
      4
      ·
      10 days ago

      Nah, once this all crashes, hardware will go back to being semi-normal. (along with new fabs going online), and we’ll all be able to get hardware to run our models locally.

      What they will be selling is the models. Just like software, we’ll purchase a model outright, subscribe to an updating model, or we’ll pirate a model, or there will be free open-source models.

      The idea that we’d all intimately interact with a single centralized AI over the net was a stupid idea doomed to failure since the beginning.