• Jiral@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    3 hours ago

    The digitisation is done at such verociuous speed that this will soon slow down to a trickle because anythimg left is hard to come by.

    “Synthetic data” created with contribution from LLMs is poisining the models just as well. It is leading to reinforcement of hallucinations and artefacts.

    • pebbles@sh.itjust.works
      cake
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 hour ago

      I would reccomend you look into sythetic data. It is a real thing and is used intentionally in basically every LLM of the past year or more. Last I heard of an LLM without sythetic data was Dots LLM1 and that wasn’t competitive when it came out.