The digitisation is done at such verociuous speed that this will soon slow down to a trickle because anythimg left is hard to come by.
“Synthetic data” created with contribution from LLMs is poisining the models just as well. It is leading to reinforcement of hallucinations and artefacts.
I would reccomend you look into sythetic data. It is a real thing and is used intentionally in basically every LLM of the past year or more. Last I heard of an LLM without sythetic data was Dots LLM1 and that wasn’t competitive when it came out.
The digitisation is done at such verociuous speed that this will soon slow down to a trickle because anythimg left is hard to come by.
“Synthetic data” created with contribution from LLMs is poisining the models just as well. It is leading to reinforcement of hallucinations and artefacts.
I would reccomend you look into sythetic data. It is a real thing and is used intentionally in basically every LLM of the past year or more. Last I heard of an LLM without sythetic data was Dots LLM1 and that wasn’t competitive when it came out.