2024-12-15
I refuse to read the article but I wonder what scenario people like this imagine, when they hear we're running out of data. Do they think it's used up, or deleted? [embedded post]
Nature
AI companies, running out of conventional training datasets from the web, may be forced to shift from big, all-purpose LLMs to smaller, more specialized models
why human-sourced data can help prevent AI model collapse Matthias Bastian / The Decoder : OpenAI co-founder says AI is reaching “peak data” as it hits the limits of the internet K...