Companies like OpenAI and Google are running out of the data used to train artificial intelligence systems. Can new methods continue years of rapid progress?
Demis Hassabis, one of the most influential artificial intelligence experts in the world, has a warning for the rest of the tech industry: Don’t expect chatbots to continue to improve as quickly as they have over the last few years.
A.I. researchers have for some time been relying on a fairly simple concept to improve their systems: The more data culled from the internet that they pumped into large language models — the technology behind chatbots — the better those systems performed.