Categories
Selected Articles

AI has already run out of training data — but there’s more waiting to be unlocked, Goldman’s data chief says

BI art of man looking at data on laptop.
  • AI is already facing a data shortage, reshaping how new systems are built, Goldman Sachs data chief says.
  • Synthetic data is filling the gap, but it risks flooding models with low-quality output.
  • Proprietary datasets, like those that come from businesses’ data, may hold the key to the data hole.

The meteoric rise of artificial intelligence may appear unstoppable — but it’s facing a shortage of training data.

“We’ve already run out of data,” Neema Raphael, Goldman Sachs’ chief data officer and head of data engineering, said on the bank’s “Exchanges” podcast published on Tuesday.

Raphael said that this shortage may already be influencing how new AI systems are built.

He pointed to China’s DeepSeek as an example, saying one hypothesis for its purported development costs came from training on the outputs of existing models rather than entirely new data.

“I think the real interesting thing is going to be how previous models then shape what the next iteration of the world is going to look like in this way,” Raphael said.

With the web tapped out, developers are turning to synthetic data — machine-generated text, images, and code. That approach offers limitless supply, but also risks overwhelming models with low-quality output or AI slop.

However, Raphael said he doesn’t think the lack of fresh data will be a massive constraint, in part because companies are sitting on untapped reserves of information.

“I think from a consumer world model, I think it’s interesting we’ve definitely in the synthetic sort of explosion of data. But from an enterprise perspective, I think there’s still a lot of juice I’d say to be squeezed in that,” he said.

That means the real frontier may not be the open internet, but the proprietary datasets held by corporations. From trading flows to client interactions, firms like Goldman sit on information that could make AI tools far more valuable if harnessed correctly.

Raphael’s comments come as the industry grapples with “peak data” since the breakout of ChatGPT three years ago.

In January, OpenAI cofounder Ilya Sutskever said at a conference that all the useful data online had already been used to train models, warning that AI’s era of rapid development “will unquestionably end.”

The next frontier: proprietary data

For businesses, Raphael stressed, the obstacle isn’t just finding more data — it’s ensuring that the data is usable.

“The challenge is understanding the data, understanding the business context of the data, and then being able to normalize it in a way that makes sense for the business to consume it,” he said.

Still, Raphael suggested that heavy reliance on synthetic data raises a deeper question about AI’s trajectory. “I think what might be interesting is people might think there might be a creative plateau,” he said.

He wondered what would happen if models keep training only on machine-generated content.

“If all of the data is synthetically generated, then how much human data could then be incorporated?” he said.

“I think that’ll be an interesting thing to watch from a philosophical perspective,” he added.

Read the original article on Business Insider
Categories
Selected Articles

What the FBI’s mass exodus means for the bureau’s future – CBS News https://www.cbsnews.com/video/what-the-fbis-mass-exodus-means-for-the-bureaus-future/

Categories
Selected Articles

Ukraine-Russia war live: Europe sends billions in frozen Russian assets to Kyiv as Moscow threatens response

Categories
Selected Articles

Trump admin to provide Ukraine with intelligence – and potentially long-range missiles – to hit targets deep inside Russia: report

The Trump admin is considering arming Ukraine with Tomahawk and Barracuda cruise missiles, capable of hitting targets more than 500 miles away from where they’re launched.
Categories
Selected Articles

Luxembourg’s grand duke will abdicate, passing the throne to his son

Luxembourg’s grand duke will abdicate, passing the throne to his son
Categories
Selected Articles

Shohei Ohtani to make postseason pitching debut for Dodgers in Game 1 of NLDS

Shohei Ohtani to make postseason pitching debut for Dodgers in Game 1 of NLDS
Categories
Selected Articles

Tropical storm edges toward the Philippines and may grow to a typhoon on path toward China

Tropical storm edges toward the Philippines and may grow to a typhoon on path toward China [deltaMinutes] mins ago Now
Categories
Selected Articles

Delta jets have ‘low-speed collision’ on the ground at New York’s LaGuardia, injuring 1

Delta jets have ‘low-speed collision’ on the ground at New York’s LaGuardia, injuring 1 [deltaMinutes] mins ago Now
Categories
Selected Articles

UK university student dies by suicide 3 months after mistakenly being told he wouldn’t graduate on time

“The University of Glasgow, the family believe, failed Ethan, and believe he took his own life as a result,” the family’s lawyer said.
Categories
Selected Articles

Europe’s drone wall against Russia: Political puzzles and bureaucratic hurdles

German drone company Quantum Systems says a European drone wall is posssible but warns that the real challenge is political and bureaucratic coordination between the EU and NATO.