AI Has Already Run Out of Training Data, Goldman’s Data Chief Says

Check out our latest products

Added to wishlistRemoved from wishlist 0
Add to compare
[Upgraded] USB Computer /Laptop Speaker with Stereo Sound & Enhanced Bass, Portable Mini Sound Bar for Windows PCs, Desktop Computer and Laptops
Added to wishlistRemoved from wishlist 0
Add to compare
16
Added to wishlistRemoved from wishlist 0
Add to compare
14 inch Laptop Computer, for Student, Windows 11, 2.6GHz Inter CPU, 8GB RAM, 256GB SSD, Thin, Lightweight, 6h Long Battery Life for Office & Study (N7P, Sliver)
Added to wishlistRemoved from wishlist 0
Add to compare
179
Added to wishlistRemoved from wishlist 0
Add to compare
14 Inch Laptop-Computer, Intel Celeron N3350 (Up to 2.4GHz), 6GB LPDDR4 RAM 320GB Storage, WI-FI 5, BT5.0, HD Camera, 34Wh Battery, Windows 10 Laptop for Home & Study, Lightweight
Added to wishlistRemoved from wishlist 0
Add to compare
Original price was: €240.Current price is: €200.
17%
Added to wishlistRemoved from wishlist 0
Add to compare
14″ Laptop Computer, Windows 11 Laptop for MS Office, 8GB RAM 512GB SSD, Intel Pentium Quad-Core Processor(Up to 2.64GHz), 1080P FHD IPS, Wi-Fi 5, BT5.0, HDMI, Students, Lightweight
Added to wishlistRemoved from wishlist 0
Add to compare
Original price was: €2,500.Current price is: €180.
93%

The meteoric rise of artificial intelligence may appear unstoppable — but it’s facing a shortage of training data.

“We’ve already run out of data,” Neema Raphael, Goldman Sachs’ chief data officer and head of data engineering, said on the bank’s “Exchanges” podcast published on Tuesday.

Raphael said that this shortage may already be influencing how new AI systems are built.

He pointed to China’s DeepSeek as an example, saying one hypothesis for its purported development costs came from training on the outputs of existing models rather than entirely new data.

“I think the real interesting thing is going to be how previous models then shape what the next iteration of the world is going to look like in this way,” Raphael said.

With the web tapped out, developers are turning to synthetic data — machine-generated text, images, and code. That approach offers limitless supply, but also risks overwhelming models with low-quality output or AI slop.

However, Raphael said he doesn’t think the lack of fresh data will be a massive constraint, in part because companies are sitting on untapped reserves of information.

“I think from a consumer world model, I think it’s interesting we’ve definitely in the synthetic sort of explosion of data. But from an enterprise perspective, I think there’s still a lot of juice I’d say to be squeezed in that,” he said.

That means the real frontier may not be the open internet, but the proprietary datasets held by corporations. From trading flows to client interactions, firms like Goldman sit on information that could make AI tools far more valuable if harnessed correctly.

Raphael’s comments come as the industry grapples with “peak data” since the breakout of ChatGPT three years ago.

In January, OpenAI cofounder Ilya Sutskever said at a conference that all the useful data online had already been used to train models, warning that AI’s era of rapid development “will unquestionably end.”

The next frontier: proprietary data

For businesses, Raphael stressed, the obstacle isn’t just finding more data — it’s ensuring that the data is usable.

“The challenge is understanding the data, understanding the business context of the data, and then being able to normalize it in a way that makes sense for the business to consume it,” he said.

Still, Raphael suggested that heavy reliance on synthetic data raises a deeper question about AI’s trajectory. “I think what might be interesting is people might think there might be a creative plateau,” he said.

He wondered what would happen if models keep training only on machine-generated content.

“If all of the data is synthetically generated, then how much human data could then be incorporated?” he said.

“I think that’ll be an interesting thing to watch from a philosophical perspective,” he added.


Added to wishlistRemoved from wishlist 0
Add to compare
2K Webcam for PC with Microphone & Light & Privacy Cover, Web Camera for Desktop Computer/Laptop/Monitor/Mac, USB Streaming Camera for Zoom/Skype/Teams/Video Calling/Studying and Conference
Added to wishlistRemoved from wishlist 0
Add to compare
Original price was: €60.Current price is: €40.
33%

We will be happy to hear your thoughts

Leave a reply

techbazar.tech
Logo
Compare items
  • Total (0)
Compare
0
Shopping cart