Indeed, Musk suggested that synthetic data — data generated by AI models themselves — is the path forward. “The only way to supplement [real-world data] is with synthetic data, where the AI creates [training data],” he said. “With synthetic data … [AI] will sort of grade itself and go through this process of self-learning.”

Billionaire owner of X suggests shift to ‘synthetic’ data, though some warn of ‘model collapse’ - Anadolu Ajansı

Tech tycoon Elon Musk says artificial intelligence will now have to write an essay or a thesis then grade itself, because the 'cumulative sum of human knowledge has been exhausted'

“We’ve now exhausted basically the cumulative sum of human knowledge …. in AI training,” Musk said during a live-streamed conversation with Stagwell chairman Mark Penn streamed on X late Wednesday. “That happened basically last year.”