The assumption that AI will soon run out of data to train on, or that it will become “corrupted” by training on AI-created content, is just an assumption. There are already cases where AI trains itself on AI data, and the limits of these techniques are not yet clear.
Quote Tweet
Arvind Narayanan
@random_walker
A popular view. I get it — learning w/o human knowledge seems implausible, even insulting. But let's wait and see.
We already know this is false in some domains like game playing — synthetic data *alone* (self play) yields superhuman agents. In which other domains can it help? twitter.com/tdietterich/st…