Researchers have been throwing tons of effort into getting better training data. For example, Surge AI had a revenue of over $1 billion last August, and Scale AI was probably in a similar boat.
Data industry > AI progress
Most focus on algorithmic breakthroughs, but author shows data companies with $1B+ revenue drive more efficiency than algorithmic innovations.