Generative AI improvements are increasingly being made through data curation and collection — not architectural — improvements. Big Tech has an advantage.
The training data is important, but currently the bottleneck is computing power. Buying so many chips and having them run full blast 24/7 costs a lot of money.
Then go ahead and buy 2000 Nvidia cards.
The training data is important, but currently the bottleneck is computing power. Buying so many chips and having them run full blast 24/7 costs a lot of money.