I disagree. Mainly because those small models are exactly what erode away the moat of needing a giant data center. Those smaller models have been proving themselves to not be far of from the SOTA models.
As OpenAI and Anthropic look to raise their prices, businesses will be much more compelled to looking at cheaper models. And if the narrative is "do the same as you did with OpenAI at 1/20th the cost" that's going to sell to a lot of businesses.
It certainly cuts into what exactly these companies can sell in general. For example, if I wanted to integrate AI into a product I'd almost certainly not chose OpenAI or Anthropic. That's because they are simply way too expensive and what they'd give me is a lot less. We've actually ran into just this. We needed a classifier for a lot of records, we picked a free model because, as you can imagine, we didn't need something as good as what OpenAI and Anthopic offered and free works.
I disagree. Mainly because those small models are exactly what erode away the moat of needing a giant data center. Those smaller models have been proving themselves to not be far of from the SOTA models.
As OpenAI and Anthropic look to raise their prices, businesses will be much more compelled to looking at cheaper models. And if the narrative is "do the same as you did with OpenAI at 1/20th the cost" that's going to sell to a lot of businesses.
It certainly cuts into what exactly these companies can sell in general. For example, if I wanted to integrate AI into a product I'd almost certainly not chose OpenAI or Anthropic. That's because they are simply way too expensive and what they'd give me is a lot less. We've actually ran into just this. We needed a classifier for a lot of records, we picked a free model because, as you can imagine, we didn't need something as good as what OpenAI and Anthopic offered and free works.