The biggest problem isn’t cost of running the models right now, the biggest problem is all the debt they built up on training and data center buildouts. That’s what they need to recoup and that’s what’s going to drive prices up. And once it’s recouped they’ll need to make pure profits.
And I hope that debt kills them because all the big AI companies are terrible in one way or another, and the eventual price disparity will make it uneconomical to use their models. Then we might return right back to development focusing on small models, not large ones.
But aren’t the AI companies always needing to train the next version and replace/upgrade the HW? If it were just a one time startup cost then maybe they could become profitable, but if they will always need to invest heavily in traing the next gen and replacing HW every 2 years, then that’s more of an ongoing expense.
The biggest problem isn’t cost of running the models right now, the biggest problem is all the debt they built up on training and data center buildouts. That’s what they need to recoup and that’s what’s going to drive prices up. And once it’s recouped they’ll need to make pure profits.
And I hope that debt kills them because all the big AI companies are terrible in one way or another, and the eventual price disparity will make it uneconomical to use their models. Then we might return right back to development focusing on small models, not large ones.
But aren’t the AI companies always needing to train the next version and replace/upgrade the HW? If it were just a one time startup cost then maybe they could become profitable, but if they will always need to invest heavily in traing the next gen and replacing HW every 2 years, then that’s more of an ongoing expense.
And I’m sure you’ve noticed how all the revenue and profit numbers that leak out ignore “one off” costs like training and data centre building.
But look how dangerous these models are. They need to be regulated so that only responsible closed model providers can produce them.
Just ignore that the responsible closed model providers are the ones opening their sandboxes and training their models on blackhat sources.