> You can't get cheaper GPUs

You absolutely can. OpenAI et al are paying a fortune for GPUs but they are not paying retail prices.

The entire business model of retail is to sell above cost.