I agree. Even just a bunch of RTX 3060s go a long way[1]. Also, in the case of my startup we can use our local storage vs uploading dozens of terabytes of data to the cloud and deal with data privacy issues.

[1] https://timdettmers.com/2023/01/16/which-gpu-for-deep-learni...