I think eventually the NVDA GPU’s will be replaced by ASICS. Just like the GPU’s were really good at mining bitcoin they were eventually replaced by ASICS and NVDA collapsed. The same will happen with AI and the future ASIC company has now, probably not even IPO’d. Unless NVDA decides to disrupt themselves.
Bitcoin mining is a very specific algorithm that is not going to change. You are not painting an apples to apples comparison here. For what you say to actually happen would require ML/AI algorithms to become set in stone. I don’t see a reason to think that is going to happen any time soon. At all.
After all, we never got an ASIC for a word processor…
I am not saying there won’t be GPU’s still BJ , I am saying that they will not be the only thing and their marketshare will shrink. It’s inevitable. Everyone wants cheaper and faster. Just something to watch. I am long NVDA
FPGA’s are more likely, as they are fixed function, but the circuit can be re-done in the field to be a new fixed function.
Fixed function logic is not always “better” than programmable, by the way. For some tasks of course it is. For others, no. For some tasks the amount of logic required would be huge, but to do it via something like a CPU or GPU, something that runs code, the amount of logic drops. That’s my biggest problem with some of these papers claiming an ASIC would always be less money, or less power, or whatever.
Fun fact: the first GPU’s were all fixed-function pipelines. The programmable shader was invented by: Nvidia. And nobody does fixed-function GPUs ever since. (worth noting: many of the pipeline stages are still fixed-function, because not everything needs to be programmable)