Andrej Karpathy leaves OpenAI

I wonder why! AI is becoming the leading technology. It certainly is driving the stock market with its hunger for AI chips

https://seekingalpha.com/news/4066571-openai-founding-member-andrej-karpathy-announces-exit

Sam Altman’s $7 trillion chip dreams are way off the mark, says Nvidia CEO Jensen Huang

The Captain

3 Likes

I think eventually the NVDA GPU’s will be replaced by ASICS. Just like the GPU’s were really good at mining bitcoin they were eventually replaced by ASICS and NVDA collapsed. The same will happen with AI and the future ASIC company has now, probably not even IPO’d. Unless NVDA decides to disrupt themselves.

Andy

1 Like

Bitcoin mining is a very specific algorithm that is not going to change. You are not painting an apples to apples comparison here. For what you say to actually happen would require ML/AI algorithms to become set in stone. I don’t see a reason to think that is going to happen any time soon. At all.

After all, we never got an ASIC for a word processor…

2 Likes

ASIC means “application-specific integrated circuit.”

Is Dojo an ASIC? Better said, are Dojo’s CPUs ASICs?

The Captain

Nothing is ever Apples to Apples but it’s all in the name. Application-Specific Integrated Circuits (ASICS).

AI and ML: How They Will Impact the ASIC Market.

Andy

1 Like

Dojo is programmable logic, not fixed-function (i.e. not ASIC).

2 Likes

AI Processing: Implications and Possibilities with ASICs.

Andy

1 Like

I am not saying there won’t be GPU’s still BJ , I am saying that they will not be the only thing and their marketshare will shrink. It’s inevitable. Everyone wants cheaper and faster. Just something to watch. I am long NVDA

Andy

1 Like

Thanks!

The Captain

“Post must be at least 20 characters”

which of course much improves the … Never mind!

1 Like

What do you think could disrupt the GPU then? FPGA’s or PLD’s?

Andy

FPGA’s are more likely, as they are fixed function, but the circuit can be re-done in the field to be a new fixed function.

Fixed function logic is not always “better” than programmable, by the way. For some tasks of course it is. For others, no. For some tasks the amount of logic required would be huge, but to do it via something like a CPU or GPU, something that runs code, the amount of logic drops. That’s my biggest problem with some of these papers claiming an ASIC would always be less money, or less power, or whatever.

Fun fact: the first GPU’s were all fixed-function pipelines. The programmable shader was invented by: Nvidia. And nobody does fixed-function GPUs ever since. (worth noting: many of the pipeline stages are still fixed-function, because not everything needs to be programmable)

2 Likes