The article suggests that AMD is close to Nvidia with the one generation old chips and that AMD is software updates away from equaling Nvidia performance in these chips. Encouraging news for AMD holders…doc
“For most (machine learning) chip companies out there, the software is the Achilles heel of it,” Tang said, adding that AMD had not paid MosaicML to conduct its research. “Where AMD has done really well is on the software side.”
Tang said that MosaicML used its tools, the PyTorch and AMD software to train a large language model without having to make any changes to its code base. If developers can find AMD’s chips at the right price, “you can already switch to these today they’re essentially interchangeable” with Nvidia chips, Tang said.