Generative AI requires a ton of memory capacity. As models are trained on more and more information, accessing some of the training data or previous conversations requires a ton of memory capacity.
In Amazon's recent shareholder letter, it disclosed several impressive stats about Amazon's custom chips. They started by discussing its first custom chips, Graviton. Before 2018, Intel CPUs dominated ...