running generative ai models like chatgpt and google bard among others requires gpus that are advanced and fast nvidia is a company at the forefront of it the company has announced the nextgeneration of nvidia gh200 grace hooper platform it is based on a new grace hopper superchip with the worlds first hbm3e processor built for generative aithe dual configuration which delivers up to 35x more memory capacity and 3x more bandwidth than the current generation offering comprises a single server with 144 arm neoverse cores eight petaflops of ai performance and 282gb of the latest hbm3e memory technology said the company in a press release the grace hopper is also claimed to be more energy efficient than previous chips which could lead to lower operating costs for data centres that use it this is important because llms are becoming increasingly popular and the cost of running them is a major barrier to adoptionhow it may help lower costschatgpt is a large language model developed by openai that is capable of generating humanquality text it is used in a variety of applications including customer service content creation and research the grace hopper chip could make it more affordable for businesses to use chatgpt and other llms which could lead to wider adoption of these technologies to meet surging demand for generative ai data centres require accelerated computing platforms with specialized needs said jensen huang founder and ceo of nvidia the new gh200 grace hopper superchip platform delivers this with exceptional memory technology and bandwidth to improve throughput the ability to connect gpus to aggregate performance without compromise and a server design that can be easily deployed across the entire data centerleading system manufacturers are expected to deliver systems based on the platform in q2 of calendar year 2024 said nvidia in a press release