{"id":34197,"date":"2023-11-13T16:01:02","date_gmt":"2023-11-13T16:01:02","guid":{"rendered":"https:\/\/isafespend.com\/news\/nvidia-unveils-h200-its-newest-high-end-chip-for-training-ai-models\/"},"modified":"2023-11-13T16:01:04","modified_gmt":"2023-11-13T16:01:04","slug":"nvidia-unveils-h200-its-newest-high-end-chip-for-training-ai-models","status":"publish","type":"post","link":"https:\/\/isafespend.com\/?p=34197","title":{"rendered":"Nvidia unveils H200, its newest high-end chip for training AI models"},"content":{"rendered":"<div id=\"SpecialReportArticle-ArticleBody-6\" data-module=\"ArticleBody\" data-test=\"articleBody-2\" data-analytics=\"SpecialReportArticle-articleBody-6-2\"><span class=\"HighlightShare-hidden\" style=\"top:0;left:0\"><\/span><\/p>\n<div class=\"group\">\n<p><span class=\"QuoteInBody-quoteNameContainer\" data-test=\"QuoteInBody\" id=\"SpecialReportArticle-QuoteInBody-1\">Nvidia<span class=\"QuoteInBody-inlineButton\"><span class=\"AddToWatchlistButton-watchlistContainer\" id=\"-WatchlistDropdown\" data-analytics-id=\"-WatchlistDropdown\"><button class=\"AddToWatchlistButton-watchlistButton\" aria-label=\"Add To Watchlist\" data-testid=\"dropdown-btn\"><span class=\"AddToWatchlistButton-addWatchListFromTag\"><\/span><\/button><\/span><\/span><\/span> on Monday unveiled the H200, a graphics processing unit designed for training and deploying the kinds of artificial intelligence models that are powering the generative AI boom.<\/p>\n<p>The new GPU is an upgrade from the H100, the chip OpenAI used to train its most advanced large language model, GPT-4. Big companies, startups and government agencies are all vying for a limited supply of the chips.<\/p>\n<p>H100 chips cost between $25,000 and $40,000, according to an estimate from Raymond James, and thousands of them working together are needed to create the biggest models in a process called &#8220;training.&#8221;<\/p>\n<p>Excitement over Nvidia&#8217;s AI GPUs has supercharged the company&#8217;s stock, which is up more than 230% so far in 2023. Nvidia expects around $16 billion of revenue for its fiscal third quarter, up 170% from a year ago.<\/p>\n<p>The key improvement with the H200 is that it includes 141GB of next-generation &#8220;HBM3&#8221; memory that will help the chip perform &#8220;inference,&#8221; or using a large model after it&#8217;s trained to generate text, images or predictions.<\/p>\n<p>Nvidia said the H200 will generate output nearly twice as fast as the H100. That&#8217;s based on a test using <span class=\"QuoteInBody-quoteNameContainer\" data-test=\"QuoteInBody\" id=\"SpecialReportArticle-QuoteInBody-7\">Meta&#8217;s<span class=\"QuoteInBody-inlineButton\"><span class=\"AddToWatchlistButton-watchlistContainer\" id=\"-WatchlistDropdown\" data-analytics-id=\"-WatchlistDropdown\"><button class=\"AddToWatchlistButton-watchlistButton\" aria-label=\"Add To Watchlist\" data-testid=\"dropdown-btn\"><span class=\"AddToWatchlistButton-addWatchListFromTag\"><\/span><\/button><\/span><\/span><\/span> Llama 2 LLM.<\/p>\n<p>The H200, which is expected to ship in the second quarter of 2024, will compete with AMD&#8217;s MI300X GPU. <span class=\"QuoteInBody-quoteNameContainer\" data-test=\"QuoteInBody\" id=\"SpecialReportArticle-QuoteInBody-9\">AMD&#8217;s<span class=\"QuoteInBody-inlineButton\"><span class=\"AddToWatchlistButton-watchlistContainer\" id=\"-WatchlistDropdown\" data-analytics-id=\"-WatchlistDropdown\"><button class=\"AddToWatchlistButton-watchlistButton\" aria-label=\"Add To Watchlist\" data-testid=\"dropdown-btn\"><span class=\"AddToWatchlistButton-addWatchListFromTag\"><\/span><\/button><\/span><\/span><\/span> chip, similar to the H200, has additional memory over its predecessors, which helps fit big models on the hardware to run inference.<\/p>\n<\/div>\n<div class=\"group\">\n<p>Nvidia said the H200 will be compatible with the H100, meaning that AI companies who are already training with the prior model won&#8217;t need to change their server systems or software to use the new version.<\/p>\n<p>Nvidia says it will be available in four-GPU or eight-GPU server configurations on the company&#8217;s HGX complete systems, as well as in a chip called GH200, which pairs the H200 GPU with an Arm-based processor.<\/p>\n<p>However, the H200 may not hold the crown of the fastest Nvidia AI chip for long.<\/p>\n<p>While companies like Nvidia offer many different configurations of their chips, new semiconductors often take a big step forward about every two years, when manufacturers move to a different architecture that unlocks more significant performance gains than adding memory or other smaller optimizations. Both the H100 and H200 are based on Nvidia&#8217;s Hopper architecture.<\/p>\n<p>In October, Nvidia told investors that it would move from a two-year architecture cadence to a one-year release pattern due to high demand for its GPUs. The company displayed a slide suggesting it will announce and release its B100 chip, based on the forthcoming Blackwell architecture, in 2024.<\/p>\n<p><strong>WATCH:<\/strong> We&#8217;re a big believer in the AI trend going into next year<\/p>\n<\/div>\n<div role=\"region\" aria-labelledby=\"Placeholder-ArticleBody-Video-107326807\">\n<div role=\"button\" tabindex=\"0\" id=\"Placeholder-ArticleBody-Video-107326807\" class=\"PlaceHolder-wrapper\" data-vilynx-id=\"7000321058\" data-test=\"VideoPlaceHolder\">\n<div class=\"InlineVideo-videoEmbed\" id=\"InlineVideo-0\" data-test=\"InlineVideo\">\n<div class=\"InlineVideo-wrapper\">\n<div class=\"InlineVideo-inlineThumbnailContainer\"><span class=\"InlineVideo-videoButton\"><\/span><span><\/span><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"group\">\n<p><em><strong>Don&#8217;t miss these stories from CNBC PRO:<\/strong><\/em><\/p>\n<\/div>\n<\/div>\n<p>Read the full article <a href=\"https:\/\/www.cnbc.com\/2023\/11\/13\/nvidia-unveils-h200-its-newest-high-end-chip-for-training-ai-models.html\" target=\"_blank\" rel=\"noopener\">here<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Nvidia on Monday unveiled the H200, a graphics processing unit designed for training and deploying the kinds of artificial intelligence models that are powering the generative AI boom. The new GPU is an upgrade from the H100, the chip OpenAI used to train its most advanced large language model, GPT-4. Big companies, startups and government<\/p>\n","protected":false},"author":1,"featured_media":34198,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[43],"tags":[],"class_list":{"0":"post-34197","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-news"},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.12 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Nvidia unveils H200, its newest high-end chip for training AI models | iSafeSpend<\/title>\n<meta name=\"description\" content=\"Nvidia on Monday unveiled the H200, a graphics processing unit designed for training and deploying the kinds of artificial intelligence models that are\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/isafespend.com\/?p=34197\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Nvidia unveils H200, its newest high-end chip for training AI models | iSafeSpend\" \/>\n<meta property=\"og:description\" content=\"Nvidia on Monday unveiled the H200, a graphics processing unit designed for training and deploying the kinds of artificial intelligence models that are\" \/>\n<meta property=\"og:url\" content=\"https:\/\/isafespend.com\/?p=34197\" \/>\n<meta property=\"og:site_name\" content=\"iSafeSpend\" \/>\n<meta property=\"article:published_time\" content=\"2023-11-13T16:01:02+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-13T16:01:04+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/isafespend.com\/wp-content\/uploads\/2023\/11\/107332323-1699642689259-H200_Graphic.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1920\" \/>\n\t<meta property=\"og:image:height\" content=\"1080\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"News Room\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"News Room\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/isafespend.com\/?p=34197#article\",\"isPartOf\":{\"@id\":\"https:\/\/isafespend.com\/?p=34197\"},\"author\":{\"name\":\"News Room\",\"@id\":\"https:\/\/isafespend.com\/#\/schema\/person\/5b8c1c75336efaf09b163cd1eab0c9bf\"},\"headline\":\"Nvidia unveils H200, its newest high-end chip for training AI models\",\"datePublished\":\"2023-11-13T16:01:02+00:00\",\"dateModified\":\"2023-11-13T16:01:04+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/isafespend.com\/?p=34197\"},\"wordCount\":467,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/isafespend.com\/#organization\"},\"articleSection\":[\"News\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/isafespend.com\/?p=34197#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/isafespend.com\/?p=34197\",\"url\":\"https:\/\/isafespend.com\/?p=34197\",\"name\":\"Nvidia unveils H200, its newest high-end chip for training AI models | iSafeSpend\",\"isPartOf\":{\"@id\":\"https:\/\/isafespend.com\/#website\"},\"datePublished\":\"2023-11-13T16:01:02+00:00\",\"dateModified\":\"2023-11-13T16:01:04+00:00\",\"description\":\"Nvidia on Monday unveiled the H200, a graphics processing unit designed for training and deploying the kinds of artificial intelligence models that are\",\"breadcrumb\":{\"@id\":\"https:\/\/isafespend.com\/?p=34197#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/isafespend.com\/?p=34197\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/isafespend.com\/?p=34197#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/isafespend.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Nvidia unveils H200, its newest high-end chip for training AI models\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/isafespend.com\/#website\",\"url\":\"https:\/\/isafespend.com\/\",\"name\":\"Solutions For Real\",\"description\":\"Latest Finance News and Updates\",\"publisher\":{\"@id\":\"https:\/\/isafespend.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/isafespend.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/isafespend.com\/#organization\",\"name\":\"Solutions For Real\",\"url\":\"https:\/\/isafespend.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/isafespend.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/isafespend.com\/wp-content\/uploads\/2023\/08\/sf-logo-1.png\",\"contentUrl\":\"https:\/\/isafespend.com\/wp-content\/uploads\/2023\/08\/sf-logo-1.png\",\"width\":690,\"height\":64,\"caption\":\"Solutions For Real\"},\"image\":{\"@id\":\"https:\/\/isafespend.com\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/isafespend.com\/#\/schema\/person\/5b8c1c75336efaf09b163cd1eab0c9bf\",\"name\":\"News Room\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/isafespend.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/isafespend.com\/wp-content\/uploads\/2023\/08\/avatar_user_1_1691264579-96x96.png\",\"contentUrl\":\"https:\/\/isafespend.com\/wp-content\/uploads\/2023\/08\/avatar_user_1_1691264579-96x96.png\",\"caption\":\"News Room\"},\"sameAs\":[\"https:\/\/isafespend.com\"],\"url\":\"https:\/\/isafespend.com\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Nvidia unveils H200, its newest high-end chip for training AI models | iSafeSpend","description":"Nvidia on Monday unveiled the H200, a graphics processing unit designed for training and deploying the kinds of artificial intelligence models that are","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/isafespend.com\/?p=34197","og_locale":"en_US","og_type":"article","og_title":"Nvidia unveils H200, its newest high-end chip for training AI models | iSafeSpend","og_description":"Nvidia on Monday unveiled the H200, a graphics processing unit designed for training and deploying the kinds of artificial intelligence models that are","og_url":"https:\/\/isafespend.com\/?p=34197","og_site_name":"iSafeSpend","article_published_time":"2023-11-13T16:01:02+00:00","article_modified_time":"2023-11-13T16:01:04+00:00","og_image":[{"width":1920,"height":1080,"url":"https:\/\/isafespend.com\/wp-content\/uploads\/2023\/11\/107332323-1699642689259-H200_Graphic.jpg","type":"image\/jpeg"}],"author":"News Room","twitter_card":"summary_large_image","twitter_misc":{"Written by":"News Room","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/isafespend.com\/?p=34197#article","isPartOf":{"@id":"https:\/\/isafespend.com\/?p=34197"},"author":{"name":"News Room","@id":"https:\/\/isafespend.com\/#\/schema\/person\/5b8c1c75336efaf09b163cd1eab0c9bf"},"headline":"Nvidia unveils H200, its newest high-end chip for training AI models","datePublished":"2023-11-13T16:01:02+00:00","dateModified":"2023-11-13T16:01:04+00:00","mainEntityOfPage":{"@id":"https:\/\/isafespend.com\/?p=34197"},"wordCount":467,"commentCount":0,"publisher":{"@id":"https:\/\/isafespend.com\/#organization"},"articleSection":["News"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/isafespend.com\/?p=34197#respond"]}]},{"@type":"WebPage","@id":"https:\/\/isafespend.com\/?p=34197","url":"https:\/\/isafespend.com\/?p=34197","name":"Nvidia unveils H200, its newest high-end chip for training AI models | iSafeSpend","isPartOf":{"@id":"https:\/\/isafespend.com\/#website"},"datePublished":"2023-11-13T16:01:02+00:00","dateModified":"2023-11-13T16:01:04+00:00","description":"Nvidia on Monday unveiled the H200, a graphics processing unit designed for training and deploying the kinds of artificial intelligence models that are","breadcrumb":{"@id":"https:\/\/isafespend.com\/?p=34197#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/isafespend.com\/?p=34197"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/isafespend.com\/?p=34197#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/isafespend.com\/"},{"@type":"ListItem","position":2,"name":"Nvidia unveils H200, its newest high-end chip for training AI models"}]},{"@type":"WebSite","@id":"https:\/\/isafespend.com\/#website","url":"https:\/\/isafespend.com\/","name":"Solutions For Real","description":"Latest Finance News and Updates","publisher":{"@id":"https:\/\/isafespend.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/isafespend.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/isafespend.com\/#organization","name":"Solutions For Real","url":"https:\/\/isafespend.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/isafespend.com\/#\/schema\/logo\/image\/","url":"https:\/\/isafespend.com\/wp-content\/uploads\/2023\/08\/sf-logo-1.png","contentUrl":"https:\/\/isafespend.com\/wp-content\/uploads\/2023\/08\/sf-logo-1.png","width":690,"height":64,"caption":"Solutions For Real"},"image":{"@id":"https:\/\/isafespend.com\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/isafespend.com\/#\/schema\/person\/5b8c1c75336efaf09b163cd1eab0c9bf","name":"News Room","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/isafespend.com\/#\/schema\/person\/image\/","url":"https:\/\/isafespend.com\/wp-content\/uploads\/2023\/08\/avatar_user_1_1691264579-96x96.png","contentUrl":"https:\/\/isafespend.com\/wp-content\/uploads\/2023\/08\/avatar_user_1_1691264579-96x96.png","caption":"News Room"},"sameAs":["https:\/\/isafespend.com"],"url":"https:\/\/isafespend.com\/?author=1"}]}},"_links":{"self":[{"href":"https:\/\/isafespend.com\/index.php?rest_route=\/wp\/v2\/posts\/34197","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/isafespend.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/isafespend.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/isafespend.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/isafespend.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=34197"}],"version-history":[{"count":1,"href":"https:\/\/isafespend.com\/index.php?rest_route=\/wp\/v2\/posts\/34197\/revisions"}],"predecessor-version":[{"id":34199,"href":"https:\/\/isafespend.com\/index.php?rest_route=\/wp\/v2\/posts\/34197\/revisions\/34199"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/isafespend.com\/index.php?rest_route=\/wp\/v2\/media\/34198"}],"wp:attachment":[{"href":"https:\/\/isafespend.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=34197"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/isafespend.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=34197"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/isafespend.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=34197"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}