{"product_id":"nvidia-tesla-h100-80gb-pcie-gpu-graphics-cards-video-card","title":"NVIDIA Tesla H100 80GB pcie GPU Graphics Cards Video Card For Server","description":"\u003cp\u003eNVIDIA H100 80GB pcie GPU Graphics Cards Video Card\u003c\/p\u003e\n\u003cdiv\u003e\u003cspan\u003eSupercharge Large Language Model Inference With H100 NVL\u003c\/span\u003e\u003c\/div\u003e\n\u003cdiv\u003e\u003cspan\u003eFor LLMs up to 70 billion parameters (Llama 2 70B), the PCIe-based NVIDIA H100 NVL with NVLink bridge utilizes Transformer Engine, NVLink, and 188GB HBM3 memory to provide optimum performance and easy scaling across any data center, bringing LLMs to the mainstream. Servers equipped with H100 NVL GPUs increase Llama 2 70B performance up to 5x over NVIDIA A100 systems while maintaining low latency in power-constrained data center environments.\u003c\/span\u003e\u003c\/div\u003e\n\u003cdiv\u003e\n\u003cdiv class=\"nv-title text h--medium aem-GridColumn aem-GridColumn--default--12\"\u003e\n\u003cdiv id=\"nv-title-2eaa66d122\" class=\"general-container-text\"\u003e\n\u003cdiv class=\"text-center lap-text-center tab-text-center mob-text-center\"\u003e\n\u003ch2 class=\"title\"\u003eProduct Specifications\u003c\/h2\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003cdiv class=\"nv-rawhtml aem-GridColumn--tablet--12 aem-GridColumn--offset--tablet--0 aem-GridColumn--default--none aem-GridColumn--phone--none aem-GridColumn--tablet--none aem-GridColumn--phone--10 aem-GridColumn aem-GridColumn--default--10 aem-GridColumn--offset--phone--1 aem-GridColumn--offset--default--1\"\u003e\n\u003cdiv id=\"nv-rawhtml-d0e2ba1d51\" class=\"general-container-text\"\u003e\n\u003cdiv\u003e\n\u003cdiv id=\"SpecsChart\" class=\"h100-specs scrolling\"\u003e\n\u003ctable id=\"tab-h100\" cellspacing=\"0\" cellpadding=\"0\"\u003e\n\u003cthead\u003e\n\u003ctr\u003e\n\u003cth\u003e \u003c\/th\u003e\n\u003cth\u003eH100 SXM\u003c\/th\u003e\n\u003cth\u003eH100 NVL\u003c\/th\u003e\n\u003c\/tr\u003e\n\u003c\/thead\u003e\n\u003ctbody\u003e\n\u003ctr\u003e\n\u003ctd\u003eFP64\u003c\/td\u003e\n\u003ctd\u003e34 teraFLOPS\u003c\/td\u003e\n\u003ctd\u003e30 teraFLOPs\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eFP64 Tensor Core\u003c\/td\u003e\n\u003ctd\u003e67 teraFLOPS\u003c\/td\u003e\n\u003ctd\u003e60 teraFLOPs\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eFP32\u003c\/td\u003e\n\u003ctd\u003e67 teraFLOPS\u003c\/td\u003e\n\u003ctd\u003e60 teraFLOPs\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eTF32 Tensor Core\u003csup\u003e*\u003c\/sup\u003e\n\u003c\/td\u003e\n\u003ctd\u003e989 teraFLOPS\u003c\/td\u003e\n\u003ctd\u003e835 teraFLOPs\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eBFLOAT16 Tensor Core\u003csup\u003e*\u003c\/sup\u003e\n\u003c\/td\u003e\n\u003ctd\u003e1,979 teraFLOPS\u003c\/td\u003e\n\u003ctd\u003e1,671 teraFLOPS\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eFP16 Tensor Core\u003csup\u003e*\u003c\/sup\u003e\n\u003c\/td\u003e\n\u003ctd\u003e1,979 teraFLOPS\u003c\/td\u003e\n\u003ctd\u003e1,671 teraFLOPS\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eFP8 Tensor Core\u003csup\u003e*\u003c\/sup\u003e\n\u003c\/td\u003e\n\u003ctd\u003e3,958 teraFLOPS\u003c\/td\u003e\n\u003ctd\u003e3,341 teraFLOPS\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eINT8 Tensor Core\u003csup\u003e*\u003c\/sup\u003e\n\u003c\/td\u003e\n\u003ctd\u003e3,958 TOPS\u003c\/td\u003e\n\u003ctd\u003e3,341 TOPS\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eGPU Memory\u003c\/td\u003e\n\u003ctd\u003e80GB\u003c\/td\u003e\n\u003ctd\u003e94GB\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eGPU Memory Bandwidth\u003c\/td\u003e\n\u003ctd\u003e3.35TB\/s\u003c\/td\u003e\n\u003ctd\u003e3.9TB\/s\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eDecoders\u003c\/td\u003e\n\u003ctd\u003e7 NVDEC\u003cbr\u003e7 JPEG\u003c\/td\u003e\n\u003ctd\u003e7 NVDEC\u003cbr\u003e7 JPEG\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eMax Thermal Design Power (TDP)\u003c\/td\u003e\n\u003ctd\u003eUp to 700W (configurable)\u003c\/td\u003e\n\u003ctd\u003e350-400W (configurable)\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eMulti-Instance GPUs\u003c\/td\u003e\n\u003ctd\u003eUp to 7 MIGS @ 10GB each\u003c\/td\u003e\n\u003ctd\u003eUp to 7 MIGS @ 12GB each\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eForm Factor\u003c\/td\u003e\n\u003ctd\u003eSXM\u003c\/td\u003e\n\u003ctd\u003ePCIe\u003cbr\u003edual-slot air-cooled\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eInterconnect\u003c\/td\u003e\n\u003ctd\u003eNVIDIA NVLink™: 900GB\/s\u003cbr\u003ePCIe Gen5: 128GB\/s\u003c\/td\u003e\n\u003ctd\u003eNVIDIA NVLink: 600GB\/s\u003cbr\u003ePCIe Gen5: 128GB\/s\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eServer Options\u003c\/td\u003e\n\u003ctd\u003eNVIDIA HGX H100 Partner and NVIDIA-\u003cbr\u003eCertified Systems\u003csup\u003e™\u003c\/sup\u003e\u003cspan\u003e \u003c\/span\u003ewith 4 or 8 GPUs\u003cbr\u003eNVIDIA DGX H100 with 8 GPUs\u003c\/td\u003e\n\u003ctd\u003ePartner and NVIDIA-Certified Systems with 1–8 GPUs\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003eNVIDIA AI Enterprise\u003c\/td\u003e\n\u003ctd\u003eAdd-on\u003c\/td\u003e\n\u003ctd\u003eIncluded\u003c\/td\u003e\n\u003c\/tr\u003e\n\u003c\/tbody\u003e\n\u003c\/table\u003e\n\u003c\/div\u003e\n\u003cdiv class=\"description h100-specs-legal\"\u003e\u003cspan class=\"p--small\"\u003e\u003cbr\u003e* With sparsity\u003c\/span\u003e\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e\n\u003c\/div\u003e","brand":"Neobitti Inc. In the field of artificial intelligence","offers":[{"title":"Default Title","offer_id":48954247905505,"sku":null,"price":59999.0,"currency_code":"USD","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0833\/6654\/3585\/files\/NVIDIATESLAH10080GPCIE_1.jpg?v=1787143575","url":"https:\/\/kingm.com\/ja\/products\/nvidia-tesla-h100-80gb-pcie-gpu-graphics-cards-video-card","provider":"Neobitti Inc. In the field of artificial intelligence","version":"1.0","type":"link"}