Compute Exchange
GPU Directory/NVIDIA H200 GPU
NVIDIA Hopper

NVIDIA H200 GPU

Access NVIDIA H200 GPUs across global providers. Compare pricing, locations, configurations, and deployment options — without vendor lock-in

Reserved Range / hr
$1.50 - $2.25
Request Quote
Overview

WHAT IS NVIDIA H200 GPU?

The NVIDIA H200 Tensor Core GPU, based on NVIDIA's Hopper architecture, is designed for large-scale AI workloads that benefit from increased memory capacity and bandwidth.

Compared to H100, H200 significantly expands available HBM memory and bandwidth, making it particularly well suited for memory-bound workloads such as large transformer models, long-context inference, and data-intensive training pipelines.

H200 GPUs are commonly deployed as reserved capacity by AI startups, research organizations, and enterprises running sustained training or production inference workloads.

Specifications

NVIDIA H200 SPECIFICATIONS

Architecture
NVIDIA Hopper
Memory
141 GB HBM3e
Memory Bandwidth
Up to ~4.8 TB/s
Precision Support
FP8 / FP16 / BF16 / TF32
Interconnect
Up to 900 GB/s NVLink
Form Factors
SXM5
Primary Use Cases
Large language model training, Memory-bound fine-tuning, High-throughput inference
TDP
700W (SXM)
Applications

WHAT IS H200 USED FOR?

Large language model training

H200 is used to train large transformer-based models where increased memory capacity and bandwidth help reduce communication overhead and improve training efficiency.

Fine-tuning & continued pre-training

Teams use H200 for fine-tuning and continued pre-training on proprietary or domain-specific datasets, particularly when model size or dataset scale pushes the limits of H100-class memory capacity.

High-throughput inference

For large inference workloads with high concurrency, H200 enables more efficient batching and higher throughput than H100, making it well suited for sustained production inference in reserved clusters.

Multi-node distributed workloads

H200 systems are commonly deployed in multi-node clusters, using NVLink for high-speed GPU-to-GPU communication within a node and InfiniBand-based networking across nodes, depending on provider infrastructure.

Pricing

H200 Pricing Is Not Fixed - It's A Market

H200 pricing varies based on region, provider, system configuration, networking, and availability. As a newer generation compared to H100, access to H200 capacity is often tied to longer-term commitments and reserved capacity agreements.

  • Live H100 availability
  • Regional price differences
  • Configuration comparisons
  • Flexible deployment options

Instead of negotiating bilaterally with a single provider, teams can benchmark H200 capacity across the broader market before committing.

Deployment Options

HOW YOU CAN DEPLOY

  • Reserved H200 capacity across cloud, neocloud, and independent providers
  • Neocloud providers with optimized AI infrastructure
  • Contract-based allocations with defined terms and guaranteed availability
  • Single-node and multi-node cluster reservations
  • Commitments aligned with sustained training or production inference workloads

"Compute Exchange acts as a broker and marketplace layer, helping buyers match workload needs to the right supply — without forcing architectural changes."

Why Compute Exchange

Why Buy H100 Through Compute Exchange

Verified suppliers

Access pre-vetted H200 suppliers globally, with capacity validated for reserved deployments.

Transparent comparison

Compare reserved H200 capacity across providers, regions, and configurations with clear visibility into technical and commercial tradeoffs.

Faster sourcing

Reduce procurement timelines by accessing existing reserved capacity and structured contracts rather than negotiating from scratch.

Complex requirements

Support for networking topology, cluster sizing, compliance constraints, and region-specific deployment needs.

Find The Right H100 Capacity For Your Workload

The NVIDIA GB200 Grace Blackwell Superchip connects two NVIDIA B200 Tensor Core GPUs to the NVIDIA Grace CPU over a high-speed NVLink-C2C interconnect.