Hardware Datasheet · GPU Server
Nexus Compute
H200 GPU Server
Expanded memory and bandwidth for the largest models and most demanding workloads.
Overview
The H200 GPU Server builds on the H100 architecture with substantially more memory and bandwidth, the difference that lets the largest models run on fewer nodes. Nexus Compute sources H200 systems for organizations whose model sizes or throughput requirements have outgrown the H100. The number that matters is 141GB against the H100's 80GB. That difference decides whether a large model fits on four GPUs instead of eight, or within one node instead of two, and removing a node boundary removes the fabric traffic, the parallelism complexity, and the failure domain that come with it. For inference the same expanded memory holds a far larger KV cache, so concurrency and context length can rise before you run out of room. The trade is that H200 nodes draw on the same allocation pool as other current-generation parts and are typically both scarcer and more expensive per GPU, so the case for them is strongest where the extra memory genuinely changes your topology rather than simply providing headroom.
Specifications
| GPU | NVIDIA H200 SXM5 (141GB HBM3e) |
| GPU Capacity | Up to 8 GPUs per node |
| GPU Interconnect | NVSwitch all-to-all |
| CPU | Dual AMD EPYC or Intel Xeon |
| System Memory | Up to 2TB ECC |
| Networking | InfiniBand NDR / 400GbE |
| Power | Redundant high-capacity PSUs |
| Form Factor | 8U rackmount |
| Memory Bandwidth | 4.8 TB/s |
| NVLink Bandwidth | 900 GB/s per GPU |
| PCIe Interface | PCIe Gen5, 128 GB/s |
| Max GPU TDP | Up to 700W configurable (SXM); up to 600W (NVL) |
| MIG Support | Up to 7 instances @ 18GB each (SXM) / 16.5GB each (NVL) |
Typical Use Cases
- ·Very large language model inference and serving
- ·Training workloads that benefit from expanded GPU memory
- ·Consolidating large models onto fewer nodes
- ·Memory-bandwidth-bound HPC and AI workloads
- ·Long-context inference where KV cache, not weights, is the constraint
- ·Fitting models that will not sit within an 80GB-class GPU
Industries
Warranty & Support
Supplied through authorized channels with full manufacturer warranty. On-site, next-business-day support options available. Every system is configured, tested, and documented before delivery, with asset and warranty records provided for enterprise audit requirements.
Request a tailored quote
Configurations are tailored per engagement, so contact us for pricing and lead times.
sales@nexus-compute.com
+1 656 218 9096
nexus-compute.com
Specifications are indicative and configured to each engagement. All product names, logos, and trademarks are the property of their respective owners. Nexus Compute is an independent enterprise hardware supplier.
