semiAIfoundry

Rack integration · Atlas v1.3.0

NVLink copper cable cartridge

Provides dense physical signal connections between compute and switch trays.

Explore in AtlasMeter-scale cable assembly containing many short links

Learning objectiveSeparate propagation delay from serialization time on a physical link.

The mechanism

A rack-wide fabric needs a physical transmission path as well as switch chips. The GB200 system uses a passive copper cable-cartridge backplane with blind-mate tray connections. That arrangement concentrates many short high-speed paths in a managed assembly rather than requiring every tray connection to be manually routed as an exposed cable. The atlas reveals the cartridge as a dense set of point-to-point paths and distinguishes it from the logical network drawn on top. Copper is not inherently obsolete: appropriate short-distance links can be effective, while optical links serve other reaches and system requirements. Connector integrity, signal quality, topology, and service access all affect whether theoretical bandwidth becomes reliable communication.

  1. Map GPU endpoint connections to the required switch connections.
  2. Bundle the physical copper paths into the cartridge structure.
  3. Mate trays to the backplane so the logical fabric has a continuous signal path.

Science and assumptions

Propagation and serialization

tlink≳Lvprop+SBpayloadt_{\mathrm{link}}\gtrsim\frac{L}{v_{\mathrm{prop}}}+\frac{S}{B_{\mathrm{payload}}}

Link time is approximately bounded below by propagation distance divided by propagation speed, plus payload bytes divided by payload bandwidth.

Symbols and units
t_link
One-hop link time in the simplified model

s

L
Path length

m

v_prop
Signal propagation speed along the medium

m/s

S
Payload size

bytes

B_payload
Payload serialization bandwidth

bytes/s

A link has propagation time along its length and serialization time to place the payload onto the channel. Short distance does not remove serialization or protocol overhead.

Assumptions Simple one-hop link model; buffering, coding, connector loss, retransmission, and routing can add further cost.

Engineering example

Synthetic one-hop link: 2 m at an assumed propagation speed of 2 × 10⁸ m/s adds 10 ns. Serializing a 1 kB payload at 25 GB/s adds 40 ns. Their sum is 50 ns before coding, connectors, buffering or retransmission.

Distinctions and tradeoffs

A drawn connection is not merely abstract: a working rack needs its physical conductor, connectors, and signal margins.

Short copper paths can serve dense racks well. Signal integrity and connector complexity constrain physical design.

Dense model communication requires real conductors and connectors. Cabling makes the rack fabric physically realizable.

Specifications and interfaces

GB200 link medium
Passive copper

Rack-scale NVLink cable-cartridge backplane.

Tray connection
Blind-mate connectors

Documented rear-side connection scheme.

Published scale
Over 5,000 copper cables

NVIDIA rack description; illustration samples paths for legibility.

Interfaces

Compute-tray connectors Input
High-speed electrical signals
Switch-tray connectors Output
Mapped physical NVLink paths

Check your understanding

Why does the atlas sample the cable paths?

  1. Thousands of physical paths would obscure the topology at viewing scale
  2. The rack has only one real cable
  3. Each visible cable represents a neural-network layer
Answer and reasoning

Thousands of physical paths would obscure the topology at viewing scale

The reference rack contains thousands of cables. A sampled rendering preserves the structural lesson without pretending to show every conductor.

Evidence and scope

Length, speed and payload rate are teaching assumptions rather than specifications for a cable cartridge. A physical cable route is distinct from the logical collective or network topology that uses it.

Use the execution investigation for the shared tensor-to-memory-to-result thread; no current standalone calculator models this lesson’s full mechanism.

Sources

Published lesson data · Atlas releases and licensing

Continue exploring

Foundations

Related lessons