Marvell says Photonic Fabric module can place AI memory up to 50 meters from GPUs
In brief
- Marvell says optical links let HBM and DDR memory sit up to 50 meters from a processor.
- Electrical connections usually limit that distance to 1.5 mm, per Crypto Briefing.
- Marvell claims pooling across 16 hosts and latency under 200 nanoseconds.
- Practical designs without retimers target 25 to 30 meters, not the 50-meter ceiling.
Light instead of copper
Copper is the bottleneck. Copper wires lose signal quality quickly at the speeds AI chips demand, which is why memory has typically sat right next to the processor. Marvell's module swaps copper for photonics, so data travels as light through optical connections.
So why move memory at all? Traditional designs tie the amount of memory to the number of chips a buyer purchases, and that's a real constraint for large-scale AI inference (bigger models need more memory). Marvell argues memory should scale independently from compute.
The specs, per Marvell
According to the company, as reported by Crypto Briefing, the module can pool memory across 16 hosts. That pool can include approximately 1 TB of HBM3e alongside 16 to 32 TB of DDR5. Marvell also points to latency claims of under 200 nanoseconds.
Dave Lazovsky, an executive vice president at Marvell, has argued the technology could lift inference throughput by up to 2 to 3 times in certain contexts. That figure comes from Marvell itself, and it applies only in specific scenarios.
It isn't a general benchmark.
50 meters is the ceiling
The headline distance is the outer bound. Optical links built without retimers can support practical designs aimed at 25 to 30 meters, and real deployments might fall well short of the 50-meter figure.
Marvell first shared details in August 2026 at industry events including FMS and Hot Interconnects, per Crypto Briefing. The company discussed the technology further in October, including in a theCUBE interview and at its investor day, where executives framed photonic memory as part of Marvell's push into AI data center infrastructure.
Frequently asked questions
How does Marvell's Photonic Fabric Memory Module move memory away from the GPU?
The module replaces copper with photonics, so data travels as light through optical connections. Marvell says this lets HBM and DDR memory operate up to 50 meters from a GPU or XPU, compared with a usual electrical limit of 1.5 mm.
Can the module really reach 50 meters in practice?
50 meters is the outer bound, according to Crypto Briefing's report. Optical links built without retimers can support practical designs aimed at 25 to 30 meters, and real deployments might fall well short of the headline distance.
Why does memory usually sit right next to the processor?
Copper wires lose signal quality quickly at the speeds AI chips demand. As a result, traditional designs tie the amount of memory to the number of chips purchased, which Marvell argues is a constraint for large-scale AI inference.
