Positioning
AMD's breakthrough AI accelerator, strong memory value
标签:
Specifications
厂商
AMD
架构
CDNA 3
类别
Datacenter
制程
TSMC 5nm/6nm
发布时间
2023
显存容量
192 GB
显存类型
HBM3
显存带宽
5.3 TB/s
FP16 算力
1307 TFLOPS
FP8 算力
2614 TFLOPS
FP4 算力
— PFLOPS
互联带宽
0 TB/s
功耗 TDP
750 W
状态
Mainstream
Sources
数据来自厂商官方文档与公开行业报告(NVIDIA、AMD、华为、IDC 等)。算力数值请结合精度与稀疏/稠密口径阅读;本站统一标注,避免纸面参数误导。采集时间 2026-11。
Frequently Asked Questions
Clear answers about AI accelerators, specs, precision and buying. (10 questions)
What is the memory capacity of Instinct MI300X?+
192 GB HBM3 with 5.3 TB/s bandwidth.
What is the FP16 throughput of Instinct MI300X?+
1307 TFLOPS (dense).
What is the difference between GPGPU and a gaming GPU?+
A gaming GPU is tuned for raster graphics and framed around real-time rendering. A GPGPU (General-Purpose GPU) is the same silicon family but optimized and marketed for compute: larger memory, ECC support, better FP64/FP8 throughput, server cooling and virtualization. Cards like the NVIDIA A100/H100 are GPGPUs, while GeForce RTX is aimed at games.
What is a chiplet and why does it matter for AI chips?+
A chiplet is a small modular die that is packaged together with other dies to form one chip. It improves yield, lets vendors mix process nodes (compute on 4nm, I/O on 6nm) and scales beyond reticle limits. AMD MI300 and Intels approaches use chiplets to build large accelerators cost-effectively.
What is CoWoS and why is it a bottleneck?+
CoWoS is TSMCs 2.5D packaging technology that places a GPU die next to HBM stacks on a silicon interposer. Advanced AI chips depend on it, and limited CoWoS capacity has been a key supply constraint for NVIDIA/AMD accelerators.
How does AMD MI300X compare to H100?+
MI300X offers 192GB HBM3 and higher memory bandwidth than H100, with competitive FP8/FP16 throughput, making it strong for large-model inference. It uses chiplet construction. The main trade-off is a less mature software ecosystem (ROCm vs CUDA).
What is AMD MI355X?+
MI355X is AMDs Blackwell-generation Instinct accelerator with 288GB HBM3e and 8 TB/s bandwidth, targeting large-scale AI training and inference. It is the successor line to MI300X.
What is AMD MI400 series?+
MI400 is AMDs next-generation Instinct line expected with 432GB HBM4, aimed at competing with NVIDIs Rubin era. It targets ultra-large model training and long-context inference.
Is ROCm mature enough for production?+
ROCm has improved substantially and supports PyTorch and major frameworks, but it still trails CUDA in library coverage, tooling and community support. It is viable for many inference and training workloads, but migration may need engineering effort.
What is AMD Infinity Fabric?+
Infinity Fabric is AMDs high-speed interconnect used both on-chip (between chiplets) and between GPUs/CPUs in servers. In Instinct platforms it links multiple GPUs and to EPYC CPUs, playing a role similar to NVIDIs NVLink.
No matching questions.