Home / AI Cards / TPU v6e (Trillium)
Google

TPU v6e (Trillium)

TPU · 2024 · ASIC

Positioning

Google in-house ASIC, cloud-only, high-throughput inference

标签:ASIC云专用推理

Specifications

厂商
Google
架构
TPU
类别
ASIC
制程
—
发布时间
2024
显存容量
32 GB
显存类型
HBM
显存带宽
— TB/s
FP16 算力
— TFLOPS
FP8 算力
— TFLOPS
FP4 算力
— PFLOPS
互联带宽
0 TB/s
功耗 TDP
— W
状态
Current

Sources

数据来自厂商官方文档与公开行业报告(NVIDIA、AMD、华为、IDC 等)。算力数值请结合精度与稀疏/稠密口径阅读;本站统一标注,避免纸面参数误导。采集时间 2026-11。

Frequently Asked Questions

Clear answers about AI accelerators, specs, precision and buying. (10 questions)

What is the memory capacity of TPU v6e (Trillium)?+
32 GB HBM with — TB/s bandwidth.
What is the FP16 throughput of TPU v6e (Trillium)?+
Not disclosed TFLOPS (dense).
What is Google TPU v6e (Trillium)?+
TPU v6e is Googles sixth-generation tensor processing unit with improved performance and memory per chip, available through Google Cloud. It excels at TensorFlow/JAX workloads at scale but is not sold as a standalone card.
GPU vs NPU vs TPU vs ASIC: which to choose?+
GPU is the most flexible and mature, ideal for research and mixed workloads. NPU suits on-device and inference-heavy deployments. TPU is Googles matrix-multiply ASIC, excellent for TensorFlow/JAX at scale but cloud-locked. ASIC offers the best efficiency for one fixed workload but no flexibility. Choose by workload stability, ecosystem and scale.
What is a dataflow architecture?+
A dataflow architecture executes operations as data becomes available, rather than fetching instructions from memory one by one (von Neumann style). NPUs and TPUs use this to keep large matrix operations fed with minimal overhead, improving efficiency for neural networks at the cost of program flexibility.
What is the difference between a GPU and an NPU?+
A GPU (Graphics Processing Unit) is a general-purpose parallel processor with many cores, excellent at matrix math and flexible enough for training and rendering. An NPU (Neural Processing Unit) is a specialized chip designed only for neural-network inference and training, with dataflow architectures that trade flexibility for higher efficiency. In short: GPU is general-purpose and programmable; NPU is domain-specific and more power-efficient for fixed AI workloads.
What is an AI accelerator card?+
An AI accelerator card is a PCIe or OAM add-in card that offloads machine-learning training and inference from the CPU. It typically carries a GPU, NPU or ASIC plus high-bandwidth memory (HBM) and is used in servers and workstations to run large neural networks efficiently.
What is the difference between training and inference hardware needs?+
Training needs very high compute throughput, large memory capacity and fast interconnect to scale across many GPUs. Inference prioritizes low latency, high throughput per watt, lower precision (INT8/FP8/FP4) and cost. Training cards are usually top-tier (H100/B200); inference can use mid-range or NPU/ASIC solutions.
What is HBM and how is it different from GDDR?+
HBM (High Bandwidth Memory) stacks DRAM vertically and connects via a wide 1024/2048-bit interposer, delivering far higher bandwidth and lower power than GDDR, which uses wide-but-shorter parallel buses on the PCB. AI accelerators use HBM3/HBM3e/HBM4 because large models are memory-bandwidth bound.
What does OAM mean in AI accelerator modules?+
OAM (OCP Accelerator Module) is an open hardware standard from the Open Compute Project defining the module form factor, cooling and high-speed interfaces for AI accelerators. It lets different vendors cards fit the same server baseboard, easing system integration.