Nvidia L40S

GPU Architecture

NVIDIA Ada Lovelace Architecture

GPU Memory

48GB GDDR6 with ECC

Memory Bandwidth

PCIe Gen4x 16: 64GB/s bidirectional

CUDA™ Cores

18,176

RT Cores

142

Tensor Cores

568

RT Core Performance

212 TFLOPS

FP32

91.6 TFLOPS

TF32 Tensor Core

366 TFLOPS

BFLOAT16 Tensor Core

366 I 733; TFLOPS

FP16 Tensor Core

366 I 733; TFLOPS

FP8Tensor Core

733 I 1466; TFLOPS

Peak INT8 Tensor

733 I 1466; TOPS

Peak INT4 Tensor

733 I 1466; TOPS

Display Ports

4 x DisplayPort 1.4a

Max. Power Consumption

350W

Power Connector

16-pin

Thermal

Passive

Virtual GPU (vGPU) Software Support

有

NVENC I NVDEC

3x l 3x (Includes AV1 Encode and Decode)

Secure Boot with Root of Trust

有

NEBS Ready

Level 3

MIG Support

无

外形尺寸

4.4" (H) x 10.5" (L), dual slot