NVIDIA L4
Data CenterAn energy-saving data center GPU in PCIe form factor, built on the Ada Lovelace architecture and purpose-built for AI inference and visual computing tasks.
Key Specifications
VRAM
24 GB GDDR6
Memory Bus
256-bit
FP16
30.29 TFLOPS
FP32
30.29 TFLOPS
TDP
72 W
Best Use Cases
AI Inference
Provides powerful tensor core acceleration for serving large language models and generative AI workloads at scale with minimal latency.
Virtual Workstations
Supports rich cloud-based graphics, CAD, and video editing environments through hardware-accelerated encoding and decoding.
GPU Cloud Services
Well-suited for providers delivering cost-effective, high-density GPU compute instances in the cloud thanks to its low per-core power draw.