Skip to main content

Module 2: GPU Terminologies

— A collection of 18 posts
August 2026

Quantization & Model Formats

August 2026

Inference

August 2026

Training

August 2026

GPU Utilization, Occupancy & MFU

August 2026

Batch Size, Throughput & Latency

August 2026

KV Cache

August 2026

Tokens & Context Window

August 2026

Model Parameters & Model Size

August 2026

Why Precision Matters

August 2026

FLOPS & TFLOPS

August 2026

FP8, INT8 & INT4

August 2026

FP16 & BF16

August 2026

Floating Point Numbers & FP32

August 2026

SMs, Threads & Warps

August 2026

Tensor Cores

August 2026

PCIe and NVLink

August 2026

Memory Bandwidth

August 2026

VRAM