Quantized Training

Jetfire: Efficient and Accurate Transformer Pretraining with INT8 Data Flow and Per-Block Quantization
Jetfire: Efficient and Accurate Transformer Pretraining with INT8 Data Flow and Per-Block Quantization

Mar 18, 2024

Training Transformers with 4-bit Integers
Training Transformers with 4-bit Integers

Jun 18, 2023