Internship: Gradient compression for distributed training of machine learning models
King Abdullah University of Science and Technology (KAUST)
Saudi Arabia
Summary
Research project focused on communication-efficient distributed machine learning: design and analysis of sparsification, quantization and related compression schemes to reduce tensor aggregation bottlenecks and accelerate large-scale training on parallel systems.
