【创源大讲堂】分布式大模型训练加速:方法和系统

来源: 发布日期:2023-09-08浏览次数: 返回列表

主讲人简介:

Jie Xu is Chair of Computing at the University of Leeds, Director of the UK White Rose Grid e-Science Centre, involving the three White Rose Universities of Leeds, Sheffield and York, and Head of the Distributed Systems and Services (DSS) Theme at Leeds. Xu has worked in the field of Distributed Computing Systems for over thirty-five years, engaging closely with industrial leaders such as Alibaba, BAE Systems, JLR, and Rolls-Royce. Professor Xu is an executive member of UKCRC (UK Computing Research Committee) and an awarded Turing Fellow in AI and Data Science. He is the co-founder of two university's spin-outs that specialise in data analytics and AI software for maximising data centre performance and in co-simulation and digital twins.

内容简介:

This talk reports our latest experience with speeding up pre-trained DNN models through fine-grained GPU parallelism and introduces an application of multi-task learning for predicting passengers' demands.


创源大讲堂-徐洁.jpg





作者:邹远   编辑:蔡京君