Webinar
ZeRO & Fastest BERT: Increasing the scale and speed of deep learning training in DeepSpeed webinar
The latest trend in AI is that larger natural language models provide better accuracy; however, larger models are difficult to train because of cost, time, and ease of code integration. With the goal of advancing…
Video
Sirius: A Flat Datacenter Network with Nanosecond Optical Switching. SIGCOMM 2020 full talk
The increasing gap between the growth of datacenter traffic and electrical switch capacity is expected to worsen due to the slowdown of Moore’s law, motivating the need for a new switching technology for the post-Moore’s…