Get the latest tech news
Torchcomms: A modern PyTorch communications API
w experimental, lightweight communication API intended for use with PyTorch Distributed (PTD). In addition to the core API, we are open-sourcing NCCLX, a new backend we developed to scale to over 100,000 GPUs.
None
Or read this on Hacker News