Rethinking Machine Learning Collective Communication as a Multi-Commodity Flow Problem
- I like their framing of collective communication as a multi-commodity flow (MCF) problem as well as their general MILP solution formulation. The support of multi-cast/copy along with utilization of buffers for store and forwarding is also pretty cool.