Harnessing 3200Gbps Network (9): Using 32 Network Cards

In the previous chapter, we clarified the system topology. And in chapter 7, we were able to achieve 97.844 Gbps bandwidth on a single network card. In this chapter, we will use 32 network cards corresponding to 8 GPUs and see how much bandwidth our program can achieve. We’ll name this program 9_multinet.cpp. Network We’ll first make a small modification to the Network class. First, we’ll record…