Using Altair PBS Professional with NVIDIA NCCL for AI Workloads

The worlds of high-performance computing (HPC) and artificial intelligence (AI) are colliding. Traditional HPC applications embrace more machine learning techniques to augment existing algorithms, and digital twin drives yet more hybrid AI-simulation workloads. On the pure AI side, workloads are scaling, models are getting larger, and it’s increasingly important to apply HPC-style resource management to the compute environment, whether it’s on-premises or in the cloud.

Altair® PBS Professional® can be leveraged for workflow management alongside AI workflow tools and integrated with distributed communication technologies such as the message passing interface (MPI) standard from the HPC world and the NVIDIA Collective Communication Library (NCCL) from the AI space.