Latest Updates to NVIDIA CUDA-X AI Libraries – NVIDIA Developer News Center

DRANK

Learn what’s new in the latest releases of NVIDIA’s CUDA-X AI libraries and NGC. For more information on NVIDIA’s developer tools, join live webinars, training, and Connect with the Experts sessions now through GTC Digital. NVIDIA Collective Communications Library 2.6NVIDIA Collective Communications Library (NCCL) implements multi-GPU and multi-node collective communication primitives that are performance optimized for NVIDIA GPUs. Highlights in this version include:Up to 2x peak bandwidth with in-network AllReduce operations utilizing SHARPV2Infiniband adaptive routing reroutes traffic to alleviate congested portsTopology support for AMD, ARM, PCI Gen4 and IB HDREnhancements to topology detection and automatic speed detection of PCI and NICsNVIDIA Triton Inference Server 20.03NVIDIA Triton Inference Server,formerly TensorRT Inference Server, is an open source inference serving software to serve deep learning models in production with maximum GPU utilization. This version includes:…