With deep learning training systems feeding big data sets to GPUs, bottlenecks start to appear. GPUs are only getting faster and data sets are becoming larger and richer. With the…