HGX-2 Benchmarks for Deep Learning in TensorFlow: A 16x V100 SXM3 NVSwitch GPU Server
Exxact HGX-2 TensorEX Server Smashes Deep Learning Benchmarks For this post, we show deep learning benchmarks for TensorFlow on an Exxact TensorEX HGX-2 Server. This behemoth of a Deep Learning…
Megatron Unleashed: NVIDIA’s NLP Model “Megatron-LM” is the Largest Transformer Ever Trained
Megatron-LM: Entering the Frontiers of NLP If you’ve followed the latest advancements in Natural Language Processing (NLP), you’ll know that Transformer Models are all the latest craze. These language models…
TensorFlow 2.0: Dynamic, Readable, and Highly Extended
TensorFlow 2.0 Introduction Considering learning a new Python framework for deep learning? If you already know some TensorFlow and are looking for something with a little more dynamism, you no…
PyTorch Release v1.2.0 – New TorchScript API with Improved Python Language Coverage, Expanded ONNX Export, NN.Transformer
PyTorch is an open source machine learning library based on the Torch library, used for applications such as computer vision and natural language processing. Here’s what’s new in PyTorch v1.2.0….
TensorFlow vs PyTorch vs Keras for NLP
Before beginning a feature comparison between TensorFlow vs PyTorch vs Keras, let’s cover some soft, non-competitive differences between them. Non-competitive facts: Below we present some differences between the 3 that…