HGX-2 Benchmarks for Deep Learning in TensorFlow: A 16x V100 SXM3 NVSwitch GPU Server
Exxact HGX-2 TensorEX Server Smashes Deep Learning Benchmarks For this post, we show deep learning benchmarks for TensorFlow on an Exxact TensorEX HGX-2 Server. This behemoth of a Deep Learning…
Megatron Unleashed: NVIDIA’s NLP Model “Megatraon-LM” is the Largest Transformer Ever Trained
Megatron-LM: Entering the Frontiers of NLP If you’ve followed the latest advancements in Natural Language Processing (NLP), you’ll know that Transformer Models are all the latest craze. These language models…
A Summary of DeepMind’s Protein Folding Upset at CASP13
At last year’s Critical Assessment of protein Structure Prediction competition (CASP13), researchers from DeepMind made headlines by taking the top position in the free modeling category by a considerable margin,…
Examining the Transformer Architecture – Part 2: A Brief Description of How Transformers Work
This post was written by Nityesh Agarwal in collaboration with and sponsorship of Exxact (@Exxactcorp). As we learned in Part 1, The GPT-2 is based on the Transformer, which is being…
What You Missed: Exxact at GTC 2019
Major Annoucement Announced during the GTC keynote by NVIDIA co-founder, Jensen Huang, Exxact will be offering workstations optimized for data-science, along with being one of the partners. What We Showcased…