eBook: Getting Started With Deep Learning
We’ve put together the definitive eBook for deep learning to get you started today. Deep Learning is everywhere, if your company hasn’t started considering using deep learning, you may be…
HGX-2 Benchmarks for Deep Learning in TensorFlow: A 16x V100 SXM3 NVSwitch GPU Server
Exxact HGX-2 TensorEX Server Smashes Deep Learning Benchmarks For this post, we show deep learning benchmarks for TensorFlow on an Exxact TensorEX HGX-2 Server. This behemoth of a Deep Learning…
Megatron Unleashed: NVIDIA’s NLP Model “Megatron-LM” is the Largest Transformer Ever Trained
Megatron-LM: Entering the Frontiers of NLP If you’ve followed the latest advancements in Natural Language Processing (NLP), you’ll know that Transformer Models are all the latest craze. These language models…
A Summary of DeepMind’s Protein Folding Upset at CASP13
At last year’s Critical Assessment of protein Structure Prediction competition (CASP13), researchers from DeepMind made headlines by taking the top position in the free modeling category by a considerable margin,…
Examining the Transformer Architecture – Part 2: A Brief Description of How Transformers Work
This post was written by Nityesh Agarwal in collaboration with and sponsorship of Exxact (@Exxactcorp). As we learned in Part 1, The GPT-2 is based on the Transformer, which is being…