Examining the Transformer Architecture – Part 3: Training a Transformer Model from Scratch in Docker
In part two of our series, “A Brief Description of How Transformers Work“, we explained the technology behind the now infamous GPT-2 at a high level. For our third and final…
New TensorFlow Release v1.14.0
Here is an overview of TensorFlow’s latest release 1.14.0. Major Features and Improvements This is the first 1.x release containing the compat.v2 module. This module is required to allow libraries…
A Summary of DeepMind’s Protein Folding Upset at CASP13
At last year’s Critical Assessment of protein Structure Prediction competition (CASP13), researchers from DeepMind made headlines by taking the top position in the free modeling category by a considerable margin,…
Examining the Transformer Architecture – Part 2: A Brief Description of How Transformers Work
This post was written by Nityesh Agarwal in collaboration with and sponsorship of Exxact (@Exxactcorp). As we learned in Part 1, The GPT-2 is based on the Transformer, which is being…
TITAN RTX Benchmarks for Deep Learning in TensorFlow 2019: XLA, FP16, FP32, & NVLink
For this blog article, we conducted deep learning performance benchmarks for TensorFlow using NVIDIA TITAN RTX GPUs. Tests were conducted using an Exxact TITAN Workstation outfitted with 2x TITAN RTXs with an…