Examining the Transformer Architecture – Part 2: A Brief Description of How Transformers Work
This post was written by Nityesh Agarwal in collaboration with and sponsorship of Exxact (@Exxactcorp). As we learned in Part 1, The GPT-2 is based on the Transformer, which is being…
TITAN RTX Benchmarks for Deep Learning in TensorFlow 2019: XLA, FP16, FP32, & NVLink
For this blog article, we conducted deep learning performance benchmarks for TensorFlow using NVIDIA TITAN RTX GPUs. Tests were conducted using an Exxact TITAN Workstation outfitted with 2x TITAN RTXs with an…
Examining the Transformer Architecture – Part 1: The OpenAI GPT 2 Controversy
This post was written by Nityesh Agarwal in collaboration with and sponsorship of Exxact (@Exxactcorp). “Recycling is NOT good for the world. It is bad for the environment, it is bad…
NVIDIA RTX 2080 Ti Benchmarks for Deep Learning with TensorFlow: Updated with XLA & FP16
For this blog article, we conducted more extensive deep learning performance benchmarks for TensorFlow on NVIDIA GeForce RTX 2080 Ti GPUs. We recently discovered that the XLA library (Accelerated Linear…
Deep Learning vs. Machine Learning vs. Data Science: How Do They Differ?
What are they? And how do they differ? In recent years, machine learning has become part of our everyday life. Together with deep learning and the field of data science,…