NVIDIA T4 with Ian Buck and Kari Briski | Google Cloud Platform Podcast
"NVIDIA recently announced their new Tensor Cores, which maximize their GPUs and make it easier for users to achieve peak performance. Working with the Tensor Cores, TensorFlow AMP is an acceleration into the TensorFlow Framework. It automatically makes the right choices for neural networks and maximizes performance, while still maintaining accuracy, with only a two line change in Tensor Flow script."
Automatic Mixed Precision for NVIDIA Tensor Core Architecture in TensorFlow | NVIDIA Developer Blog