AI Datacenters - Seven Lessons Learned - 02 - Outline
Channel: Greg Diamos
Date: 2019-10-21

A quick summary of the seven lessons.

1. Use AI Accelerators
2. Speed vs accuracy is a fundamental tradeoff
3. We need more memory
4. Train in mixed precision
5. How much IO does training need?
6. Reusable infrastructure
7. General NLP is compute limited