Kayak is a library for automatic differentiation with applications to deep neural networks.