[16] Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., and Hochreiter, S. Gans trained by a two time-scale update rule converge to a local nash equilibrium. In Guyon, I., Luxburg, U. V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (eds.), Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc., 2017. URL https://proceedings.neurips.cc/paper_files/paper/2017/file/8a1d694707eb0fefe65871369074926d-Paper.pdf.
[17] Ho, J., Jain, A., and Abbeel, P. Denoising diffusion probabilistic models. In Advances in Neural Information Processing Systems, 2020.
[18] Ho, J., Jain, A., and Abbeel, P. Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems, 33:6840-6851, 2020.
[19] Hockney, R. W. A fast direct solution of Poisson's equation using Fourier analysis. J. ACM, 12(1):95-113, jan 1965. ISSN 0004-5411. doi: 10.1145/321250.321259. URL https://doi.org/10.1145/321250.321259.
[20] Horton, M., Jin, Y., Farhadi, A., and Rastegari, M. Layer-wise data-free CNN compression. 2022. URL https://arxiv.org/pdf/2011.09058.pdf.
[21] Huang, X. and Belongie, S. Arbitrary style transfer in real-time with adaptive instance normalization. In Proceedings of the IEEE international conference on computer vision, pp. 1501-1510, 2017.
[22] Jouppi, N. P., Kurian, G., Li, S., Ma, P., Nagarajan, R., Nai, L., Patil, N., Subramanian, S., Swing, A., Towles, B., et al. Tpu v4: An optically reconfigurable supercomputer for machine learning with hardware support for embeddings. arXiv preprint arXiv:2304.01433, 2023.
[23] Kenyon, C. and Capano, C. Apple silicon performance in scientific computing. In 2022 IEEE High Performance Extreme Computing Conference (HPEC), pp. 1-10. IEEE, 2022.
[24] Kirby, A., Samsi, S., Jones, M., Reuther, A., Kepner, J., and Gadepally, V. Layer-parallel training with GPU concurrency of deep residual neural networks via nonlinear multigrid. In 2020 IEEE High Performance Extreme Computing Conference (HPEC), pp. 1-7, 2020. doi: 10.1109/HPEC43674.2020.9286180.
[25] Krizhevsky, A. Learning multiple layers of features from tiny images. Technical report, University of Toronto, 2009.
[26] Krizhevsky, A., Sutskever, I., and Hinton, G. E. Imagenet classification with deep convolutional neural networks. Communications of the ACM, 60(6):84-90, 2017.
[27] Lee, N., Ajanthan, T., and Torr, P. H. S. SNIP: single-shot network pruning based on connection sensitivity. In International Conference on Learning Representations, 2019.
[28] Li, H., Kadav, A., Durdanovic, I., Samet, H., and Graf, H. P. Pruning filters for efficient ConvNets. In International Conference on Learning Representations, 2017.
[29] Liu, Z., Luo, P., Wang, X., and Tang, X. Deep learning face attributes in the wild. In ICCV, pp. 3730-3738. IEEE Computer Society, 2015.
[30] Long, J., Shelhamer, E., and Darrell, T. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3431-3440, 2015.
[31] Massaroli, S., Poli, M., Sonoda, S., Suzuki, T., Park, J., Yamashita, A., and Asama, H. Differentiable multiple shooting layers. ArXiv, abs/2106.03885, 2021.
[32] Moon, E. and Cyr, E. C. Parallel training of GRU networks with a multi-grid solver for long sequences. In International Conference on Learning Representations, 2022. URL https://openreview.net/forum?id=N1WI0vJLER.
[33] Naumov, M. Parallel complexity of forward and backward propagation. CoRR, abs/1712.06577, 2017. URL http://arxiv.org/abs/1712.06577.