Harvard AM205 video 0.4 - Finite-precision arithmetic
Channel: Chris Rycroft
Date: 2020-09-10

Harvard Applied Math 205 is a graduate-level course on scientific computing and numerical methods. This video introduces the finite-precision arithmetic systems that are used on modern computer hardware. It discusses the typical rounding errors that we expect to get when performing numerical calculations.

For more information see the main course website at https://people.math.wisc.edu/~chr/am205