After looking at the data more, I think we definitely need some of the special table values they have.  For example -- median income, median mortgage payment, etc. are all values that we cannot calculate from the underlying data.

But these data points don't really fit into the tables as well, so maybe we do need an aggregates table?  Rows would be the fields "median income", "median mortgage", etc.