Remove a silly array wrapper class in factor of std::vector.

And change some u32s to size_t to avoid unnecessary casts (although some
things do store indexes in short).