Get rid of all the unnecessary mutable hashmaps. The type of map isn't
important yet.