Remove minitest-display

It doesn't get enough updates to keep up with minitest.
Remove unused variable
Remove the need for memoized methods by simply using instance vars