Remove the now ignored directory "reference"