Woohoo! I fixed the rectangle. They required an offset from y. Probably because of the file bar and the fact that the mouselistener is in the game frame, not just the board panel.
Merge branch 'master' of https://github.com/mpatt3970/Clue