Fix bug where we can click outside the bounds of the focus object.