Embarrassingly only just found out how to properly get the source object from the event object by casting.  Oops.  No longer have to pass the CellPanel to the mouse listener.