sam left the show early during season four