The family is spending time together