If on appeal, it is determined that you were not entitled to the benefits (for example, that you had quit or resigned--a voluntary separation from work--or that you had been fired for cause), then yes, it is likely you will have to repay all unemployment benefits which you received. If they appeal and win, you could potentially appeal their appeal, even bringing the matter to court via a lawsuit, if necessary.