Yes — you can appeal to the Board of Immigration Appeals (BIA). This is an appeal within the Departments of Justice and carries with it an automatic stay of removal. Appeals after that are to federal court, either in the court of appeals or in the district court, depending upon the kind of case. A stay of removal in these cases is not automatic and must be applied for with the court.