Yes, most state unemployment agencies maintain records of your Unemployment Pay Stubs for a certain number of years. You can typically access these records through your online account or by contacting the agency.