Consider the reputation of the company and its staff: you deserve to see clients' reviews of their services. Check the agency's portfolio and check out other advertisers' ads. You don't have to look for a Facebook ad agency with a long history; 2 or 3 years is good enough. But remember, a good agency is only as good as its staff: look for specialists who have experience with Facebook ads management.