Clean up temporary profile.yaml on each test