Removing pem files from app root