As long as your profile is set to private, people who view your profile must send you a follower request. You can accept or reject the request. Tap on ‘Delete’ and that request will be rejected.