The potential challenges of having virtual assistants handle phone calls include the need for 100% execution and knowledge of the product. Additionally, the public may have little patience for incompetence, so it is important to consider your audience and the types of accents that may be present in the calls.