Your existing lawyer cannot legally refuse to hand over your case. However, if they do so, then you should contact your state bar association and let them know of the situation.