No, it is unlikely that mice will ever leave on their own. If you have mice living in your walls, you will either have to tackle the problem with mouse traps or call in a professional extermination service.