It is possible to have milk teeth when permanent are missing during adulthood. These teeth stay for few years and slowly shed. As these are already loose and doctor has advised you fixed replacement, it may be right to get these extracted and get bridges done at the place. If you do not like preparation of healthy teeth for bridgework, explore the option of getting implants if conditions permit. Get yourself examined for it by doctor who is doing it.