You can remove voice match permission later by turning it off in assistant settings or family link