As a DM myself, it's important to talk this out with your players and set the boundaries together. Some players aren't comfortable with another player manipulating their character like this, and some players are perfectly fine with it. As the DM, you have the final say, but I urge you to sit down with your group or text them to figure out the boundary together.