This doesn't sound like a shared custody arrangement. If he is simply seeing her on a whim, then you need to take him back to court to amend the order.  Further, your ex in laws should have no reason or cause to hold onto your child's passport. You need to demand it back immediately and if they refuse, you need to get the police involved. Period. Bring this up in court, as well.