Of course not! To do so, you must have a strong valid reason to take such a drastic step. It doesn't matter whether you are the custodial parent or not unless the court also supports your decision.