Okay well first you need to make sure that he can not come near the house or your granddaughter.  See if the law in your state would allow for a restraining order or order of protection. Next, you are going to have to have papers prepared and serve him with them.  I am assuming that he will not contest the matter.  Once he is served he either answers the petition or not and if he does not then you ask for a default divorce.  You have not said if there are assets that are jointly held that have to be distributed.  That could take time.  Good luck.