No, if you are inactive for a long time then blogger can't do anything to your domain if you are using Blogspot as well.