Yes, it is possible to lose a life estate in GA. Under GA code (law) section 44-6-83, you only keep the life estate so long as you exercise the ordinary care of a prudent person in taking care of his/her own property--e.g. maintenance, paying necessary bills, etc. If you fail to take such care, the "remainderman"--the person who gets the house after you--can take it over from you. If your brother was the remainder man and you did not live in the home for a year--so left it empty, and so were not in a position to check on it or maintain it properly--that could constitute grounds for you to lose your life estate. If you disagree, you can bring a legal action challenging the lose of your life estate, and prove that you were taking care of the property.