Yes, and most likely sooner than if you used your Air-Con daily.
Air conditioning refrigerant gas does not get "used up" when the air conditioning system is turned on. The system loses gas naturally through the porous rubber hoses and the system connections / joints.
In fact, by not using the system, the lubricating oil is not being pumped around the system, which will cause the hoses and connections to dry out, which will increase the rate of gas lose, especially if they dry out enough to crack and break.