Yes, a 12V inverter will still draw power from the battery even when it's not in use. To prevent unnecessary battery drain, it's recommended to turn off the inverter when it's not needed.  When on, even with no load, it may draw current as low as 0.3A for a 200W inverter, or as large as 2-3A for a 2000W inverter.