However , New Year 's Day was already a public holiday , and Commonwealth Day did not gather much support .
Australia Day is a public holiday held each year in Australia .