Sadly you cannot neglect it. Because these headquarters act as your strong bases, you cannot build up your Army and defend them from enemies without them.