You may take actions that result in negative popularity (although your tracker can't drop below zero), but you may not take any actions that "cost" popularity. In your example, yes, you may attack a hex with a worker on it because the drop in popularity is a result of your action. Your popularity would remain at zero.