Check if chunk is loaded before modifying sign

We don't want to cause unnecessary load