Yes, it is illegal to walk around construction sites without permission. Unauthorized entry can lead to fines and legal action.