framework for agent to explore grid