If player inventory is not open then we can allow him to interact with blocks