Calculate V for agent pos as well since edge-cases calculate derivative
based on V at agent pos.