There's a invisible timer to rescue Halsin and end the druidic ritual. It's supposed to be tied to long rests. I remember to have read that more than ten long rests before taking care of the goblins makes the grove inaccessible.