Light is odd in some ways. You have experienced the same thing, roller blading over a smoother surface with one skate, while the other skate is still on a rough path. Light bends in a similar way both when it enters and leaves the raindrop. Light enters the drop at the top and bends as it enters the water. But there's something else going on.
Some colors slow down more than others and so they bend more than the others.
Violet light, for example, goes slower than red. That's what separates the violet and red colors from the white light. The red and violet rays continue until they reach the other side of the drop. Here some rays bounce back and travel toward the lower part of the drop where they bend again as they leave the drop and enter the air. The red light emerges at a 42-degree angle to the original white ray.