The death toll due to heavy rains accompanied by stormy winds in Sri Lanka's southern coastal areas rose to 20.