If you do not require offline access anymore or want to free up space on your device, go to the album or playlist you wish to remove from downloads and toggle the Downloaded button to off (Android) or tap the green, downward-facing arrow on the top left and hit Remove in the pop-up window (iOS).