Yes! Deleting the Apple Music app frees up memory from your device by deleting all the downloaded songs.