If you delete a song, then that particular song will be deleted from your library. If you remove an album or playlist, then all of the songs in that album or playlist will be removed.