You can delete a song by first selecting it, then tapping and holding on it until an X appears next to it, and finally dragging it up onto the Trash Can icon that is located at the top of your screen. Alternately, if you have multiple songs selected, you can tap the Delete button in the bottom-right corner of your screen and then drag the songs up onto the icon that looks like a trash can in the upper-right corner of your screen.