MP4 is short for MPEG-4 Part 14, which is a multimedia container used to store audio and video, plus images and subtitles. When you strip away the video from an MP4 file, you can be left with just the audio file, which is usually then an MP3 file for listening only.