To change cache values in VLC Media Player, go to the preferences or settings menu, navigate to the Input/Codecs section, and adjust the file caching value to a higher number. This can help improve playback and potentially resolve issues in the MP4 video.