You can, and some people can successfully wear their eyeshadows that way with no issues. For most people, though, a primer helps keep the shadow in place all day. If you’re wearing a heavily pigmented eyeshadow, putting an eyeshadow primer down as a barrier will protect you from staining your lids.