Yes, you can! If you'd like your pillow to be simply soft, all you need to do is remove the Memory foam insert and zip it back.