You can! It is however, a good idea to use olives with pits inside. This is because they'll hold their shape and structure better even when they're marinated and refrigerated for weeks.