Yes, you definitely can! We use the whole stem for this lemongrass recipe, but you can freeze the remaining parts whenever you ever only need a small portion and use them for other recipes later.