Yes, it's perfectly safe to eat the stem. However, it's best to remove it when cooking since it's often tough and tastes bitter.