A walk does not hurt your batting average. Since a walk does not count as an out or a hit, it bears no effect on one's batting average. Your batting average will neither go up nor down following a walk; it only stays the same.