One of the most effective ways to kill a zombie is with a knife. Simply find one and start stabbing.