No, he didn't. He was wary of him, but he didn't fear him. A commonality between the people who Walt goes up against is that they all underestimate just how far Walt is willing to go in order to achieve his goals, and that underestimation ends up costing them big time.