Yes. You could build — and maintain — muscle without consuming whey protein or other protein supplements. You need to be consuming 0.8 to 1 gram of protein per pound of body weight through whole foods to build muscle mass.