There are a couple things that could have gone wrong. First, make sure your milk you combine your yeast with was warm enough. Your yeast should form bubbles when it's activated. Second, make sure you are kneading your dough well. Third, make sure your kitchen is not cold when you are doing the rise. Do not skip the second rise.