Yes, you do need to sand hardwood floors between both coats of water-based polyurethane. Use 320 or 400 grit sandpaper and lightly rub at the surface of the wood. Then make sure you clear away the sawdust before applying the second coat.
Water-based stains can lift the woodgrain slightly, so it needs to be sanded back smooth, or it will look unsightly.