Begin by establishing the dimensions of the castle, be sure it is large enough to accommodate all of the castle inhabitants, including the serfs, in case of a siege.
Draw an outline of the main castle and of all the outbuildings that you will need.