There is no one definitive answer to this question. Some players have had success by attacking the castle early and often, while others have been more successful by waiting until they have a stronger army. The best approach may vary depending on the individual player's strengths and weaknesses.