On Sunday night 4 March 1804, the convicts rose up as one in what was to become known as the Castle Hill convict rebellion, leading to "The Second Battle of Vinegar Hill". Overpowering their guards, they marched towards Parramatta,