Stamp duty is a state government tax on property purchase.  The amount of stamp duty you have to pay varies from state to state, but it always has to be paid upfront.  It can be taken out of your deposit, but bear in mind that reducing the deposit you have will mean you need to borrow more, and therefore pay more interest.