For small stains using a mixture of baking powder and lemon juice is very effective in removing rust stains. Moreover, they are easily available inside your house.