You may have undercooked your toffee. Make sure you cook your toffee until it registers at least 295 F once they are at the hard crack stage. If you don’t cook your toffee enough it will never harden and it will make your crackers soggy.