No, it won't ruin it but it will make the ladyfingers a bit soggy. The key is to lightly soak the ladyfingers ensuring you don't completely soak them. The best way to ensure you don't over soak them is to drizzle on the coffee with a large spoon.