Yes, you can overnight in Alexandria, but we do not recommend to do that as hotels in the city are not well equipped and maintained as a rule.