Fix adding close message

By saving issue number to a file