Follow your nose for about five minutes until you see a sign saying Kuledibi on the left, which points the way to the tower.
The tower is directed to by as sign on which Kuledibi is written.