A stained-glass window featuring stone tablets has been removed from above the entrance.