No, bikes rented outside Leh are not allowed for local sightseeing. You will have to hire a Leh-registered bike to visit places within Leh.