Bus tours leave from the Jardine des Tuileries on the rue de Rivoli side but you may prefer to do things in your own time.
There are some bus tours that depart from Jardine des Tuileries.