In the grand old lighthouse (and second prison), the Tour de la Lanterne, you will find prisoners' graffiti on the walls as you climb up to the balcony for a view over the city and the bay.
There is prisoners' graffiti all along the walls of the Tour de la Lanterne, an old lighthouse in the city.