I think there is an example which does something similar too (http://matplotlib.org/examples/pylab_examples/marker_path.html).