[1.5.x] Fixed the reusable apps docs to use a rst file extension for the README and follow PEP8 a bit more.

Backport of 949b4e94588e73067f64b5b6d22e569a105baaf7 from master.