As we had spoken at the planing of the last sprint, in the .openshift/ folder there should be only openshift specific stuff, which I don't think cpanfile and Makefile.PL are. I would consider possibility that user could place them in the root of the application, where those deps. files actually were, when I was looking at some Perl project on github.
Also I don't know if this is the right way to name those two variables, would rename them to CPANFILE and MAKEFILE just for consistency.