There was some code in @pascanur 's code to do what you are talking about, but the amount of transfers that were needed on the GPU to make it work completely negated any advantage Gemm would buy.  I still have the original code (that uses Gemm) and timings indicate that it's a tiny bit faster my way.