Okay. Just for future reference then: doing the one-hot formatting on the GPU gives a speedup of 13% (bartvm/pylearn2@f6f2e03934). If I don't do any conversion to one-hot formatting at all, but use indexing to pick only the target outputs I get a speedup of only 1% more (so 14%, bartvm/pylearn2@1e9462dd22).