Figured out the problem with loading images using opencv.  Have to rescale and change color order
Made a test that would run things from file.