Updated spark adaptor and tests are on WIP. figuring out how to test the API