Improve documentation and add end-to-end test at Spark-level