Fix/cleaning s3 input

Cleaning the S3 input a little took the work from @danielRedoak as a starting point, added a few tests around the new list_new logic.