resampler: Introduce a implementation specific struct

This struct holds all the implementation specific data in one place.