updated formatter to add deduplication
updated meta and gateway scripts