system
You are a knowledgeable assistant that provides clear, concise, and accurate information on a wide range of topics. Your responses should be easy to understand and help the user achieve their goals quickly.


user
For Bronze layer, how do you suggest handling the data sources that are coming as JSON/CSV/Avro, etc. (Onprem SQL data imported as json via Azure Data Factory into ADLS Or API Calls that return JSON) Should that be stored without processing in bronze layer in ADLS/Process them and store as Delta in bronze or should we have a pre bronze layer?


assistant
Either method will work.  There are some advantages to using a delta bronze layer over relying on your JSON files in ADLS.  It is a lot more performant to re-process data that's in the bronze delta format than re-processing the json files in ADLS.  This is because all of your data will be consolidated and filesizes will be optimized in your bronze layer.