Data wrangling  - importing 300+ datasets a quarter
Channel: Coffee Conspiracies
Date: 2019-09-26

Sqwyre is a business intelligence service helping you assess opportunities and risks for every commercial property in England and Wales. 

Every quarter we update the occupier history for just about every business premise in our database so that you can see what the business environment is like in any area you may be running a business in, or interested in starting one.

There are 348 local authorities responsible for collecting business rates, and they publish that data in every way you can imagine and a whole bunch it's best not to think about.

Every quarter, we need to restructure these spreadsheets into a single, standardised format, so we can import it into our database. 
This is how we do it.

For the wrangling user-guide: https://docs.google.com/document/d/1OY_IoV81zmdNLXJteLIn4MeUILpptIcS13AILk_gsa0/edit
Visit Sqwyre.com - https://sqwyre.com