Position: ETL/SQL Developer
Company: deventor.io
Experience required: 3y
Category: SQL
English level: upper
Published: 2021-08-01T00:00:00+03:00

The Customer collects container tracking data from multiple sources including Project 44, Inttra and ocean carrier EDI/APIs. To capture additional tracking information not provided directly, The Customer employs web scraping technology to scan carrier websites for the latest container events. The team has developed scrapers that run in Azure on a scheduler to check the latest status for containers that have been flagged for this additional level of tracking.

**What is the Customer looking for?**

A provider or resources that can manage and maintain the scraping process and transmit back the results. The Customer would also like to standardize the data coming back into a single format. Today each carrier scrape result is returned into a different JSON format. The Customer is currently collecting events from 14 different carrier websites

**Responsibilities:**

● Develop and implement ETL solutions, updating the architecture of our databases as necessary
● Develop or update SQL queries and scripts
● Work with business stakeholders to assist with data modeling, or outlining the data requirements to support our business processes
● Develop source-to-target mapping, or data transformation instructions that outline how to convert data in the source system to the target system as well as map the data values
● Test databases and troubleshoot any issues

**Requirements:**

● Bachelor’s degree in computer science (or equivalent experience)
● Experience with SQL/relational databases
● Experience working with DBMS and ETL tools
● Familiarity with Agile approaches to development a plus
● Problem-solving and analytical skills