Position: Data Developer, Information Technology Services
Company: DataArt
Experience required: 3y
Category: SQL
English level: intermediate
Published: 2021-11-01T00:00:00+02:00

This Europe-based client is one of the world's most established stock exchanges. This is a new project that just started last month and will last several years. We have several teams with about 100 people total operating from the EU with no overtime work expected. The work is split up into small parts based on priority; after a part is released, the team moves on to the next one.

Our scope of engagement includes modern approach to SOA, including AWS and Microservices stack, data warehousing, modern APIs, frontend development and other areas.

We are using Scrum and scaled Agile framework for the project. Program management, Solution Architects, and Business Analysts are involved on the DataArt side.

DataArt’s specialists focus on data streaming and sourcing solutions to ensure data processing necessary for trading operations. The team is preparing to roll out a portal with embedded widgets.

DataArt is also engaged in transforming business processes and migrating from on-premise hosting to Cloud by re-platforming the entire system and using Cloud native technologies. Part of the work includes the integration of systems and data related to a new asset class into the customer's existing IT landscape.

Technology stack & infrastructure: basics: Java 1.7-1.8, Maven, Spring Boot/Security/Data/etc Git (BitBucket); database part: Snowflake, AWS, Matillion, Python; UI: Angular 2+, JSP; AWS: Anthos/Kubernetes. Snowflake, Matillion, S3, Lambda

Responsibilities
- Design and support various ETL processes for the corporate DWH
- Upgrade the existing ETL process and tune its performance
- Assist with the deployment and maintain recently introduced functionalities
- Collaborate with the QA team on bug fixing
- Perform task estimation

Must have
- 3+ years of experience with DWH
- Excellent knowledge of SQL and PL/SQL
- SQL Queries optimization experience
- Ability to work with dataflows with heterogeneous data sources
- Working experience with ETL/ELT tools or custom pipelines
- In-depth understanding of data warehouse + data modelling principles
- Good spoken English

Would be a plus
- Experience with AWS
- Knowledge of Snowflake, or willingness to learn it and work with it
- Knowledge of Bash scripts
- Experience with Matillion, or willingness to learn it and work with
- Ability to reverse engineer complex systems.
- Ability to work with documentation and versioning tools such as Git