Position: Cloud Data Engineer
Company: Amach Software
Experience required: 2y
Category: Data Engineer
English level: intermediate
Published: 2022-01-01T00:00:00+02:00

The customer operates a data store which is extracted from an external supplier system. The data is hosted in AWS and consists of a set of relational tables stored in Parquet format in S3 and queried with Apache Spark SQL and Amazon Athena. The customer transforms this data store via custom SQL queries developed by the existing Amach Software team to create several daily and weekly feeds to external systems.

In 2022, the customer will be migrating feeds currently delivered directly from the external supplier system to feeds delivered from their copy of this data in AWS. This will require writing moderately complex SQL queries in order to transform this data. The existing Amach Team is composed of DevOps Engineers and would benefit from an engineer who specializes in Data and SQL.

Must Haves:

Good working knowledge of SQL
Experience working with AWS data technologies (e.g., Hive, Athena, Spark)
Good level of communication (both written and spoken) in English.

Duties will include, but not limited to:

Advising on database technologies in AWS
Exploring and understanding relational data, to advise on what is possible
Translating business requirements for data into code
Writing or assisting others to write complicated SQL queries joining multiple tables
Participating in an all-remote Agile team

Skills & Experience:

Desirable experience:
Have worked on databases / data lakes based in AWS
Reverse-engineering external data models
Familiarity with ingesting data as JSON and outputting CSV
Knowledge of Python or another programming language
Desirable certifications:
AWS Certified Data Analytics – Specialty (DAS-C01)
AWS Certified Database – Specialty (DBS-C01)

We offer:

An opportunity to join a fast-growing company
Options for career advancement
Learning and development opportunities
Flexible working environment
Competitive rate based on experience