Position: Big Data Software Engineer
Company: DataArt
Experience required: 3y
Category: SQL
English level: intermediate
Published: 2021-01-01T00:00:00+02:00

The Big Data specialist will work on building a system for creating complex queries into a structured data warehouse system for the operations of quantum traders.

The specialist we are looking for will join the distributed team of 30-people working from Ukraine, Russia, Poland, and the USA. The whole DataArt team consists of several streams dedicated to different projects. Each project team is under the leadership of a technical lead.

Responsibilities

Developing a cloud data analytics platform using AWS and Apache Spark (Databricks)
Developing Apache Spark applications aimed at processing financial data

Must have

Basic theoretical knowledge of Big Data and related technologies: RDBMS, NoSQL, Consistency (ACID, BASE), OLAP and OLTP, massive parallel processing, data warehousing.
Intermediate level in Python.
Intermediate level in data platforms (RDBMS). Understanding of relational models and basic database concepts and components. Proven experience with at least one relational database.
Novice level in Big Data Platforms (Apache Spark).

Would be a plus

	
Scala programming language
Experience with AWS (S3, EMR, Athena)
Experience with Databricks