Position: Big Data Engineer
Company: GreenM
Category: Data Science
Experience required: 3y
English level: intermediate
Published: 2021-08-01T00:00:00+03:00

Required skills

Proficient understanding of distributed computing principles
Good understanding of traditional and modern Data Warehouse concept (Data Lake, DWH, Data Mart, Operational Data Storage)
Experience with Apache Spark
Ability to solve any ongoing issues with operating the Big Data clusters
Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
Experience with integration of data from multiple data sources
Knowledge of various workflow management tools such as Apache Airflow
Good understanding of Lambda Architecture, along with its advantages and drawbacks
Have good presentation and communication skills, ability to work in multiple cultures and mixed teams
B1 and upper written and spoken English


As a plus

Experience with Cloudera/MapR/Hortonworks
Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
Experience with various messaging systems, such as Kafka or RabbitMQ

We offer

Competitive salary depending on experience and skills
Flexible working hours
Partial remote work is acceptable
Office in the heart of Kharkiv downtown
Team building events
20 days of vacation, follow UA holidays
Company compensates English courses, books, participation in conferences local and abroad

Responsibilities

Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
Implementing ETL process
Monitoring performance and advising any necessary infrastructure changes
Defining data retention policies