Position: Senior Big Data Engineer
Company: Binariks
Experience required: 3y
Category: Data Engineer
English level: upper
Published: 2022-09-01T00:00:00+03:00

Binariks is looking for a highly motivated and skilled Senior Big Data Engineer for the Open-source project.

The client is an organization that works in the areas of open source. They are solving challenging technology problems with their worldwide open source community.

One of the products they build is to use internally within the organizations(not open source) - it is a platform that tracks the engagement that is happening across the open source world. i.e. you contributed to some open-source projects that our client's hosts, and it starts to show on this platform. It is already in production.
From Binariks side we have the Solution Architect, who works closely with the CTO, development team on Binariks side will be 2 backend developers (Node.js, Go) and Big Data Engineer


**Responsibilities:**

- Design, Develop, Deploy and Maintain solutions in Big Data technologies (Hadoop, AWS, Hive, Databricks, Spark (Scala/Python), and other open-source technologies) in 3 main areas including:
- Data ingestion pipelines from diverse sources, large-scale structured and unstructured data
- Transmission between systems (API based) of Data — organizing data being captured and organized within our systems.
- Modifying existing/add new functionalities to ETL
- Troubleshooting email delivery of reports
- Actively improve the existing processes to make the structure more efficient and informative/functional

**Requirements:**

- 4+ years in enterprise Big Data projects
- Data mapping to normalize data structure
- Creating data documentation including entity-relationship and data flow diagrams
- Performance optimization for distributed data processing jobs, excellent querying skills, and Spark SQL knowledge
- AWS services: S3, Redshift, DynamoDB, Kinesis, Athena, AWS Glue
- Designed pipelines in Airflow and developed the notebooks according to Databricks architecture
- Experience in working remotely across time zones.

**We provide the following for our employees:**

- 18 working days of paid vacation
- 10 working days of sick leave annually (5 days paid at 100% and 5 days at 75% rate of your average monthly salary)
- Medical insurance
- 50% cost compensation for English courses at the office
- Flexible work schedule
- Additional days off for special occasions, national holidays off
- A competitive and rewarding salary based on performance appraisals/knowledge evaluation
- Possibility to share and gain knowledge on regular tech talks
- Friendly and professional team
- Innovative projects with advanced technologies
- Corporate events
- Remote work
- Accounting service