Position: Data Engineer
Company: EX.CO
Experience required: 5y
Category: Data Engineer
English level: fluent
Published: 2023-06-01T00:00:00+03:00

**Your Story**
As a Data Engineer at EX.CO you will be a key factor in developing our data solution. You’ll need to come up with solutions to complex problems that should maintain performance in scale. You'll be responsible for driving exciting innovations around data and AI that will help the company grow faster and wiser.

You’ll work closely with devs, analysts, and business stakeholders to automatically generate predictive models that utilize our collected data and empower our system to make decisions in real time.

As part of the job, you will be a focal point for all things related to data, which includes creating a tech roadmap for pipe-lines performance, data architecture, managing storage, assessing performance and budget limitations, and much more.

 

**Long story short, you will**
Taking full ownership of designing, implementing, deploying and maintaining existing and new data pipelines by using cloud based tools in a cloud based infrastructure.
Work with different stakeholders to design and develop system features.
Owning EX.CO's data solution consumes and processes billions of events every day
Build, test, and deploy new DAGs by using the latest data stack on top of AWS & GCP.
Implementing DAGs to generate new business value out of the collected data while analyzing performance, correctness and value.
Build dashboards and reports to internal users, for self service data analysis 
Hands-on work on our core data infrastructure, tools and automation.
Take part in POCs and innovation for new technologies, databases, tools and services that can significantly push the division goals.




**And will be awesome if you have**
5 years experience taking business requirements and translating them to working data solutions (system analysis,pipelines ,dashboarding)



5 years experience in ETL / data orchestration tools (advantage: Apache Airflow)
5 years experience working with different DBs: relational (MySQL, PostgreSQL, Oracle, etc.), Columnar (BigQuery, Snowflake, Redshift, etc.) NoSQL (MongoDB, DynamoDB, Redis, etc.)
strong SQL skills (performance tuning, analytical functions, etc.)
2 years experience in Python programming
2 years experience with data visualization and dashboarding tools (Tableau, Power BI, etc.) 
1 year experience working with version control systems like Git 
Experience with data integration and data warehousing concepts
Strong problem-solving and troubleshooting skills, with the ability to identify and resolve data-related issues
Understanding of data governance, data quality, and data security best practices


**Advantages**
Experience with data streaming and near real-time data processing
Knowledge of big data technologies (ex. AWS Kinesis, Athena, Apache Hadoop, Spark, Kafka)
Java/Scala
Familiarity with cloud platforms like Amazon Web Services (AWS), Google Cloud Platform (GCP)
Familiarity with machine learning concepts and frameworks for data analysis and predictive modeling
Knowledge of data privacy regulations and compliance standards (e.g., GDPR)