Position: Data Engineer
Company: SoftTeco
Category: Data Science
Experience required: 3y
English level: intermediate
Published: 2021-06-01T00:00:00+03:00

These solutions are designed to scale with the increasing size of various crypto assets available for trading. As the number of coins continues to grow, so will ability to filter the noise of market activity and provide valuable data on all developments.

**Responsibilities and Duties:**
- Taking part in end-to-end big data infrastructure development for new and existing projects;
- Building ETL solutions with the ability to apply ETL concepts broadly across multiple technologies;
- Developing streaming and batch data intensive applications;
- Building and maintaining data warehouse solutions;
- Working with DevOps engineers to design, implement and maintain cloud architectures;
- Working with Analysts and Business stakeholders to translate data specifications into technical designs for implementation and deployment.

**Qualifications:**
- BSc/MSc in Computer Sciences, or equivalent;
- English level: Upper Intermediate / Upper Intermediate+;
- 4+ years of software development (preferably in Python/Java);
- Very good understanding of data modeling, ETL processes, BI practices and concepts, building and designing data warehouse;
- Hands-on experience in building production services end-to-end - including architecture design, research, development, testing, deployment and monitoring;
- Good knowledge of cloud solutions (primarily based on AWS and GCP), incl. serverless applications;
- Experience with streaming and messaging platforms (Apache Kafka, Cloud Pub/Sub);
- RDBMS and NoSQL databases (PostgreSQL/MySQL, S3, Cloud Storage, Redis, HBase, ClickHouse, BigQuery, ELK, etc);
- Experience with CI/CD tools, workflow management tools (Airflow).