Position: Data Engineer
Company: Busy Rebel Development LLC
Category: Data Engineer
Experience required: 5y
English level: upper
Published: 2023-05-01T00:00:00+03:00

We are currently seeking a skilled and motivated **Data Engineer** to join our team. The ideal candidate will possess a strong skillset in **AWS**, **Python**, **Dagster**, **MongoDB**, and experience in integrating different systems using **APIs** or frameworks like Airbyte, Zapier, or Make.

**Responsibilities:**

- Collaborate with cross-functional teams to develop and implement point-to-point integrations between our system and various Student Information Systems, Learning Management Systems, and Online Application Systems used by our university clients.
- Design, develop, and maintain data pipelines and workflows to ensure smooth and efficient data integration processes.
- Utilize AWS services such as DynamoDB, Lambda, S3, CloudWatch, and Secrets Manager to build scalable and reliable data solutions.
- Leverage Python programming language for data manipulation, transformation, and analysis tasks.
- Work with the Dagster framework to build and manage data pipelines, ensuring data quality, reliability, and reproducibility.
- Implement and maintain MongoDB databases for data storage and retrieval.
- Connect different systems using APIs or frameworks like Airbyte, Zapier, or Make to enable seamless data flow and integration.

**Requirements:**

- Proficiency in AWS services such as DynamoDB, Lambda, S3, CloudWatch, and Secrets Manager.
- Strong programming skills in Python for data processing and analysis.
- Familiarity with the Dagster framework and its application in building data pipelines.
- Experience working with MongoDB databases.
- Knowledge and expertise in connecting different systems using APIs or frameworks like Airbyte, Zapier, or Make.
- Solid understanding of data integration concepts and best practices.
- Ability to work collaboratively in a team environment and effectively communicate technical concepts to both technical and non-technical stakeholders.

Please note that this role primarily focuses on point-to-point integrations between our system and the various Student Information Systems, Learning Management Systems, and Online Application Systems used by our university clients. While there may be future opportunities to work on big data and machine learning projects, the primary focus for this year is to fulfill the integration needs of our expanding customer base.

**If you are interested in this position, please make sure you are aware of the type of work involved and the integration solutions we provide.** We look forward to receiving applications from enthusiastic candidates who are excited to contribute to our growing team and make a positive impact on the education sector.