Position: GCP Data Engineer
Company: CHI Software
Experience required: 3y
Category: Data Engineer
English level: intermediate
Published: 2023-07-01T00:00:00+03:00

The CHI Software team is not standing still. We love our job and give it one hundred percent of us! Every new project is a challenge that we face successfully. The only thing that can stop us is… Wait, it’s nothing! Now the CHI team is looking for a GCP Data Engineer!

**Requirements:**
- Extensive hands-on experience with GCP technologies and components, including BigQuery, Cloud SQL, Pub/Sub, Cloud Storage, Cloud Spanner, and Cloud Firestore.
- Proven track record of building and maintaining data pipelines on GCP using App Engine, Cloud Functions, Cloud Run, and DataFlow.
- Familiarity with DevOps practices and tools, including CI/CD pipelines on GCP with Cloud Build and Infrastructure as Code (IaC) using Terraform.
- Strong understanding of Google IAM and best practices for authentication and authorization.
- Knowledge of data curation and dimensionality to cater to the needs of data consumers effectively.
- Proficiency in ETL and ELT techniques and best practices.
- Ability to design, develop, and deploy highly scalable and reliable data pipelines.
- Solid programming skills in Python, Java, and SQL.
- Excellent communication and collaboration skills for effective cross-functional team interaction.
- Experience with data modeling and schema design for ensuring data integrity and performance.

**Responsibilities:**
- Utilize your expertise in GCP technologies, including BigQuery, Cloud SQL, Pub/Sub, Cloud Storage, Cloud Spanner, and Cloud Firestore to build robust and scalable data solutions.
- Demonstrate a proven track record of creating and managing data pipelines on GCP using App Engine, Cloud Functions, Cloud Run, and DataFlow to handle large-scale data processing.
- Implement DevOps best practices and utilize tools like Cloud Build and Terraform for smooth CI/CD pipeline deployments on GCP.
- Apply in-depth knowledge of Google IAM to ensure proper authentication and authorization for secure access management.
- Optimize the utilization of various GCP services by closely monitoring cost aspects and implementing cost-effective solutions.
- Curate data and manage dimensionality effectively, providing valuable insights to data consumers.
- Leverage your understanding of ETL and ELT techniques and best practices to enhance data processing efficiency.
- Design, develop, and deploy highly scalable and reliable data pipelines that meet business requirements.
- Utilize programming languages such as Python, Java, and SQL to create efficient data transformations and data integration solutions.
- Collaborate effectively with cross-functional teams, showcasing excellent communication skills to drive successful project outcomes.
- Apply your experience with data modeling and schema design to ensure data integrity and optimal performance.