Position: Cloud Data Engineer (ID:10153)
Company: Infopulse
Experience required: 3y
Category: Other
English level: intermediate
Published: 2021-08-01T00:00:00+03:00

Areas of Responsibility
Contribute to the design of the database schema and related data movement architecture
Manage data loading
Evaluate requirements for their relevancy to and impact on existing models and reference architecture
Manage and evaluate system enhancements, and resolve system issues
Improve general refactoring and performance
Create documentation at all levels
Qualifications
Experience with big data and distributed data systems (NoSQL, Hadoop, Spark, Hive, etc.)
Experience with one or more public cloud technologies (preferable GCP, AWS, Azure)
2+ years of experience in ETL and streaming technologies like Kafka, Nifi, Flink, Spark SQL, and Spark Streaming
At least 1 year of experience in Google Cloud services (Data Flow, Data Proc, BigQuery, Pub/Sub)
Intermediate level of English (or higher)
Will be an advantage
Experience with serverless computing (i.e. Lambda, Cloud Functions, Cloud Run, Kubernetes)
Experience with Python, Java or Kotlin