Position: Backend Chapter Lead ​(Data engineering focused)
Company: GeeksForLess Inc.
Category: Data Engineer
Experience required: 5y
English level: upper
Published: 2022-10-01T00:00:00+03:00

We are looking for a Chapter lead- Backend-Data engineering focused ​ (streaming data software development) 

**Responsibilities:** Backend Chapter Lead ​

-12 plus years of experience around big data/streaming data software development - streaming is from a data point of view, not service ​
-Experience with Big Data tools like Spark batch and structured streaming Spark Streaming, Storm, KSql, Kafka Streams ​
-Experience creating frameworks around data jobs batch, micro-batch, and streaming / near real-time computation ​

Technical Mentorship and People Leadership of backend engineers across squads​

**Requirements:**
ETL/Orchestration tools: Airflow, Argo, Airbyte, DBT.
Data quality and profiling: Deequ, Great Expectations.
Big Data: understanding shuffle, data skew, partitioning/bucketing, etc
Data: CAP theorem, understanding different types of databases and where to use them
Streaming: Event sourcing, CDC, actor pattern, consumer/producer pattern, etc
Kafka and Kafka connect (here we have some code in Java where we extend current connectors and create custom SMT (single message transformers)

**Technical Experience:​**
Knowledge of functional programming E Key contributions to technical architecture and design​

Experience with defining data pipelines including a complete end-to-end life cycle including data quality and governance, metadata management approach, and actual deployment methodologies for data pipeline in a fully automated manner​

Hands experience with Orchestration technologies such as Airflow or Glue ​

Professional Attributes :​
Team Management Experience ​
Excellent communication Skills ​
Client stakeholder management ​
Good People Leadership