Position: Senior Software Engineer
Company: ABCloudZ
Category: Lead
Experience required: 5y
English level: upper

**Required skills**
— 5+ years’ experience with building and operating in-production large-scale, distributed data pipelines, as well as data management, modeling, storage, data lineage, data providence, data quality, and reusable frameworks.
— Good knowledge of AWS managed service offerings and demonstrated experience delivering in a cloud environment.
— Good understanding of modern data engineering practices including scalability, distributed computing, AWS cloud infrastructure, containerization, etc.
— Development and delivery experience with multiple programming languages, including C#, Java, Python, Javascript, and Typescript.
1+ years of hands-on Kafka/Confluent/Data Streaming development/GraphQL/operational platform experience.
— Working knowledge and hands-on experience with Docker and Kubernetes (or similar container/orchestration)
— Experience with leveraging DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation, and Test-Driven Development to enable the rapid delivery of end user capabilities.
— Deployment automation with tools such as Terraform, Jenkins, Cloudformation, and Serverless framework.
— Expertise in database platforms such as SQL Server, Oracle, Postgres.
Good understanding of Spark framework.
— Strong organizational skills, interpersonal skills, written and oral communications.
— Experience with Agile development methodologies and practices.

**Responsibilities**
— Building and operating in-production large-scale, distributed data pipelines, as well as data management, modeling, storage, data lineage, data providence, data quality, and reusable frameworks.
— Working with modern data engineering practices including scalability, distributed computing, AWS cloud infrastructure, containerization, etc.
— Development and delivery with multiple programming languages, including C#, Java, Python, Javascript, and Typescript.
— Working with Docker and Kubernetes (and similar container/orchestration).
— Deployment automation with tools such as Terraform, Jenkins, Cloudformation, and Serverless framework.
— Running data security concepts and implementing authentication, encryption, and authorization.