Position: Data Engineer (Python)
Company: GlobalLogic
Category: Data Science
Experience required: 3y
English level: intermediate
Published: 2021-08-01T00:00:00+03:00

**Experience & Education**

- Expert in Python programming and using Python to build data products.
- Expert in using python to read/write/manipulate large complex datasets in different input/output formats (JSON, CSV, Avro, parquet)
- Good knowledge of Django, Flask, or similar Python frameworks
- Expertise in Python libraries such as NumPy, Pandas, Faker, etc
- Knowledge of schema definitions such as AVRO, Thrift, Protocol Buffers, and Parquet
- Experience building test automation for data loading, performance, and API validation
- Exposure to Stream Analysis and ML with tools such as Spark/PySpark, Apache Flink, etc
- Experience with one or more public clouds (AWS, GCP, Azure)
- Experience with Docker and K8s.
- Experience with DevOps tools such as GitHub Actions, Azure DevOps, Travis CI, and Jenkins.
**
Job Responsibilities**

- Build python libraries and modules that will enable a highly scalable data processing pipeline for various applications such as Bulk Ingestion, Real-Time Streaming Applications, and AI/ML-based insights
- Build applications and write code that meets the high-quality standards and scale horizontally in a cloud environment
- Collaborating with the Dev Leads and Product Manager to ensure that the requirements are meet
- Ensure applications are tested through the usage of automated test tools
- Delivering well-instrumented system that provides insights into Operational Metrics and helps in resolving issues
- Utilize Agile practices to manage and delivers features