Position: Looking for a Python/ Go Engineer for Scientific Data Solutions
Company: New Wave Devs
Experience required: 5y
Category: Golang
English level: upper
Published: 2023-08-01T00:00:00+03:00

Key Responsibilities:
— Translate scientific user requirements into intuitive, scalable software solutions;
— Engineer tools for orchestrating and monitoring large-scale data pipelines and machine learning workflows;
— Design and implement a high-performance Data Lakehouse for streamlined data access;
— Engage in collaborative code and design reviews;
— Mentor team members to elevate technical skills;
— Liaise with scientific stakeholders, offering technical guidance and support.

Qualifications
— Minimum 6-8 years of proven track record in software engineering teams, with products in production serving diverse user groups;
— Proficiency in high-level programming languages, such as Python or Go;
— Hands-on experience with Docker and orchestration frameworks like Kubernetes;
— Demonstrable skills in designing distributed systems on cloud platforms (GCP preferred);
— Commitment to DevOps culture, CI/CD practices, and Infrastructure as Code;
— Expertise in system-level profiling, debugging, and Observability tools;
— Familiarity with various data storage solutions including SQL, NoSQL, columnar, and timeseries databases;
— Exceptional adaptability, with a proven ability to thrive in a collaborative setting and navigate uncertain requirements.

Preferred Skills
— Prior experience in accelerating data engineering, research, and machine learning projects;
— Knowledge of distributed computing frameworks and best practices;
— Experience with workflow orchestrators like Flyte, Metaflow, or Argo Workflows;
— Familiarity with Infrastructure as Code solutions like Terraform or Pulumi;
— Exposure to columnar data formats like Apache Parquet;
— Understanding of data lake technologies such as Apache Iceberg, DeltaLake, or Apache Hudi;
— Expertise in distributed query engines like Apache Spark or Trino/Presto.