Position: Data Engineer
Company: Surprise
Experience required: 2y
Category: Data Science
English level: upper
Published: 2020-11-01T00:00:00+02:00

**Your typical day:**
Create and maintain optimal data pipeline architecture
Assemble large, complex data sets that meet functional / non-functional business requirements
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and big data technologies
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product

**Requirements**
Advanced working SQL knowledge and experience working with relational databases, working familiarity with a variety of databases
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets
Experience in software developmen 4+ years
Experience in database management 2+ years
Practical experience with high-level programming languages: Python, Java, C++, Scala, etc.
Big Data tools: Hadoop, Spark, Kafka, etc.
Data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
AWS cloud services: EC2, EMR, RDS, Redshift
Stream-processing systems: Storm, Spark-Streaming, etc.
NoSQL databases: MongoDB, Cassandra, HBase
Building microservices and containerized applications: Docker, k8s
Understanding of the ETL process
Understanding of software development process, Agile approach, and CI/CD
Degree in computer science or related field
Upper-Intermediate English level or higher

**Nice to have:**
Experience with mining of structured, semi-structured, and unstructured data
Applied statistics skills, such as distributions, hypothesis testing, regression analysis, etc.
RESTful API creation in Python (Flask, Falcon or similar)
Experience with data visualization tools, such as Ggplot2, Plotly, Matplotlib

**Benefits**
Friendly and highly professional team
Flexible working hours
20 working days of paid vacation
English lessons and English speaking club with a native speaker
Modern comfortable office with all amenities
15 days of paid sick leave
Relax zone (including a terrace with a barbecue in summer)
Yoga classes
Lectures and after-work activities
Snacks and fruit in the office kitchen:)