Position: Middle Data Engineer
Company: Diceus
Experience required: 2y
Category: Data Science
English level: intermediate
Published: 2021-01-01T00:00:00+02:00

Requirements:

• 2+ years working with AWS cloud services: EC2, EMR, RDS, Athena, Glue

Will be a plus:

• Python or JavaScript language
• Knowledge of specific tools related to data like Pandas, Pyspark
• Other AWS services like ES2, S3, RDS

Responsibilities:

• Create and maintain optimal data pipeline architecture
• Assemble large, complex data sets that meet business requirements
• Identify, design, and implement internal process improvements: automating manual
processes, optimizing data delivery, re-designing infrastructure for greater scalability
• Build the infrastructure required for optimal extraction, transformation, and loading of
data from a wide variety of data sources
• Work with relational databases and unstructured data sources, query authoring (SQL
and AWS Athena)
• Build and optimize ‘big data’ data pipelines, architectures, and data sets
• Build processes supporting data transformation, data structures, metadata,
dependency, and workload management
• Help choose and work with stream-processing systems: Storm, Spark-Streaming, etc.

We offer:

• Competitive compensation level
• Paid Vacations (18 days), Statutory Holidays and Sick leaves.
• Comfortable Office or Full remote work
• Flexible Work Schedule.
• Professional Growth
• Free English lessons