Position: AWS Data Engineer
Company: Jabil
Category: Data Engineer
Experience required: 3y
English level: upper
Published: 2023-04-01T00:00:00+03:00

Job Description:

As a Cloud Data Engineer, you will design and maintain ETL pipelines from different sources (Databases, File System, Sharepoint, Smartsheets, etc) into AWS Cloud Storages (RDS, Redshift, S3, etc) and create streaming and batching pipelines using PySpark on Glue, EMR, Lambda.

You will be expected to

•  Build ETL pipelines from different sources (Databases, File System, Sharepoint, Smartsheets, etc) into AWS Cloud Storages (RDS, Redshift, S3, etc)
• Create streaming and batching pipelines using PySpark on Glue, EMR, Lambda
• Maintain data integrity by designing backup and recovery procedures
• Identify opportunities to improve performance by improving database structure or indexing methods
• Maintain existing applications by updating existing code or adding new features to meet new requirements
• Designi and implement security measures to protect data from unauthorized access or misuse
• Recommendinfrastructure changes to improve storage capacity or performance

Requirements:

•  5 years experience with PySpark (streaming and batching), relational DBs (SQL Server, Postgres, etc), AWS Cloud — Redshift, Airflow, Glue, S3, Lambda, CloudWatch, etc
• 3 years of commercial expertise with AWS Cloud
• Familiar with SQL Server, SSIS, AWS — Kinesis, EMR, Apache Airflow (AWS MWAA), Redshift, Aurora PostgreSQL, S3, Glue
• Understanding of EMR, Apache Kafka (AWS MSK), Snowflake
• Experience working directly with technical and business teams
• Ability to learn quickly, be organized and detail oriented
• Understanding of database schema design
• Upper-Intermediate English