Position: Data Engineer 5+ (location Armenia)
Company: itsoft.co.il
Experience required: 5y
Category: Data Engineer
English level: upper
Published: 2023-06-01T00:00:00+03:00

Responsibilities:
Design, develop, and implement scalable data pipelines and ETL processes to extract, transform, and load data from various sources into our big data ecosystem.
Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and translate them into efficient and reliable data solutions.
Optimize and maintain existing data pipelines and ETL processes to ensure high performance, data integrity, and data quality.
Perform data profiling, cleansing, and validation to ensure the accuracy and reliability of data.

Requirements:
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Minimum 5+ years of experience working as a Data Engineer, preferably in a big data environment.
VAST proficiency in building and optimizing ETL processes and data pipelines.
In-depth knowledge of big data technologies such as Hadoop, Spark, or similar distributed computing frameworks - Optional
Experience with cloud-based data warehousing solutions.
Vast Proficiency in working with SQL and NoSQL databases -Big data TERABITES
Familiarity with data visualization and reporting tools such as Atana and Redshift.
Strong programming skills in Python, including experience with Panda Advantage.
Solid understanding of data modeling concepts and database design principles - Advantage
Expr AWS GLUE Advantage