Job Title: Data Engineer
Company: PwC Acceleration Centers
Location: Bengaluru, Karnataka, India
Description:
Summary: We are seeking a skilled Data Engineer to join our offshore team. The ideal candidate will have a strong background in data engineering, with expertise in AWS, Databricks, SQL, Delta Live Tables, Delta Tables, Spark, Kafka, Spark Streaming, MQ, and ETL processes. As a Data Engineer, you will be responsible for developing and maintaining efficient data pipelines and systems that support our organization's data initiatives and analytics needs.




Minimum Degree Required: Bachelor's degree in computer science/IT or relevant field







Degree Preferred: Master’s degree in computer science/IT or relevant field




Minimum Years of Experience: 2 -5.5 year(s)




Certifications Required: NA




Certifications Preferred: Certifications in AWS Certified Data Analytics, Azure Data Engineer Associate, Databricks, Teradata, SQL databases, and DevOps tools like Terraform and GitHub are preferred.

Required Knowledge/Skills: (character count limit 5000) *PLEASE ONLY USE THIS FIELD IF THIS IS A MUST HAVE SKILL FOR APPLICANT*







Key Responsibilities:

· Develop and maintain scalable data pipelines and ETL processes using AWS and Databricks platforms.

· Design and implement solutions for data extraction, transformation, and loading using SQL and Databricks.

· Manage and utilize Delta Live Tables and Delta Tables to handle both batch and streaming data efficiently.

· Implement real-time data processing solutions using Spark, Kafka, and Spark Streaming.

· Collaborate with onshore and offshore teams to understand data requirements and deliver solutions that meet business needs.

· Monitor data pipelines, troubleshoot issues, and ensure timely data delivery and accuracy.

· Integrate message queuing systems (e.g., MQ) to support data processing workflows.

· Adhere to data governance and security best practices to protect data integrity and compliance.

· Continuously explore and adopt new technologies and methodologies to enhance data engineering capabilities.

Qualifications:

· Bachelor’s degree in Computer Science, Information Systems, or a related field.

· Proven experience as a Data Engineer with a focus on AWS, Databricks, and SQL.

· Strong understanding of data modeling and ETL concepts.

· Experience with big data technologies, including Spark and Kafka.

· Familiarity with Delta Live Tables and Delta Tables in Databricks.

· Experience integrating message queuing systems (e.g., MQ) into data solutions.

· Excellent problem-solving skills and the ability to work collaboratively in a team environment.

· Strong communication skills, with a focus on collaboration between onshore and offshore teams.

Preferred Skills:

· AWS certification or relevant certifications in data engineering technologies.

· Experience with data visualization tools and techniques.

· Understanding of Agile methodologies and project management tools.

What We Offer:

· Competitive salary and comprehensive benefits package.

· Opportunities for professional development and career advancement.

· A collaborative and innovative work environment.




Interested Candidates can reach out to mentioned email ID: mehvish.mir@pwc.com

Show more