Position: Senior BigData Engineer (Poland)
Company: SoftServe
Category: Data Engineer
Experience required: 3y
English level: upper
Published: 2022-05-01T00:00:00+03:00

**WE ARE**
We are a big distributed team working with a fantastic customer, a giant in the mining industry, located in Canada. Mining is an amazingly interesting, broad and challenging domain. Having dived into it about 3 years ago, we are now developing several web applications and dashboards for different categories of users simultaneously. The destination of all of our products is simplification, time and resource-saving. And we rock!
Our expertise, knowledge and dedication are highly valued by the customer and earned us the status of a trusted vendor. SoftServe keeps being engaged in new activities, and here we are - looking for new talents to expand our fantastic team.

**YOU ARE**
• A highly motivated Data Engineer looking for an exciting opportunity to join a vibrant and dynamic team of professionals and work for a reputable international company
• Experienced in Big Data/Cloud
• Strong in Python
• Confident in SQL
• Accustomed to Agile/Scrum methodologies
• A good communicator, not afraid to get clarifications from customer
• Fluent in English
A holder of such extra benefits:
• Microsoft Azure
• Microsoft SQL Server knowledge
• PySpark

**YOU WANT TO WORK WITH**
• Designing scalable, robust data engineering framework to meet current and future business needs
• Defining and developing sample data pipelines to harmonize disparate data sources
• Developing data engineering framework to ingest, cleanse, harmonize and store processed data in data lake or Data Warehouse
• Identifying and addressing data quality issues – driving improved data quality in all activities
• Defining and building frameworks to automate code deployment & integration. Design CI/CD pipelines and version control frameworks
• Translating high-level objectives into feasible, testable, and measurable functional specifications
• Providing solutions for the deployment, execution, validation, monitoring, and improvement of data solutions
• Developing production quality code and libraries that can be packaged as containers, installed, and deployed
• Making out reusable production data pipelines
• Growing solutions that comply with Security and Data Governance policies
• Building Databricks SQL endpoint integrations; Databricks Event Hub integrations
• Providing granular access to data
• Ensuring integrations to ODBC SQL, PostgreSQL Cosmos, ADX, etc.
• Building AirFlow, ADF orchestrations

**TOGETHER WE WILL**
• Accomplish great things
• Get a great deal of learning and development opportunities along with our structured career path