Position: Middle Data Engineer [Automotive]
Company: Intellias
Category: Data Engineer
Experience required: 2y
English level: upper
Published: 2021-12-01T00:00:00+02:00

Our client is a company that enables people, enterprises, and cities to harness the power of location. By making sense of the world through the lens of location, it empowers their customers to achieve better outcomes from helping a city manage its infrastructure or an enterprise optimize its assets to delivering drivers to their destination safely.

The Program will transform the way all map-making is completed within the company to be automated and real-time while eliminating duplicate work and moving into the new future of a Software as a Service (SaaS) ecosystem. The company needs all components used for map-making as a service, real-time content updates, and full enriched maps. The goal is for all products to be within a single architecture, with the ability to expose each individual service as an external solution.

As a **Data Engineer** you will play a vital role in collaborating as part of the cross-functional Agile team to create and enhance data ingestion pipelines and address big data challenges. 
We expect you to work closely with the Chief Architect, systems engineers and software engineers on the following key tasks:

- Provide Extraction, Transformation, and Load (ETL) experience coupled with enterprise search capabilities to solve Big Data challenges.
- Leverage strategic and analytical skills to understand and solve customer and business centric questions.
- Create prototypes and proofs of concept for iterative development.
- Learn new technologies and apply the knowledge in production systems.
- Monitor and troubleshoot performance issues on the enterprise data pipelines and the data lake.
- Partner with various teams to define and execute data acquisition, transformation, processing and make data actionable for operational and analytics initiatives.

**Qualifications and Experience:**
- **Experience working with SQL, database management systems.**
- **Experience working with Python.**
- Experience working with data visualisation software/platforms: dashboard design, development, testing, implementation, and support.
- **Experience with AWS cloud services**: EC2, S3, EMR, RDS, Redshift, Athena and/or Glue.
- Good knowledge of principles of software development, ability to find and fix bugs, and solve complex tasks.
-** Upper-intermediate level of written and spoken English** or higher, ability to articulate and communicate clearly complex topics.
- Experience with Jira, Confluence and extensive experience with Agile methodologies.

**Preferred Qualifications:**
- Java.
- Experience with big data tools: Hadoop, Spark, Kafka.
- Experience in designing/developing platform components like caching, messaging, event processing, automation, transformation and tooling frameworks.
- Experience transforming data in various formats, including JSON, XML, CSV, and zipped files.
- Experience with performance tuning of ETL jobs.
- Strong interpersonal and communication skills necessary to work effectively with customers and other team members.
- Experience with software configuration management tools such as Git/Gitlab.
- Detailed oriented/self-motivated with the ability to learn and deploy new technology quickly.