Position: Data Engineer
Company: Recruiting Republic
Category: Data Engineer
Experience required: 3y
English level: upper

**About The Client**

We are looking for a person to has solid expertise with PowerBI to be able to create apps that will solve the business problems of our clients and deploy them fast into our platform.

The partner you will work with is building a platform for data analytics and data visualization in the consultancy area. Built on complex backend mathematics, it solves various retail problems and provides extensive analytical insights based on numerouswell-designed metrics. The team works with Scrum ceremonies to ensure stable product delivery. Tech stack is Python, FastAPI, Postgresql, Pandas, Scipy, Spark, AzureDatabricks, Plotly, React js.

Our customer is a leading cybersecurity provider of digital identity solutions with more than 700,000 customers and over 20 years of experience in online trust, has partners with organizations of all sizes to deliver automated public and private PKI solutions for securing webservers, user access, connected devices, and applications. They have been recognized for their award-winning innovation and best-in-class global customer support has the proven performance needed to secure the digital landscape of today and tomorrow.

** About the Project**
Our team builds software for a new messaging-based contact channel for Amazon Customer Service with an Automated Assistant (ChatBot) that uses new cutting edge technologies and ML. Despite continuous improvements in our self-service offerings on Amazon.com, many customers still prefer to get support using natural language. Our intention is to answer questions and solve customer problems using automation to allow us to scale globally across many languages for the millions of customers that use our marketplaces every day.

 **Tech Stack**
— BS or MS degree in Computer Science or a related technical field
— 3+ years coding experience in Python/ pySpark
— Experienced in Analysis Services.
— 2+ years’ experience with Data Visualization tool — Power BI, Tableau
— Excellent problem solving and troubleshooting skills
— Process oriented with great documentation skills
— Excellent oral and written English communication skills
—Team player with analytical talent, high performance motivation, curiosity,
persuasiveness
—Experience with or knowledge of Agile Software Development
methodologies is a plus

• Excellent understanding of distributed computing technologies, approaches, and patterns
• Proficiency in one of the following programming languages: Java, Scala, or Python
• Cloud experience which is a big plus point: AWS, GCP or Azure
• Hands-on experience with Hadoop, NoSQL, MPP technologies, processing frameworks, or other Big Data technology areas: data ingestion, consolidation, streaming or batching
• Skill in at least one of the processing and computation frameworks: Kafka Streams, Storm, Spark, Flink, Beam/DataFlow, Akka, etc.
• Experience in at least one of the RDBMS or NoSQL engines: PostgreSQL, MySQL, Cassandra, HBase, Elasticsearch, Redis, MongoDB, Impala, Kudu, etc.
• Background of implementing Data Lakes, Data Warehousing, or analytics systems is a big advantage. 

**Technical stack of the project: **
Azure Services, Azure DevOps, Azure Functions, Azure Redis Service, Azure SignalR Service, Azure SQL Service, Azure Table Storage, Azure CosmosDB, .NET, .NET Core, AngularJS(migrating to Angular 2+), Angular 8

**Job responsibilities**
— Analyze and organize raw data
— Build data systems and pipelines
— Evaluate business needs and objectives, propose effective solutions
— Detect and interpret trends and patterns
— Conduct complex data analysis and report on results
— Prepare data for prescriptive and predictive modeling
— Explore ways to enhance data quality and reliability, develop
measurements to assess the data
— Collaborate with data scientists and architects on projects
— Suggest and set up processes and systems to monitor data quality,
ensuring production data is always accurate.
— Perform data analysis required to troubleshoot data related issues and
assist in the resolution of data issues.
— Contribute to engineering wiki, and documents work. (swapped with the
prev one to keep data quality points closer)
— Work closely with a team of frontend and backend engineers, product
managers, and analysts