Position: Data Engineer
Company: GlobalLogic
Category: Data Science
Experience required: 5y
English level: upper
Published: 2023-04-01T00:00:00+03:00

**Job Description
Required Skills & Qualifications:**

Cassandra & other columnar stores, e.g. BigQuery or RedShift
Elasticsearch or Solr
Relational databases, such as MySQL and PostgreSQL
Apache Spark, or similar
Cloud ETL & Data Warehouses, e.g. Airflow
Cloud Hosting with AWS
Queuing and streaming with RabbitMQ and Kafka
Python
ORM
Schema definitions, e.g. Avro
Non-relational databases such as Redis or MongoDB
Source Control and CI/CD systems, such as Git
Engineering Practices, such as TDD and continuous integration
Jira and Confluence
Technical documentation, such as coding styles, branching strategies, and functional specifications
Automated enforcement of policies (e.g. linting, static analysis, stylecop)
Agile development practices and continuous improvement
Adopter of Open Source and awareness of intellectual property concerns
Degree in Computer Science, Mathematics, Data Science, or a similar field

**Beneficial Skills & Experience:**
Snowflake, ClickHouse
Familiarity with Machine Learning and Natural Language Processing
Graph databases
Data visualization tools such as Looker, Tableau, or Power BI
GCP and AWS

**Job Responsibilities**
Design and deliver improvements to the data platform that creates the foundation for a data-driven future
Ensure a well-designed data model where changes are managed and coordinated across the system
Create an efficient data warehousing system with BI tool integration
Engineer solutions to speed up data processing, increase scale and optimize for cost
Design and deliver data migrations from complex legacy platforms to new formats
Develop a compliant data lifecycle spanning multiple storage technologies
Integrate with AI & Data Science teams
Deliver quality code and create full documentation, including flowcharts, layouts, diagrams, charts, code comments, and clear code, for all developed solutions
Share knowledge, guide the teams and the wider engineering community

**Department/Project Description**
Our Client is one of the leading providers of a comprehensive program that enables businesses to secure brand value and thrive commercially. They serve over 5000 clients on five continents!
The project we are working on is the largest technology transformation for the Client at the moment. It consists of Engineering and Data Science functions, with 180 people globally, aligned to Trademark Solutions or Online Brand Protection Business Units. Brand Protection has large-scale web crawling and workflow web applications (including browser plugins). The platform is tracking millions of product listings each day and a dataset in excess of 150TB.