Position: Senior Data Engineer, Online Genealogy Servicer
Company: DataArt
Experience required: 3y
Category: Data Engineer
English level: intermediate
Published: 2022-02-01T00:00:00+02:00

About the project:
The team employs pair/mob programming and DevOps practices; works together in a shared online space (e.g. team zoom rooms); has autonomy to make technology decisions that best fit the problems they’re tasked with; works cross-functionally with other internal teams and external partners.

Tech Stack:
• Ruby scripts for internal workflows (plus some Python and Bash) • Ruby-on-Rails for internal web apps • Administration and usage of large MySQL databases • ZFS on Ubuntu and Solaris for mass data storage • Many images stored as JPEG 2000 • Large amounts of XML • Docker and Git are fundamental for a lot of the work within the team • The team uses both Ubuntu and Mac OS

Duties:
-Building and maintaining data workflows for processing a constant flow of data, both historical records and newspapers on client's sites;
-Building and maintaining the tooling service used by our internal teams for managing the data on the site;
-Managing the storage of large quantities of document images and OCR data in a secure and efficient way.

Requirements:
-Experience in SQL databases and managing large amounts of data;
-Comfortable working with Linux/Unix terminals;
-Good knowledge of multiple programming languages;
-Working knowledge of, or an interest in the image data processing;
-A hands-on approach to getting stuff done;
-A curiosity to learn and widen your skillset;
-Good spoken English.

Will be a plus:
-Focus on quality, with testing experience and a willingness to pair collaboratively;
-Background in DevOps/Systems Administration;
-Experience with Docker, Git, Kubernetes;
-Experience with XML processing.