Position: Senior Data Engineer
Company: Onix-Systems
Category: Data Engineer
Experience required: 5y
English level: intermediate
Published: 2023-05-01T00:00:00+03:00

We are looking for a Python Developer to join our team and help build a data pipeline that collects and analyzes vast amounts of text data. The ideal candidate should have experience designing and implementing data pipelines, text mining, and analytics using Python.

In this role, you will work closely with our data science team to gather, clean, and analyze data from various sources, including social media, news articles, and other unstructured text data. You will then extract insights and meaningful information from this data, design and develop analytics tools, and implement features based on these insights.

**Key Responsibilities:**
 - Design and develop scalable data pipelines to collect, clean, and analyze large amounts of text data;
 - Build and maintain natural language processing (NLP) models to extract insights from the data;
 - Develop data visualizations and analytics tools to facilitate data exploration and interpretation;
 - Collaborate with data scientists and business stakeholders to identify areas for analytics development and implement solutions to drive business value;
 - Work with the team to design and build scalable infrastructure and data storage solutions to support the pipeline and analytics tools.

**Requirements:**
 - Bachelor's or Master's degree in Computer Science or related field;
 - 6+ years of experience in Python development and data engineering;
 - Experience with data analysis, machine learning, and natural language processing (NLP) techniques;
 - Strong understanding of distributed systems and scalable data storage solutions;
 - Experience with cloud computing platforms such as AWS or Google Cloud;
 - Familiarity with database technologies such as SQL and NoSQL;
 - Strong problem-solving and analytical skills;
 - Excellent communication and collaboration skills.

**Technical skills:**
 - Python, including multi-processing (e.g. Asyncio);
 - Production experience working with Python API frameworks (e.g. FastAPI) and ASGI web server implementation for Python (e.g. Uvicorn);
 - Production experience in relational DB design (MySQL and PostgreSQL);
 - Solid understanding of web services, distributed application design, and design patterns;
 - Solid experience working with Cloud storage (such as S3);
 - Expertise in machine learning frameworks (e.g. PyTorch/Keras)
 - Experience with production implementation of mid-size NLP models (e.g. RoBERTa and similar);
 - Experience working with Natural Language toolkits (e.g. NLTK, Flair, etc.);
 - Experience working with messaging systems, such as SQS/SNS, and distributed cache systems (such as Redis);
 - Experience working and production implementation of the Transformers (e.g. Sentence Transformers/Hugging Face transformers).

If you are a highly motivated, data-driven Python Developer looking to work on cutting-edge data pipeline and analytics projects, we encourage you to apply. This position is a unique opportunity to work on complex data challenges and significantly impact business.