Position: Data Engineer
Company: Toughbyte
Experience required: 5y
Category: Data Engineer
English level: fluent
Published: 2022-02-01T00:00:00+02:00

Tasks: 
- Implement data engineering best practices
- Design and develop data systems for machine learning
- Write real-time pipelines that execute complex operations on incoming data
- Experiment in ways that accelerate prototyping and maximize resource utilization
- Ensure pipelines work quickly, focus on fast single node performance and leverage horizontal scaling
- Manage our data pipeline, including scheduling, dataflow programming, SQL and data labeling
- Orchestrate the operation of clusters of commodity machines
- Review code, mentor other engineers and support the data team
- Attract, recruit and retain top engineering and scientific talent

Must-have skills:
- Expertise in microservices and cloud computing—across cloud platforms
- Proficient with distributed systems and the coordination of high volume independent commodity machines into complete, functional systems to handle diverse workloads
- Minimum 8+ years of professional software engineering experience
- Expertise with ETL
- Expertise with Go
- Expertise with Python
- Proven expertise and leadership as a world class senior data engineer

Nice-to-have skills:
- Bachelor’s or Master’s degree in computer science/engineering, mathematics, physics, or other related technical fields with equivalent practical experience
- Experience with Natural Language Processing and Understanding (NLP & NLU)
- Knowledge of math, probability, statistics and algorithms
- Experience with Golang
- Familiarity with machine learning frameworks (like Keras or PyTorch)
- Ability to run a CPU and IO profiler to figure out where to optimize the pipeline
- Advanced working knowledge of information retrieval and search technologies and have set up and used open-source search systems to query and understand data