Position: Senior Data Engineer
Company: Toughbyte
Experience required: 5y
English level: upper

Our client is a tech company that is on a mission to build the world's best code discovery engine. It is well-funded by top investors in Silicon Valley, including the first investors of Google, Twitter, Zoom, LinkedIn, and Uber. Your future team has backgrounds from NASA, LinkedIn, Facebook, Amazon, AWS, Cisco and MIT, Harvard, Stanford, and Berkeley. It is headquartered in San Francisco, California.

Now they are looking for a **Remote Senior Data Engineer**.

**Responsibilities:**
Implement data engineering best practices
Design and develop data systems for machine learning
Write real-time pipelines that execute complex operations on incoming data
Experiment in ways that accelerate prototyping and maximize resource utilization
Ensure pipelines work quickly, focus on fast single node performance and leverage horizontal scaling
Manage our data pipeline, including scheduling, dataflow programming, SQL and data labelling
Orchestrate the operation of clusters of commodity machines
Review code, mentor other engineers and support the data team
Attract, recruit and retain top engineering and scientific talent

**Must-have skills:**
Knowledge of cloud platforms
Proficient with distributed systems and the orchestration of large numbers of independent commodity machines into complete, functional systems to handle diverse workloads
Minimum **5+ years** of professional software engineering experience
Expertise with **ETL**
Significant experience with **Python** and **Golang**
Proven experience as a senior data engineer or similar role

**Nice-to-have skills:**
Bachelor’s or Master’s degree in computer science/engineering, mathematics, physics, or other related technical fields with equivalent practical experience
Experience with Natural Language Processing and Understanding (**NLP & NLU**)
Knowledge of math, probability, statistics and algorithms
Familiarity with machine learning frameworks (like Keras or PyTorch)
Ability to run a CPU and IO profiler to figure out where to optimize the pipeline
Advanced working knowledge of information retrieval and search technologies and have set up and used open-source search systems to query and understand data

**Benefits:**
Stock options
Paid vacation and sick leave
Strong remote work culture that includes group activities and local gatherings