Position: Senior Big Data Engineer
Company: Adaptiq
Category: Data Science
Experience required: 5y
English level: upper
Published: 2021-07-01T00:00:00+03:00

**Responsibilities:**
Develop high-end solutions to the technical challenges we will face when working to fulfil our mission using your deep knowledge of Spark and the hadoop ecosystem.
Maintain the product in production to ensure the best possible service to our customers
Build a product that fits the market by taking part in analyzing the feedback from the community and the design partners
Work in a trusted team and ensure others on the team feel safe and trusted.

**What would make you a good match?**
Spark Expert:
     * 5+ years experience as a software engineer
     * At least 3 years experience with Java/Scala and Spark
     * Must: Deep understanding of Spark's internals: Query planning, Filesystem API, codegen, etc.
     * Nice to have: experience with PySpark Hive Metastore, Delta Lake, Apache Hudi or Apache Iceberg

**What do we do:**
LakeFS (our project) is a data lake management solution that works by extending existing object stores (e.g. S3) with advanced Git-like capabilities.

By supercharging the storage layer with ACID-like guarantees based on atomic branching/committing/merging of changes.
We free developers from the risks and complexities of managing data at scale: changes can be reverted instantly, writers have full control of when their data becomes visible to their consumers, and by applying CI rules, we can enforce standards and avoid costly mistakes.