Position: Data Engineer
Company: Proxet
Experience required: 3y
Category: Data Engineer
English level: intermediate
Published: 2022-04-01T00:00:00+03:00

Requirements

Experience in Data Validation, Data QA, Pipelines, ETL, Kubernetes
Experience of using Terraform to automate infrastructure creation
Experience and understanding of relational databases - PostgreSQL and NoSQL databases – Redis
Experiencing of using Spark (Python/Scala), or pure SQL (e.g., using DBT)
Experience building and automated testing frameworks around data ingestion pipelines for master data management
Solid skills in writing and understanding SQL queries
Familiarity with CI/CD principles and best practices in data processing
Experience with job orchestration/scheduling tools such as Airflow
Advanced / fluent written and spoken English


Responsibilities

Build a real-time index of what wallets are on what blockchains
Reading from the blockchains and keeping the index up to date
Set up pipelines
Ingest Ethereum, Polygon and Solana blockchains


Nice to have

Knowledge working with Web3 technologies using networks like Ethereum/Solana, Polygon
Experience with GraphDB’s such as Neo4J, ArangoDB, RedisGraph, etc. 
Knowledge of advanced data structures and algorithms
Experience with Python, Sсala
Expertise in TypeScript