Position: Senior/Tech Lead Big Data Engineer (Poland)
Company: AOG.jobs
Category: Data Engineer
Experience required: 5y
English level: upper
Published: 2022-03-01T00:00:00+02:00

We are looking for a Senior/Tech Lead Big Data Engineer from Poland to join our client’s team on subcontract basis.
 
Briefly about the client:
Successfully cooperating with our client helping people move forward with credit, providing products that responsibly meet their needs. Whether this is offering new ways of accessing credit with a leading retailer or providing tools to facilitate customers’ management of their accounts, clients will continuously strive to help customers responsibly make the most of their credit.
We offer an approach to financial services that are in touch with people and their lives. It is an approach grounded in customer knowledge and differentiated by our passion to deliver the products, services, tools, and expertise that best meet our customers’ needs.

You want to work with:
Modeling, manipulation, transformation, and loading of the Data Lake technology layers
Designing and coding of data transformation and loading processes through the various layers of the Data Lake using Big Data open-source technologies such as Kafka, Spark, Scala, and associated AWS ETL tooling
Owning all of the Data Content, manipulation, business rules, and associated processes within the Data Lake
Champion quality and simplicity in the system code and leading the enforcement to quality within the data landscape
Us according to Agile approach
Monitoring and profiling performance and suggesting/implementing solutions where appropriate
Recommending and testing new data structures, and physical data layouts, to improve throughput and performance
Championing the new Data Lake technology across the organization to address a broad set of use cases across data science and data warehousing
Researching, testing, and recommending new layers or products in the Data Lake stack as these fast-moving technologies develop, keeping Client at the forefront able to attract the best talent
Educating and training other resources in the organization whenever needed

Successful candidates should be:
Proficient in Big Data integration technologies such as Spark, Scala, AWS Data Pipeline for orchestration, Dremio, Glue, AWS Athena, AWS S3, EMR
Excellent with API and library design skills
Proficient with traditional database SQL technologies (Oracle, SQL Server, DB2)
Having practiced with the integration of data from multiple data sources
Able to write high-performance, reliable and maintainable code
Pretty knowledgeable of NoSQL database structures theories, principles, and practices
Confident in CI/CD best practice, multi-threading, and concurrency concepts
Accustomed to cloud deployment
Familiar with the fundamentals of Linux scripting language
At least Upper-Intermediate English communication skills

Nice-to-have such expertise as:
Python
Building applications for cloud environment

We offer:
Work on a remote basis
Full-time workload (40 hours per week)
Interesting long-term project (till the end of 2022)
Project starts ASAP after approval
Worthy reward based on your skills and experience

If this sounds like you, we'd welcome your application!