Position: Java Developer
Company: Scalors Gmbh
Category: Java
Experience required: 3y
English level: upper
Published: 2023-03-01T00:00:00+02:00

On behalf of our client, we are looking for Java Developers, starting with one Developer with the following Skills:

 

Must have:

Java 9
lambda expression
Java Functions
Spring Boot
git
Should have:

Spring Cloud Streams
Spring Cloud Function
Spring Cloud Dataflow
Gradle
Atlassian JIRA for project management (SCRUM)
Apache Kafka
ElasticSearch/OpenSearch
Kubernetes
Project Description


We are developing a platform for collecting market data like offers, products and merchants or retailers. The platform under development is getting the data from different sources, one will be a web crawler.

This data will be consolidated and linking between data from different domains and sources will be created. For some domains, we will maintain a history of change, for instance for prices of offers.

The whole data processing is done with streams backed by Apache Kafka. The stream processing is organized in pipelines, where processing components are Spring Cloud Functions wrapped in Spring Boot Applications deployed with Kubernetes and orchestrated with Spring Cloud Dataflow.

The resulting Data is stored in OpenSearch and the advanced searching capabilities of OpenSearch are used to match data - create linkage between them.

The platform must be able to process mass of data in a short time - it's BigData. So, the platform is built for scale and speed. 

 

We are developing in a small team following the SCRUM principles.

We are pressing for short delivery cycles using a high degree of test automation and frameworks enabling continuous deployment.