Position: Big Data Engineer
Company: Storypoint
Category: Data Science
Experience required: 3y
English level: upper

The Big Data Software Eng will join the TIS Israeli Engineering team as a Data Services team member, partaking, contributing and leading research and development activities mapped to the Threat-InDepth product as well as to cross-product and cross-team big data infrastructures

Responsibilities:

- Develop and test complex data pipelines leveraging Kafka, Hadoop & Spark frameworks
- Develop and test data classification engines
- Implement health and monitoring solutions in a cloud environment
- Work in an agile environment, continuously strive to increase team’s velocity and productivity
Requirements:

- At least 5 years of experience as a backend Developer
- Experience with Big Data pipelines, specifically with Hadoop, Spark, Elasticsearch and Kafka frameworks
- Experience with ML
- Experience with SaaS products and cloud deployments
- Experience with Micro Services architecture
- Experience with OOP programing, design patterns and Java technology stack
- Experience and good understanding of multi-threading and reactive paradigms
- Experience with as many of the following technologies: K8S, Docker, ELK, Zeppelin, RDBMs, InfluxDB, Prometheus
- Good understanding of QA/Automation/CI/CD methodologies
- Good interpersonal skills with proven ability to work with small teams in a distributed organization
- Ability to think, learn and resolve problems independently
- Able to promote projects and initiatives
- Team player, strong interpersonal skills with ability to maintain collaborative working relationships with peers, management and external parties.
- Bachelor’s degree in Computer Science, Information Technology or equivalent