Position: Big Data Specialist
Company: MWDN
Category: Data Science
Experience required: 3y
English level: upper
Published: 2020-07-01T00:00:00+03:00

WE OFFER:
-People-oriented management without bureaucracy
-Friendly climate inside the company – previous employees have come back often
-Flexible working hours
-100% paid sick leave
-Educational budget

RESPONSIBILITIES:
-Storing and manipulating the data sets
-Designing the flow of data
-Write efficient, maintainable and reusable code
-Analyze and finalize requirements
-Realize existing requirements

REQUIREMENTS:
-4+ years of experience in software development
-Experience with MongoDB and/or Elastic Search
-Experience with MySQL
-Experience with Kafka or similar solution
-Experience with Spark
-Experience with S3 (or S3 compatible solution)
-Experience with Python or Node.JS
-Experience with Git
-Upper-intermediate English

WILL BE A PLUS:
-Experience with Cassandra

ABOUT THE PROJECT
Operia is solution to crawl the web without the need to use multiple IP vendors, proxy services, etc.
You are sending your http get request to Operia. At the back end, Operia sends that request to an available vendor and produces the results on the same connection.
https://operia.io/