Position: Big Data engineer (Java AND Hadoop AND Spark)
Company: Luxoft
Experience required: 5y
Category: Data Science
English level: intermediate
Published: 2021-02-01T00:00:00+02:00

Project Description:
One of the largest retail worldwide company that located in USA needs a professional, effective and result-oriented team to design, develop and support complex enterprise Big Data solutions. The team supports Product data for the Company Analytical Platform. The main goal is to organize all data related tasks across the domain: allocation, transferring, processing and storage.

Also, a candidate must be ready for periodical 12 hours of on-call support.
Responsibilities:
-implement new features
-bugfix existing features
-refactor existing code
-improve test coverage
-build and ship product artifacts to dev/prod cluster
Mandatory Skills Description:
MUST
Java
Hadoop
Spark


SHOULD
HDFS
Hive
Kafka or any other messaging system
Docker
AWS
Shell script
Python
Yarn
Apache Ranger
EMR
Dynamo DB
Kubernetes
DevOps skills
Terraform
Nice-to-Have Skills:
Golang
Apache Atlas
Apache Knox
Okta
GitLab CI/CD
Disaster Recovery
New Relic
Splunk
Pagerduty
Languages:
English: B1 Intermediate