Position: Senior Bigdata engineer
Company: Zoolatech
Category: Java
Experience required: 3y
English level: upper
Published: 2020-07-01T00:00:00+03:00

Responsibilities
A day in the life of an Engineer on the team...
· Design, develop, test, and debug large scale complex platform using big data technologies
· Create high-performance Nordstrom data analytics platform
· Possesses deep proficiency in engineering best practices
· Support the development and evolution of Biddata platform and data warehouse
· Partner with other Technology teams, Program, and Product on building a best-in-class suite of tools and reporting mechanisms to bring the most salient, insightful data more directly into key business functions
· Take part in the production support

Skills Required
Must have:
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- One or more of the following data processing technologies: Hadoop Map Reduce, Spark, Kafka Streams, Flink, Storm, Apache Beam
- Good object-oriented design and development skills
- Some Experience with Kafka, Presto, Hive, Impala or similar SQL based engine for Big Data
- Some experience with at least one of Java, Scala, Python, JavaScript, or other modern language stack
- Good SQL writing skills
- Good DW experience

Nice to have:
1. Cloud Experience
2. Kubernetes Experience
3. Understanding of automation and orchestration platforms such as Airflow
4. Understanding of various data formats such as JSON, Parquet, Avro, ORC