Position: Big Data Engineer, Multinational Financial Services
Company: DataArt
Experience required: 2y
Category: Data Science
English level: intermediate
Published: 2021-10-01T00:00:00+03:00

About the vacancy

DataArt's specialists participate in data governance and data improvement processes for one of the top three UK insurance companies. Our team helps the client in finding and clearing issues with the data.

The Big Data engineer will be responsible for creating applications and solutions that will manage data flow using Spark.

Must have
- Hands-on experience with Spark and Scala
- Experience handling large data using streaming
- Strong experience with SQL and Data modeling
- Spoken English

Would be a plus
- Experience working in an agile environment and understanding of various phases of the software development life cycle
- Skills working with Hadoop (HDFS, MapReduce) and Oozie
- Skills working with the Cloudera platform
- Skills using source code and version control systems like SVN, Git, etc.
- Knowledge of Hadoop architecture components

Learn more about our policy of equal opportunities in employment