Position: Middle  Big Data Engineer
Company: GlobalLogic
Experience required: 2y
Category: Data Science
English level: intermediate
Published: 2021-10-01T00:00:00+03:00

Job Description:

As a member of our Data Services team you will be a member of a service group responsible for continuing organizational expansion of our data processing projects. Ideal candidate must be enthused about all spectrum of big data development, including data transport, data processing, data warehouse/ETL integration, quick learning and self-starting. This is a demanding role that will require hands-on experience with big data processing development to be deployed on Linux. You will be responsible for the day to day operation and new developments. We are seeking a candidate with good skills in software development life cycle, build data services with Java (or Scala), script languages, like, Python etc. 

What we look for:

Strong experience using Java
Working directly against RDMS and Data Warehousing (Strong SQL)
PowerMock, Mockito or similar
Writing tech specs and documentation
Some Linux bash scripting
Great if you have:

One or more of the following data processing technologies: Hadoop Map Reduce, Spark, Kafka Streams, Flink, Storm, Apache Beam.
Kafka (preferred) OR one of the mainstream queue systems: ZeroMQ, RabbitMQ, ActiveMQ
Experience with some of the following AWS tools: EMR, Kinesis, Firehose, Redshift, RDS, S3 API, Lambda, SQS
Experience with Presto, Hive, Impala or similar SQL based engine for Big Data
Experience with Redis, Cassandra, MongoDB or similar NoSQL databases.
Scala, Python
Experience with any of the following message / file formats: Parquet, Avro, Protocol Buffer
 

Job Responsibilities
What you will be doing:

Design, develop and support various big data platforms applications, using supported tech stack technologies like Hadoop MR, Spark, Kafka, Druid, ETL and data warehouse applications integration
Develop applications with Java/Scala, Spark programming languages and Big Data technology; including the script languages (Python, shell etc.) to wrap applications execution.
Involved in the design and implementation of full cycle of data services, from data transportation, data processing, ETL to data delivery for reporting
Identify, troubleshoot and resolve production data integrity and performance issues

Department/Project Description:

Founded in 2007, Rubicon Project’s pioneering technology created a new model for the advertising industry. Today, our automated advertising platform is used by the world’s leading publishers and applications to transact with top brands around the globe enabling them to reach more than 1 billion consumers.  Rubicon Project operates the largest independent Display Advertising Exchange and Supply Side Platform that automates the buying and selling of Display Advertising across all formats (banner, video) on all devices (desktop browsers, mobile devices, billboards).  This brief video by the IAB describes how Real Time Bidding (RTB) works.  Rubicon Project auctions over 20 Billion Ads on a daily basis in real time in less than 1/2 of a second each.  Rubicon Project is a publicly traded company (NYSE: RUBI) headquartered in Los Angeles, California, USA.

 

Keyskills - Must Have
Big Data Java
Keyskills - Nice to Have
Scala Druid