Position: BigData software developer
Category: Other
English level: intermediate
Years of experience: 1


Work experience:
Migrating on-premise solution to Cloud
GCP (Dataproc, Cloud Storage, etc), Scala, Hive, Apache Airflow, Apache Spark, JUnit, Jenkins.
Responsibilities: Ingestion tables
AWS Data Lake Project
Technologies: Python, Java, AWS (EMR, Athena, Glue, Redshift, S3, DynamoDB, Parameter Store, etc), Apache Airflow,
Apache Spark, JUnit, Docker, Oracle DB, MS SQL, PostgreSQL, DBeaver.
Responsibilities: developing new features, implement unit test, take part in development flow of ingestion and
aggregating, API development and testing
Proof of concept project
Technologies: Scala, Spark Streaming, Docker, Kafka.
Responsibilities: Implementing configurable Kafka producer and consumer, creating docker images, packing
application with docker-compose utility, data transformation and analysis with Spark Streaming
Interesting project, friendly team, competitive salary