Position: Data Engineer (Python)
Company: Data Science UA
Experience required: 2y
English level: intermediate

The Technology team in this company is one of the best in the business. From patented machine learning methods to developing an award-winning application, their Technology team is continuously innovating and enabling technology to solve real problems for their customers. They are looking for a proficient Python Data Engineer who is excited about working with some of the most talented Data Engineers and Data Scientists in the industry to build amazing technologies and develop their careers to be the best at what they do.

Minimum Qualifications:
- Bachelor's degree in Computer Science, similar technical field of study, or equivalent practical experience
- Commercial experience building data solutions using Python
- Commercial experience with data models and data warehouses
- Good experience in SQL, database management, and performance tuning

Preferred qualifications:
- Knowledge working cloud technologies (AWS)
- Building complex ETL workflows (Luigi, Airflow)
- Excellent communication skills
- Experience in data processing using traditional and distributed systems (Hadoop, Spark)
- Web frameworks (flask / django / react)
- Messaging technologies (rabbitMQ / kafka)
- Basic Linux system administration
- Continuous Integration technologies

Responsibilities:
- Design, build and maintain analytics solutions and Python bases platforms and services.
- Collaborate with teams to identify, profile and validate potential sources of data to meet reporting requirements
- Work with Analyst teams to ensure requirements are understood and translated into a development buildInput into the organization’s understanding of data utilization, i.e. canonical data models, data lineage, data dictionaries, user metric guides, and liaise accordingly with stakeholders
- Write high quality, extensible and testable code by applying good engineering practices (TDD, SOLID)
- Understand and apply modern technologies, data structures, and design patterns to solve real problems efficiently
- Understand data architecture and use appropriate design patterns and designs complex database tables
- Proactively identify and help fixing production and non-production application issues
- Develop reports, documents, and dashboards as per requirements
- Provide a high-level estimate of effort and risk regarding the expected deliverables
- Work as part of Agile team to maintain, improve, monitor data collection processes
- Take ownership and pride in the products they build and always make sure they are of the highest standard
- Be empathetic towards team members and customers

Technologies They Use:
- Languages: Python, Java, Scala, JavaScript (React, Backbone), SQL
- Frameworks: DropWizard, React, Akka, and Play Framework (Scala)
- Databases: PostgreSQL, AWS(S3), Redshift, Redis, MongoDB, Cassandra
- Technologies: RabbitMQ (messaging), Quartz scheduling, Docker and Kubernetes, MavenCI/CD: TeamCity, Jenkins
- Source Control: Git (GitHub)
- Other Tools: IntelliJ IDEA, Jira, Grafana

About the Data Team:
This company is a market leader in developing competitive intelligence for search. Their award-winning technology includes complex ETL and machine learning solutions. They have published authors in their engineering and data science team who contribute some of the major machine learning and distributed data technologies. They are a friendly, passionate group of engineers making a career out of building great software for their customers.
This is a great opportunity to take the lead in a new python data team. Their current data team is dealing with hundreds of millions of data points every day, generated from over two thousand data processes running through workflows, using huge distributed computations in spark, streaming data coming in twenty-four hours a day at hundreds of times a second.
Their engineering culture is underpinned by sharing knowledge, coaching, and growing together. You will have the opportunity to explore/innovate new technologies, mentor engineers, and lead Technology initiatives. You will enjoy this role if you love writing code, learning cutting-edge new technologies, solving problems, and winning as a team.
As a Python Data Engineer, you will be working across their entire stack, so a real passion to drive the product and technology forward is something that they value. Your responsibilities will include architecting and building a suite of technologies for use by analysts. You will work closely with Business Intelligence, Data, and Data Science teams to deliver user-centric solutions to their customers and become an expert in developing high-quality technical solutions.


About company:
The company's mission is a world of search transparency where precise ads connect marketers to consumers. This statement is key to their ethos here and is backed by their Whole Market View technology, a dynamic, AI-driven, data model that is unique for each advertiser, representing their entire relevant search landscape. Powered by their patented machine learning technology, Whole Market View provides the comprehensive data scope and quality required by the world’s leading advertisers to precisely assess competitive opportunities at scale across their entire market, without limitations. Their index information hourly, processing over 10TB of new data, 500 million adverts, and 200 million keywords across 15 different languages each day. The segmented data is presented in an intuitive format, helping digital marketers to understand their landscape and acquire more customers. The technology has also won a number of awards for its ease of use and value-added to clients including Best Search Software Tool at the UK Search Awards 2016, Technical Innovation of the Year at the Drum Search Awards 2017, Best Search Technology of the Year at the Biddable Media Awards 2017 and Best Tech Platform at the DADI awards 2017. The company was founded by Ian O’Rourke and is backed by Mel Morris, the entrepreneur behind Candy Crush and former chairman of King.com.