Position: Lead Big Data Engineer
Company: Toughbyte
Category: Data Engineer
Experience required: 5y
English level: upper
Published: 2022-02-01T00:00:00+02:00

Company creates an intelligent site search solution designed to help eCommerce businesses increase onsite sales and improve the customer online shopping experience. The company produces mass amounts of data on a daily basis. Combined with shopping data being directly delivered to their backend systems with access to shopping catalogues containing both the structured attributes and unstructured product descriptions, they have a wealth of data with immense opportunity to extract valuable insights and improve search accuracy.

Tasks:
Architect, build and scale the company's data platform
Lead the effort on democratizing data within the company
Design and develop solutions for business needs on the data platform
Provide technical guidance and mentor the team

Must-have:
5+ years of experience working with big data systems
Experience in designing and scaling large data pipelines and data lakes/warehouses
Strong experience in one of the data processing technologies like Spark, Storm, Flink, etc
Experience working with NoSQL and data warehouse technologies like Redshift, BigQuery, etc
Product minded engineer with strong problem solving and analytical skills
Ability to communicate effectively within and outside the organization, and write good technical documentation
Familiar with Agile software development process
Excellent oral and written communication in English

Nice-to-have:
Experience in AWS cloud
Familiar with R or Python
Experience working with microservices architecture
Experience working in eCommerce and/or SAAS startups