Position: Jr/Mid Data Engineer
Company: Forecasa
Experience required: 1y
Category: Data Engineer
English level: upper
Published: 2022-03-01T00:00:00+02:00

For the last two years, we've operated in stealth mode as we developed our MVP product and established our client base. This upcoming year we are adding product lines that will include significant greenfield engineering projects. 

We are looking for an enthusiastic Junior or Mid level Data Engineer who is interested in working with a fast-growing team in building industry-leading private lending data services. You will be part of designing and implementing server side services to ingest, organize, analyze, and display private lending data and insight. You will be working in a small team and be a real partner in the design and implementation of all aspects of our product.

Our current tech stack primarily uses Kubernetes, Docker, Airflow, PySpark, Pandas, DBT, Postgres, S3, and gitlab for CI/CD.

You will be responsible for:
- Developing ETL pipelines using a combination of DBT(sql), Spark, and Pandas.
- Integrating data scraped from websites and our OCR/NLP pipelines.
- Creating new pipelines to execute transformations on scraped data in pyspark, pandas, and sql.