Position: Senior Data Engineer / DevOps
Category: Data Engineer
English level: fluent
Years of experience: 5

Ported CI/CD workflows for building containers from bitbucket pipelines to aws codebuild

Developed and deployed data pipeline 
"incoming webhooks -> snowflake" using AWS Api gateway, SQS, Lambda, Kinesis datastream/firehose, snowpipes.

Implemented a feature for an internal tool that allows it to build data warehouse replica containers for both amd64 and arm64 architectures.
Data Engineer/DevOps (ad-tech domain) 
Apr 2022 - present
Working with internal tools to support analytics team Main such tool was a sampling engine to create Snowflake sampled replicas in a form of a Postgres container for local work.
Deploying cloud infrastructure on AWS using terraform. Services used: S3, IAM, Lambda, Kinesis, Kinesis Firehose.
Developing containerised ETL jobs to move data from anywhere to snowflake dwh using snowpipes.
Implementing CICD for purposes of testing and building containers.
Working on snowflake stored procedures used for compliance with PII related regulations.
Performing admin-related Snowflake tasks (roles, schemas, integrations) using Schemachange

Data Platform Engineer, contract, (retail) Apr 2023
Architecture planning (GCP: Cloud Run Jobs, Bigquery, Looker, Pub/Sub; Other: DBT, Slack integrations, Google Sheets integration).
Deployment of the above (Terraform).
Porting workflows from excel reports to the cloud.
Training staff on working on this platform.

Data Engineer  Nov 2020 - Apr 2022
Developing python scripts for semi or complete automation of data collection and preparing for ingestion into proprietary system using various sources.
Financial data sets analysis.
Writing and maintaining documentation of implemented solutions and user workflows.
Communication with customer’s stakeholders, clarifying task requirements and making changes according to business needs.
Communication with data providers across the globe
 New employee onboarding

Data Analyst Mar 2018 - Nov 2020
Developing regular and ad-hoc reports in Excel and Power BI
Establishing data pipelines for automated reporting
MSSQL DB administration
Power BI server management