Position: Software/Data Engineer
Category: Java
English level: upper
Years of experience: 11

The client put the whole team (except myself) on hold for ~3 months due to COVID.
During that time I had fixed existing issues, implemented new API's, successfully performed the rollout for the first production release and set up monitoring/alerting.

---

Set up new Hadoop cluster, prepared architecture for migration from old Hadoop cluster and implemented metadata and data replication between clusters, so that the migration can be done without impact to the business (no downtimes).

---

Implemented several operators for in-house execution engine (not SQL, but semantically close), along with the migration of dimension model from row storage to columnar storage (this was required by execution engine).
Currently (last 2 years) - tech&team lead. Main responsibility is long term architecture (no hard switch - new services should work along with legacy services during the long transition period), planning short-mid backlog and release/production rollout.

During the last ~9 years worked (lead and senior positions) almost exclusively on data and performance(latency/throughput of api/db/query engine) centric projects.

---

I would like to be less of a jack-of-all-trades and focus more on data-related and/or performance-critical parts of the project.
Not interested in team/tech lead positions.

----

Any of the following on the project would be a plus:
- Apache Arrow 
- Apache Arrow Datafusion (yes, I know it is in Rust)
- Apache Iceberg
- Presto/Trino
- Spark
- Observability (tracing/metrics/logs)

If the project is performance-centric (low latency and/or high throughput) - this is a big plus.