Position: Senior Data Quality Automation Engineer
Company: DASH Financial Technologies
Category: QA Automation
Experience required: 5y
English level: upper
Published: 2023-04-01T00:00:00+03:00

We are DASH Financial Technologies - the industry’s leading capital markets technology and execution provider. DASH Financial provides customizable trading technologies, execution services, analytics, and regulatory tools for the institutional trading community.

Required experience and skills for Senior Data Quality Test Automation Engineer:
Minimum experience required is 5 to 8 years in Automation Testing, with particular experience in ETL testing and/or Big Data Quality testing.

Responsibilities:
•	Design, lead, and manage a Data Quality and Testing Strategy.
•	Create test plans and test cases, manage continuous integration and regression testing processes – based on the requirements and in close collaboration with BA and Dev team.
•	Prepare Data Quality and Testing environments and applications in compliance with the standards
•	Collaborate with Dev and BA to obtain and/or prepare the Test Data sets.
•	Perform Data Profiling and benchmarking.
•	Design, monitor, and maintain DQ and QA reports, KPIs & quality trends.
•	Collaborate with all teams involved in Data Solution Development to ensure efficient tasks execution for achieving results.

Must have skills:
•	Ability to work in a fast-paced (startup like) agile development environment.
•	Advanced Test Automation, Data Quality framework application (e.g. Deequ).
•	Scripting, Data Analysis using Java/Scala, Python; should be able to write complex scripts.
•	Experience with (Py)Spark, Pandas, Jupyter Notebook.
•	Experience with Jaeger and/or Prometheus, Grafana – for monitoring, alerting, observability of streaming and batch data.
•	Advanced at doing Data Profiling and documenting the results.
•	Advanced at identifying common data issues related to data types, formats, missing values, duplicate data, errors in (application of) transformation rules etc.
•	Experience working with various file formats more specifically CSV (other delimited), XML, JSON; Columnar formats as Avro, knowledge of complex types in Avro would be a plus
•	Advanced at working with relational tables in SQL.
•	Good understanding of time series and historical data.
•	Good understanding of QA and Testing best practices.
•	Should have strong testing basics test process, design techniques, defect management & methodology.
•	Be able to create test plans and test cases to do end-to-end testing of data pipelines, and appropriately identify data quality issues, and document them for bug fixes; once the bugs are fixed - should be able to go back and do regression testing.
•	Good with designing test harness for automated testing.
•	Engineering experience and practice in Data Management, Data Quality verification/Data Governance, Data Visualization testing, Data Integration
•	Good Programming Skills in Java/Scala, Python.
•	Strong organizational and problem-solving skills with great attention to detail, critical thinking, solid communication.
•	Understanding of CI/CD principles and best practices in data processing.
•	Analytical approach to problem solving; excellent interpersonal and communication skills.
•	Experience in Data analysis & requirements validation.
•	English Upper-Intermediate.

Nice to have:
•	Technical background in development.
•	Experience in automated test suite integration with Continuous integration (Jenkins / Bamboo / TeamCity).
•	Familiar with concepts of data ingestion pipelines, data storages like: OLTP databases, Data Warehousing, Data Lakes.
•	Ability to read and understand code created by developers.
•	Reverse engineering experience.
•	Experience with streaming solutions.
•	Trading Domain knowledge (Equities and Options trading).
•	FIX (Financial Information eXchange) protocol knowledge.
•	Being comfortable in a fast-paced environment and able to deal with changes.
•	Fluency in English.


Workstream description:
Development of a streaming data platform for broker-dealers that enables real-time supervision, analytics, reporting and compliance in the U.S. Regulatory Space.

Team members: 1 PMs, 1 Technical Lead, 2 Systems analysts, 3 Java developers, 1 DevOps. There are plans to grow the team during the project development.

We are offering
•	Full-time remote job 
•	Flexible working hours (European time zone)
•	Direct contract with the company (as an independent contractor / PE)
•	Accounting support
•	Paid vacations and sick leave
•	All required equipment if necessary (laptop, monitors, chair, etc.)
•	No bureaucracy, you can easily communicate with C-level managers
•	Strong product-minded engineering team