Position: Data Analyst Middle/Senior
Company: QArea/Test Fort
Experience required: 3y
Category: Other
English level: intermediate
Published: 2021-03-01T00:00:00+02:00

Requirements:
    • The engineer should have at least analytical skills and had experience in data analytics.
    • He may not have any ML model experience, just need basic data analytical skills.
    • He should have working experience with some python package to run data quality checks and cleansing.
    • Knowledge of anomaly and outlier detection on streaming(training and serving) data such as MAD (median absolute deviation), box/scatter/whisker plots, Correlation, etc...
    • Knowledge or experience in exploratory data analysis (EDA), data schema validation, imputation techniques, model evaluation concepts.
    • Experience with data quality check libraries such as TensorFlow Data Validation (TFDV), Datawig, DEEQUE.
    • Experience with data quality validation test cases, automation, alerting, and reporting tools.
    • Knowledge of Google Cloud services like BigQuery, Storage, Bigtable preferred.
    • Experience working on relational and non-relational databases like MySQL, HBase, etc.
    • English— Intermediate +
Duties:
    • Create feature roadmap, design, build and maintain an automated data quality assurance framework;
    • Understands basic machine learning concepts – predictive models and underlying mathematics;
    • Implement data quality governance and best practices;
    • Design and develop testing frameworks for Kubeflow ETL jobs, data pipelines, product recommendation ML model results;
    • Create/Manage validation test cases and SQL scripts for the large dataset in PROS environment and compare against data from source systems;
    • Track, monitor, and document testing results;
    • Analyze and troubleshoot data management code and issues;
    • Monitor and improve data platform;
    • Generate data quality reports and alerts.