Position: AI Data Analytics
Company: AppsDelivered
Category: Data Analyst
Experience required: no_exp
English level: upper

The AI Data Analytics role focuses on leveraging advanced analytical techniques to evaluate the performance of our AI models, specifically in the areas of Few-shot Learning Models (LLM) and model fine-tuning. The candidate will be responsible for calculating accuracy scores based on predetermined metrics, whether it's through testing specific AI features or evaluating the performance across all our products.
Key Responsibilities:

Model Evaluation:

Evaluate the performance of Few-shot Learning Models (LLM) and other AI models after fine-tuning.

Calculate accuracy scores using various metrics and methodologies.

Compare model performance against benchmarks and historical data.

2. Testing Strategy:

Design and implement testing strategies to evaluate specific AI features.

Develop comprehensive testing plans to assess the performance of AI across all our products.

Collaborate with the AI development team to understand model changes and their potential impact on performance.

3. Data Management:

Source, clean, and preprocess data for model evaluation.

Ensure data integrity and consistency for accurate performance measurement.

4. Reporting:

Generate regular reports on model performance, highlighting areas of improvement and success.

Present findings to both technical and non-technical stakeholders, providing actionable insights.

5. Continuous Learning:

Stay updated with the latest advancements in AI, machine learning, and data analytics.

Recommend new tools, techniques, and methodologies to improve model evaluation processes.

6. Soft Skills: Strong analytical and problem-solving skills.

Excellent communication skills, both written and verbal.

Ability to work collaboratively in a team environment.

Detail-oriented with a strong focus on accuracy and quality.
English B2

7. Preferred Qualifications:

Experience with Few-shot Learning Models (LLM) and model fine-tuning.

Certification in data analytics or machine learning.