open-index/open-npm huggingface dataset:
npm package: @open-engx/node
Description: OpenEngX is an open source EngX (Engineering Excellence) tool to help you build the project right.
Author: Jacky Song
Latest version: 0.1.5
Deprecated: Package no longer supported. Contact Support at https://www.npmjs.com/support for more info.

# OpenEngX User Guide

OpenEngX is an open source EngX (Engineering Excellence) tool to help you build the project right.

> Engineering excellence is usually defined in terms of efficiency and effectiveness in delivering business value and satisfying customer needs. It requires continuous learning, collaboration, and adaptation to emerging technologies and changing customer needs. Software engineers must work together as interdisciplinary teams to formulate solution strategies, foster innovation, and create value for customers and stakeholders.

For details, please refer to [this great blog](https://solutionshub.epam.com/blog/post/engineering-excellence-in-software-development).

## Commands

OpenEngX checks your node project.

To run OpenEngX, use:

```bash
npx @open-engx/node
```

This gives you suggestions to achieve engineering excellence.

To get a help, use `npx @open-engx/node -h` or `npx @open-engx/node --help`.

## TODO

### Chore (apply EngX best practices)

- git hooks (husky, lint commit message, and others)
- static code analysis (eslint, prettier, SonarQube or other tools)
- test (unit tests, integration tests, e2e tests)
- CI/CD
- code coverage report
- security analysis (npm-audit, snyk, or other tools)
- observability (logging, error handling, error report, .etc.)
- monorepo (@open-engx/core, @open-engx/node, @open-engx/react, @open-engx/vue, @open-engx/angular, etc.)

### Feature (check EngX best practices)

- check git hooks (husky, lint commit message, and others)
- check static code analysis (eslint, prettier, SonarQube or other tools)
- check test (unit tests, integration tests, e2e tests)
- check CI/CD
- check code coverage report
- check security analysis (npm-audit, snyk, or other tools)
- check observability (logging, error handling, error report, .etc.)
- support monorepo projects
- support react/vue/angular projects
npm package: @open-evals/core
Description: Core package for Open Evals
Author: Can Temizyurek
Latest version: 0.1.3

# @open-evals/core

Core evaluation framework for testing and measuring LLM application performance.

## Installation

```bash
pnpm add @open-evals/core
```

## Features

- **Datasets**: Create and manage evaluation datasets with single-turn or multi-turn samples
- **Metrics**: Define custom metrics or use built-in ones for evaluation
- **Evaluation Engine**: Run evaluations with configurable concurrency and error handling
- **Type Safety**: Full TypeScript support with comprehensive type definitions
npm package: @open-evals/generator
Description: Generator for Open Evals
Author: Can Temizyurek
Latest version: 0.1.2

# @open-evals/generator

Synthetic test data generation for LLM applications using knowledge graphs, personas, and scenarios.

## Installation

```bash
pnpm add @open-evals/generator
```

## Features

- **Knowledge Graphs**: Build and transform document relationships into structured knowledge
- **Personas**: Generate diverse user personas from your documents
- **Scenarios**: Create realistic query scenarios with different styles and complexities
- **Query Synthesis**: Automatically generate test queries (single-hop and multi-hop)
- **Transforms**: Pipeline-based document processing (chunk, embed, summarize, etc.)
npm package: @open-evals/metrics
Description: Metrics for Open Evals
Author: Can Temizyurek
Latest version: 0.1.4

# @open-evals/metrics

Pre-built evaluation metrics for RAG and LLM applications.

## Installation

```bash
pnpm add @open-evals/metrics
```

## Features

- **Faithfulness**: Measures how grounded responses are in the provided context
- **Factual Correctness**: Evaluates factual accuracy against reference answers
- **Answer Similarity**: Semantic similarity between generated and reference answers
- **Context Recall**: Measures retrieval quality against reference answers
- **Noise Sensitivity**: Tests robustness against irrelevant context
- **Evalite Integration**: Convert metrics to Evalite scorers
npm package: @open-evals/rag
Description: RAG utilities for Open Evals
Author: Can Temizyurek
Latest version: 0.1.5

# @open-evals/rag

RAG (Retrieval-Augmented Generation) utilities for text processing and chunking.

## Installation

```bash
pnpm add @open-evals/rag
```

## Features

- **Text Splitters**: Intelligent chunking strategies for different document types
- **Recursive Character Splitting**: Smart text splitting with configurable separators
- **Markdown Splitting**: Specialized splitter for markdown documents
- **Flexible Configuration**: Customizable chunk sizes, overlap, and separator handling