semvec/pypi-packages huggingface dataset:
capturejob 0.3.1
A library to capture job outputs to persistent storage
License: MIT
Requires Python: >=3.8,<4.0

# CaptureJob

This library provides the ability to copy stdout and stderr files to cloud storage.

## Usage

Programmatically it is used like this:
```
from capturejob import CaptureJob

CaptureJob()
```

but mainly its intended to be used in a dockerfile command script followng execution of a command script.

```
echo "Running batch"

cd /work && poetry run python src/etl_noop/batchrun.py

TASK_ID="...
JOB_DATE="..."
CAPTURE_CONNECTION_STRING="..." 
CAPTURE_CONTAINER_NAME="..."
poetry run python -m capturejob 

echo "Done"
```

## Configuration

The following environment variables need to be set

- TASK_ID:  A name of the job which is used in the storage folder name created
- JOB_DATE:  The date of the job which is used in the storage folder name created
- CAPTURE_CONNECTION_STRING: Azure connection string
- CAPTURE_CONTAINER_NAME: Azure container name