semvec/pypi-packages huggingface dataset:
dbt-pal 0.3.0
A dbt adapter for running Python models without Dataproc or BigQuery DataFrames.
License: Apache-2.0
Requires Python: >=3.11

# dbt-pal

dbt-pal is **P**ython **A**dapter **L**ayer

A dbt adapter for running Python models without Dataproc or BigQuery DataFrames.

- SQL models work the same as dbt-bigquery
- Python models are executed in the process running dbt, and the results are written to BigQuery
- The only supported data platform is BigQuery

Inspired by [dbt-fal](https://github.com/fal-ai/dbt-fal), but this is an unrelated project with no guaranteed compatibility.

## Usage

### Installation

```
pip install dbt-pal
```

### Prerequisites

- Python >= 3.11
- dbt-core >= 1.11.0
- dbt-bigquery >= 1.11.0
- Authentication to BigQuery must be configured (e.g. `gcloud auth application-default login`)

### profiles.yml Configuration

Create a `target` with `type: pal` and specify the target name of the actual BigQuery `target` in `db_profile` field.

```yaml
my_project:
  target: pal
  outputs:
    pal:
      type: pal
      db_profile: bq
    bq:
      type: bigquery
      method: oauth
      project: my-project
      dataset: my_dataset
      location: asia-northeast1
```

## Limitations

- Only table materialization is supported
- Python models are executed in the process running dbt, so the data size that can be handled depends on the memory of that process

## License

Apache License 2.0.  
This project was created by modifying code from [dbt-fal](https://github.com/fal-ai/dbt-fal).
adapta 3.5.19
Logging, data connectors, monitoring, secret handling and general lifehacks to make data people lives easier.
License: Apache-2.0
Requires Python: <3.13,>=3.11

# Adapta
This project aim at providing tools needed for everyday activities of data scientists and engineers:
- Connectors for various cloud APIs
- Secure secret handlers for various remote storages
- Logging framework
- Metrics reporting framework
- Storage drivers for various clouds and storage types

## Delta Lake

This module provides basic Delta Lake operations without Spark session, based on [delta-rs](https://github.com/delta-io/delta-rs) project.

Please refer to the [module](adapta/storage/delta_lake/v3/README.md) documentation for examples.

## Secret Storages

Please refer to the [module](adapta/storage/secrets/README.md) documentation for examples.

## NoSql (Astra DB)

Please refer to the [module](adapta/storage/distributed_object_store/v3/datastax_astra/README.md) documentation for examples.

## Dataclass Validation framework
Please refer to the [module](adapta/dataclass_validation/README.md) documentation for examples.