semvec/pypi-packages huggingface dataset:
digixt-pipeline-template 1.4.1
A template generator for PySpark projects, streamlining the setup process with predefined structures and configurations.

# Digixt Pipeline Template Plugin Builder

## Overview
The Digixt Pipeline Template Plugin Builder is a tool designed to help you quickly set up PySpark projects with a predefined structure. It automates the creation of a project directory with necessary templates and configuration files, making it easier to get started with PySpark development.

## Features
## Features

- **Automated Project Structure**: Generates a standardized project directory with predefined directories and files, ensuring a consistent starting point for new PySpark projects.
- **Automated Data Migration Setup**: Generates a project structure specifically tailored for data migration from a database to Iceberg tables, including necessary configurations and files for seamless integration.
- **Customizable Configuration:** Supports the customization of project settings through configuration files, allowing adjustments to match specific project requirements.
- **Enhanced Functionality:** Offers enriched functions that assist Data Engineers in developing and managing PySpark pipelines efficiently.
- **Ease of Use:** Simplifies the setup process for new projects, reducing manual configuration and setup time.

## Installation
To install the plugin, use pip:

```pip install digixt-pipeline-template```

## Packaging manually on local (optional).


## Usage
To create a new PySpark project structure, run:

```digixt-pipeline-template --name <my-project-name> [-data-migration]```

Also, user can run  help command.

``` digixt-pipeline-template --help ```

Replace ```<my-project-name>``` with your desired project name.
django-communications 0.1.0
A Django app for tracking and sending communications like Emails and WhatsApp messages.
Requires Python: >=3.9

# django-communications

## Overview
`django-communications` is a Django package designed to provide a central platform for sending different types of communications such as emails, SMS, WhatsApp messages, push notifications, and more. Currently, it supports sending emails using an SMTP provider.

## Installation
To install `django-communications`, use pip:
```sh
pip install django-communications
```

## Configuration
Add `communication` to your `INSTALLED_APPS` in `settings.py`:
```python
INSTALLED_APPS = [
    ...
    'communication',
]
```

### Settings
Define the allowed communication types and configuration settings in `settings.py`:
```python
from communication.constants.communication_types import CommunicationTypes
from communication.constants.providers import EmailProviders

ALLOWED_COMMUNICATION_TYPES = [CommunicationTypes.EMAIL]

COMMUNICATION_CONFIG = {
    CommunicationTypes.EMAIL: {
        'provider': EmailProviders.SMTP,
        'smtp_host': 'smtp.gmail.com',
        'smtp_port': '587',
        'smtp_user': '',
        'smtp_password': '',
        'smtp_use_tls': True
    }
}
```

## Creating a Communication Event
Before sending communications, you need to create a **Communication Event**. This can be done through the Django Admin panel:
1. Navigate to **Communication Events** in the Django Admin.
2. Click **Add Communication Event**.
3. Define a **Code** for the event.
4. Select the allowed **Communication Types**.
5. Ignore the fields **Default Value** and **Can User Change Preference** (reserved for future use).
6. Save the event.

Once created, save the event's code in your constants for future use.

## Sending a Communication
To send a communication, create a `data_dict` with the necessary details:

```python
data_dict = {
    'emails': ['example@example.com'],
    'email_data': {
        'subject': "This is a Subject",
        'content': "This is content",  # Content can be plain text or HTML
        'attachments': []  # List of file paths if needed
    }
}
```

Then, initiate the communication using:
```python
from communication.communication import Communication

Communication().initiate_communication("{communication_event_code}", data_dict)
```

### Background Processing
You can also send communications in the background using Celery or threads to improve performance:
```python
from threading import Thread
Thread(target=Communication().initiate_communication, args=("{communication_event_code}", data_dict)).start()
```

## Viewing Logs
All sent communications can be viewed in the Django Admin under **Communication Requests**, allowing tracking and debugging.

## Future Enhancements
- Support for additional communication channels (SMS, WhatsApp, Push Notifications, etc.).
- User preference management for different communication types.

## Contributing
If you'd like to contribute to `django-communications`, feel free to submit a pull request or report issues on the GitHub repository.

## License
`django-communications` is open-source and available under the MIT License.
shang-guigu-java-jishu-zhi-gaoji-jiaocheng-fix1 2025.3.25.1
尚硅谷 Java 技术之高级教程
Requires Python: >=3.6

# 尚硅谷 Java 技术之高级教程

## 下载

### Docker

```
docker pull apachecn0/shang-guigu-java-jishu-zhi-gaoji-jiaocheng
docker run -tid -p <port>:80 apachecn0/shang-guigu-java-jishu-zhi-gaoji-jiaocheng
# 访问 http://localhost:{port} 查看文档
```

### PYPI

```
pip install shang-guigu-java-jishu-zhi-gaoji-jiaocheng
shang-guigu-java-jishu-zhi-gaoji-jiaocheng <port>
# 访问 http://localhost:{port} 查看文档
```

### NPM

```
npm install -g shang-guigu-java-jishu-zhi-gaoji-jiaocheng
shang-guigu-java-jishu-zhi-gaoji-jiaocheng <port>
# 访问 http://localhost:{port} 查看文档
```
shang-guigu-java-jishu-zhi-dianshang-xiangmu-fix1 2025.3.25.1
尚硅谷 Java 技术之电商项目
Requires Python: >=3.6

# 尚硅谷 Java 技术之电商项目

## 下载

### Docker

```
docker pull apachecn0/shang-guigu-java-jishu-zhi-dianshang-xiangmu
docker run -tid -p <port>:80 apachecn0/shang-guigu-java-jishu-zhi-dianshang-xiangmu
# 访问 http://localhost:{port} 查看文档
```

### PYPI

```
pip install shang-guigu-java-jishu-zhi-dianshang-xiangmu
shang-guigu-java-jishu-zhi-dianshang-xiangmu <port>
# 访问 http://localhost:{port} 查看文档
```

### NPM

```
npm install -g shang-guigu-java-jishu-zhi-dianshang-xiangmu
shang-guigu-java-jishu-zhi-dianshang-xiangmu <port>
# 访问 http://localhost:{port} 查看文档
```
shang-guigu-java-jichu-shizhan-zhi-yinxing-xiangmu-fix1 2025.3.25.1
尚硅谷 Java 基础实战之银行项目
Requires Python: >=3.6

# 尚硅谷 Java 基础实战之银行项目

## 下载

### Docker

```
docker pull apachecn0/shang-guigu-java-jichu-shizhan-zhi-yinxing-xiangmu
docker run -tid -p <port>:80 apachecn0/shang-guigu-java-jichu-shizhan-zhi-yinxing-xiangmu
# 访问 http://localhost:{port} 查看文档
```

### PYPI

```
pip install shang-guigu-java-jichu-shizhan-zhi-yinxing-xiangmu
shang-guigu-java-jichu-shizhan-zhi-yinxing-xiangmu <port>
# 访问 http://localhost:{port} 查看文档
```

### NPM

```
npm install -g shang-guigu-java-jichu-shizhan-zhi-yinxing-xiangmu
shang-guigu-java-jichu-shizhan-zhi-yinxing-xiangmu <port>
# 访问 http://localhost:{port} 查看文档
```
shang-guigu-it-jingying-jihua-javase-neibu-xuexi-biji-fix1 2025.3.25.1
尚硅谷 IT 精英计划 JavaSE 内部学习笔记
Requires Python: >=3.6

# 尚硅谷 IT 精英计划 JavaSE 内部学习笔记

## 下载

### Docker

```
docker pull apachecn0/shang-guigu-it-jingying-jihua-javase-neibu-xuexi-biji
docker run -tid -p <port>:80 apachecn0/shang-guigu-it-jingying-jihua-javase-neibu-xuexi-biji
# 访问 http://localhost:{port} 查看文档
```

### PYPI

```
pip install shang-guigu-it-jingying-jihua-javase-neibu-xuexi-biji
shang-guigu-it-jingying-jihua-javase-neibu-xuexi-biji <port>
# 访问 http://localhost:{port} 查看文档
```

### NPM

```
npm install -g shang-guigu-it-jingying-jihua-javase-neibu-xuexi-biji
shang-guigu-it-jingying-jihua-javase-neibu-xuexi-biji <port>
# 访问 http://localhost:{port} 查看文档
```
shang-guigu-da-shuju-jishu-zhi-zookeeper-fix1 2025.3.25.1
尚硅谷大数据技术之 Zookeeper
Requires Python: >=3.6

# 尚硅谷大数据技术之 Zookeeper

## 下载

### Docker

```
docker pull apachecn0/shang-guigu-da-shuju-jishu-zhi-zookeeper
docker run -tid -p <port>:80 apachecn0/shang-guigu-da-shuju-jishu-zhi-zookeeper
# 访问 http://localhost:{port} 查看文档
```

### PYPI

```
pip install shang-guigu-da-shuju-jishu-zhi-zookeeper
shang-guigu-da-shuju-jishu-zhi-zookeeper <port>
# 访问 http://localhost:{port} 查看文档
```

### NPM

```
npm install -g shang-guigu-da-shuju-jishu-zhi-zookeeper
shang-guigu-da-shuju-jishu-zhi-zookeeper <port>
# 访问 http://localhost:{port} 查看文档
```
shang-guigu-da-shuju-jishu-zhi-sqoop-oozie-azkaban-fix1 2025.3.25.1
尚硅谷大数据技术之 Sqoop Oozie Azkaban
Requires Python: >=3.6

# 尚硅谷大数据技术之 Sqoop Oozie Azkaban

## 下载

### Docker

```
docker pull apachecn0/shang-guigu-da-shuju-jishu-zhi-sqoop-oozie-azkaban
docker run -tid -p <port>:80 apachecn0/shang-guigu-da-shuju-jishu-zhi-sqoop-oozie-azkaban
# 访问 http://localhost:{port} 查看文档
```

### PYPI

```
pip install shang-guigu-da-shuju-jishu-zhi-sqoop-oozie-azkaban
shang-guigu-da-shuju-jishu-zhi-sqoop-oozie-azkaban <port>
# 访问 http://localhost:{port} 查看文档
```

### NPM

```
npm install -g shang-guigu-da-shuju-jishu-zhi-sqoop-oozie-azkaban
shang-guigu-da-shuju-jishu-zhi-sqoop-oozie-azkaban <port>
# 访问 http://localhost:{port} 查看文档
```
shang-guigu-da-shuju-jishu-zhi-spark-fix1 2025.3.25.1
尚硅谷大数据技术之 Spark
Requires Python: >=3.6

# 尚硅谷大数据技术之 Spark

## 下载

### Docker

```
docker pull apachecn0/shang-guigu-da-shuju-jishu-zhi-spark
docker run -tid -p <port>:80 apachecn0/shang-guigu-da-shuju-jishu-zhi-spark
# 访问 http://localhost:{port} 查看文档
```

### PYPI

```
pip install shang-guigu-da-shuju-jishu-zhi-spark
shang-guigu-da-shuju-jishu-zhi-spark <port>
# 访问 http://localhost:{port} 查看文档
```

### NPM

```
npm install -g shang-guigu-da-shuju-jishu-zhi-spark
shang-guigu-da-shuju-jishu-zhi-spark <port>
# 访问 http://localhost:{port} 查看文档
```
shang-guigu-da-shuju-jishu-zhi-scala-yuyan-hexin-biancheng-fix1 2025.3.25.1
尚硅谷大数据技术之 Scala 语言核心编程
Requires Python: >=3.6

# 尚硅谷大数据技术之 Scala 语言核心编程

## 下载

### Docker

```
docker pull apachecn0/shang-guigu-da-shuju-jishu-zhi-scala-yuyan-hexin-biancheng
docker run -tid -p <port>:80 apachecn0/shang-guigu-da-shuju-jishu-zhi-scala-yuyan-hexin-biancheng
# 访问 http://localhost:{port} 查看文档
```

### PYPI

```
pip install shang-guigu-da-shuju-jishu-zhi-scala-yuyan-hexin-biancheng
shang-guigu-da-shuju-jishu-zhi-scala-yuyan-hexin-biancheng <port>
# 访问 http://localhost:{port} 查看文档
```

### NPM

```
npm install -g shang-guigu-da-shuju-jishu-zhi-scala-yuyan-hexin-biancheng
shang-guigu-da-shuju-jishu-zhi-scala-yuyan-hexin-biancheng <port>
# 访问 http://localhost:{port} 查看文档
```
shang-guigu-da-shuju-jishu-zhi-redis-fix1 2025.3.25.1
尚硅谷大数据技术之 Redis
Requires Python: >=3.6

# 尚硅谷大数据技术之 Redis

## 下载

### Docker

```
docker pull apachecn0/shang-guigu-da-shuju-jishu-zhi-redis
docker run -tid -p <port>:80 apachecn0/shang-guigu-da-shuju-jishu-zhi-redis
# 访问 http://localhost:{port} 查看文档
```

### PYPI

```
pip install shang-guigu-da-shuju-jishu-zhi-redis
shang-guigu-da-shuju-jishu-zhi-redis <port>
# 访问 http://localhost:{port} 查看文档
```

### NPM

```
npm install -g shang-guigu-da-shuju-jishu-zhi-redis
shang-guigu-da-shuju-jishu-zhi-redis <port>
# 访问 http://localhost:{port} 查看文档
```
shang-guigu-da-shuju-jishu-zhi-linux-fix1 2025.3.25.1
尚硅谷大数据技术之 Linux
Requires Python: >=3.6

# 尚硅谷大数据技术之 Linux

## 下载

### Docker

```
docker pull apachecn0/shang-guigu-da-shuju-jishu-zhi-linux
docker run -tid -p <port>:80 apachecn0/shang-guigu-da-shuju-jishu-zhi-linux
# 访问 http://localhost:{port} 查看文档
```

### PYPI

```
pip install shang-guigu-da-shuju-jishu-zhi-linux
shang-guigu-da-shuju-jishu-zhi-linux <port>
# 访问 http://localhost:{port} 查看文档
```

### NPM

```
npm install -g shang-guigu-da-shuju-jishu-zhi-linux
shang-guigu-da-shuju-jishu-zhi-linux <port>
# 访问 http://localhost:{port} 查看文档
```
shang-guigu-da-shuju-jishu-zhi-kafka-fix1 2025.3.25.1
尚硅谷大数据技术之 Kafka
Requires Python: >=3.6

# 尚硅谷大数据技术之 Kafka

## 下载

### Docker

```
docker pull apachecn0/shang-guigu-da-shuju-jishu-zhi-kafka
docker run -tid -p <port>:80 apachecn0/shang-guigu-da-shuju-jishu-zhi-kafka
# 访问 http://localhost:{port} 查看文档
```

### PYPI

```
pip install shang-guigu-da-shuju-jishu-zhi-kafka
shang-guigu-da-shuju-jishu-zhi-kafka <port>
# 访问 http://localhost:{port} 查看文档
```

### NPM

```
npm install -g shang-guigu-da-shuju-jishu-zhi-kafka
shang-guigu-da-shuju-jishu-zhi-kafka <port>
# 访问 http://localhost:{port} 查看文档
```