Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -12,107 +12,33 @@ pinned: false
|
|
| 12 |
This repository hosts the official models and datasets released as part of the Human Behavior Atlas (HBA) project β a benchmark and foundation model ecosystem for unified multimodal social behavior understanding and reasoning.
|
| 13 |
|
| 14 |
The resources include:
|
| 15 |
-
- Unified behavioral foundation models
|
| 16 |
- Specialized downstream behavioral adapters
|
| 17 |
-
- The Human Behavior Atlas benchmark
|
| 18 |
|
| 19 |
---
|
| 20 |
|
| 21 |
-
# Models
|
| 22 |
-
|
| 23 |
-
## [OmniSapiens 2.0](https://huggingface.co/HumanBehaviorAtlas/OmniSapiens2.0)
|
| 24 |
-
|
| 25 |
-
**Repository:** `HumanBehaviorAtlas/OmniSapiens2.0`
|
| 26 |
-
|
| 27 |
-
**OmniSapiens 2.0** is the latest and strongest OmniSapiens foundation model for multimodal social behavior reasoning. The model is trained using **Heterogeneity-Aware Relative Policy Optimization (HARPO)** on the Human Behavior Atlas benchmark, enabling more balanced and consistent learning across diverse behavioral tasks and domains.
|
| 28 |
-
|
| 29 |
-
The model supports unified reasoning over:
|
| 30 |
-
- Emotion understanding
|
| 31 |
-
- Humor detection
|
| 32 |
-
- Sarcasm understanding
|
| 33 |
-
- Sentiment analysis
|
| 34 |
-
- Social reasoning
|
| 35 |
-
- Behavioral interpretation
|
| 36 |
-
|
| 37 |
-
This model represents the current state-of-the-art OmniSapiens release.
|
| 38 |
-
|
| 39 |
-
---
|
| 40 |
-
|
| 41 |
-
## [OmniSapiens SFT](https://huggingface.co/HumanBehaviorAtlas/omnisapiens_sft)
|
| 42 |
-
|
| 43 |
-
**Repository:** `HumanBehaviorAtlas/omnisapiens_sft`
|
| 44 |
-
|
| 45 |
-
**OmniSapiens SFT** is the supervised fine-tuned version of OmniSapiens trained on Human Behavior Atlas tasks using classification and QA-style supervision.
|
| 46 |
-
|
| 47 |
-
This model serves as:
|
| 48 |
-
- The supervised baseline prior to reasoning-RL training
|
| 49 |
-
- The initialization model for subsequent RL-based OmniSapiens variants
|
| 50 |
-
- A unified multimodal behavioral understanding model
|
| 51 |
-
|
| 52 |
-
---
|
| 53 |
-
|
| 54 |
-
## [BAM β Humour Detection Adapter](https://huggingface.co/HumanBehaviorAtlas/omnisapiens_bam_humour_detection)
|
| 55 |
-
|
| 56 |
-
**Repository:** `HumanBehaviorAtlas/omnisapiens_bam_humour_detection`
|
| 57 |
-
|
| 58 |
-
A specialized **Behavioral Adapter Module (BAM)** trained for multimodal humor detection tasks.
|
| 59 |
-
|
| 60 |
-
This adapter is designed for downstream humor understanding applications while retaining the broader OmniSapiens behavioral representations.
|
| 61 |
-
|
| 62 |
---
|
| 63 |
|
| 64 |
-
#
|
| 65 |
-
|
| 66 |
-
**Repository:** `HumanBehaviorAtlas/omnisapiens_bam_sarcasm_detection`
|
| 67 |
-
|
| 68 |
-
A specialized **Behavioral Adapter Module (BAM)** optimized for sarcasm detection and sarcastic intent understanding across multimodal behavioral inputs.
|
| 69 |
-
|
| 70 |
-
---
|
| 71 |
-
|
| 72 |
-
## [BAM β Sentiment Polarity (MOSEI) Adapter](https://huggingface.co/HumanBehaviorAtlas/omnisapiens_bam_sentiment_polarity_mosei)
|
| 73 |
-
|
| 74 |
-
**Repository:** `HumanBehaviorAtlas/omnisapiens_bam_sentiment_polarity_mosei`
|
| 75 |
-
|
| 76 |
-
A specialized **Behavioral Adapter Module (BAM)** trained for sentiment polarity prediction on the MOSEI benchmark.
|
| 77 |
-
|
| 78 |
-
The adapter supports multimodal sentiment understanding using behavioral and expressive cues.
|
| 79 |
-
|
| 80 |
-
---
|
| 81 |
-
|
| 82 |
-
# Datasets
|
| 83 |
-
|
| 84 |
-
## [Human Behavior Atlas (Parquet Version)](https://huggingface.co/datasets/HumanBehaviorAtlas/human_behavior_atlas)
|
| 85 |
-
|
| 86 |
-
**Repository:** `HumanBehaviorAtlas/human_behavior_atlas`
|
| 87 |
-
|
| 88 |
-
The primary release of the **Human Behavior Atlas (HBA)** benchmark.
|
| 89 |
-
|
| 90 |
-
This version is distributed in **Parquet format**, which is generally easier and faster to use with the Hugging Face `datasets` library and most downstream training pipelines.
|
| 91 |
|
| 92 |
-
|
| 93 |
-
-
|
| 94 |
-
|
| 95 |
-
-
|
| 96 |
-
|
| 97 |
-
|
| 98 |
-
|
| 99 |
-
- Mental health related behavioral understanding
|
| 100 |
|
|
|
|
| 101 |
|
| 102 |
---
|
| 103 |
|
| 104 |
-
#
|
| 105 |
-
|
| 106 |
-
**Repository:** `HumanBehaviorAtlas/human_behavior_atlas_tar`
|
| 107 |
-
|
| 108 |
-
An alternative release of the Human Behavior Atlas benchmark distributed in **TAR file format**.
|
| 109 |
-
|
| 110 |
-
This version may be useful for:
|
| 111 |
-
- Custom preprocessing pipelines
|
| 112 |
-
- Streaming-based workflows
|
| 113 |
-
- Manual media extraction
|
| 114 |
-
- Large-scale storage systems
|
| 115 |
|
| 116 |
-
|
|
|
|
|
|
|
|
|
|
| 117 |
|
| 118 |
-
|
|
|
|
| 12 |
This repository hosts the official models and datasets released as part of the Human Behavior Atlas (HBA) project β a benchmark and foundation model ecosystem for unified multimodal social behavior understanding and reasoning.
|
| 13 |
|
| 14 |
The resources include:
|
| 15 |
+
- Unified OmniSapiens behavioral foundation models
|
| 16 |
- Specialized downstream behavioral adapters
|
| 17 |
+
- The Human Behavior Atlas benchmark
|
| 18 |
|
| 19 |
---
|
| 20 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
---
|
| 22 |
|
| 23 |
+
# Models
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 24 |
|
| 25 |
+
| Model | Description |
|
| 26 |
+
|---|---|
|
| 27 |
+
| [OmniSapiens 2.0](https://huggingface.co/HumanBehaviorAtlas/OmniSapiens2.0) | Latest and strongest OmniSapiens reasoning foundation model trained with HARPO for unified multimodal social behavior understanding. |
|
| 28 |
+
| [OmniSapiens SFT](https://huggingface.co/HumanBehaviorAtlas/omnisapiens_sft) | Supervised fine-tuned OmniSapiens model used as the initialization model for RL training. |
|
| 29 |
+
| [BAM β Humour Detection](https://huggingface.co/HumanBehaviorAtlas/omnisapiens_bam_humour_detection) | Behavioral Adapter Module specialized for multimodal humor detection. |
|
| 30 |
+
| [BAM β Sarcasm Detection](https://huggingface.co/HumanBehaviorAtlas/omnisapiens_bam_sarcasm_detection) | Behavioral Adapter Module specialized for sarcasm understanding. |
|
| 31 |
+
| [BAM β Sentiment Polarity (MOSEI)](https://huggingface.co/HumanBehaviorAtlas/omnisapiens_bam_sentiment_polarity_mosei) | Behavioral Adapter Module for multimodal sentiment polarity prediction. |
|
|
|
|
| 32 |
|
| 33 |
+
**OmniSapiens 2.0** is the latest and strongest OmniSapiens foundation model for multimodal social behavior reasoning. The model is trained using **Heterogeneity-Aware Relative Policy Optimization (HARPO)** on the Human Behavior Atlas benchmark, enabling more balanced and consistent learning across diverse behavioral tasks and domains. The model demonstrates strong multi-task performance, out-of-distribution generalization, and more interpretable reasoning traces.
|
| 34 |
|
| 35 |
---
|
| 36 |
|
| 37 |
+
# Benchmark
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
|
| 39 |
+
| Dataset | Description |
|
| 40 |
+
|---|---|
|
| 41 |
+
| [Human Behavior Atlas (Parquet)](https://huggingface.co/datasets/HumanBehaviorAtlas/human_behavior_atlas) | Primary HBA release optimized for Hugging Face `datasets` workflows. |
|
| 42 |
+
| [Human Behavior Atlas (TAR)](https://huggingface.co/datasets/HumanBehaviorAtlas/human_behavior_atlas_tar) | TAR-based release for custom preprocessing and large-scale storage workflows. |
|
| 43 |
|
| 44 |
+
The version distributed in **Parquet format**, is generally easier and faster to use with the Hugging Face `datasets` library and most downstream training pipelines. Although, we also provide the tar version to allow for flexible use.
|