lzanardos9 commited on
Commit
6bf7b48
·
verified ·
1 Parent(s): d92fecc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +103 -68
README.md CHANGED
@@ -7,137 +7,172 @@ sdk: static
7
  pinned: false
8
  ---
9
 
10
- Spatial9
11
 
12
- The Home of Generative Spatial Audio™
13
 
14
- Spatial9 is an AI research and technology company pioneering Generative Spatial Audio™ — a new paradigm where artificial intelligence understands music and automatically creates immersive spatial sound environments.
15
 
16
- Our mission is to enable creators, developers, and platforms to transform traditional audio into fully immersive spatial experiences using AI.
17
 
18
- What is Generative Spatial Audio™
19
 
20
- Generative Spatial Audio is the ability for AI systems to:
21
 
22
- • Understand musical structure
23
- • Detect instruments and sonic roles
24
- Position sound in 3D acoustic environments
25
- • Generate spatial movement and interaction
26
- Adapt mixes to immersive playback formats automatically
 
 
 
 
 
 
27
 
28
- Instead of manually mixing spatial audio, AI becomes the spatial mixer.
29
 
30
- This allows creators to convert stereo audio and video into immersive spatial scenes in seconds.
31
 
32
- Core Technologies
33
- GravityLLM
 
34
 
35
- The world's first Spatial Audio Language Model (SLM).
36
 
37
- GravityLLM understands music structure, instruments, and acoustic constraints to automatically generate spatial audio scenes.
38
 
39
- Capabilities
40
 
41
- AI-driven spatial object placement
42
- • Music-aware positioning and motion
43
- Automatic immersive mixing
44
- Scene generation for immersive audio formats
 
 
45
 
46
  GravityLLM converts:
47
 
 
48
  music + constraints → spatial audio scene
 
49
 
50
- Example generated layout:
51
 
 
52
  {
53
- "scene": {
54
- "layout": "7.1.4",
55
- "objects": [
56
- {"class": "lead_vocal", "az": 0, "el": 10, "distance": 1.5},
57
- {"class": "pad", "az": -70, "el": 20, "distance": 4},
58
- {"class": "fx", "az": 110, "el": 30, "distance": 6}
59
- ]
60
- }
61
  }
62
- Spatializer API
 
 
 
 
63
 
64
  The Spatializer API enables developers to convert audio into immersive spatial sound programmatically.
65
 
66
- Features
67
 
68
- Stereo Spatial Audio conversion
69
- Video spatialization
70
- Interactive sound environments
71
- Real-time immersive audio generation
72
 
73
- Eclipsa Audio Pipeline
74
 
75
- Spatial9 provides tools for producing immersive audio compatible with YouTube’s Eclipsa Audio ecosystem, enabling immersive audio distribution at scale.
76
 
77
- Models on Hugging Face
 
 
 
 
78
 
79
  The Spatial9 Hugging Face ecosystem includes models for:
80
 
81
- 🎵 Audio Understanding
82
 
83
- AI models that analyze music structure and instrument roles.
84
 
85
- 🌌 Spatial Scene Generation
86
 
87
- Models that predict spatial audio placement.
88
 
89
- GravityLLM
90
 
91
- The Spatial Audio Language Model powering immersive scene generation.
92
 
93
- Use Cases
94
- Music Production
 
 
 
95
 
96
  Convert stereo music into immersive spatial mixes automatically.
97
 
98
- Video Spatialization
99
 
100
  Spatialize video audio for immersive playback platforms.
101
 
102
- XR & Gaming
103
 
104
- Generate dynamic spatial sound environments.
105
 
106
- Creator Tools
107
 
108
- Enable creators to produce immersive audio without complex mixing workflows.
 
 
109
 
110
- Vision
111
 
112
- The future of audio will be interactive, spatial, and intelligent.
113
 
114
  Spatial9 is building the AI foundation that will power:
115
 
116
- immersive music
117
- spatial video
118
- XR audio environments
119
- adaptive sound experiences
120
 
121
- Generative Spatial Audio will transform how sound is created and experienced.
122
 
123
- Open Ecosystem
 
 
124
 
125
- Spatial9 believes immersive audio should be accessible and scalable.
126
 
127
  We are building open models, APIs, and developer tools that allow anyone to create immersive sound experiences.
128
 
129
- Links
 
 
130
 
131
  Website
132
- https://spatial9.com
 
133
 
134
  Hugging Face
135
- https://huggingface.co/spatial9
 
 
136
 
137
- Spatial9
138
 
139
  Generative Spatial Audio™
140
 
141
- AI that understands audio and generates immersive spatial sound.
 
 
 
 
142
 
143
- GravityLLM Spatializer API Immersive AI
 
7
  pinned: false
8
  ---
9
 
 
10
 
11
+ # Spatial9 Inc.
12
 
13
+ ![Spatial9 Banner](https://raw.githubusercontent.com/spatial9/assets/main/spatial9-banner.png)
14
 
15
+ ## Generative Spatial Audio™
16
 
17
+ Spatial9 is an artificial intelligence company pioneering **Generative Spatial Audio™**, a new paradigm where AI systems understand music and automatically generate immersive spatial sound environments.
18
 
19
+ Our mission is to enable creators, developers, and platforms to transform traditional audio into **interactive and immersive spatial experiences** using AI.
20
 
21
+ ---
22
+
23
+ # What is Generative Spatial Audio
24
+
25
+ Generative Spatial Audio is the capability for AI systems to:
26
+
27
+ * Understand musical structure and sonic roles
28
+ * Detect instruments and acoustic layers
29
+ * Place sounds in three-dimensional environments
30
+ * Generate spatial movement and interaction
31
+ * Adapt mixes to immersive playback formats automatically
32
 
33
+ Instead of manually mixing spatial audio objects, **AI becomes the spatial mixer**.
34
 
35
+ This allows creators to convert stereo music, video audio, and stems into **immersive spatial scenes in seconds**.
36
 
37
+ ---
38
+
39
+ # Core Technologies
40
 
41
+ ## GravityLLM
42
 
43
+ GravityLLM is the world's first **Spatial Audio Language Model (SLM)**.
44
 
45
+ GravityLLM understands musical structure, instruments, and acoustic constraints to automatically generate spatial audio scenes.
46
 
47
+ ### Capabilities
48
+
49
+ * AI-driven spatial object placement
50
+ * Music-aware positioning and motion
51
+ * Automatic immersive mixing
52
+ * Scene generation for immersive audio formats
53
 
54
  GravityLLM converts:
55
 
56
+ ```
57
  music + constraints → spatial audio scene
58
+ ```
59
 
60
+ Example output:
61
 
62
+ ```json
63
  {
64
+ "scene": {
65
+ "layout": "7.1.4",
66
+ "objects": [
67
+ { "class": "lead_vocal", "az": 0, "el": 10, "distance": 1.5 },
68
+ { "class": "pad", "az": -70, "el": 20, "distance": 4 },
69
+ { "class": "fx", "az": 110, "el": 30, "distance": 6 }
70
+ ]
71
+ }
72
  }
73
+ ```
74
+
75
+ ---
76
+
77
+ ## Spatializer API
78
 
79
  The Spatializer API enables developers to convert audio into immersive spatial sound programmatically.
80
 
81
+ ### Features
82
 
83
+ * Stereo to spatial audio conversion
84
+ * Video spatialization
85
+ * Interactive sound environments
86
+ * Real-time immersive audio generation
87
 
88
+ ---
89
 
90
+ ## Eclipsa Audio Pipeline
91
 
92
+ Spatial9 provides tools for producing immersive audio compatible with **YouTube's Eclipsa Audio ecosystem**, enabling immersive audio distribution at scale.
93
+
94
+ ---
95
+
96
+ # Models on Hugging Face
97
 
98
  The Spatial9 Hugging Face ecosystem includes models for:
99
 
100
+ ### Audio Understanding
101
 
102
+ AI models that analyze music structure, instrument roles, and sonic layers.
103
 
104
+ ### Spatial Scene Generation
105
 
106
+ Models that predict spatial placement of sound sources in immersive environments.
107
 
108
+ ### GravityLLM
109
 
110
+ The Spatial Audio Language Model responsible for generating **Spatial9Scene layouts**.
111
 
112
+ ---
113
+
114
+ # Use Cases
115
+
116
+ ## Music Production
117
 
118
  Convert stereo music into immersive spatial mixes automatically.
119
 
120
+ ## Video Spatialization
121
 
122
  Spatialize video audio for immersive playback platforms.
123
 
124
+ ## XR and Gaming
125
 
126
+ Generate dynamic spatial sound environments for interactive media.
127
 
128
+ ## Creator Tools
129
 
130
+ Enable creators to produce immersive audio without complex spatial mixing workflows.
131
+
132
+ ---
133
 
134
+ # Vision
135
 
136
+ The future of audio will be **interactive, spatial, and intelligent**.
137
 
138
  Spatial9 is building the AI foundation that will power:
139
 
140
+ * immersive music
141
+ * spatial video
142
+ * XR audio environments
143
+ * adaptive sound experiences
144
 
145
+ Generative Spatial Audio represents a new generation of sound creation and distribution.
146
 
147
+ ---
148
+
149
+ # Open Ecosystem
150
 
151
+ Spatial9 believes immersive audio should be **accessible and scalable**.
152
 
153
  We are building open models, APIs, and developer tools that allow anyone to create immersive sound experiences.
154
 
155
+ ---
156
+
157
+ # Links
158
 
159
  Website
160
+ [https://spatial9.com](https://spatial9.com)
161
+
162
 
163
  Hugging Face
164
+ [https://huggingface.co/spatial9](https://huggingface.co/spatial9)
165
+
166
+ ---
167
 
168
+ # Spatial9
169
 
170
  Generative Spatial Audio™
171
 
172
+ AI systems that understand music and generate immersive spatial sound.
173
+
174
+ GravityLLM • Spatializer API • Immersive AI
175
+
176
+ ---
177
 
178
+ If you'd like, I can also give you a **second README optimized for the GravityLLM model page itself**, which usually converts **much better on Hugging Face and attracts researchers and developers.**