# Nouns AR Lab


# TLDR

**Pilot project introducing 3 AR experiences to the Nouns community, with 3 ETH for development and 2 ETH to encourage community engagement within rounds.wtf. If successful, we'll seek further funding to expand AR applications, enhance web and app development, and diversify with more AR experiences, supporting NounsDAO and its community projects.**

**Total 5 ETH**

-------
AR use cases are often highly specific, requiring creative solutions tailored to particular events and campaigns within the Nouns community. Therefore, instead of requesting a large budget initially, we prefer a kickstart budget. Once the project proves successful, we will seek semi-retroactive funding to continue development (web and apps) and gradually expand our portfolio to include a diverse range of 12+ AR experiences.

![1](https://hackmd.io/_uploads/B1z7JYBB0.png)

# AR Introduction
### What is Augmented Reality (AR)

- Enhances real-world perception by overlaying digital objects onto physical environments via smartphones or head-mounted displays with real-time render.
- Advanced significantly in recent years, shifting from a simple augmentation of the physical world to a social design tool, enabling immersive experiences that seamlessly interact with the user's environment.

### Why Augmented Reality?:

- Offers immersive and personalized experiences with higher retention and engagement compared to static traditional media. 
- Encourages active promotion of projects with easy-to-use, interactive content.
-  Ideal for community-based projects, as it fosters trust and encourages natural support

### The Rise of Social AR
- Previously required standalone apps, creating barriers to entry.
- Now integrated into social media platforms like Snapchat, Meta, and TikTok.
- Increases accessibility, reduces development costs, and boosts engagement and sharing.

### Our Vision:

Our goal is to create fun and innovative AR experiences that enhance the Nouns community and showcase the Nouns brand. We want everyone to have easy access and enjoy these experiences. By studying the results, we will gather feedback to improve and expand these experiences, making sure they meet the changing needs of the Nouns community

---
We plan to create the following experiences:

> Note: this is work in progress

# AR Concept 1: Giant Nouns
##### [Video Demo ](https://x.com/mmsolig/status/1783112975655763982) | Snap AR | World Tracker 

Users will find themselves surrounded by towering Nouns emerging from a distance. Some of these giant Nouns will approach the user, while others will animate individually, perhaps dancing or engaging in playful interactions. To convey a sense of scale and distance, we'll utilize sky segmentation ML, which will make the 3D models appear as towering giants in the distance. 

![](https://media.giphy.com/media/v1.Y2lkPTc5MGI3NjExbmQwaDZydWVzOTJlNDk2YWY4cm5xNmI1aThta3R4dWJoZzJlYWg2OSZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/DEkZpWJC90OtUixVOj/giphy.gif)
![](https://media.giphy.com/media/v1.Y2lkPTc5MGI3NjExa2lnaGo2c21tbHV5OHhmajdsazdpN2E5bzkzZzQxcGNrcTZ1em56aCZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/SLAeHGBCpdvrzO0icB/giphy-downsized-large.gif)

Features:
- Character Personalization: Some characters will use actual Nouns builder PFP instead of randomly generated ones
- Enhanced Interactivity: Users will have the ability to tap on characters to trigger some reactions
- Expanded Noun Selection: Currently, we've only utilized about 30% of the size limit. We plan to incorporate an additional 20-30 nouns into the experience.
- Animation will be more diverse and not too repetitive
-  There will be a  airplane banner, which will regularly update to upcoming events from Nouns:

![is COMing!](https://hackmd.io/_uploads/SJlNmOfLC.png)



# AR Concept 2: Enter the World of Nouns
##### [Video Demo](https://www.youtube.com/shorts/xTyeuMSyvKo) | [Test on Snapchat](https://www.snapchat.com/lens/f0416812a8f746c483d26056341d2499?type=SNAPCODE&metadata=01) | Snap AR | World Mesh

This concept transforms our reality into a world of Nouns. The AR effect brings Nouns heads' traits into the physical world, adding diverse features to our surroundings.

This AR experience can recognize surfaces like the ground, tables, walls, and ceilings, and adds the appropriate head traits to them. we will updating this experience with adding more dynamic animations, enhance the materials and adding more details.

![](https://media.giphy.com/media/v1.Y2lkPTc5MGI3NjExajl3OHR2ZnFsZGZ0bnIzMHkxYWRsbWxyNnp3ajg1NjV6OTJyemtkOCZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/CBGJVQG0xthxjJgYgd/giphy-downsized.gif)



# AR Concept 3: Nounification Station
##### [WebAR testing on browser](https://lens.snap.com/experience/257a1274-cc99-4852-a7f1-b2d0a5f4892c) | Snap AR | Body Tracker / Interactive

This Experience designed to put in the desktop + big screen with camera which can be put in the nounish event like: Edcon or upcoming Nouns Fest 2024.
![by snapchat (900 x 750 px) (7)](https://hackmd.io/_uploads/HyjWsirUR.png)



  **User Journey:**
- When a user passes in front of the monitor installation, their body is detected.
- A rapid sequence of Nouns ecosystem logos and icons (e.g., Noggles, Nouns logo, $NOGS coin, Nouns GG logo, head traits, TNS etc.) is throwed onto the user's body.
- After 5-7 seconds of body detection and non-stop throwing :  
    - The user is transformed into a Nouns character (details subject to change).
    - A "nounishness level" appears, ranging from 30% to 100% (random).
    
![](https://media.giphy.com/media/v1.Y2lkPTc5MGI3NjExeGVrdmFyZGQ2d2J1aGtidXBnZWt5M2xyY3BxbXhnaGQ4eGVyMWM5ZiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/SS998MUD0B4J0eFNDe/giphy-downsized-large.gif)
    
**Benefits of this AR Experience:**

- **Engagement**: Attracts and entertains attendees, creating a memorable and interactive experience.
- **Community Building**: Acts as an icebreaker, encouraging interaction and conversation among event attendees.
- **Innovation Showcase**: Demonstrates the innovative use of AR technology, highlighting the creativity and forward-thinking nature of the Nouns community.


    
# Distribution Platform

**Snap AR** is the chosen platform for its features and accessibilty on web, but we are also open to exploring other than social ar platforms like Google Maps ([will available later this year](https://developers.google.com/ar/geospatialcreator)), or [Niantic's 8th wall](https://www.8thwall.com/niantic), and Adobe Aero. To reach a wider audience, we will use Twitter and Farcaster to updaing our project. Additionally, we plan to develop dedicated apps for accessibility


# Kickstarting the Experience

AR has immense potential for **spreading virality** and making a lasting impression. However, to kickstart a chain reaction and amplify the spread of these experiences, **we propose initiating a small contest within the rounds.wtf (Farcaster)**. Participants will be incentivized to share their experiences through the rounds channel or X. This rounds session will be easy to participate in, allowing everyone to join without specific skills. With this low entry barrier, we expect more participants to join and share their AR experiences.

- ***The incentive for the winners with pool of 1 ETH x 2 rounds, totaling 2 ETH for 2 rounds.***

# What's next?
## some example case study, what we can achieve with AR

Our plan is to continuously develop and explore cutting-edge AR experiences, and integrating Nouns into our creations. We believe AR can now serve as more than just **a marketing gimmick. With rapid advancements from major tech companies, AR now can be utilized as a design tool that enhances and supports proliferating the nouns ecosystem**
    
If this proposal is approved, **we will persist in exploring AR applications using a retroactive funding model**. which means we complete some projects first and then request funding from the DAO afterwards. This approach allows us to demonstrate tangible results and ensures that funds are well-allocated based on proven success and impact. As an estimate, the budget **for each AR experience will range from 1 ETH to 3 ETH depending on its complexity - between 3,600 and 10,800 USD (as of 18/06/2024).** Additionally, we also occasionally create simple AR experiences for the community as part of our ongoing commitment.

***This is an example how we can utilize AR in various creative ways:***
    
![by snapchat (900 x 750 px) (1350 x 750 px) (2)](https://hackmd.io/_uploads/BJvqm9EE0.png)


    


## [John Hamon x Nouns (Props 126)](https://nouns.wtf/vote/126),
#### [Video Demo](https://x.com/mmsolig/status/1788131329458241876) | [Test on Snapchat](https://www.snapchat.com/unlock/?type=SNAPCODE&uuid=b8c095de232c41f08b03d64087cc33a8&metadata=01) | Snap AR | World Mesh
----
John Hamon and his team successfully launched a remarkable campaign, creating a dynamic collaboration between Nouns and John Hamon as an artist. 

  **Here's how augmented reality can further enhance this project with AR:** 
  
Community members can also spread John Hamon's poster in their own environments or landmarks and share it on social media only using phone.  Users can point their cameras at a wall or the ground, **tap the screen and the John Hamon poster, complete with randomized Noggle colors will appear, record it, and have the video on any socials**. This interactive AR feature allows for widespread and engaging promotion, with additional *rounds.wtf* allocation, the reach will be massive.
    

    
![JH](https://hackmd.io/_uploads/S1C31c4EC.png)

 
    


## Gamifying artwork from the Nounish 'Three Artist' series can create engaging, interactive experiences that make the art more immersive and fun.

#### [Demo video |](https://x.com/mmsolig/status/1792381190340813260) Meta Spark AR / Instagram | Gamification

####
![AR game](https://hackmd.io/_uploads/HyV2MvHEA.png)
----
    
    
## Full-Body size Nouns, as seen in *Shark, Pickle, Cone* documentaries that mirroring the movement of the user. 
#### [Demo Video](https://x.com/mmsolig/status/1795759662584996231) | [Test on Snapchat](https://www.snapchat.com/unlock/?type=SNAPCODE&uuid=3e5727d25fff4f60b0f29c26f0473943&metadata=01) | Snap AR | Full Body Tracking
----
    
This full-body tracking technology can be utilized in numerous ways, from just goofing around, enriching your content, to dancing tools (example : for [Nouns Breaker](https://x.com/nounsbreakers)) and many more, **user can decide that their own body will be appears or hidden in this experiences**, using Machine Learning feature that allow 'erase' user.
    
Great thing about publishing AR is sometime we just amazed how user creatively exploring this experience with their own unique ideas. But most importantly, it definitely can be leveraged to promote the documentary of itself and nounsDAO in general.
![by snapchat (900 x 750 px) (3)](https://hackmd.io/_uploads/rkuTRDBER.png)
![oneline](https://hackmd.io/_uploads/HyG9msgU0.png)

![](https://media.giphy.com/media/v1.Y2lkPTc5MGI3NjExNHRmMGdyeWw4NHgzOG1hNHppcHg1eXZmbjRxazc2aTdkcjc4MHBiNiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/RsGgflQT9H67xRsuWo/giphy-downsized-large.gif)


    
## Developing 3D Printed AR try-on fashion from [Props 26](https://nouns.wtf/vote/26)
#### [Fashion AR 1](https://x.com/mmsolig/status/1638840297005416448) | [Fashion AR 2](https://x.com/mmsolig/status/1623363003918979072) | [Avatar with clothing](https://x.com/mmsolig/status/1669734999439081472) | 
---
3D Printed Fashion collection from Props 26 by Danit has captured considerable attention in the fashion, tech, and design sectors for its innovative and stylish designs. 
    
**AR try-on fashion**  presents an opportunity to enhance this project further. While the 3D printed material may be expensive to produce and difficult to fit, **AR fashion allows users to virtually try on these designs using just a camera or a large screen**. This accessibility means that anyone from around the world can now experience the 3D printed fashion, potentially sharing their interactions on social media platforms.
    
![](https://media.giphy.com/media/v1.Y2lkPTc5MGI3NjExaGJtZDhsbDJqcDJocmM4cDFlcml6bzNycmVtZTRncTM2dGJkbTY2ZSZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/8cNd2ko33L1EO2wPgK/giphy.gif) 

![by snapchat (900 x 750 px) (1350 x 750 px) (2)](https://hackmd.io/_uploads/B1CLeqBBA.png)

-----
## AR StoryTelling: The Nouncil has spoken
##### [Video Demo](https://x.com/mmsolig/status/1799752797409489306) | Snap AR | World Tracker / Storytelling games

![NouncilHasSpoken](https://hackmd.io/_uploads/SkYcwhzHC.png)


  **User Journey:**
- User opens the experience through a provided link. and will open snapchat apps
- User is optionally prompted to enter the 3-digit proposal number.
- After tapping the screen or starting a recording
    - The proposal text appears floating in front of the user.
    - Nouncil members appear surrounding the user.
- Over the next 2-3 seconds, each nouncil member can be tapped to reveal their vote (randomized for fun) along with personalized Nounish comments.
- After all the member is cast the vote, the Final number will appears, deciding your props is pass / not.
    
![](https://media.giphy.com/media/v1.Y2lkPTc5MGI3NjExZHNsZ3pnejBmODNhbHdnNm84eHYycjhjaHNsMThlZnYxb3UzYnd1NSZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/c170gHP0AjOdXs1W6a/giphy-downsized-large.gif)
    
**Benefits of this AR Experience:**

- **Storytelling Tool**: Helps a wider audience understand Nouncill votes and NounsDAO governance in fun way.
- **Proposer Ritual**: Encourages upcoming proposers to have ritual to use this experience for fun before submitting actual props :)
- **Community Engagement**: May interest community members in contributing to governance within the Nouncill even without needing nouns token

## Geospatial  / Geolocation / Location based AR
##### [Example of Niantic Geolocation AR (VPS)](https://x.com/mmsolig/status/1694720837432312241) | [Example Snap AR Geolocation](https://x.com/mmsolig/status/1650478008195751936)
Geolocation AR leverages the user's geographic location to deliver contextually relevant experiences. By combining geographical data with environment recognition, it can accurately track and create immersive experiences that are seamlessly integrated with the user's surroundings.
![](https://media.giphy.com/media/v1.Y2lkPTc5MGI3NjExeGZ3bDk2bHp3Z3FvYW85am5zZWNyOXhmaWc3MmlqenUxb2ZiYm44YSZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/m48m4BzurIr8iHpCwH/giphy-downsized-large.gif)

###### Suitable for physical landmark like *Mount Liu Pian* or *Rusutsu resort* , *Eiffel Tower, and Liberty statue*
![Untitled (1500 x 1280 px)](https://hackmd.io/_uploads/H1l8-n9BR.png)



**SnapAR offers ready-to-use template locations at global landmarks** like the Eiffel Tower and the Statue of Liberty, and also allows us to create custom locations through 3D scanning. **Niantic, the creator of Pokémon Go, has extensive area data ideal for scavenger hunts**. Additionally, Google plans to integrate AR experiences with **Google Maps this year**, with pilot projects expected to be available in Singapore and Paris.
    
With this type of AR experience, we can offer location-based interactions for our community. For example, we could create a **"Noggles Spreading Frenzy"** or **"Gigantic Noggles"** at the Eiffel Tower when paris blockchain week, **or making more immersive experience on Mount Liu Pian**, **Organize a scavenger hunt** using Niantic's platform data, or decorate various buildings with Nouns-themed elements, enhancing both engagement and visibility.

----
## Other Idea
Numerous features and use cases for augmented reality also can be applied to:
- Animating covers or artworks
- Creating playable digital Kendama using physics simulation and hand tracking
- Developing simple platform jumping games like the scene from of The Rise of Blus (episode 2)
- Crafting storytelling scenes about Nouns builders participating in voting processes
- Transform your eyebrows into weirdy, hairy noggle eyebrows 

**The possibility are endless.**
    
This proposal will serve as a kickoff for utilizing AR within the Nouns, setting the stage for a series of innovative and fun experiences. This initial effort will pave the way for future developments.

# Question and Answer:


**Q: Whats the goal of this project?**
A: In the short term, this proposal aims to create 3+ AR experiences, allowing the community to use AR in their environments and share their experiences through two rounds.wtf sessions on Farcaster or X. This exploration has several goals:

- Familiarize the community with using AR and its workflow.
- Generate buzz on Farcaster/social media about our new tools, with low barrier entry on Farcaster (everyone can join without specific skills).
- Establish proof of concept to determine the project's success and guide future decisions.

In the long term, we aim to become a studio that supports other projects with our expertise in AR and MR (Mixed Reality). We will continue researching this evolving medium while creating state-of-the-art tools for the Nouns community to proliferate Nouns. 
    
**Q: Will you only use 3D Nouns, and will you assist us in using our own community (other project) assets?**
A: While we have our own 3D artist, 3D Nouns provide a good interpretation of Nouns's pixel art from 2D to 3D voxel. It's lightweight with a small number of vertices, allowing for quick, accurate work and fast prototyping. However, as community members, we are open to using other 3D assets (Nounish friends, Nounies, etc.) and our custom creations. We support and collaborate with other projects to help proliferate Nouns and are flexible if you request similar experiences with different assets.
    
**Q: Will you use influencers to promote this?**
A: No, we will rely on community participation boosted through rounds.wtf. However, if someone wants to involve influencers, these AR experiences will always be available for that purpose. 
 
----
#
## Who is Claw?

[Claw](https://twitter.com/mmsolig) / clawscape, also known as Imam in [the web2](https://www.instagram.com/mmsolihin/). I'm a [Meta-certified](https://www.credly.com/badges/8acd6570-a54d-432e-b6c3-8cc2ed469f5e/public_url) augmented reality creator, member of Snap's AR [Lens Network](https://twitter.com/mmsolig/status/1773287764483559798) (alpha) and RTFKT Creators. I've been immersed in AR since 2020. Last year, Meta selected me to develop and present an [AR curriculum](https://www.facebook.com/watch/?ref=saved&v=605705107704753) for Indonesia's next-generation AR creators. Additionally, I was awarded 4th highest prize in [Meta's global competition](https://spark.meta.com/blog/spark-worlds-competition-winners/) in 2022. Currently, I freelance for a London-based agency where my team has collaborated with brands such as Dior, Tommy Hilfiger, Amazon Music, JD, and Hasbro.

## Timeline

The Timeline will be 2-3 months after proposal is approved.

## Our Ask

**We are requesting a budget of 3 ETH to kickstart this ongoing project. This budget will be used to compensate our small team, which includes a 3D artist, a developer, and a technical artist (claw). Additionally, we are asking for 2 ETH to encourage participation in the Rounds.wtf channel on Farcaster.**
    
**Total 5 ETH**

## Media and Links

- [https://twitter.com/mmsolig](https://twitter.com/mmsolig)   
- [https://www.instagram.com/mmsolihin/](https://www.instagram.com/mmsolihin/)   
- [Meta's interview](https://www.facebook.com/watch/?ref=saved&v=605705107704753)   
- [portofolio](https://solihinimam.my.canva.site/home)   
- [Meta Spark global winning](https://spark.meta.com/blog/spark-worlds-competition-winners/)   
- [Vuiz Creator Winning Interview](https://www.instagram.com/vuiz_creators/?img_index=1) 
- [Google maps AR integration](https://developers.google.com/ar/geospatialcreator)
- [SNAP AR](https://ar.snap.com/)

# 

A big thanks to [3D Nouns](https://3dnouns.com/) from [props 2](https://nouns.wtf/vote/2) by [coralorca](https://twitter.com/coralorca) & [0xFloyd](https://twitter.com/0xFloyd), their collection of CC0-licensed 3D models will be instrumental in bringing this AR experiences to life. We appreciate the ease of use and accessibility they provide.

**Thank you, lets build 2024!**

Outcome: EXECUTED