Comparison: Decentralized storage
Published: 2022-09-07 07:05:22

_Layer 1 and Layer 2 market movers of decentralized cloud storage_

Today I would like to bring some attention to the web3 discipline heavily overshadowed by **Defi** and **NFT** sectors, borrowing the voice of critics one could say the current state of Defi and NFT is just a synthetic economy pouring capital to a limited group of people without solving any real problem world…on the other hand, there is a tech with ability to optimize costs of billions $$$ on monthly basis by maintaining internet content and data, all in a decentralized manner where anyone could benefit from participation.

Ideas of **peer-to-peer** data protocols are already known in space for more than 20 years with the introduction of [BitTorrent](https://en.wikipedia.org/wiki/BitTorrent) where regular users got the ability to share any data with each other using just the internet. Blockchain technology adds a next step to the picture with its architectural properties to:

- Create an easily **decentralized shared economy** in any industry, with consensuses like Proof of Work (PoW) or Proof of Stake (PoS)
- Support **smart contracts** , self-executable business logic with given conditions

Thanks to these concepts existing protocols can evolve, from sharing a favorite movie or music to completely hosting parts of their computer for others in need and helping them with:

- **Enterprise data backups**
- **Media storage for dApps** operating with pictures/audio/video
- **Website Hosting**

_This article will briefly introduce the key protocols taking a role decentralized storage market right now or in close future, as an addition to already massively growing IT services market included Amazon Web Service (AWS), Google Cloud, Microsoft Azure — _[_projected to grow from $78.6b in 2022 to $183.7b by 2027_](https://www.marketsandmarkets.com/PressReleases/cloud-storage.asp)_._

#### **Summarized protocols**

![Decentralized cloud storage — Comparison](https://miro.medium.com/max/525/1*WkxjlXovTCcybN7KzwYFrQ.png) 

---

### **1. IPFS**

IPFS, Interplanetary File System is a distributed system for storing and accessing files, websites, applications, and data. Most used L1 decentralized peer-to-peer storage combines three[**Key concepts**](https://docs.ipfs.tech/concepts/how-ipfs-works/) **:**

- Search by Content Identifier **(CID) i**nstead of physical place, it means validation by SHA hash won't match
- Linking content via Directed Acyclic Graphs **(DAG),** mainly [Merkle DAG](https://docs.ipfs.tech/concepts/merkle-dag) used also in Git to connect all the commits into a repository. Check [dag.ipfs.io](https://dag.ipfs.io/) to visualize DAG
- Content search using Distribute Hash Tables **(DHT)** with key-value pairs to find which peers are hosting searched content, using [libp2p](https://libp2p.io/)as core component.

![Interplanetary FileSystem](https://medium.com/coinmonks/what-is-ipfs-interplanetary-filesystem-7e48f32a7dce)

**A large network of nodes (200 000+)** is designed to store shares of single files into multiple devices and manage data flow effectively based on their demand.

- Using IPFS service is absolutely **FREE** , similarly to BitTorrent you just need to be part of the network and share any amount of data. The important thing to remember the **data won't persist by default** if you don't run the node 24/7 or use 3rd party service to do that for you.
- **Security** : IPFS is **public** protocol, including the contents of files themselves, unless they're [encrypted](https://docs.ipfs.tech/concepts/privacy-and-encryption/#encryption) on their own. CIDs are public and additional measures are required to keep data private.

**Applications**

Luckily, to mitigate IPFS issues and advance its usage, periphery protocols on top of IPFS developed services to do the hard stuff for you:

- [**Ceramic**](https://ceramic.network/), permissionless data streaming network for data storage, decentralized identity, and much more
- [**Fission**](https://fission.codes/) **,** WebNative file system with encrypted-at-rest storage capabilities
- [**Fleek**](https://fleek.co/)/ [**Spheron**](https://spheron.network/) **,** decentralized hosting for your frontend. Primary supported React/Next but with a possibility to deploy more frontend frameworks.
- [**Lit protocol**](https://litprotocol.com/), L2 privacy layer to securely store IPFS data
- [**OrbitDB**](https://orbitdb.org/), peer-to-peer serverless, decentralized database leveraging[IPFS Pubsub](https://github.com/ipfs/go-ipfs/blob/master/core/commands/pubsub.go#L23)
- [**Pinata**](https://www.pinata.cloud/) **,** CDN with 200+ caching locations all over the world. Simplifies management of IPFS files and grants ability to manage premium content via [Submarine](https://www.pinata.cloud/submarine%C2%A8) product. Ideal to store and maintain NFT business.
- [**Filebase**](https://docs.filebase.com/), similarly to Pinata, Filebase offers UI for pinning files, in this case to IPFS, Storj, Sia or Skynet. In addition provide a set of tooling to sync AWS S3 including JavaScript and Python SDK

### **1.1 Filecoin**

[Filecoin](https://docs.filecoin.io/about-filecoin/how-filecoin-works/) is one of the missing incentive layers (L2) for IPFS and verifies that data is being stored, while maintaining the efficiency, authenticity and resiliency provided by IPFS.

Filecoin enhances IPFS with:

- **Storage market** , determines pricing for data storage given by market conditions.
- [**Filgram**](https://filecoin.io/blog/posts/introducing-filgram-the-newest-sp-discovery-tool/) **,** first storage provider discovery and client marketplace tool
- [**Data indexer**](https://filecoin.io/blog/posts/how-does-the-network-indexer-work/)to improve search quality and performance

Developers could interact with Filecoin in multiple ways:

- [**Powergate**](https://docs.filecoin.io/build/powergate)exposes higher-level API to interact with IPFS and Filecoin nodes easier via CLI or gRPC API endpoints with **JavaScript** or **Go**
- [**Lotus CLI**](https://lotus.filecoin.io/lotus/get-started/what-is-lotus) represents a more powerful though complicated toolset to manage Filecoin data through its Lotus nodes.

#### **Filecoin vs IPFS**

- **IPFS** allows peers to store, request, and transfer verifiable data with each other (like BitTorrent)
- **Filecoin** is designed to provide a system of **persistent data storage**. Guarantee that miners have correctly stored the data they committed to maintain.

#### **Filecoin Economy**

**Contract-based storage** can be more simply thought of as a [pay-as-you-go model](https://coinmarketcap.com/alexandria/article/the-decentralized-storage-war-filecoin-vs-arweave).[**Over 4000 miners**](https://filfox.info/en) **participate in Filecoin network** compensated by FIL token and price agreed in data marketplaces, [right now](https://file.app/):

- $0.0000002 GB/Month

In comparison with Amazon S3:

- $0.013 GB/Month

[**Ultimate Guide to Filecoin: Breaking Down Filecoin Whitepaper & Economics**](https://medium.com/swlh/ultimate-guide-to-filecoin-breaking-down-filecoin-whitepaper-economics-9212541a5895)

[_What is Filecoin, How it Works? Understanding Technical & Economic Aspects of Filecoin._](https://medium.com/swlh/ultimate-guide-to-filecoin-breaking-down-filecoin-whitepaper-economics-9212541a5895)[medium.com](https://medium.com/swlh/ultimate-guide-to-filecoin-breaking-down-filecoin-whitepaper-economics-9212541a5895)

#### **FVM**

Filecoin Virtual Machine (FVM) could be one of the game-changing capabilities upgrading protocol outside just storing data with additional business logic, coming in 2023. EVM-compatible smart contracts with _unlimited_ storage might enable use cases like:

- NFTs with on-chain media
- Decentralized computation
- Data DAOs

*More on FVM at:*

[**Filecoin Virtual Machine**](https://fvm.filecoin.io/)

[_A robust WASM-based VM The FVM is a WASM-based polyglot execution environment for IPLD data. It is designed to support…_](https://fvm.filecoin.io/)[fvm.filecoin.io](https://fvm.filecoin.io/)

### **1.2 Crust**

Crust Network is essentially an IPFS incentive layer protocol and a substrate-based blockchain (Polkadot ecosystem), similarly to Filecoin Crust:

- Settles **data storage market** between IPFS node providers and data providers
- Offers personal "Google Drive" like **Web3.0 storage**** encrypted** for private or public use

Key consensus concepts backed by 2000+ nodes consist of[3 layers](https://wiki.crust.network/docs/en/crustOverview):

- **MPOW** (Meaningful Proof of Work) — low-trust/zero-trust storage proof layer based on TEE (Trusted Execution Environment) serves as off-chain messaging to inspect and prove the storage work of miners.
- **GPOS** (Guaranteed Proof of Stake) — PoS-derived consensus layer that requires nodes to provide storage proof to get staking quota as a motivation aspect.
- **DSM**  — Decentralized Storage Market to handshake pricing conditions between buyers and sellers.

All supported by set of tooling to:

- **Auto-deploy** the DApp/website through **Github action**
- **Decentralized pin** through Github action, Node.js package or [Crust CLI](https://github.com/crustio/crust-cli)

As a winner of [Polkadot parachain auction](https://parachains.info/), Crust aims to leverage its interoperability properties with other parachains like Astar or Moonbeam and become home of data storage for smart contracts built in Polkadot or Kusama ecosystem

---

### **2. Sia**

[Sia](https://docs.sia.tech/) is a **contract-based** layer 1 decentralized cloud storage (Similarly to Filecoin) using blockchain technology with economy powered by token SIA. Each file is split into 30 pieces around multiple nodes, from which 10 is enough to compose the file back in case of unavailability ([Reed-Solomon erasure coding](https://en.wikipedia.org/wiki/Reed%E2%80%93Solomon_error_correction)). A key aspect to remember should be **its focus on privacy.**

- Max individual file size = 300GB
- All files are private by default using [Threefish algorithm](https://en.wikipedia.org/wiki/Threefish) for **high performance and secure encryption**
- **Pricing** moves dynamically, right now with monthly storage price around $1/TB, Upload price $0.50/TB, Download price $2/TB

![Sia average pricing in $$$](https://siastats.info/storage_pricing)

The combination of its privacy and pricing makes Sia environment suitable to store long-term large backups cheaper than centralized clouds like [Google Drive](https://one.google.com/about/plans), unlimited inflation of Sia coin also indicates its price won't skyrocket and keeps storage cheap.

[**2.1 Skynet**](https://siasky.net/)

I did prepare a few sentences about a layer on top of Sia called **Skynet** but at the time of writing **Skynet Labs announced the game over** due to the lack of funding…so fuck it

[**Skynet Labs is shutting down. Skynet remains online.**](https://blog.sia.tech/skynet-labs-is-shutting-down-skynet-remains-online-5397184e214d)

[_It is with great sadness that we announce the shutdown of Skynet Labs. Skynet and its data will remain online._](https://blog.sia.tech/skynet-labs-is-shutting-down-skynet-remains-online-5397184e214d)[blog.sia.tech](https://blog.sia.tech/skynet-labs-is-shutting-down-skynet-remains-online-5397184e214d)

_Although the decentralized storage market does not experience the same competitiveness and excitement as NFT or Defi, it requires a huge effort, creativity and discipline to offer something special to attract users and developers to migrate from centralized solution…this will in startup companies happen, visions and personalities could clash, mistakes could be made and sometimes it's too much from everything._

---

### **3. Storj**

Storj became from its creation in 2014 quite a powerful layer 1 contract-based storage solution with developed network and interesting features including:

- Sync option with **AWS S3 buckets** via [Uplink CLI](https://www.storj.io/integrations/uplink-cli) secured with[AES-256-GCM encryption](https://docs.storj.io/dcs/concepts/access/encryption-and-keys/)
- **Backups on MongoDB**
- File **transfer** with **Filezilla**

**Data**

Files are divided into 80 or more bundles and placed between multiple nodes around the world ( **total 14k+** ), only 29 bundles are needed to compose a file to ensure enough buffer in case of nodes failure (again [using Reed-Solomon coding](https://en.wikipedia.org/wiki/Reed%E2%80%93Solomon_error_correction)) and high availability \> 99.9%.

All with **rich FREE** and PRO **pricing models**

- FREE: 150GB storage and bandwidth monthly
- PRO: Storage $4/TB, Bandwith $7/TB, monthly

User could think with StorJ of use cases like audio/video streaming services, calculate costs with dedicated team and explore continuously improving technology.

---

### **4. Arweave**

Arweave's approach is kind of different, consensus called PoA (Proof of Access) aims for all files to be stored **permanently** , consensus motivates to randomly split block history between nodes, its algorithm identifies which data is shared less and gives larger reward for miners covering rare files. More at:

On one hand the capacities of miners could be very well optimized and no file would be forgotten or lost by mistake, on the other hand, there is a concern regarding its content moderation rule, some users could struggle with the idea of storing data _expensively_ on censored protocol, where files identified as abusive could be discarded from the archive by democratic voting.

- Users pay **one fee to store data permanently,** price is calculated [dynamically](https://ar-fees.arweave.dev/). Right now costs about $2/GB
- The **network** covers over 1000 blockchain ([SPoRA](https://tokenpost.com/Arweave-Introduces-New-Consensus-SPoRA-6729)) nodes with transaction throughput of over 5000 TPS.
- Data on Arweave is **always immutable**
- [ArDrive](https://ardrive.io/) serves as encrypted file storage and organization platform

Although direct interaction with Arweave [might be challenging](https://arwiki.wiki/#/en/creating-a-dapp-02), there is a solution making life easier called **Bundlr…**

#### **Bundlr**

Bundlr increases the number of transactions conducted on Arweave by 4,000% without sacrificing security or usability and is around ~3,000x faster at uploading data.

Bundlr is actually Proof-of-Stake network sits on top of Arweave, currently accounts for over 90% of data uploaded to Arweave. It is a multichain solution and is compatible with leading blockchains including Ethereum, Solana, Avalanche, Polygon, and many more.

Validators are chosen every day randomly to be charge of making sure transactions pass to Arweave, provides in addition:

- Caching layer
- _Infinite_ scalability
- Guaranteed instant transaction finality
- **free data uploads under 100kb**

The bundle spec, designed by Bundlr, is open-sourced and is currently implemented in JavaScript and Go.

---

_ **Other references:** _

[**CESS Cumulus Encrypted Storage System**](https://cess.cloud/)

[_CESS Decentralized Storage Web3 Data Security Data Privacy Data Ownership Confirmation Cumulus Encrypted Storage System_](https://cess.cloud/)[cess.cloud](https://cess.cloud/)

[**The Decentralized Storage War: Filecoin vs. Arweave | CoinMarketCap**](https://coinmarketcap.com/alexandria/article/the-decentralized-storage-war-filecoin-vs-arweave)

[_Disclosure: Multicoin has established, maintains and enforces written policies and procedures reasonably designed to…_](https://coinmarketcap.com/alexandria/article/the-decentralized-storage-war-filecoin-vs-arweave)[coinmarketcap.com](https://coinmarketcap.com/alexandria/article/the-decentralized-storage-war-filecoin-vs-arweave)

#### **Summary**

Sharing computing resources will take a huge role in the future, although its impact does not represent blockchain use cases many would like to see — like ending world hunger, fixing economical flaws or achieving political fairness. Its benefits are straight and anyone involved in IT will appreciate cost optimization for data and throughput which became at some scale non-affordable for smaller businesses and dreamers.

In addition, cheap data storage in pair with high-performance scaling blockchains could unlock new ways of interactions I couldn't think of now.

If I summarize what I saw, there are several base protocols for storing data in a decentralized manner:

- **IPFS** , which is not exactly blockchain but developed a rich ecosystem of ideas by 3rd parties uses a blockchain economy to bring nice cheap data services to everyone.
- **Storj** , a very well developed contract based cloud storage, continuously improving with the possibility to sync with AWS S3
- **Sia** , on paper secure protocol to store large backups privately and cheaper than on Google, although with a questionable reputation, and doubtful future through the lack of ecosystem incentives.
- **Arweave** , truly permanent storage useful for archival boosted with L2 Bundlr, however with built-in content moderation mechanism one could be afraid of potential censorship if the content is controversial for any reason.

One note to pour here a bit of pure wine if someone entitles any project as AWS/GCP killer…all protocols mentioned above still do not contain even 1% of all the features and gadgets GCP or AWS offers right now…the image blockchain alternatives could eat a significant amount of this market pie of hundreds of billions is rather pessimistic.

If the market proves the way blockchain is working in data storage and cloud computing, providers and consumers both profit, at some point largest world companies with thousand-year experience in IT would probably notice, adapt, buy teams and gain some advantage…but that's not all bad — it would mean this path was meaningful and will generate business and benefits for many in next years or decades.