Project: Alluxio (Runtime / Cloud Native Storage)
File: Storage-Overview.md

layout: global title: Storage Integrations Overview This guide will cover general prerequisites and running Alluxio locally with your desired under storage system. To learn how to configure Alluxio with each individual storage system, please look at their respective pages. In preparation for using your chosen storage system with Alluxio, please be sure you have all the required location, credentials, and additional properties before you begin configuring Alluxio to your under storage system. For the purposes of this guide, the following are placeholders. <table class="table table-striped"> <tr> <th>Storage System</th> <th>Location</th> <th>Credentials</th> <th>Additional Properties</th> </tr> <tr> <td markdown="span"></td> <td markdown="span">`S3BUCKET`, `S3DIRECTORY`</td> <td markdown="span">`S3ACCESSKEYID`, `S3SECRET_KEY`</td> <td markdown="span"></td> </tr> <tr> <td markdown="span"></td> <td markdown="span">`HDFSNAMENODE`, `HDFSPORT`</td> <td markdown="span"></td> <td markdown="span"> Specify Hadoop version: <br /> `HADOOP_VERSION`</td> </tr> <tr> <td markdown="span"></td> <td markdown="span">`OSSBUCKET`, `OSSDIRECTORY`</td> <td markdown="span">`OSSACCESSKEYID`, `OSSACCESSKEYSECRET`, `OSS_ENDPOINT`</td> <td markdown="span"></td> </tr> <tr> <td markdown="span"></td> <td markdown="span">`AZURECONTAINER`, `AZUREDIRECTORY`</td> <td markdown="span">`AZUREACCOUNT`, `AZUREACCOUNT_KEY`</td> <td markdown="span"></td> </tr> <tr> <td markdown="span"></td> <td markdown="span">`AZURE_DIRECTORY`</td> <td markdown="span">`AZURE_ACCOUNT`</td> <td markdown="span">OAuth credentials: <br /> `CLIENTID`, `AUTHENTICATIONKEY`, `TENANT_ID`</td> </tr> <tr> <td markdown="span"></td> <td markdown="span">`AZURECONTAINER`, `AZUREDIRECTORY`</td> <td markdown="span">`AZUREACCOUNT`, `AZURESHARED_KEY`</td> <td markdown="span"> OAuth credentials: <br /> `OAUTHENDPOINT`, `CLIENTID`, `CLIENTSECRET`, `MSIENDPOINT`, `MSI_TENANT`</td> </tr> <tr> <td markdown="span"></td> <td markdown="span"></td> <td markdown="span">`CEPHFSCONFFILE`, `CEPHFSNAME`, `CEPHFSDIRECTORY`, `CEPHFSAUTHID`, `CEPHFSKEYRINGFILE`</td> <td markdown="span"></td> </tr> <tr> <td markdown="span"></td> <td markdown="span">`CEPHBUCKET`, `CEPHDIRECTORY`</td> <td markdown="span"> `S3ACCESSKEYID`, `S3SECRETKEYID` </td> <td markdown="span"> `RGWHOSTNAME`, `RGWPORT`, `INHERIT_ACL` </td> </tr> <tr> <td markdown="span"></td> <td markdown="span">`GCSBUCKET`, `GCSDIRECTORY`</td> <td markdown="span">For GCS Version 1: `GCSACCESSKEYID`, `GCSSECRETACCESSKEY`</td> <td markdown="span"></td> </tr> <tr> <td markdown="span"></td> <td markdown="span">`OBSBUCKET`, `OBSDIRECTORY`</td> <td markdown="span">`OBSACCESSKEY`, `OBSSECRETKEY`, `OBS_ENDPOINT`</td> <td markdown="span"></td> </tr> <tr> <td markdown="span"></td> <td markdown="span">`MINIOBUCKET`, `MINIODIRECTORY`</td> <td markdown="span">`S3ACCESSKEYID`, `S3SECRETKEY`, `MINIOENDPOINT`</td> <td markdown="span"></td> </tr> <tr> <td markdown="span"></td> <td markdown="span"></td> <td markdown="span"></td> <td markdown="span"></td> </tr> <tr> <td markdown="span"></td> <td markdown="span"> : `OZONEBUCKET`, `OZONEVOLUME` <br /> : `OZONEMANAGER`, `OZONEBUCKET`, `OZONEDIRECTORY`, `OZONEVOLUME`</td> <td markdown="span"> `OMSERVICEIDS`</td> <td markdown="span"> Mount specific version: <br /> `OZONE_VERSION`</td> </tr> <tr> <td markdown="span"></td> <td markdown="span">`COSBUCKET`, `COSDIRECTORY`</td> <td markdown="span">`COSACCESSKEY`, `COSSECRETKEY`</td> <td markdown="span"> Specify COS region: <br /> `COSREGION`, `COSAPPID` </td> </tr> <tr> <td markdown="span"></td> <td markdown="span">`COSNBUCKET`, `COSNDIRECTORY`</td> <td markdown="span">`COSNSECRETID`, `COSNSECRETKEY`</td> <td markdown="span"> Specify COSN region: <br /> `COSN_REGION` </td> </tr> </table> Once you have configured Alluxio to your desired under storage system, start up Alluxio locally to see that everything works. ```shell $ ./bin/alluxio init format $ ./bin/alluxio process start local ``` This should start an Alluxio master and an Alluxio worker. You can see the master UI at . Run a simple example program: ```shell $ ./bin/alluxio exec basicIOTest ``` Visit your container `<CONTAINER>/<DIRECTORY>` or bucket `<BUCKET>/<DIRECTORY>` to verify the files and directories created by Alluxio exist. If there are no errors, then you have successfully configured your storage system! To stop Alluxio, you can run: ``` shell $ ./bin/alluxio process stop local ```