Package: omnata-snowcli-fork
Snowflake Developer CLIThis is an open source and community supported tool. Support is provided on a best effort basis by project contributors.OverviewSnowCLI is a command line interface for working with Snowflake. It lets you create, manage, update, and view apps running in Snowflake.This is an open source project and contributions are welcome (though the project is maintained on a best-effort basis).We plan to incorporate some patterns and features of this CLI into the Snowflake CLI (SnowSQL) in the future. We hope this project starts a conversation about what a delightful developer experience could look like, and we'd love your help in shaping that with us!Tour and quickstartBenefits of SnowCLISnowCLI lets you locally run and debug Snowflake apps, and has the following benefits:Search, create, and upload python packages that may not be yet supported in Anaconda.Has support for Snowpark Pythonuser defined functionsandstored procedures,warehouses, andStreamlitapps.Define packages usingrequirements.txt, with dependencies automatically added via integration with Anaconda at deploy time.Use packages inrequirements.txtthat aren't yet in Anaconda and have them manually included in the application package deployed to Snowflake (only works with packages that don't rely on native libraries).Update existing applications with code and dependencies automatically altered as needed.Deployment artifacts are automatically managed and uploaded to Snowflake stages.Limitations of SnowCLISnowCLI has the following limitations:You must have theSnowSQLconfiguration file to authenticate to SnowCLI. See thePrerequisitesfor more details.To run Streamlit in Snowflake using SnowCLI, your Snowflake account must have access to the Streamlit private preview.Install SnowCLIInstall with Homebrew (Mac only)RequiresHomebrew.brewtapsfc-gh-jhollan/snowcli
brewinstallsnowcli
snow--helpInstall with pip (PyPi)Requires Python >= 3.8pipinstallsnowflake-cli-labs
snow--helpInstall from sourceRequires Python >= 3.8 and gitgitclonehttps://github.com/snowflake-labs/snowclicdsnowcli# you can also do the below in an active virtual environment:# python -m venv .venv# source .venv/bin/activatehatchbuild&&pipinstall.
snow--versionYou should now be able to runsnowand get the CLI message.Get started using SnowCLIUse SnowCLI to build a function or stored procedure, or create a streamlit if you have access to the Streamlit in Snowflake private preview.PrerequisitesYou must add your credentials to connect to Snowflake before you can use SnowCLI.Add credentials with SnowCLISnowCLI uses the same configuration file as SnowSQL. If you don't have SnowSQL installed,download SnowSQLand install it. SeeInstalling SnowSQL. You do not need to set up SnowSQL to use SnowCLI.After installing SnowSQL, use the following SnowCLI command to add your Snowflake account credentials:snow connection addProvide a name for your connection, your account, username, and password for Snowflake.Add credentials manually on *nix systemsIf you do not want to install SnowSQL, you can add Snowflake account credentials manually:In your home directory, make.snowsqldirectory with aconfigfile:mkdir .snowsqlcd .snowsqltouch configOpen the config file for editing:vi configAdd a new configuration for your Snowflake connection with SnowCLI. You must prefix the configuration withconnections..For example, to add a Snowflake accountmyaccountfor a user profilejohndoeand a password ofhunter2, add the following:[connections.connection_name]accountname=myaccountusername=jondoepassword=hunter2Add credentials manually using WindowsCreate a.snowsqlfolder with aconfigfile at the following path:%USERPROFILE%\.snowsql\configAdd a new configuration for your Snowflake connection with SnowCLI. You must prefix the configuration withconnections..Manage packages in Snowflake StagesYou can use the Snowflake CLI to assist you in creating and uploading custom packages for Snowflake. This includes both full Python packages (and all needed dependencies) and Python packages that have native dependencies that are supported by Anaconda. All dependency evaluation is performed usingpipon the machine the SnowCLI runs on and can create and help upload packages. Here's a flow to upload a custom package:Check to see if a package is supported:snow package lookup <package-name>NOTE: if you see a WARNING! message, it means the package has likely has native libraries that are NOT supported by the Anaconda Snowflake channel.Create a zip file of the package:snow package create <package-name>- this creates a{package}.zipfile in the current directory that can be uploaded to a stage to used in imports to include the package.Connect to snowflakesnow loginsnow configureUpload to a stage (I'll upload to a stage calledpackagesin the database / schema configured in previous step):snow package upload -f <package-name>.zip -s packages --overwriteYou can now use the package in functions / procedures by adding an import to@packages/<package-name>.zip.It's worth noting that if you create and publish functions and procedures using the SnowCLI using the patterns below (snow functionandsnow procedure), SnowCLI will automatically bundle packages + code in a single zip that is created. But you can manage packages independently in stages as desired.Build a functionTo build a function or a stored procedure using SnowCLI, do the following:Navigate to an empty directory to create your function.Run the command:snow function initSnowCLI populates the directory with the files for a basic function. You can openapp.pyto see the files.Test the code by running theapp.pyscript:python app.pyYou see the message:Hello World!Package the function:snow function packageThis creates anapp.zipfile that has your files in itLog in to snowflake:snow loginConfigure your first environment:snow configureCreate a function:snow function createTry running the function:snow function execute -f 'helloFunction()'You see Snowflake return the message: 'Hello World!'After building your function, you can modifyapp.py,requirements.txt, or other files and follow a similar flow, or update a function by running the following:snow function update -n <myfunction> -f <app.zip>Create a StreamlitTo create a Streamlit, do the following:Note: Your account must have access to the Streamlit in Snowflake private preview to create a Streamlit.Change to a directory with an existing Streamlit app, or create a directory for a new Streamlit app.Log into Snowflake::snow loginCreate an environment and select your database, schema, role, and warehouse:snow configureThe environment name defaults to 'dev'.Create a streamlit with a name that you specify:snow streamlit create <name>If you don't specify a name, the file defaults tostreamlit_app.py.Deploy your app and open it in the browser:snow streamlit deploy <name> -oDeploy a packaged Streamlit app (temporary workaround)As at April 2023, you must provide a single file script to Streamlit, with an optional environment.yml file containing a list of Anaconda packages.By adding the--use-packaging-workaroundparameter duringsnow streamlit createandsnow streamlit deploy, you can have your directory packaged into an app.zip file with PyPi packages.A wrapper file will be generated as a Streamlit entrypoint, and it will download the app.zip from the stage, add it to the system path and import the original Streamlit script.Create a stored procedureSeeBuild a function.Code coverage for stored proceduresWhen runningsnow procedure createorsnow procedure update, you can choose to add the flag--install-coverage-wrapper. This will automatically capture code coverage information whenever your stored procedure is invoked.For example, imagine anapp.pylike this:import sys

def calculator(session,thing_to_do:str,first:float,second:float):
  if thing_to_do=='add':
    return first + second
  if thing_to_do=='subtract':
    return first - second
  if thing_to_do=='multiply':
    return first * second
  if thing_to_do=='divide':
    return other_stuff.divide_two_numbers(first,second)
  raise Exception(f"Unknown thing_to_do {thing_to_do}")andother_stuff.pylike this:def divide_two_numbers(first,second):
    return first/secondAftersnow procedure package, we run:snow procedure create -n calculator -h "app.calculator" -i "(thing_to_do string, first float, second float)" --return-type "numeric" --install-coverage-wrapper --replace-alwaysThen invoke it:snow procedure execute -p "calculator('add',1,1)"We can build a coverage report:snow procedure coverage report -n "calculator" -i "(thing_to_do string, first float, second float)"Under htmlcov/index.html we see a summary of the two files:and drilling into app.py:Then use a couple of other code paths:snow procedure execute -p "calculator('multiply',3,4)"snow procedure execute -p "calculator('divide',10,2)"If we run the report again, we're now up to 85%:With app.py showing a bit more green:and other_stuff.py fully covered:More code coverage tips:Remember toclearthe coverage data whenever you change the code or start a new test run.Ensure that you don't enable code coverage in production, it adds a delay and a small amount of stage storage for each invocation.You can choose the output format by using the--output-formatoptionYou can write the coverage percentage value back into Snowflake as a procedure comment, by using the--store-as-commentoption. This means that after your test suite completes, you can check coverage across a number of procedures with a query like so:select COALESCE(COMMENT,0)::numeric(5,2) as COVERAGE, *
from information_schema.procedures
where COVERAGE < 75;ContributingIf interested in contributing, you will want to instanstiate the pre-commit logic to help with formatting and linting of commits. To do this, run the following in thesnowclicloned folder on your development machine:pipinstallpre-commit
pre-commitTest dependenciesDependencies are defined as optional dependencies, to install them runpipinstall".[dev]"Integration testsEvery integration test should haveintegrationmark. By default, integration tests are not execute inpytest.To execute only unit tests runpytestTo execute only integration tests runpytest -m integrationGet involvedHave a feature idea? Running into a bug? Want to contribute? We'd love to hear from you! Please open or review issues, open pull requests, or reach out to us on Twitter or LinkedIn@jeffhollanand@jroes.