Instructions to use SceneWorks/gemma-2-2b-it with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SceneWorks/gemma-2-2b-it with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="SceneWorks/gemma-2-2b-it") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("SceneWorks/gemma-2-2b-it") model = AutoModelForCausalLM.from_pretrained("SceneWorks/gemma-2-2b-it", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use SceneWorks/gemma-2-2b-it with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "SceneWorks/gemma-2-2b-it" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SceneWorks/gemma-2-2b-it", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/SceneWorks/gemma-2-2b-it
- SGLang
How to use SceneWorks/gemma-2-2b-it with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "SceneWorks/gemma-2-2b-it" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SceneWorks/gemma-2-2b-it", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "SceneWorks/gemma-2-2b-it" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SceneWorks/gemma-2-2b-it", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use SceneWorks/gemma-2-2b-it with Docker Model Runner:
docker model run hf.co/SceneWorks/gemma-2-2b-it
sc-8025: non-gated mirror of stock google/gemma-2-2b-it (PiD caption encoder) — Gemma Terms + Prohibited Use Policy shipped; README de-gated
684c553 verified Download LICENSE from SceneWorks/gemma-2-2b-it: direct link, hf CLI and curl.
- Browser
- Download file 9.23 kB
-
https://huggingface.co/SceneWorks/gemma-2-2b-it/resolve/main/LICENSE
- Command line
-
hf download hf://SceneWorks/gemma-2-2b-it/LICENSE
-
curl -L -o LICENSE https://huggingface.co/SceneWorks/gemma-2-2b-it/resolve/main/LICENSE
9.23 kB
| Gemma is provided under and subject to the Gemma Terms of Use found at | |
| https://ai.google.dev/gemma/terms | |
| The complete, authoritative Agreement is reproduced below (canonical source: | |
| https://ai.google.dev/gemma/terms). | |
| ============================================================================ | |
| Gemma Terms of Use | |
| The terms below apply to Gemma models listed in the Appendix at bottom of this page. For Gemma 4 terms, see the Gemma 4 license. | |
| Last modified: April 1, 2026 | |
| By using, reproducing, modifying, distributing, performing or displaying any | |
| portion or element of Gemma, Model Derivatives including via any Hosted Service, | |
| (each as defined below) (collectively, the "Gemma Services") or otherwise | |
| accepting the terms of this Agreement, you agree to be bound by this Agreement. | |
| Section 1: DEFINITIONS | |
| 1.1 Definitions | |
| (a) "Agreement" or "Gemma Terms of Use" means these terms and conditions | |
| that govern the use, reproduction, Distribution or modification of the Gemma | |
| Services and any terms and conditions incorporated by reference. | |
| (b) "Distribution" or "Distribute" means any transmission, publication, | |
| or other sharing of Gemma or Model Derivatives to a third party, including by | |
| providing or making Gemma or its functionality available as a hosted service via | |
| API, web access, or any other electronic or remote means ("Hosted Service"). | |
| (c) "Gemma" means the set of machine learning language models, trained model | |
| weights and parameters identified in the Appendix, | |
| regardless of the source that you obtained it from. | |
| (d) "Google" means Google LLC. | |
| (e) "Model Derivatives" means all (i) modifications to Gemma, (ii) works based | |
| on Gemma, or (iii) any other machine learning model which is created by transfer | |
| of patterns of the weights, parameters, operations, or Output of Gemma, to that | |
| model in order to cause that model to perform similarly to Gemma, including | |
| distillation methods that use intermediate data representations or methods based | |
| on the generation of synthetic data Outputs by Gemma for training that model. | |
| For clarity, Outputs are not deemed Model Derivatives. | |
| (f) "Output" means the information content output of Gemma or a Model | |
| Derivative that results from operating or otherwise using Gemma or the Model | |
| Derivative, including via a Hosted Service. | |
| 1.2 | |
| As used in this Agreement, "including" means | |
| "including without limitation". | |
| Section 2: ELIGIBILITY AND USAGE | |
| 2.1 Eligibility | |
| You represent and warrant that you have the legal capacity to enter into this | |
| Agreement (including being of sufficient age of consent). If you are accessing | |
| or using any of the Gemma Services for or on behalf of a legal entity, (a) you | |
| are entering into this Agreement on behalf of yourself and that legal entity, | |
| (b) you represent and warrant that you have the authority to act on behalf of | |
| and bind that entity to this Agreement and (c) references to "you" or | |
| "your" in the remainder of this Agreement refers to both you (as an | |
| individual) and that entity. | |
| 2.2 Use | |
| You may use, reproduce, modify, Distribute, perform or display any of the Gemma | |
| Services only in accordance with the terms of this Agreement, and must not | |
| violate (or encourage or permit anyone else to violate) any term of this | |
| Agreement. | |
| Section 3: DISTRIBUTION AND RESTRICTIONS | |
| 3.1 Distribution and Redistribution | |
| You may reproduce or Distribute copies of Gemma or Model Derivatives if you meet | |
| all of the following conditions: | |
| - You must include the use restrictions referenced in Section 3.2 as an | |
| enforceable provision in any agreement (e.g., license agreement, terms of use, | |
| etc.) governing the use and/or distribution of Gemma or Model Derivatives and | |
| you must provide notice to subsequent users you Distribute to that Gemma or | |
| Model Derivatives are subject to the use restrictions in Section 3.2. | |
| - You must provide all third party recipients of Gemma or Model Derivatives a | |
| copy of this Agreement. | |
| - You must cause any modified files to carry prominent notices stating that you | |
| modified the files. | |
| - All Distributions (other than through a Hosted Service) must be accompanied | |
| by a "Notice" text file that contains the following notice: | |
| "Gemma is provided under and subject to the Gemma Terms of Use found at ai.google.dev/gemma/terms". | |
| You may add your own intellectual property statement to your modifications and, | |
| except as set forth in this Section, may provide additional or different terms | |
| and conditions for use, reproduction, or Distribution of your modifications, or | |
| for any such Model Derivatives as a whole, provided your use, reproduction, | |
| modification, Distribution, performance, and display of Gemma otherwise complies | |
| with the terms and conditions of this Agreement. Any additional or different | |
| terms and conditions you impose must not conflict with the terms of this | |
| Agreement. | |
| 3.2 Use Restrictions | |
| You must not use any of the Gemma Services: | |
| - for the restricted uses set forth in the Gemma Prohibited Use Policy at | |
| ai.google.dev/gemma/prohibited_use_policy | |
| ("Prohibited Use Policy"), which is hereby incorporated by reference into | |
| this Agreement; or | |
| - in violation of applicable laws and regulations. | |
| To the maximum extent permitted by law, Google reserves the right to restrict | |
| (remotely or otherwise) usage of any of the Gemma Services that Google | |
| reasonably believes are in violation of this Agreement. | |
| 3.3 Generated Output | |
| Google claims no rights in Outputs you generate using Gemma. You and your users | |
| are solely responsible for Outputs and their subsequent uses. | |
| Section 4: ADDITIONAL PROVISIONS | |
| 4.1 Updates | |
| Google may update Gemma from time to time. | |
| 4.2 Trademarks | |
| Nothing in this Agreement grants you any rights to use Google's trademarks, | |
| trade names, logos or to otherwise suggest endorsement or misrepresent the | |
| relationship between you and Google. Google reserves any rights not expressly | |
| granted herein. | |
| 4.3 DISCLAIMER OF WARRANTY | |
| UNLESS REQUIRED BY APPLICABLE LAW, THE GEMMA SERVICES, AND OUTPUTS, ARE PROVIDED | |
| ON AN "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, EITHER | |
| EXPRESS OR IMPLIED, INCLUDING ANY WARRANTIES OR CONDITIONS OF TITLE, | |
| NON-INFRINGEMENT, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE | |
| SOLELY RESPONSIBLE FOR DETERMINING THE APPROPRIATENESS OF USING, REPRODUCING, | |
| MODIFYING, PERFORMING, DISPLAYING OR DISTRIBUTING ANY OF THE GEMMA SERVICES | |
| OR OUTPUTS AND ASSUME ANY AND ALL RISKS ASSOCIATED WITH YOUR USE OR DISTRIBUTION | |
| OF ANY OF THE GEMMA SERVICES OR OUTPUTS AND YOUR EXERCISE OF RIGHTS AND | |
| PERMISSIONS UNDER THIS AGREEMENT. | |
| 4.4 LIMITATION OF LIABILITY | |
| TO THE FULLEST EXTENT PERMITTED BY APPLICABLE LAW, IN NO EVENT AND UNDER NO | |
| LEGAL THEORY, WHETHER IN TORT (INCLUDING NEGLIGENCE), PRODUCT LIABILITY, | |
| CONTRACT, OR OTHERWISE, UNLESS REQUIRED BY APPLICABLE LAW, SHALL GOOGLE OR ITS | |
| AFFILIATES BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY DIRECT, INDIRECT, | |
| SPECIAL, INCIDENTAL, EXEMPLARY, CONSEQUENTIAL, OR PUNITIVE DAMAGES, OR LOST | |
| PROFITS OF ANY KIND ARISING FROM THIS AGREEMENT OR RELATED TO, ANY OF THE GEMMA | |
| SERVICES OR OUTPUTS EVEN IF GOOGLE OR ITS AFFILIATES HAVE BEEN ADVISED OF THE | |
| POSSIBILITY OF SUCH DAMAGES. | |
| 4.5 Term, Termination, and Survival | |
| The term of this Agreement will commence upon your acceptance of this Agreement | |
| (including acceptance by your use, modification, or Distribution, reproduction, | |
| performance or display of any portion or element of the Gemma Services) and will | |
| continue in full force and effect until terminated in accordance with the terms | |
| of this Agreement. Google may terminate this Agreement if you are in breach of | |
| any term of this Agreement. Upon termination of this Agreement, you must delete | |
| and cease use and Distribution of all copies of Gemma and Model Derivatives in | |
| your possession or control. Sections 1, 2.1, 3.3, 4.2 to 4.9 shall survive the | |
| termination of this Agreement. | |
| 4.6 Governing Law and Jurisdiction | |
| This Agreement will be governed by the laws of the State of California without | |
| regard to choice of law principles. The UN Convention on Contracts for the | |
| International Sale of Goods does not apply to this Agreement. The state and | |
| federal courts of Santa Clara County, California shall have exclusive | |
| jurisdiction of any dispute arising out of this Agreement. | |
| 4.7 Severability | |
| If any provision of this Agreement is held to be invalid, illegal or | |
| unenforceable, the remaining provisions shall be unaffected thereby and remain | |
| valid as if such provision had not been set forth herein. | |
| 4.8 Entire Agreement | |
| This Agreement states all the terms agreed between the parties and supersedes | |
| all other agreements between the parties as of the date of acceptance relating | |
| to its subject matter. | |
| 4.9 No Waiver | |
| Google will not be treated as having waived any rights by not exercising (or | |
| delaying the exercise of) any rights under this Agreement. | |
| Appendix | |
| - Gemma 1 | |
| - Gemma 1.1 | |
| - Gemma 2 | |
| - Gemma 3 | |
| - Gemma 3n | |
| - FunctionGemma | |
| - EmbeddingGemma | |
| - PaliGemma | |
| - PaliGemma 2 | |
| - ShieldGemma | |
| - ShieldGemma 2 | |
| - CodeGemma | |
| - CodeGemma 1.1 | |
| - Gemma 2 JPN | |
| - DataGemma RIG | |
| - DataGemma RAG | |
| - RecurrentGemma | |
| - Gemma Scope | |
| - Gemma-APS | |
| - T5Gemma | |
| - VaultGemma | |
| - FunctionGemma | |
| - T5Gemma 2 | |
| - TranslateGemma | |
| Note: Previous versions of these Terms are archived here. | |
| - |