helloadhavan/github_issues huggingface dataset:
Repository: facebook/react
Pull request: Enable flag disableClientCache

Enable flag disableClientCache

Forcing a `__VARIANT__` in the mock file so we keep testing this until fully removing it.


Changed files:
filename: packages/shared/ReactFeatureFlags.js
patch: @@ -159,7 +159,7 @@ export const disableIEWorkarounds = true;
 export const enableFilterEmptyStringAttributesDOM = true;
 
 // Disabled caching behavior of `react/cache` in client runtimes.
-export const disableClientCache = false;
+export const disableClientCache = true;
 
 // Changes Server Components Reconciliation when they have keys
 export const enableServerComponentKeys = true;

filename: scripts/jest/setupTests.www.js
patch: @@ -15,10 +15,11 @@ jest.mock('shared/ReactFeatureFlags', () => {
   // code live.
   actual.disableInputAttributeSyncing = __VARIANT__;
 
-  // This is hardcoded to true for the next release,
+  // These are hardcoded to true for the next release,
   // but still run the tests against both variants until
   // we remove the flag.
   actual.disableIEWorkarounds = __VARIANT__;
+  actual.disableClientCache = __VARIANT__;
 
   return actual;
 });
Repository: ggml-org/llama.cpp
Pull request: CUDA: avoid mul + bias fusion when buffers are split

Fix #16799. When fusing just a mul-mat + bias, we don't check if the buffer is split. We check this when fusing gate + up. Tested on 3x 4090 with gpt-oss-120b

Changed files:
filename: ggml/src/ggml-cuda/ggml-cuda.cu
patch: @@ -2115,6 +2115,14 @@ static bool ggml_cuda_should_fuse_mul_mat_vec_f(const ggml_tensor * tensor) {
     const int cc      = ggml_cuda_info().devices[ggml_cuda_get_device()].cc;
     use_mul_mat_vec_f = use_mul_mat_vec_f && ggml_cuda_should_use_mmvf(src0->type, cc, src0->ne, is_mul_mat_id ? src1->ne[2] : src1->ne[1]);
 
+    const bool split = ggml_backend_buft_is_cuda_split(src0->buffer->buft) ||
+                       ggml_backend_buft_is_cuda_split(src1->buffer->buft);
+
+    //TODO: add support for fusion for split buffers
+    if (split) {
+        return false;
+    }
+
     //we only support fusion for ncols_dst = 1
     if (tensor->op == GGML_OP_MUL_MAT && dst->ne[1] != 1) {
         return false;
@@ -2154,6 +2162,15 @@ static bool ggml_cuda_should_fuse_mul_mat_vec_q(const ggml_tensor * tensor) {
         return false;
     }
 
+
+    const bool split = ggml_backend_buft_is_cuda_split(src0->buffer->buft) ||
+                       ggml_backend_buft_is_cuda_split(src1->buffer->buft);
+
+    //TODO: add support for fusion for split buffers
+    if (split) {
+        return false;
+    }
+
     return use_mul_mat_vec_q;
 }
Repository: ollama/ollama
Pull request: Use default RoPE params for new models


Changed files:
filename: llm/llama.go
patch: @@ -306,13 +306,19 @@ func newLlama(model string, adapters []string, runners []ModelRunner, numLayers
 	params := []string{
 		"--model", model,
 		"--ctx-size", fmt.Sprintf("%d", opts.NumCtx),
-		"--rope-freq-base", fmt.Sprintf("%f", opts.RopeFrequencyBase),
-		"--rope-freq-scale", fmt.Sprintf("%f", opts.RopeFrequencyScale),
 		"--batch-size", fmt.Sprintf("%d", opts.NumBatch),
 		"--n-gpu-layers", fmt.Sprintf("%d", numGPU),
 		"--embedding",
 	}
 
+	if opts.RopeFrequencyBase > 0 {
+		params = append(params, "--rope-freq-base", fmt.Sprintf("%f", opts.RopeFrequencyBase))
+	}
+
+	if opts.RopeFrequencyScale > 0 {
+		params = append(params, "--rope-freq-scale", fmt.Sprintf("%f", opts.RopeFrequencyScale))
+	}
+
 	if opts.NumGQA > 0 {
 		params = append(params, "--gqa", fmt.Sprintf("%d", opts.NumGQA))
 	}

filename: llm/llm.go
patch: @@ -85,7 +85,10 @@ func New(workDir, model string, adapters []string, opts api.Options) (LLM, error
 
 	switch ggml.Name() {
 	case "gguf":
-		opts.NumGQA = 0 // TODO: remove this when llama.cpp runners differ enough to need separate newLlama functions
+		// TODO: gguf will load these options automatically from the model binary
+		opts.NumGQA = 0
+		opts.RopeFrequencyBase = 0.0
+		opts.RopeFrequencyScale = 0.0
 		return newLlama(model, adapters, chooseRunners(workDir, "gguf"), ggml.NumLayers(), opts)
 	case "ggml", "ggmf", "ggjt", "ggla":
 		return newLlama(model, adapters, chooseRunners(workDir, "ggml"), ggml.NumLayers(), opts)
Repository: facebook/react
Pull request: Decrease nested update limit from 1000 to 50

An infinite update loop can occur when an update is scheduled inside a lifecycle method, which causes a re-render, which schedules another update, and so on. Before the Fiber rewrite, this scenario resulted in a stack overflow.

Because Fiber does not use the JavaScript stack, we maintain our own counter to track the number of nested, synchronous updates. We throw an error if the limit is exceeded.

The nested update limit is currently 1000. I chose this number arbitrarily, certain that there was no valid reason for a component to schedule so many synchronous re-renders.

I think we can go much lower. This commit decreases the limit to 50. I believe this is still comfortably above the reasonable number of synchronous re-renders a component may perform.

This will make it easier for developers to debug infinite update bugs when they occur.

Changed files:
filename: packages/react-reconciler/src/ReactFiberScheduler.js
patch: @@ -1544,7 +1544,7 @@ let currentRendererTime: ExpirationTime = msToExpirationTime(
 let currentSchedulerTime: ExpirationTime = currentRendererTime;
 
 // Use these to prevent an infinite loop of nested updates
-const NESTED_UPDATE_LIMIT = 1000;
+const NESTED_UPDATE_LIMIT = 50;
 let nestedUpdateCount: number = 0;
 let lastCommittedRootDuringThisBatch: FiberRoot | null = null;
Repository: electron/electron
Pull request: build: ignore files in .git when running markdownlint-cli2

Backport of #46608

See that PR for details.


Notes: none <!-- Please add a one-line description for app developers to read in the release notes, or 'none' if no notes relevant to app developers. Examples and help on special cases: https://github.com/electron/clerk/blob/main/README.md#examples -->


Changed files:
filename: script/lint.js
patch: @@ -278,7 +278,7 @@ const LINTERS = [{
 }, {
   key: 'md',
   roots: ['.'],
-  ignoreRoots: ['node_modules', 'spec/node_modules'],
+  ignoreRoots: ['.git', 'node_modules', 'spec/node_modules'],
   test: filename => filename.endsWith('.md'),
   run: async (opts, filenames) => {
     let errors = false;
Repository: vercel/next.js
Pull request: fix: validation return types of pages API routes

## For Contributors

### Fixing a bug

- Updates the (previously incorrect) API route handler type definition in the validator
- Changes the return type from `Promise<Response | void> | Response | void` to `unknown | Promise<unknown>`
- Updates the test route example to use the `NextApiHandler` type (making sure it works)

Fixes #83067

Changed files:
filename: packages/next/src/server/lib/router-utils/typegen.ts
patch: @@ -565,7 +565,7 @@ export function generateValidatorFile(
 
   if (pagesApiRouteValidations) {
     typeDefinitions += `type ApiRouteConfig = {
-  default: (req: any, res: any) => Promise<Response | void> | Response | void
+  default: (req: any, res: any) => ReturnType<NextApiHandler>
   config?: {
     api?: {
       bodyParser?: boolean | { sizeLimit?: string }
@@ -611,18 +611,25 @@ export function generateValidatorFile(
     ? "import type { NextRequest } from 'next/server.js'\n"
     : ''
 
-  // Only import metadata types if there are App Router pages or layouts that might use them
-  const metadataImport =
-    appPageValidations || layoutValidations
-      ? 'import type { ResolvingMetadata, ResolvingViewport } from "next/dist/lib/metadata/types/metadata-interface.js"\n'
+  // Conditionally import types from next/types, merged into a single statement
+  const nextTypes: string[] = []
+  if (pagesApiRouteValidations) {
+    nextTypes.push('NextApiHandler')
+  }
+  if (appPageValidations || layoutValidations) {
+    nextTypes.push('ResolvingMetadata', 'ResolvingViewport')
+  }
+  const nextTypesImport =
+    nextTypes.length > 0
+      ? `import type { ${nextTypes.join(', ')} } from "next/types.js"\n`
       : ''
 
   return `// This file is generated automatically by Next.js
 // Do not edit this file manually
 // This file validates that all pages and layouts export the correct types
 
 ${routeImportStatement}
-${metadataImport}${nextRequestImport}
+${nextTypesImport}${nextRequestImport}
 ${typeDefinitions}
 ${appPageValidations}
 

filename: test/e2e/app-dir/typed-routes-validator/pages/api/test-route.ts
patch: @@ -1,12 +1,11 @@
-import type { NextApiRequest, NextApiResponse } from 'next/types'
+import type { NextApiHandler } from 'next/types'
 
 type ResponseData = {
   message: string
 }
 
-export default function handler(
-  req: NextApiRequest,
-  res: NextApiResponse<ResponseData>
-) {
+const handler: NextApiHandler<ResponseData> = (req, res) => {
   res.status(200).json({ message: 'Hello from Next.js!' })
 }
+
+export default handler
Repository: ollama/ollama
Pull request: fix log

if there's a remainder, the log line will show the remainder instead of the actual size

Changed files:
filename: server/upload.go
patch: @@ -104,7 +104,7 @@ func (b *blobUpload) Prepare(ctx context.Context, requestURL *url.URL, opts *Reg
 		offset += size
 	}
 
-	log.Printf("uploading %s in %d %s part(s)", b.Digest[7:19], len(b.Parts), format.HumanBytes(size))
+	log.Printf("uploading %s in %d %s part(s)", b.Digest[7:19], len(b.Parts), format.HumanBytes(b.Parts[0].Size))
 
 	requestURL, err = url.Parse(location)
 	if err != nil {
Repository: denoland/deno
Pull request: ci: fix release script to format semver


Changed files:
filename: tools/release/00_start_release.ts
patch: @@ -18,10 +18,10 @@ if (Deno.args.some((a) => a === "--dry-run")) {
 } else {
   const octoKit = createOctoKit();
   const result = await octoKit.request("POST /gists", {
-    description: `Deno CLI v${nextVersion} release checklist`,
+    description: `Deno CLI v${semver.format(nextVersion)} release checklist`,
     public: false,
     files: {
-      [`release_${nextVersion}.md`]: {
+      [`release_${semver.format(nextVersion)}.md`]: {
         content: releaseInstructions,
       },
     },
@@ -57,10 +57,12 @@ function buildDenoReleaseInstructionsDoc() {
     .join("release_doc_template.md")
     .readTextSync()
     .replaceAll("$BRANCH_NAME", `v${nextVersion.major}.${nextVersion.minor}`)
-    .replaceAll("$VERSION", nextVersion.toString())
-    .replaceAll("$MINOR_VERSION", getMinorVersion(nextVersion.toString()))
-    .replaceAll("$PAST_VERSION", currentVersion.toString());
-  return `# Deno CLI ${nextVersion.toString()} Release Checklist\n\n${templateText}`;
+    .replaceAll("$VERSION", semver.format(nextVersion))
+    .replaceAll("$MINOR_VERSION", getMinorVersion(semver.format(nextVersion)))
+    .replaceAll("$PAST_VERSION", semver.format(currentVersion));
+  return `# Deno CLI ${
+    semver.format(nextVersion)
+  } Release Checklist\n\n${templateText}`;
 }
 
 function getCliVersion() {
Repository: electron/electron
Pull request: build: ignore files in .git when running markdownlint-cli2

#### Description of Change

<!--
Thank you for your Pull Request. Please provide a description above and review
the requirements below.

Contributors guide: https://github.com/electron/electron/blob/main/CONTRIBUTING.md
-->

Unknown reason why this suddenly became a problem, but the lint script started popping false positives inside the `.git` directory so explicitly ignore it.

#### Checklist
<!-- Remove items that do not apply. For completed items, change [ ] to [x]. -->

- [x] PR description included and stakeholders cc'd

#### Release Notes

Notes: none <!-- Please add a one-line description for app developers to read in the release notes, or 'none' if no notes relevant to app developers. Examples and help on special cases: https://github.com/electron/clerk/blob/main/README.md#examples -->


Changed files:
filename: script/lint.js
patch: @@ -278,7 +278,7 @@ const LINTERS = [{
 }, {
   key: 'md',
   roots: ['.'],
-  ignoreRoots: ['node_modules', 'spec/node_modules'],
+  ignoreRoots: ['.git', 'node_modules', 'spec/node_modules'],
   test: filename => filename.endsWith('.md'),
   run: async (opts, filenames) => {
     let errors = false;
Repository: facebook/react
Pull request: Ensure sizebot doesn't swallow large diffs

## Sumamry

So that sizebot reports for large changes aren't swallowed like in  https://github.com/facebook/react/pull/28827 

## Test plan

- [x] sizebot comment when based on https://github.com/facebook/react/pull/28827 (check the previous versions of the react-sizebot comment)

Changed files:
filename: .circleci/config.yml
patch: @@ -211,6 +211,8 @@ jobs:
       - setup_node_modules
       - run:
           command: node ./scripts/tasks/danger
+      - store_artifacts:
+          path: sizebot-message.md
 
   build_devtools_and_process_artifacts:
     docker: *docker

filename: dangerfile.js
patch: @@ -31,6 +31,7 @@ const {markdown, danger, warn} = require('danger');
 const {promisify} = require('util');
 const glob = promisify(require('glob'));
 const gzipSize = require('gzip-size');
+const {writeFileSync} = require('fs');
 
 const {readFileSync, statSync} = require('fs');
 
@@ -236,7 +237,7 @@ function row(result, baseSha, headSha) {
     }
   }
 
-  markdown(`
+  const message = `
 Comparing: ${baseSha}...${headSha}
 
 ## Critical size changes
@@ -263,5 +264,17 @@ ${significantResults.join('\n')}
 `
     : '(No significant changes)'
 }
-`);
+`;
+
+  // GitHub comments are limited to 65536 characters.
+  if (message.length > 65536) {
+    // Make message available as an artifact
+    writeFileSync('sizebot-message.md', message);
+    markdown(
+      'The size diff is too large to display in a single comment. ' +
+        `The [CircleCI job](${process.env.CIRCLE_BUILD_URL}) contains an artifact called 'sizebot-message.md' with the full message.`
+    );
+  } else {
+    markdown(message);
+  }
 })();
Repository: ollama/ollama
Pull request: go mod tidy

```
go mod tidy
go fmt ./...
```

Changed files:
filename: go.mod
patch: @@ -11,7 +11,6 @@ require (
 	github.com/olekukonko/tablewriter v0.0.5
 	github.com/spf13/cobra v1.7.0
 	golang.org/x/sync v0.3.0
-	gonum.org/v1/gonum v0.14.0
 )
 
 require github.com/rivo/uniseg v0.2.0 // indirect

filename: go.sum
patch: @@ -140,8 +140,6 @@ golang.org/x/text v0.13.0 h1:ablQoSUd0tRdKxZewP80B+BaqeKJuVhuRxj/dkrun3k=
 golang.org/x/text v0.13.0/go.mod h1:TvPlkZtksWOMsz7fbANvkp4WM8x/WCo/om8BMLbz+aE=
 golang.org/x/tools v0.0.0-20180917221912-90fa682c2a6e/go.mod h1:n7NCudcB/nEzxVGmLbDWY5pfWTLqBcC2KZ6jyYvM4mQ=
 golang.org/x/xerrors v0.0.0-20191204190536-9bdfabe68543/go.mod h1:I/5z698sn9Ka8TeJc9MKroUUfqBBauWjQqLJ2OPfmY0=
-gonum.org/v1/gonum v0.14.0 h1:2NiG67LD1tEH0D7kM+ps2V+fXmsAnpUeec7n8tcr4S0=
-gonum.org/v1/gonum v0.14.0/go.mod h1:AoWeoz0becf9QMWtE8iWXNXc27fK4fNeHNf/oMejGfU=
 google.golang.org/protobuf v1.26.0-rc.1/go.mod h1:jlhhOSvTdKEhbULTjvd4ARK9grFBp09yW+WbY/TyQbw=
 google.golang.org/protobuf v1.28.0/go.mod h1:HV8QOd/L58Z+nl8r43ehVNZIU/HEI6OcFqwMG9pJV4I=
 google.golang.org/protobuf v1.30.0 h1:kPPoIgf3TsEvrm0PFe15JQ+570QVxYzEvvHqChK+cng=

filename: readline/term_bsd.go
patch: @@ -1,4 +1,5 @@
 //go:build darwin || freebsd || netbsd || openbsd
+
 package readline
 
 import (

filename: readline/term_linux.go
patch: @@ -1,4 +1,5 @@
 //go:build linux || solaris
+
 package readline
 
 import (
Repository: denoland/deno
Pull request: fix: Deno.serve correctly passes tcpBacklog option

Typo made in https://github.com/denoland/deno/pull/30541

Changed files:
filename: ext/http/00_serve.ts
patch: @@ -893,7 +893,7 @@ function serveInner(options, handler) {
     port: options.port ?? 8000,
     reusePort: options.reusePort ?? false,
     loadBalanced: options[kLoadBalanced] ?? false,
-    backlog: options.backlog,
+    tcpBacklog: options.tcpBacklog,
   };
 
   if (options.certFile || options.keyFile) {
Repository: ollama/ollama
Pull request: fix tautology


Changed files:
filename: cmd/cmd.go
patch: @@ -102,16 +102,14 @@ func RunHandler(cmd *cobra.Command, args []string) error {
 	name := args[0]
 	// check if the model exists on the server
 	_, err = client.Show(context.Background(), &api.ShowRequest{Name: name})
-	if err != nil {
-		var statusError api.StatusError
-		switch {
-		case errors.As(err, &statusError) && statusError.StatusCode == http.StatusNotFound:
-			if err := PullHandler(cmd, args); err != nil {
-				return err
-			}
-		case err != nil:
+	var statusError api.StatusError
+	switch {
+	case errors.As(err, &statusError) && statusError.StatusCode == http.StatusNotFound:
+		if err := PullHandler(cmd, args); err != nil {
 			return err
 		}
+	case err != nil:
+		return err
 	}
 
 	return RunGenerate(cmd, args)
Repository: ggml-org/llama.cpp
Pull request: model-conversion : pass config to from_pretrained

This commit modifies the script `run-org-model.py` to ensure that the model configuration is explicitly passed to the `from_pretrained` method when loading the model. It also removes a duplicate configuration loading which was a mistake.

The motivation for this change is that enables the config object to be modified and then passed to the model loading function, which can be useful when testing new models.

Changed files:
filename: examples/model-conversion/scripts/causal/run-org-model.py
patch: @@ -138,6 +138,9 @@ def fn(_m, input, output):
         "Model path must be specified either via --model-path argument or MODEL_PATH environment variable"
     )
 
+
+print("Loading model and tokenizer using AutoTokenizer:", model_path)
+tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)
 config = AutoConfig.from_pretrained(model_path, trust_remote_code=True)
 
 print("Model type:       ", config.model_type)
@@ -147,10 +150,6 @@ def fn(_m, input, output):
 print("BOS token id:     ", config.bos_token_id)
 print("EOS token id:     ", config.eos_token_id)
 
-print("Loading model and tokenizer using AutoTokenizer:", model_path)
-tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)
-config = AutoConfig.from_pretrained(model_path, trust_remote_code=True)
-
 if unreleased_model_name:
     model_name_lower = unreleased_model_name.lower()
     unreleased_module_path = (
@@ -171,7 +170,7 @@ def fn(_m, input, output):
         exit(1)
 else:
     model = AutoModelForCausalLM.from_pretrained(
-        model_path, device_map="auto", offload_folder="offload", trust_remote_code=True
+        model_path, device_map="auto", offload_folder="offload", trust_remote_code=True, config=config
     )
 
 for name, module in model.named_modules():
Repository: huggingface/transformers
Pull request: [serve] fix ` request_id` unexpected

# What does this PR do?

This PR fixes transformers serve as it is currently not working due to an unexpected field being passed `request_id`

# reproducer 
```python 
transformers serve
transformers chat localhost:8000 --model-name-or-path HuggingFaceTB/SmolLM3-3B
```
the second message will trigger an error. 

Changed files:
filename: src/transformers/commands/chat.py
patch: @@ -129,7 +129,6 @@ async def stream_output(self, stream: AsyncIterator[ChatCompletionStreamOutput])
             text = ""
             async for token in await stream:
                 outputs = token.choices[0].delta.content
-                request_id = token.id
 
                 if not outputs:
                     continue
@@ -168,7 +167,7 @@ async def stream_output(self, stream: AsyncIterator[ChatCompletionStreamOutput])
 
         self._console.print()
 
-        return text, request_id
+        return text
 
     def input(self) -> str:
         """Gets user input from the console."""
@@ -700,8 +699,6 @@ async def _inner_run(self):
         interface.clear()
         chat = self.clear_chat_history(args.system_prompt)
 
-        request_id = None
-
         # Starts the session with a minimal help message at the top, so that a user doesn't get stuck
         interface.print_help(minimal=True)
         while True:
@@ -733,13 +730,12 @@ async def _inner_run(self):
                     chat,
                     stream=True,
                     extra_body={
-                        "request_id": request_id,
                         "generation_config": generation_config.to_json_string(),
                         "model": model,
                     },
                 )
 
-                model_output, request_id = await interface.stream_output(stream)
+                model_output = await interface.stream_output(stream)
 
                 chat.append({"role": "assistant", "content": model_output})
Repository: vercel/next.js
Pull request: [turbopack] Ammend the error message for module not found errors

Just add 'file not found' to the error message.

Closes PACK-5345

Changed files:
filename: turbopack/crates/turbopack-ecmascript/src/lib.rs
patch: @@ -1826,7 +1826,7 @@ async fn process_parse_result(
                 }
                 ParseResult::NotFound => {
                     let path = ident.path().to_string().await?;
-                    let msg = format!("Could not parse module '{path}'");
+                    let msg = format!("Could not parse module '{path}', file not found");
                     let body = vec![
                         quote!(
                             "const e = new Error($msg);" as Stmt,
Repository: ollama/ollama
Pull request: append LD_LIBRARY_PATH

only append LD_LIBRARY_PATH in case it's already set

Related #758 

Changed files:
filename: llm/llama.go
patch: @@ -360,7 +360,15 @@ func newLlama(model string, adapters []string, runners []ModelRunner, numLayers
 			runner.Path,
 			append(params, "--port", strconv.Itoa(port))...,
 		)
-		cmd.Env = append(os.Environ(), fmt.Sprintf("LD_LIBRARY_PATH=%s", filepath.Dir(runner.Path)))
+
+		var libraryPaths []string
+		if libraryPath, ok := os.LookupEnv("LD_LIBRARY_PATH"); ok {
+			libraryPaths = append(libraryPaths, libraryPath)
+		}
+
+		libraryPaths = append(libraryPaths, filepath.Dir(runner.Path))
+
+		cmd.Env = append(os.Environ(), fmt.Sprintf("LD_LIBRARY_PATH=%s", strings.Join(libraryPaths, ":")))
 		cmd.Stdout = os.Stderr
 		statusWriter := NewStatusWriter()
 		cmd.Stderr = statusWriter
Repository: huggingface/transformers
Pull request: sped up gguf tokenizer for nemotron test

# What does this PR do?
Speeds up GGUF tokenizer used in `tests/quantization/ggml/test_ggml.py` by using original tokenizer from NVIDIA.

Fixes #40334

## Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

@SunMarc 
@ArthurZucker 
@jiqing-feng

Changed files:
filename: tests/quantization/ggml/test_ggml.py
patch: @@ -825,8 +825,8 @@ def test_nemotron_q6_k(self):
             gguf_file=self.q6_k_nemotron_model_id,
             dtype=torch.float16,
         )
-
-        tokenizer = AutoTokenizer.from_pretrained(self.nemotron_model_id, gguf_file=self.q6_k_nemotron_model_id)
+        # use the original tokenizer from nvidia to avoid long load times
+        tokenizer = AutoTokenizer.from_pretrained("nvidia/Nemotron-Mini-4B-Instruct")
         text = tokenizer(self.example_text, return_tensors="pt")["input_ids"]
         out = model.generate(text, max_new_tokens=16)