helloadhavan/github_issues huggingface dataset:
Repository: electron/electron
Pull request: fix: `net.isOnline` always true in utility processes

Backport of #48111

See that PR for details.


Notes: Fixed an issue where `net.isOnline()` always returned `true` in utilityProcesses.


Changed files:
filename: shell/services/node/node_service.cc
patch: @@ -12,6 +12,7 @@
 #include "base/process/process.h"
 #include "base/strings/utf_string_conversions.h"
 #include "electron/mas.h"
+#include "net/base/network_change_notifier.h"
 #include "services/network/public/cpp/wrapper_shared_url_loader_factory.h"
 #include "services/network/public/mojom/host_resolver.mojom.h"
 #include "services/network/public/mojom/network_context.mojom.h"
@@ -127,6 +128,10 @@ void NodeService::Initialize(
 
   node_bindings_->Initialize(isolate, isolate->GetCurrentContext());
 
+  network_change_notifier_ = net::NetworkChangeNotifier::CreateIfNeeded(
+      net::NetworkChangeNotifier::CONNECTION_UNKNOWN,
+      net::NetworkChangeNotifier::ConnectionSubtype::SUBTYPE_UNKNOWN);
+
   // Append program path for process.argv0
   auto program = base::CommandLine::ForCurrentProcess()->GetProgram();
 #if defined(OS_WIN)

filename: shell/services/node/node_service.h
patch: @@ -11,6 +11,7 @@
 #include "mojo/public/cpp/bindings/pending_remote.h"
 #include "mojo/public/cpp/bindings/receiver.h"
 #include "mojo/public/cpp/bindings/remote.h"
+#include "net/base/network_change_notifier.h"
 #include "services/network/public/cpp/shared_url_loader_factory.h"
 #include "services/network/public/mojom/host_resolver.mojom.h"
 #include "services/network/public/mojom/url_loader_factory.mojom-forward.h"
@@ -84,6 +85,8 @@ class NodeService : public node::mojom::NodeService {
 
   // depends-on: js_env_'s isolate
   std::shared_ptr<node::Environment> node_env_;
+
+  std::unique_ptr<net::NetworkChangeNotifier> network_change_notifier_;
 };
 
 }  // namespace electron
Repository: ollama/ollama
Pull request: fix: add unsupported architecture message for linux/windows

Running unsupported models on linux/windows outputs
`Error: llama runner process has terminated: signal: aborted (core dumped)`

New error message:
`Error: this model is not supported by your version of Ollama. You may need to upgrade`

Resolves: https://github.com/ollama/ollama/issues/4889

Changed files:
filename: llm/server.go
patch: @@ -560,6 +560,9 @@ func (s *llmServer) WaitUntilRunning(ctx context.Context) error {
 			if s.status != nil && s.status.LastErrMsg != "" {
 				msg = s.status.LastErrMsg
 			}
+			if strings.Contains(msg, "unknown model") {
+				return fmt.Errorf("this model is not supported by your version of Ollama. You may need to upgrade")
+			}
 			return fmt.Errorf("llama runner process has terminated: %v %s", err, msg)
 		default:
 		}

filename: llm/status.go
patch: @@ -25,6 +25,7 @@ var errorPrefixes = []string{
 	"CUDA error",
 	"cudaMalloc failed",
 	"\"ERR\"",
+	"architecture",
 }
 
 func (w *StatusWriter) Write(b []byte) (int, error) {
Repository: vercel/next.js
Pull request: [Turbopack] clean up `completion.rs` a bit

* `all` is dead
* `unchanged` is dead
* `wrap` should be private



Changed files:
filename: turbopack/crates/turbo-tasks/src/completion.rs
patch: @@ -1,6 +1,6 @@
 use anyhow::Result;
 
-use crate::{self as turbo_tasks, RawVc, ResolvedVc, TryJoinIterExt, Vc};
+use crate::{self as turbo_tasks, ResolvedVc, TryJoinIterExt, Vc};
 
 /// Just an empty type, but it's never equal to itself.
 ///
@@ -30,37 +30,13 @@ impl Completion {
     pub fn new() -> Vc<Self> {
         Completion::cell(Completion)
     }
-
-    /// Uses the previous completion. Can be used to cancel without triggering a
-    /// new invalidation.
-    pub fn unchanged() -> Vc<Self> {
-        // This is the same code that Completion::cell uses except that it
-        // only updates the cell when it is empty (Completion::cell opted-out of
-        // that via `#[turbo_tasks::value(cell = "new")]`)
-        let cell = turbo_tasks::macro_helpers::find_cell_by_type(
-            <Completion as crate::VcValueType>::get_value_type_id(),
-        );
-        cell.conditional_update(|old| old.is_none().then_some(Completion));
-        let raw: RawVc = cell.into();
-        raw.into()
-    }
 }
 
 #[turbo_tasks::value(transparent)]
 pub struct Completions(Vec<ResolvedVc<Completion>>);
 
 #[turbo_tasks::value_impl]
 impl Completions {
-    /// Merges multiple completions into one. The passed list will be part of
-    /// the cache key, so this function should not be used with varying lists.
-    ///
-    /// Varying lists should use `Vc::cell(list).completed()`
-    /// instead.
-    #[turbo_tasks::function]
-    pub fn all(completions: Vec<ResolvedVc<Completion>>) -> Vc<Completion> {
-        Vc::<Completions>::cell(completions).completed()
-    }
-
     /// Merges the list of completions into one.
     #[turbo_tasks::function]
     pub async fn completed(&self) -> anyhow::Result<Vc<Completion>> {
@@ -91,7 +67,7 @@ impl Completions {
 }
 
 #[turbo_tasks::function]
-pub async fn wrap(completion: Vc<Completion>) -> Result<Vc<Completion>> {
+async fn wrap(completion: Vc<Completion>) -> Result<Vc<Completion>> {
     completion.await?;
     Ok(Completion::new())
 }
Repository: facebook/react
Pull request: Bump RC version to 19.0.0-rc.1


Changed files:
filename: ReactVersions.js
patch: @@ -30,7 +30,7 @@ const canaryChannelLabel = 'rc';
 
 // If the canaryChannelLabel is "rc", the build pipeline will use this to build
 // an RC version of the packages.
-const rcNumber = 0;
+const rcNumber = 1;
 
 const stablePackages = {
   'eslint-plugin-react-hooks': '5.1.0',
Repository: electron/electron
Pull request: fix: `net.isOnline` always true in utility processes

Backport of #48111

See that PR for details.


Notes: Fixed an issue where `net.isOnline()` always returned `true` in utilityProcesses.


Changed files:
filename: shell/services/node/node_service.cc
patch: @@ -12,6 +12,7 @@
 #include "base/process/process.h"
 #include "base/strings/utf_string_conversions.h"
 #include "electron/mas.h"
+#include "net/base/network_change_notifier.h"
 #include "services/network/public/cpp/wrapper_shared_url_loader_factory.h"
 #include "services/network/public/mojom/host_resolver.mojom.h"
 #include "services/network/public/mojom/network_context.mojom.h"
@@ -126,6 +127,10 @@ void NodeService::Initialize(
 
   node_bindings_->Initialize(js_env_->isolate()->GetCurrentContext());
 
+  network_change_notifier_ = net::NetworkChangeNotifier::CreateIfNeeded(
+      net::NetworkChangeNotifier::CONNECTION_UNKNOWN,
+      net::NetworkChangeNotifier::ConnectionSubtype::SUBTYPE_UNKNOWN);
+
   // Append program path for process.argv0
   auto program = base::CommandLine::ForCurrentProcess()->GetProgram();
 #if defined(OS_WIN)

filename: shell/services/node/node_service.h
patch: @@ -11,6 +11,7 @@
 #include "mojo/public/cpp/bindings/pending_remote.h"
 #include "mojo/public/cpp/bindings/receiver.h"
 #include "mojo/public/cpp/bindings/remote.h"
+#include "net/base/network_change_notifier.h"
 #include "services/network/public/cpp/shared_url_loader_factory.h"
 #include "services/network/public/mojom/host_resolver.mojom.h"
 #include "services/network/public/mojom/url_loader_factory.mojom-forward.h"
@@ -84,6 +85,8 @@ class NodeService : public node::mojom::NodeService {
 
   // depends-on: js_env_'s isolate
   std::shared_ptr<node::Environment> node_env_;
+
+  std::unique_ptr<net::NetworkChangeNotifier> network_change_notifier_;
 };
 
 }  // namespace electron
Repository: vuejs/vue
Pull request: added v-once directive unit tests


Changed files:
filename: test/unit/features/directives/once.spec.js
patch: @@ -0,0 +1,106 @@
+import Vue from 'vue'
+
+describe('Directive v-once', () => {
+  it('should not rerender component', done => {
+    const vm = new Vue({
+      el: '#app',
+      template: '<div v-once>{{ a }}</div>',
+      data: { a: 'hello' }
+    })
+
+    expect(vm.$el.innerHTML).toBe('hello')
+    vm.a = 'world'
+    waitForUpdate(() => {
+      expect(vm.$el.innerHTML).toBe('hello')
+      done()
+    }).catch(done)
+  })
+
+  it('should not rerender self and child component', done => {
+    const vm = new Vue({
+      el: '#app',
+      template: `<div v-once>
+                  <span>{{ a }}</span>
+                  <item :b="a"></item>
+                </div>`,
+      data: { a: 'hello' },
+      components: {
+        item: {
+          template: '<div>{{ b }}</div>',
+          props: ['b']
+        }
+      }
+    })
+
+    expect(vm.$children.length).toBe(0)
+    expect(vm.$el.innerHTML)
+      .toBe('<span>hello</span><div>hello</div>')
+    vm.a = 'world'
+    waitForUpdate(() => {
+      expect(vm.$el.innerHTML)
+        .toBe('<span>hello</span><div>hello</div>')
+      done()
+    }).catch(done)
+  })
+
+  it('should rerender parent but not self', done => {
+    const vm = new Vue({
+      el: '#app',
+      template: `<div>
+                  <span>{{ a }}</span>
+                  <item v-once :b="a"></item>
+                </div>`,
+      data: { a: 'hello' },
+      components: {
+        item: {
+          template: '<div>{{ b }}</div>',
+          props: ['b']
+        }
+      }
+    })
+
+    expect(vm.$children.length).toBe(0)
+    expect(vm.$el.innerHTML)
+      .toBe('<span>hello</span><div>hello</div>')
+    vm.a = 'world'
+    waitForUpdate(() => {
+      expect(vm.$el.innerHTML)
+        .toBe('<span>world</span><div>hello</div>')
+      done()
+    }).catch(done)
+  })
+
+  it('should not rerender static sub nodes', done => {
+    const vm = new Vue({
+      el: '#app',
+      template: `<div>
+                  <span v-once>{{ a }}</span>
+                  <item :b="a"></item>
+                  <span>{{ suffix }}</span>
+                </div>`,
+      data: {
+        a: 'hello',
+        suffix: '?'
+      },
+      components: {
+        item: {
+          template: '<div>{{ b }}</div>',
+          props: ['b']
+        }
+      }
+    })
+
+    expect(vm.$el.innerHTML)
+      .toBe('<span>hello</span><div>hello</div><span>?</span>')
+    vm.a = 'world'
+    waitForUpdate(() => {
+      expect(vm.$el.innerHTML)
+        .toBe('<span>hello</span><div>world</div><span>?</span>')
+      vm.suffix = '!'
+    }).then(() => {
+      expect(vm.$el.innerHTML)
+        .toBe('<span>hello</span><div>world</div><span>!</span>')
+      done()
+    }).catch(done)
+  })
+})
Repository: ggml-org/llama.cpp
Pull request: model-conversion : remove max diff check in compare-logits [no ci]

This commit removes the maximum difference check from the compare-logits.py which would stop early if the difference between the logits exceeded a threshold.

The motivation for removing this is that it can be useful to be able to get the complete log for debugging/reporting purposes.


Changed files:
filename: examples/model-conversion/scripts/causal/compare-logits.py
patch: @@ -32,10 +32,6 @@ def quick_logits_check(pytorch_file, llamacpp_file):
     print(f"Top 10 llama.cpp logits: {llamacpp_logits[llamacpp_top10]}")
     print(f"Max absolute difference: {max_diff:.4f}")
 
-    if max_diff > 1.0:
-        print(f"❌ NOK: Large differences detected - max diff: {max_diff:.4f}")
-        return False
-
     return True
 
 def main():
Repository: facebook/react
Pull request: Turn on enableSiblingPrerendering in canary

In preparation for the next RC, I set this feature flag to true everywhere. I did not delete the feature flag yet, in case there are yet more bugs to be discovered.

I also didn't remove the dynamic feature flag from the Meta builds; I'll let the Meta folks handle that.

Changed files:
filename: packages/shared/ReactFeatureFlags.js
patch: @@ -145,7 +145,7 @@ export const enableOwnerStacks = __EXPERIMENTAL__;
 
 export const enableShallowPropDiffing = false;
 
-export const enableSiblingPrerendering = false;
+export const enableSiblingPrerendering = true;
 
 /**
  * Enables an expiration time for retry lanes to avoid starvation.

filename: packages/shared/forks/ReactFeatureFlags.native-oss.js
patch: @@ -83,7 +83,7 @@ export const retryLaneExpirationMs = 5000;
 export const syncLaneExpirationMs = 250;
 export const transitionLaneExpirationMs = 5000;
 export const useModernStrictMode = true;
-export const enableSiblingPrerendering = false;
+export const enableSiblingPrerendering = true;
 
 // Profiling Only
 export const enableProfilerTimer = __PROFILE__;

filename: packages/shared/forks/ReactFeatureFlags.test-renderer.js
patch: @@ -81,7 +81,7 @@ export const enableInfiniteRenderLoopDetection = false;
 
 export const renameElementSymbol = true;
 export const enableShallowPropDiffing = false;
-export const enableSiblingPrerendering = false;
+export const enableSiblingPrerendering = true;
 
 // TODO: This must be in sync with the main ReactFeatureFlags file because
 // the Test Renderer's value must be the same as the one used by the

filename: packages/shared/forks/ReactFeatureFlags.test-renderer.native-fb.js
patch: @@ -79,7 +79,7 @@ export const syncLaneExpirationMs = 250;
 export const transitionLaneExpirationMs = 5000;
 export const useModernStrictMode = true;
 export const enableFabricCompleteRootInCommitPhase = false;
-export const enableSiblingPrerendering = false;
+export const enableSiblingPrerendering = true;
 
 // Flow magic to verify the exports of this file match the original version.
 ((((null: any): ExportsType): FeatureFlagsType): ExportsType);

filename: packages/shared/forks/ReactFeatureFlags.test-renderer.www.js
patch: @@ -92,7 +92,7 @@ export const renameElementSymbol = false;
 export const enableObjectFiber = false;
 export const enableOwnerStacks = false;
 export const enableShallowPropDiffing = false;
-export const enableSiblingPrerendering = false;
+export const enableSiblingPrerendering = true;
 
 // Flow magic to verify the exports of this file match the original version.
 ((((null: any): ExportsType): FeatureFlagsType): ExportsType);
Repository: vuejs/vue
Pull request: Update package.json

404 on repo


Changed files:
filename: package.json
patch: @@ -23,17 +23,17 @@
   },
   "repository": {
     "type": "git",
-    "url": "git+https://github.com/vuejs/vue-lite.git"
+    "url": "git+https://github.com/vuejs/vue.git"
   },
   "keywords": [
     "vue"
   ],
   "author": "Evan You",
   "license": "MIT",
   "bugs": {
-    "url": "https://github.com/vuejs/vue-lite/issues"
+    "url": "https://github.com/vuejs/vue/issues"
   },
-  "homepage": "https://github.com/vuejs/vue-lite#readme",
+  "homepage": "https://github.com/vuejs/vue#readme",
   "devDependencies": {
     "babel-core": "^6.0.0",
     "babel-loader": "^6.0.0",
Repository: vuejs/vue
Pull request: ci bugfix

fixed some small issues, but still failed for:

```
    Expected message "Invalid component name: "123"" to have been warned
        at /Users/zhaojinjiang/Sites/public/vue/test/unit/specs/index.js:11313 <- webpack:///test/unit/specs/global_api_spec.js:45:0
        at /Users/zhaojinjiang/Sites/public/vue/test/unit/specs/index.js:11055 <- webpack:///test/unit/specs/filters/filters_spec.js:109:0
    Expected message "Invalid component name: "_fesf"" to have been warned
        at /Users/zhaojinjiang/Sites/public/vue/test/unit/specs/index.js:11315 <- webpack:///test/unit/specs/global_api_spec.js:47:0
        at /Users/zhaojinjiang/Sites/public/vue/test/unit/specs/index.js:11055 <- webpack:///test/unit/specs/filters/filters_spec.js:109:0
    Expected message "Invalid component name: "Some App"" to have been warned
        at /Users/zhaojinjiang/Sites/public/vue/test/unit/specs/index.js:11317 <- webpack:///test/unit/specs/global_api_spec.js:49:0
        at /Users/zhaojinjiang/Sites/public/vue/test/unit/specs/index.js:11055 <- webpack:///test/unit/specs/filters/filters_spec.js:109:0
PhantomJS 1.9.8 (Mac OS X 0.0.0): Executed 670 of 670 (1 FAILED) (10.153 secs / 9.392 secs)
```


Changed files:
filename: src/compiler/compile.js
patch: @@ -4,8 +4,8 @@ import { compileProps } from './compile-props'
 import { parseText, tokensToExp } from '../parsers/text'
 import { parseDirective } from '../parsers/directive'
 import { parseTemplate } from '../parsers/template'
-import { resolveAsset } from '../util/index'
 import {
+  resolveAsset,
   toArray,
   warn,
   remove,

filename: src/global-api.js
patch: @@ -1,17 +1,3 @@
-import {
-  set,
-  del,
-  nextTick,
-  mergeOptions,
-  classify,
-  toArray,
-  commonTagRE,
-  reservedTagRE,
-  warn,
-  isPlainObject,
-  extend
-} from './util/index'
-
 import config from './config'
 import directives from './directives/public/index'
 import elementDirectives from './directives/element/index'
@@ -27,6 +13,20 @@ import * as transition from './transition/index'
 import FragmentFactory from './fragment/factory'
 import internalDirectives from './directives/internal/index'
 
+const {
+  set,
+  del,
+  nextTick,
+  mergeOptions,
+  classify,
+  toArray,
+  commonTagRE,
+  reservedTagRE,
+  warn,
+  isPlainObject,
+  extend
+} = util
+
 export default function (Vue) {
   /**
    * Vue and every constructor that extends Vue has an

filename: test/unit/specs/parsers/expression_spec.js
patch: @@ -178,7 +178,7 @@ var testCases = [
     scope: {
       c: '\'c'
     },
-    expected: "a\'b\'c",
+    expected: "a'b'c",
     paths: ['c']
   },
   {
Repository: huggingface/transformers
Pull request: Fix model name test for compressed tensors 

# What does this PR do?

As per title, the models that were used to test compressed-tensors changed. Also test_llama_8b_fp8 output depends on the hardware, so I changed it even it passes on h100. 

Changed files:
filename: tests/quantization/compressed_tensors_integration/test_compressed_models.py
patch: @@ -155,8 +155,8 @@ def test_no_warnings_for_all_models(self):
 @require_compressed_tensors
 @require_torch
 class RunCompressedTest(unittest.TestCase):
-    tinyllama_w4a16 = "nm-testing/tinyllama-w4a16-compressed-hf-quantizer"
-    tinyllama_w8a8 = "nm-testing/tinyllama-w8a8-compressed-hf-quantizer"
+    tinyllama_w4a16 = "nm-testing/tinyllama-w4a16-compressed"
+    tinyllama_w8a8 = "nm-testing/tinyllama-w8a8-compressed"
 
     prompt = "Paris is the capital of which country?"
 

filename: tests/quantization/compressed_tensors_integration/test_compressed_tensors.py
patch: @@ -13,9 +13,9 @@
 @require_compressed_tensors
 @require_torch
 class CompressedTensorsTest(unittest.TestCase):
-    tinyllama_w8a16 = "nm-testing/tinyllama-w8a16-dense-hf-quantizer"
-    tinyllama_w4a16 = "nm-testing/tinyllama-w4a16-compressed-hf-quantizer"
-    tinyllama_w8a8 = "nm-testing/tinyllama-w8a8-compressed-hf-quantizer"
+    tinyllama_w8a16 = "nm-testing/tinyllama-w8a16-dense"
+    tinyllama_w4a16 = "nm-testing/tinyllama-w4a16-compressed"
+    tinyllama_w8a8 = "nm-testing/tinyllama-w8a8-compressed"
     llama3_8b_fp8 = "nm-testing/Meta-Llama-3-8B-Instruct-fp8-hf_compat"
 
     prompt = "Paris is the capital of which country?"
@@ -59,7 +59,7 @@ def test_tinyllama_w8a16(self):
         self._test_quantized_model(self.tinyllama_w8a16, expected_out)
 
     def test_llama_8b_fp8(self):
-        expected_out = "
Paris is the capital of which country? France\nWhat is the name of the famous art museum in Paris? The Louvre\nWhat is the name of the famous opera house in Paris? Palais Garnier\nWhat is the name of the"
+        expected_out = "
Paris is the capital of which country? France\nWhat is the name of the famous art museum in Paris? The Louvre\nWhat is the name of the famous bridge in Paris? Pont des Arts\nWhat is the name of the famous opera? "
         self._test_quantized_model(self.llama3_8b_fp8, expected_out)
 
     def _test_quantized_model(self, model_name: str, expected_output: str):
Repository: electron/electron
Pull request: build: use new 7z command line switch

#### Description of Change
Our Github Actions Windows runners were recently updated to https://github.com/actions/runner/releases/tag/v2.328.0.  This ended up pulling in a newer version of 7zip which has changed the flag we use from `-snld` to `-snld20`: https://github.com/ip7z/7zip/releases/tag/25.01
<!--
Thank you for your Pull Request. Please provide a description above and review
the requirements below.

Contributors guide: https://github.com/electron/electron/blob/main/CONTRIBUTING.md
-->

#### Checklist
<!-- Remove items that do not apply. For completed items, change [ ] to [x]. -->

- [x] PR description included and stakeholders cc'd
- [x] [PR release notes](https://github.com/electron/clerk/blob/main/README.md) describe the change in a way relevant to app developers, and are [capitalized, punctuated, and past tense](https://github.com/electron/clerk/blob/main/README.md#examples).

#### Release Notes

Notes: none


Changed files:
filename: .github/actions/restore-cache-azcopy/action.yml
patch: @@ -97,7 +97,7 @@ runs:
 
       $TEMP_DIR=New-Item -ItemType Directory -Path temp-cache
       $TEMP_DIR_PATH = $TEMP_DIR.FullName
-      C:\ProgramData\Chocolatey\bin\7z.exe -y -snld x $src_cache -o"$TEMP_DIR_PATH"
+      C:\ProgramData\Chocolatey\bin\7z.exe -y -snld20 x $src_cache -o"$TEMP_DIR_PATH"
 
   - name: Move Src Cache (Windows)
     if: ${{ inputs.target-platform == 'win' }}
Repository: ggml-org/llama.cpp
Pull request: model-conversion : remove -c 0 from model card template [no ci]

This commit removes the `-c, --ctx-size N` from the llama-server command in the model card template for causal models.

The motivation for this is that -c 0 is the default and specifying it is redundant.

Changed files:
filename: examples/model-conversion/scripts/causal/modelcard.template
patch: @@ -7,7 +7,7 @@ base_model:
 Recommended way to run this model:
 
 ```sh
-llama-server -hf {namespace}/{model_name}-GGUF -c 0
+llama-server -hf {namespace}/{model_name}-GGUF
 ```
 
 Then, access http://localhost:8080
Repository: ollama/ollama
Pull request: Document concurrent behavior and settings

Merge after #4218 

Changed files:
filename: docs/faq.md
patch: @@ -257,3 +257,17 @@ If you wish to override the `OLLAMA_KEEP_ALIVE` setting, use the `keep_alive` AP
 ## How do I manage the maximum number of requests the Ollama server can queue?
 
 If too many requests are sent to the server, it will respond with a 503 error indicating the server is overloaded.  You can adjust how many requests may be queue by setting `OLLAMA_MAX_QUEUE`.
+
+## How does Ollama handle concurrent requests?
+
+Ollama supports two levels of concurrent processing.  If your system has sufficient available memory (system memory when using CPU inference, or VRAM for GPU inference) then multiple models can be loaded at the same time.  For a given model, if there is sufficient available memory when the model is loaded, it is configured to allow parallel request processing.
+
+If there is insufficient available memory to load a new model request while one or more models are already loaded, all new requests will be queued until the new model can be loaded.  As prior models become idle, one or more will be unloaded to make room for the new model.  Queued requests will be processed in order.  When using GPU inference new models must be able to completely fit in VRAM to allow concurrent model loads.
+
+Parallel request processing for a given model results in increasing the context size by the number of parallel requests.  For example, a 2K context with 4 parallel requests will result in an 8K context and additional memory allocation.
+
+The following server settings may be used to adjust how Ollama handles concurrent requests:
+
+- `OLLAMA_MAX_LOADED_MODELS` - The maximum number of models that can be loaded concurrently provided they fit in available memory.  The default is 3 * the number of GPUs or 3 for CPU inference.
+- `OLLAMA_NUM_PARALLEL` - The maximum number of parallel requests each model will process at the same time.  The default will auto-select either 4 or 1 based on available memory.
+- `OLLAMA_MAX_QUEUE` - The maximum number of requests Ollama will queue when busy before rejecting additional requests. The default is 512