sharjeelyunus/github-issues-dataset huggingface dataset:
Repository: go
Issue: cmd/go: TestScript/mod_prefer_compatible failures
Labels: NeedsInvestigation

```
#!watchflakes
default <- pkg == "cmd/go" && test == "TestScript/mod_prefer_compatible"
```

Issue created automatically to collect these failures.

Example ([log](https://ci.chromium.org/b/8752921764314283089)):

    === RUN   TestScript/mod_prefer_compatible
    === PAUSE TestScript/mod_prefer_compatible
    === CONT  TestScript/mod_prefer_compatible
        script_test.go:136: 2024-03-20T19:25:11Z
        script_test.go:138: $WORK=/Users/swarming/.swarming/w/ir/x/t/cmd-go-test-2387070046/tmpdir210179505/mod_prefer_compatible3060224572
        script_test.go:160: 
            PATH=/Users/swarming/.swarming/w/ir/x/t/cmd-go-test-2387070046/tmpdir210179505/testbin:/Users/swarming/.swarming/w/ir/x/w/goroot/bin:/Users/swarming/.swarming/w/ir/x/w/goroot/bin:/Users/swarming/.swarming/w/ir/x/w/goroot/bin:/Users/swarming/.swarming/w/ir/cache/tools/bin:/Users/swarming/.swarming/w/ir/bbagent_utility_packages:/Users/swarming/.swarming/w/ir/bbagent_utility_packages/bin:/Users/swarming/.swarming/w/ir/cipd_bin_packages:/Users/swarming/.swarming/w/ir/cipd_bin_packages/bin:/Users/swarming/.swarming/w/ir/cipd_bin_packages/cpython3:/Users/swarming/.swarming/w/ir/cipd_bin_packages/cpython3/bin:/Users/swarming/.swarming/w/ir/cache/cipd_client:/Users/swarming/.swarming/w/ir/cache/cipd_client/bin:/Users/swarming/.swarming/cipd_cache/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin
            HOME=/no-home
            CCACHE_DISABLE=1
            GOARCH=amd64
    ...
            go: github.com/rsc/legacytest@7303f7796364: invalid version: git ls-remote -q origin in /Users/swarming/.swarming/w/ir/x/t/cmd-go-test-2387070046/tmpdir210179505/mod_prefer_compatible3060224572/gopath/pkg/mod/cache/vcs/02e2b870e781600b12f669a2429e9f625455accbfc13989fc24e53973cfac1fb: exit status 128:
            	12:25:17.281364 http.c:699              == Info: Couldn't find host github.com in the .netrc file; using defaults
            	12:25:17.292742 http.c:699              == Info:   Trying 64:ff9b::8c52:7204...
            	12:25:17.292872 http.c:699              == Info: TCP_NODELAY set
            	12:25:17.388678 http.c:699              == Info: Connected to github.com (64:ff9b::8c52:7204) port 443 (#0)
            	12:25:27.665845 http.c:699              == Info: Server aborted the SSL handshake
            	12:25:27.665885 http.c:699              == Info: Closing connection 0
            	fatal: unable to access 'https://github.com/rsc/legacytest/': Server aborted the SSL handshake
        script_test.go:160: FAIL: testdata/script/mod_prefer_compatible.txt:76: go list -m github.com/rsc/legacytest@7303f7796364: exit status 1
    --- FAIL: TestScript/mod_prefer_compatible (17.19s)


— [watchflakes](https://go.dev/wiki/Watchflakes)
Repository: go
Issue: cmd/go: TestScript/mod_download_hash failures
Labels: NeedsInvestigation

```
#!watchflakes
default <- pkg == "cmd/go" && test == "TestScript/mod_download_hash"
```

Issue created automatically to collect these failures.

Example ([log](https://ci.chromium.org/b/8752920296404474577)):

    === RUN   TestScript/mod_download_hash
    === PAUSE TestScript/mod_download_hash
    === CONT  TestScript/mod_download_hash
        script_test.go:136: 2024-03-20T19:31:42Z
        script_test.go:138: $WORK=C:\b\s\w\ir\x\t\cmd-go-test-1085195779\tmpdir138375874\mod_download_hash4264072448
    2024/03/20 12:31:42 serving /git/issue47650/info/refs?service=git-upload-pack
    2024/03/20 12:31:42 serving /git/issue47650/git-upload-pack
    2024/03/20 12:31:42 serving /git/issue47650/info/refs?service=git-upload-pack
        script_test.go:160: 
            PATH=C:\b\s\w\ir\x\t\cmd-go-test-1085195779\tmpdir138375874\testbin;C:\b\s\w\ir\x\w\goroot\bin;C:\b\s\w\ir\x\w\goroot\bin;C:\b\s\w\ir\x\w\goroot\bin;C:\b\s\w\ir\cache\tools\bin;C:\b\s\w\ir\bbagent_utility_packages;C:\b\s\w\ir\bbagent_utility_packages\bin;C:\b\s\w\ir\cipd_bin_packages;C:\b\s\w\ir\cipd_bin_packages\bin;C:\b\s\w\ir\cipd_bin_packages\cpython3;C:\b\s\w\ir\cipd_bin_packages\cpython3\bin;C:\b\s\w\ir\cache\cipd_client;C:\b\s\w\ir\cache\cipd_client\bin;C:\b\s\cipd_cache\bin;C:\Program Files\OpenSSH\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\Program Files\Puppet Labs\Puppet\bin;C:\b\s\w\ir\cache\tools\cc\windows\gcc64\bin
    ...
            	12:31:53.718640 http.c:724              == Info: [CONN-0-0][CF-SSL] TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
            	12:31:53.718640 http.c:724              == Info: [CONN-0-0][CF-SSL] TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
            	12:31:53.718640 http.c:724              == Info: old SSL session ID is stale, removing
            	12:31:58.893657 http.c:724              == Info: [CONN-0-0][CF-SSL] TLSv1.3 (IN), TLS alert, close notify (256):
            	12:31:58.893657 http.c:724              == Info: HTTP/2 stream 1 was not closed cleanly before end of the underlying stream
            	12:31:58.893657 http.c:724              == Info: Closing connection 0
            	12:31:58.893657 http.c:724              == Info: [CONN-0-0][CF-SSL] TLSv1.3 (OUT), TLS alert, close notify (256):
            	fatal: unable to access 'https://github.com/rsc/quote/': HTTP/2 stream 1 was not closed cleanly before end of the underlying stream
        script_test.go:160: FAIL: testdata\script\mod_download_hash.txt:9: go mod download rsc.io/quote@a91498bed0a73d4bb9c1fb2597925f7883bc40a7: exit status 1
    --- FAIL: TestScript/mod_download_hash (18.22s)


— [watchflakes](https://go.dev/wiki/Watchflakes)
Repository: go
Issue: cmd/go/internal/vcweb/vcstest: TestScripts failures
Labels: NeedsInvestigation

```
#!watchflakes
default <- pkg == "cmd/go/internal/vcweb/vcstest" && test == "TestScripts"
```

Issue created automatically to collect these failures.

Example ([log](https://ci.chromium.org/b/8752920296120798593)):

    === RUN   TestScripts
        vcstest_test.go:120: GET http://127.0.0.1:33919:
            <html>
            <title>vcweb</title>
            <pre>
            <b>vcweb</b>
            
            This server serves various version control repos for testing the go command.
            
            For an overview of the script language, see <a href="/help">/help</a>.
    ...
            hg/custom-hg-hello.txt		2024-03-20T12:27:49-07:00	custom-hg-hello.txt:1: handle hg: server for `hg` VCS is not installed
            hg/hello.txt			2024-03-20T12:27:49-07:00	hello.txt:1: handle hg: server for `hg` VCS is not installed
            hg/hgrepo1.txt			2024-03-20T12:27:49-07:00	hgrepo1.txt:1: handle hg: server for `hg` VCS is not installed
            hg/vgotest1.txt			2024-03-20T12:27:49-07:00	vgotest1.txt:1: handle hg: server for `hg` VCS is not installed
            insecure.txt			2024-03-20T12:27:49-07:00	ok
            svn/hello.txt			2024-03-20T12:27:49-07:00	hello.txt:1: handle svn: server for `svn` VCS is not installed
            svn/nonexistent.txt		2024-03-20T12:27:49-07:00	nonexistent.txt:1: handle svn: server for `svn` VCS is not installed
            svn/test1-svn-git.txt		2024-03-20T12:27:49-07:00	test1-svn-git.txt:1: handle svn: server for `svn` VCS is not installed
            svn/test2-svn-git.txt		2024-03-20T12:27:49-07:00	test2-svn-git.txt:1: handle svn: server for `svn` VCS is not installed
    --- FAIL: TestScripts (4.84s)


— [watchflakes](https://go.dev/wiki/Watchflakes)
Repository: go
Issue: net/http: TestServerNoReadTimeout/h2 failures
Labels: NeedsInvestigation

```
#!watchflakes
default <- pkg == "net/http" && test == "TestServerNoReadTimeout/h2"
```

Issue created automatically to collect these failures.

Example ([log](https://ci.chromium.org/b/8752857292252966385)):

    === RUN   TestServerNoReadTimeout/h2
        serve_test.go:818: Server.Config.ReadTimeout = 0
        serve_test.go:818: Server.Config.ReadTimeout = -1
        serve_test.go:824: Post "https://127.0.0.1:51316": http2: Transport: cannot retry err [http2: Transport received Server's graceful shutdown GOAWAY] after Request.Body was written; define Request.GetBody to avoid this error
    --- FAIL: TestServerNoReadTimeout/h2 (0.38s)


— [watchflakes](https://go.dev/wiki/Watchflakes)
Repository: awesome-mac
Issue: 🎉 Add GitX (the latest fork)
Labels: addition

### 🪩 Provide a link to the proposed addition

https://github.com/gitx/gitx

### 😳 Explain why it should be added

This is the new fork for the now-abandoned [GitX-dev](https://rowanj.github.io/gitx/) which is already listed.

### 📖 Additional context

GitX-dev is abandoned since 10 years ago.

### 🧨 Issue Checklist

- [X] I have checked for other similar issues
- [X] I have explained why this change is important
- [X] I have added necessary documentation (if appropriate)
Repository: pytorch
Issue: Distributed checkpoint state_dict load may report nccl error and hide the real root-cause exception
Labels: oncall: distributed,triaged,has workaround,bug,module: distributed_checkpoint,oncall: distributed checkpointing

### 🐛 Describe the bug

Hi, when we call `torch.distributed.checkpoint.load_state_dict(state_dict, storage_reader)`, and if there is exception in storage_reader.read_data(), the exception is not immediately raised.[ It's captured here, and then dist.all_gather_objects(exception) before raising. ](https://github.com/pytorch/pytorch/blob/main/torch/distributed/checkpoint/utils.py#L246-L255)

Issue is:
1. [that `self.all_gather_object()`](https://github.com/pytorch/pytorch/blob/main/torch/distributed/checkpoint/utils.py#L251) might timeout if only one rank failed storage_reader.read_data() and the remaining ranks continue read_data, which takes longer time than nccl timeout. 
2. User might use a customized `storage_reader` (e.g. downloading from cloud), and there might be nccl communication in the `customized_storage_reader.read_data()`. In this case, if one rank failed `customized_storage_reader.read_data()`, the failure rank starts this [all_gather_object()](https://github.com/pytorch/pytorch/blob/main/torch/distributed/checkpoint/utils.py#L251), the remaining ranks start the other nccl comms in the `customized_storage_reader.read_data()`. This causes nccl comms mismatch 100%. 

What's worse, in both above case, the program crashes caused by nccl error before raising the real `storage_reader.read_data()` exception. The real exception message will never be visible to user. 

To print the `read_data` exception message, we have to capture the exception and  immediately print the exception message inside `read_data`. Example: https://github.com/mosaicml/composer/pull/3131

Can we just raise the `read_data()` exception immediately for the failure rank? I understand that the non-failure rank will continue run and timeout eventually at the next nccl comm, but at least the failure rank can print the real root-cause. 



### Versions

PyTorch version: 2.3.0.dev20240110+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A

cc @mrshenli @pritamdamania87 @zhaojuanmao @satgera @gqchen @aazzolini @osalpekar @jiayisuse @H-Huang @kwen2501 @awgu @penguinwu @fegin @XilunWu @wanchaol @fduwjj @wz337 @tianyu-l @wconstab @yf225 @chauhang @d4l3k @LucasLLC @MeetVadakkanchery @mhorowitz @rohan-varma
Repository: storybook
Issue: [Bug]: @storybook/html doesn't support Autodocs
Labels: bug,needs triage

### Describe the bug

`@storybook/html` exports a type `Meta`, that seems to be used for specifying the type of arguments. It allows good TS types in the `Button.stories.ts` file, but the "Autodocs" doesn't seem to be able to interpret the JSDoc comments of the properties.

### To Reproduce

1. Go to any of the HTML sandboxes
   - https://stackblitz.com/github/storybookjs/sandboxes/tree/next/html-webpack/default/after-storybook?preset=node
   - https://stackblitz.com/github/storybookjs/sandboxes/tree/next/html-vite/default-js/after-storybook?preset=node
   - https://stackblitz.com/github/storybookjs/sandboxes/tree/next/html-vite/default-ts/after-storybook?preset=node
2. Navigate to e.g. the Button docs

### System

```bash
System:
    OS: Linux 5.0 undefined
    CPU: (2) x64 Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz
    Shell: 1.0 - /bin/jsh
  Binaries:
    Node: 18.18.0 - /usr/local/bin/node
    Yarn: 1.22.19 - /usr/local/bin/yarn
    npm: 10.2.3 - /usr/local/bin/npm <----- active
    pnpm: 8.15.3 - /usr/local/bin/pnpm
  npmPackages:
    @storybook/addon-essentials: ^8.1.0-alpha.4 => 8.1.0-alpha.4 
    @storybook/addon-interactions: ^8.1.0-alpha.4 => 8.1.0-alpha.4 
    @storybook/addon-links: ^8.1.0-alpha.4 => 8.1.0-alpha.4 
    @storybook/blocks: ^8.1.0-alpha.4 => 8.1.0-alpha.4 
    @storybook/html: ^8.1.0-alpha.4 => 8.1.0-alpha.4 
    @storybook/html-vite: ^8.1.0-alpha.4 => 8.1.0-alpha.4 
    @storybook/test: ^8.1.0-alpha.4 => 8.1.0-alpha.4 
    storybook: ^8.1.0-alpha.4 => 8.1.0-alpha.4
```


### Additional context

![Screenshot from 2024-03-22 23-24-24](https://github.com/storybookjs/storybook/assets/138395/52d4fc0f-9b6d-4d70-acea-f6bb09a03344)
Repository: godot
Issue: Custom resource types are unable to be imported.
Labels: bug,topic:editor,topic:plugin,needs testing,topic:import

### Tested versions

4.2-stable

### System information

Godot v4.2.stable - Linux Mint 21.1 (Vera) - X11 - Vulkan (Forward+) - integrated Intel(R) Iris(R) Plus Graphics (ICL GT2) () - Intel(R) Core(TM) i7-1068NG7 CPU @ 2.30GHz (8 Threads)

### Issue description

When using a `EditorImportPlugin`, the `_get_resource_type()` function cannot return a custom resource type. This means that files cannot be dragged into inspector properties of a custom resource type.

### Steps to reproduce

1. Create editor plugin
2. Follow [import plugin documentation](https://docs.godotengine.org/en/stable/tutorials/plugins/editor/import_plugins.html)
3. Make a custom resource
4. Change return value of `_get_resource_type()` to `"CustomResource"`
5. _Cannot get class "CustomResource"_

### Minimal reproduction project (MRP)

[test_project.zip](https://github.com/godotengine/godot/files/14729143/test_project.zip)
Repository: go
Issue: x/website/_content/doc/tutorial: unnecessary cd into home directory
Labels: Documentation,help wanted,NeedsInvestigation,website

## Issue

The tutorial suggests making the project folder in the home directory:-
![image](https://github.com/golang/go/assets/73871477/2dc775fa-8438-4968-8342-d8d128c03b7d)
Ex:- https://go.dev/doc/tutorial/getting-started , https://go.dev/doc/tutorial/getting-started

Which can be misleading and can convey that a go project must be created in the home directory.

## Suggested fix

1. **Remove** the step
2. Mark the step as **optional**
3. Add a **note** implying the project directory can be made in other directories as well
Repository: pytorch
Issue: [RFC] Solving Warm Start in torch.compile
Labels: triaged,oncall: pt2,module: fakeTensor,module: aotdispatch,module: inductor,module: dynamo

### 🚀 The feature, motivation and pitch

https://docs.google.com/document/d/1XR66WrFv6hspNyyTUsGAp7FvN-aKcckEj-hwfRGAPQ8/edit

Will copy over the summary from the doc.

Clearly, warm-start compilation times are a big obstacle to many users of torch.compile.

To name a couple:
1. Training job killed - we want to restart from the checkpoint as fast as possible.
2. We have 10k GPUs, our goal is to not occupy all 10k GPUs with compilation when starting up.
3. Users want to perform inference with some kind of dynamic scaling, and so when they start up a new process they want the minimal startup time.
4. Users want to use torch.compile in a manner similar to a “custom operator” - compile times are one of the main issues preventing this.

In many of these cases, there is essentially no compilation time that is acceptable. 

The north-star goal here is: “If it runs correctly and with speedups compared to eager, there should be nothing preventing users from using torch.compile”. 

The doc describes a couple of solutions to the problem. We have broad agreement on pursuing Solution 1, and some tenuous agreement on doing a version of Solution 2.

Today, there already exists an Inductor code cache (`torch._inductor.config.fx_graph_cache`) that skips the Inductor component of compilation

### Alternatives

_No response_

### Additional context

_No response_

cc @ezyang @msaroufim @bdhirsh @anijain2305 @zou3519 @chauhang @eellison @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @peterbell10 @ipiszy @yf225 @chenyang78 @kadeng @muchulee8 @aakhundov @ColinPeppler @amjames @desertfire
Repository: godot
Issue: [4.3.dev3+] Editor and project manager windows are always borderless when using wayland
Labels: bug,platform:linuxbsd,topic:porting

### Tested versions

Reproducible with 4.3.dev3, dev4, and dev5 for both standard and .NET versions

### System information

Linux 6.7.6-arch1-1; Gnome 45.4 with wayland; i5-7200u with Intel HD Graphics 620

### Issue description

With `run/platforms/linuxbsd/prefer_wayland` set to true, the project manager and editor window are both borderless and as a result are impossible to move or resize. Additionally, (at least on Gnome) with both x and wayland the project manager follows window positioning keyboard shortcuts but the editor only follows fullscreen shortcuts. This leaves the editor effectively only usable while fullscreened on wayland (ie no good way to split screen the godot editor with an external code editor)

[sidenote - disabling `prefer_wayland` and then following the save and restart prompt still results in the editor using wayland; it needs to be restarted separately from that prompt for the setting to actually take effect]

### Steps to reproduce

Launch any affected version of godot with wayland support enabled on a system using wayland

### Minimal reproduction project (MRP)

N/A
Repository: vscode
Issue: Allow icons in menus
Labels: under-discussion,menus

<!-- ⚠️⚠️ Do Not Delete This! feature_request_template ⚠️⚠️ -->
<!-- Please read our Rules of Conduct: https://opensource.microsoft.com/codeofconduct/ -->
<!-- Please search existing issues to avoid creating duplicates. -->

Can VS Code add the ability to have icons beside menu items? I think it would greatly improve UX. Below is a comparison of context menu examples from some common programs.
I realize this is a duplicate of https://github.com/microsoft/vscode/issues/53868 and https://github.com/microsoft/vscode/issues/173981, but since it's been over 4 years since that issue got closed I am hoping things have changed and you will reconsider whether this is still out-of-scope.
<!-- Describe the feature you'd like. -->
Repository: electron
Issue: [Bug]: Frameless Mica windows animate and jiggle when shown
Labels: platform/windows,bug :beetle:,status/confirmed,has-repro-gist,29-x-y

### Preflight Checklist

- [X] I have read the [Contributing Guidelines](https://github.com/electron/electron/blob/main/CONTRIBUTING.md) for this project.
- [X] I agree to follow the [Code of Conduct](https://github.com/electron/electron/blob/main/CODE_OF_CONDUCT.md) that this project adheres to.
- [X] I have searched the [issue tracker](https://www.github.com/electron/electron/issues) for a bug report that matches the one I want to file, without success.

### Electron Version

29.1.5

### What operating system are you using?

Windows

### Operating System Version

Windows 11 23H2

### What arch are you using?

x64

### Last Known Working Electron version

_No response_

### Expected Behavior

A hidden window should appear instantly without any kind of animation when it is shown with `window.show()`.

### Actual Behavior

A window with these properties:

```
backgroundMaterial: "mica",
titlebarStyle: "hidden"
```

Will always animate when shown, as if it were opening for the first time, causing the already-rendered contents to jiggle around.

![CleanShot 2024-03-22 at 22 24 17](https://github.com/electron/electron/assets/7342119/dccda7b3-bbd8-44eb-9470-ee967d44d8ae)

### Testcase Gist URL

https://gist.github.com/bcabb1d9179ef9a0e0d42aec06ce7d97

### Additional Information

_No response_
Repository: deno
Issue: `expo start` hangs at `validateDependenciesVersionsAsync`
Labels: bug,node compat

https://github.com/expo/expo/blob/b3a8afdc230e2c9fd421936c90833a5b3934d802/packages/%40expo/cli/src/start/doctor/dependencies/validateDependenciesVersions.ts#L33-L46

Running with `EXPO_OFFLINE=1` fixes the issue.
Repository: deno
Issue: `StatWatcher.unref` is not implemented
Labels: bug,node compat,node API

```
⠋ Stopping server
✖ Failed to stop server
Error: Not implemented: StatWatcher.unref() is not implemented
Error: Not implemented: StatWatcher.unref() is not implemented
    at notImplemented (ext:deno_node/_utils.ts:9:9)
    at StatWatcher.unref (ext:deno_node/_fs/_fs_watch.ts:181:5)
    at FileNotifier.unsubscribe (file:///Users/divy/gh/rn-app/node_modules/.deno/@expo+cli@0.17.8/node_modules/@expo/cli/src/utils/FileNo
tifier.ts:78:15)
    at FileNotifier.stopObserving (file:///Users/divy/gh/rn-app/node_modules/.deno/@expo+cli@0.17.8/node_modules/@expo/cli/src/utils/File
Notifier.ts:57:5)
    at DevServerManager.stopAsync (file:///Users/divy/gh/rn-app/node_modules/.deno/@expo+cli@0.17.8/node_modules/@expo/cli/src/start/serv
er/DevServerManager.ts:218:22)
    at KeyPressHandler.onPress (file:///Users/divy/gh/rn-app/node_modules/.deno/@expo+cli@0.17.8/node_modules/@expo/cli/src/start/interfa
ce/startInterface.ts:75:34)
    at ReadStream.KeyPressHandler.handleKeypress (file:///Users/divy/gh/rn-app/node_modules/.deno/@expo+cli@0.17.8/node_modules/@expo/cli
/src/start/interface/KeyPressHandler.ts:43:18)
    at ReadStream.emit (ext:deno_node/_stream.mjs:1854:9)
    at addChunk (ext:deno_node/_stream.mjs:2876:16)
    at readableAddChunk (ext:deno_node/_stream.mjs:2850:15)
```
Repository: pytorch
Issue: Unexpected device casting from CPU-pinned tensor to GPU tensor.
Labels: needs reproduction,triaged,module: python frontend

### 🐛 Describe the bug

```py
import torch

X = torch.ones([1024000]).pin_memory()
Y = torch.ones([1024000]).cuda()

Z = torch.add(X, Y)    # X will be casted to CUDA-device tensor, which is not expected.
```

Even though X is pinned memory, Pytorch will still implicit cast it to CUDA device due to a CPU tensor during the execution of `torch.add`. But it shouldn't be since users don't actually plan to run `torch.add(X.cuda(), Y)`. This implicit casting triggers more GPU memory usage and results in GPU wastes and even out of memory if unlucky.

### Versions

Pytorch version = all
Ubuntu version = 22.04

cc @albanD
Repository: transformers
Issue: Mixture of All Intelligence (MoAI)
Labels: New model,Multimodal

### Model description

A new large language and vision model (LLVM) that uses auxiliary visual information and natural language for prediction.

It uses 2 modules: 𝙈𝙤𝘼𝙄-𝘾𝙤𝙢𝙥𝙧𝙚𝙨𝙨𝙤𝙧 and 𝙈𝙤𝘼𝙄-𝙈𝙞𝙭𝙚𝙧. Here 𝗖𝗼𝗺𝗽𝗿𝗲𝘀𝘀𝗼𝗿 condenses the verbalized outputs of the external CV models into auxiliary visual information and 𝗠𝗶𝘅𝗲𝗿 blends three types of intelligence — visual features, auxiliary features from external CV models and language features into a cohesive whole.

MoAI-7B surpasses both open-source and closed-source LLVMs in vision language tasks.

Model repo: https://github.com/ByungKwanLee/MoAI


### Open source status

- [X] The model implementation is available
- [X] The model weights are available

### Provide useful links for the implementation

_No response_