Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

8-bit precision

4-bit precision

Misc with no match

Carbon Emissions

Mixture of Experts

Models

233

Full-text search

Active filters: int8

michaelfeil/ct2fast-GPT-JT-6B-v0

Text Generation • Updated May 19, 2023 • 19 • 1

Intel/bert-large-uncased-rte-int8-dynamic-inc

Text Classification • Updated Mar 21 • 20

Intel/whisper-large-int8-static-inc

Automatic Speech Recognition • Updated May 18, 2023 • 11

Intel/whisper-large-int8-dynamic-inc

Automatic Speech Recognition • Updated May 18, 2023 • 13 • 1

Intel/bert-large-uncased-rte-int8-static-inc

Text Classification • Updated Mar 22 • 16

Intel/distilbert-base-uncased-MRPC-int8-dynamic-inc

Text Classification • Updated Mar 21 • 6 • 1

Intel/distilbert-base-uncased-MRPC-int8-static-inc

Text Classification • Updated Mar 22 • 4

Intel/albert-base-v2-MRPC-int8-inc

Text Classification • Updated Mar 22 • 25

Intel/bert-base-uncased-CoLA-int8-inc

Text Classification • Updated Mar 22 • 8

Intel/bert-large-uncased-cola-int8-inc

Text Classification • Updated Mar 22 • 7

Intel/bert-base-uncased-STS-B-int8-inc

Text Classification • Updated Mar 22 • 11

Intel/bert-base-cased-finetuned-sst2-int8-inc

Text Classification • Updated Mar 21 • 25

Intel/bert-base-uncased-QNLI-int8-inc

Text Classification • Updated Mar 22 • 13

michaelfeil/ct2fast-RedPajama-INCITE-Chat-7B-v0.1

Updated May 19, 2023 • 11 • 1

michaelfeil/ct2fast-RedPajama-INCITE-Instruct-7B-v0.1

Updated May 19, 2023 • 7 • 1

michaelfeil/ct2fast-pythia-12b-sft-v8-7k-steps

Text Generation • Updated May 19, 2023 • 18 • 1

michaelfeil/ct2fast-codet5p-770m

Updated May 20, 2023 • 6 • 4

michaelfeil/ct2fast-codet5p-770m-py

Updated May 20, 2023 • 3 • 6

michaelfeil/ct2fast-codegen-350M-mono

Updated May 21, 2023 • 8 • 2

michaelfeil/ct2fast-codegen-350M-multi

Updated May 21, 2023 • 5 • 1

michaelfeil/ct2fast-codegen-2B-mono

Updated May 21, 2023 • 6 • 1

michaelfeil/ct2fast-codegen2-1B

Updated May 21, 2023 • 3 • 1

michaelfeil/ct2fast-codegen2-3_7B

Updated May 21, 2023 • 6 • 1

michaelfeil/ct2fast-codegen-2B-multi

Updated May 21, 2023 • 8 • 1

michaelfeil/ct2fast-codegen-6B-multi

Updated May 21, 2023 • 11 • 1

michaelfeil/ct2fast-codegen-6B-mono

Updated May 21, 2023 • 3 • 1

michaelfeil/ct2fast-codegen-16B-mono

Updated May 22, 2023 • 11 • 2

michaelfeil/ct2fast-stablelm-base-alpha-7b

Updated May 22, 2023 • 26

michaelfeil/ct2fast-codegen-16B-multi

Updated May 22, 2023 • 2

michaelfeil/ct2fast-codegen2-7B

Updated May 22, 2023 • 4 • 3