Spaces:
Paused
Paused
<!--Copyright 2022 The HuggingFace Team. All rights reserved. | |
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with | |
the License. You may obtain a copy of the License at | |
http://www.apache.org/licenses/LICENSE-2.0 | |
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on | |
an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the | |
β οΈ Note that this file is in Markdown but contain specific syntax for our doc-builder (similar to MDX) that may not be | |
rendered properly in your Markdown viewer. | |
--> | |
# λ€μ€ GPUμμ ν¨μ¨μ μΈ μΆλ‘ [[efficient-inference-on-a-multiple-gpus]] | |
μ΄ λ¬Έμμλ λ€μ€ GPUμμ ν¨μ¨μ μΌλ‘ μΆλ‘ νλ λ°©λ²μ λν μ λ³΄κ° ν¬ν¨λμ΄ μμ΅λλ€. | |
<Tip> | |
μ°Έκ³ : λ€μ€ GPU μ€μ μ [λ¨μΌ GPU μΉμ ](./perf_infer_gpu_one)μμ μ€λͺ λ λλΆλΆμ μ λ΅μ μ¬μ©ν μ μμ΅λλ€. κ·Έλ¬λ λ λμ νμ©μ μν΄ κ°λ¨ν κΈ°λ²λ€μ μμμΌ ν©λλ€. | |
</Tip> | |
## λ λΉ λ₯Έ μΆλ‘ μ μν `BetterTransformer` [[bettertransformer-for-faster-inference]] | |
μ°λ¦¬λ μ΅κ·Ό ν μ€νΈ, μ΄λ―Έμ§ λ° μ€λμ€ λͺ¨λΈμ λν λ€μ€ GPUμμ λ λΉ λ₯Έ μΆλ‘ μ μν΄ `BetterTransformer`λ₯Ό ν΅ν©νμ΅λλ€. μμΈν λ΄μ©μ μ΄ ν΅ν©μ λν [λ¬Έμ](https://huggingface.co/docs/optimum/bettertransformer/overview)λ₯Ό νμΈνμμμ€. |