I run a simple react frontend locally with fastapi backend, using ct2 to load the model, there is a sample script here for using hugging face 8bit.
確定! 回上一頁