Linux distribution (Ubuntu, MacOS, etc.) + CUDA > 10.0. LLM.int8() requires Turing or Ampere GPUs. Installation: pip install bitsandbytes. Using 8-bit optimizer ...
確定! 回上一頁