主要记录这些踩过的坑:
12345
pip install transformers accelerate bitsandbytes pillow sentencepiece protobuf # 基准packages pip install protobuf==3.20pip install accelerate==0.26.0 # 模型量化指定版本pip install transformers --upgrade # transformers更新到最新版本,一定要大于4.39.0、