vllm [Bug]:在MacOS上无法工作

m3eecexj  于 2个月前  发布在  Mac
关注(0)|答案(2)|浏览(45)

当前环境信息如下:

用户名@My-MacBook-Pro ~ % python3 collect_env.py torch.device('cpu'), Collecting environment information... PyTorch 版本: 2.2.2 是否为调试版本: False 用于构建 PyTorch 的 CUDA: None 用于构建 PyTorch 的 ROCM: N/A
操作系统: macOS 14.5 (x86_64) GCC 版本: Could not collect Clang 版本: 15.0.0 (clang-1500.3.9.4) CMake 版本: Could not collect Libc 版本: N/A Python 版本: 3.9.6 (default, Feb 3 2024, 15:58:28) [Clang 15.0.0 (clang-1500.3.9.4)] (64-bit runtime) Python 平台: macOS-14.5-x86_64-i386-64bit Is CUDA 可用: False CUDA 运行时版本: No CUDA
CUDA_MODULE_LOADING set to: N/A GPU 模型和配置: No CUDA Nvidia 驱动程序版本: No CUDA cuDNN 版本: No HIP 运行时版本: N/A MIOpen 运行时版本: N/A Is XNNPACK 可用: True CPU:
Intel(R) Core(TM) i9-8950HK CPU @ 2.90GHz
Versions of relevant libraries:
[pip3] numpy==2.0.1
[pip3] torch==2.2.2
[conda] Could not collect
ROCM Version: Could not collect
Neuron SDK Version: N/A
vLLM Version: N/A
vLLM Build Flags:
CUDA Archs: Not Set; ROCm: Disabled; Neuron: Disabled
GPU Topology:
Could not collect

pip install vllm
Defaulting to user installation because normal site-packages is not writeable
Collecting vllm
Downloading vllm-0.5.4.tar.gz (958 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 958.6/958.6 kB 2.8 MB/s eta 0:00:00
Installing build dependencies ... error
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> [10 lines of output]
Collecting cmake>=3.21
Downloading cmake-3.30.2-py3-none-macosx_11_0_universal2.macosx_10_10_x86_64.macosx_11_0_arm64.whl.metadata (6.1 kB)
Collecting ninja
Downloading ninja-1.11.1.1-py2.py3-none-macosx_10_9_universal2.macosx_10_9_x86_64.macosx_11_0_arm64.macosx_11_0_universal2.whl.metadata (5.3 kB)
Collecting packaging
Using cached packaging-24.1-py3-none-any.whl.metadata (3.2 kB)
Collecting setuptools>=49.4.0
Downloading setuptools-72.1.0-py3-none-any.whl.metadata (6.6 kB)
ERROR: Could not find a version that satisfies the requirement torch==2.4.0 (from versions: 1.7.1, 1.8.0, 1.8.1, 1.9.0, 1.9.1, 1.10.0, 1.10.1, 1.10.2, 1.11.0, 1.12.0, 1.12.1, 1.13.0, 1.13.1, 2.0.0, 2.0.1, 2.1.0, 2.1.1, 2.1.2, 2.2.0, 2.2.1, 2.2.2)
ERROR: No matching distribution found for torch==2.4.0
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

🐛 Describe the bug

The instructions on the front page don't seem to work for MacOS. I'm at a loss for what to do next.

pip install vllm


默认安装到用户目录,因为普通站点包不可写入。正在收集 vllm
下载 vllm-0.5.4.tar.gz (958 kB) ...
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 958.6/958.6 kB 2.8 MB/s eta 0:00:00
安装构建依赖项 ... error
错误:子进程退出时未成功运行。
原因:`pip` 在安装构建依赖项时出现问题。
gtlvzcf8

gtlvzcf81#

不确定是什么造成了上面的混乱。抱歉。

q3qa4bjr

q3qa4bjr2#

这是一个关于vllmpytorch的问题。
这些是在Intel Mac上可用的PyTorch CPU版本:

pip index versions torch           
WARNING: pip index is currently an experimental command. It may be removed/changed in a future release without prior warning.
torch (2.2.2)
Available versions: 2.2.2, 2.2.1, 2.2.0

这些是在PyTorch GPU上的可用版本:

pip index versions torch
WARNING: pip index is currently an experimental command. It may be removed/changed in a future release without prior warning.
WARNING: Ignoring invalid distribution -m-eval (/opt/conda/lib/python3.10/site-packages)
torch (2.4.0)
Available versions: 2.4.0, 2.3.1, 2.3.0, 2.2.2, 2.2.1, 2.2.0, 2.1.2, 2.1.1, 2.1.0, 2.0.1, 2.0.0, 1.13.1, 1.13.0, 1.12.1, 1.12.0, 1.11.0

  INSTALLED: 2.3.1
  LATEST:    2.4.0

我的假设是,在最近的更新中,他们只是替换了版本号并添加了+cpu,但二进制文件似乎还没有发布(尽管这可能是错误的)。
我在开始贡献PR时遇到了同样的问题,但无法在本地构建vllm。
我认为#6931可能是原因。
虽然这里的wheel似乎已经列出了https://download.pytorch.org/whl/torch/

相关问题