[Installation]: 910B部署vllm-ascend启动失败

[ahutkai]

Your current environment

vllm启动serve 提示torch-npu缺少torch_npu.npu_selfattention、torch_npu.npu_rope函数，用的torch-npu和torch版本都是2.4.0，是bug么？

<img width="1096" alt="Image" src="https://github.com/user-attachments/assets/130ec6bc-752f-4a37-ae43-701fbe16fff1" />

How you are installing vllm and vllm-ascend

pip install -vvv vllm vllm-ascend

[Yikun]

@ahutkai Hi, pls follow https://vllm-ascend.readthedocs.io/en/latest/installation.html to install the vllm and vllm-ascend .

If there is still have problems, pls show complete installation process, thanks.

[ahutkai]

@ahutkai Hi, pls follow https://vllm-ascend.readthedocs.io/en/latest/installation.html to install the vllm and vllm-ascend .

If there is still have problems, pls show complete installation process, thanks.
启动还是同样的问题，下面是我的环境，看报错是torch_npu缺少对应函数：
[root@pod-1341781059626872832 pta]# pip list | grep vllm
vllm 0.7.1+empty
vllm_ascend 0.7.1rc1
[root@pod-1341781059626872832 pta]# pip list | grep torch
mindietorch 2.0a3+torch2.1.0.abi0
torch 2.5.1
torch-npu 2.5.1rc1
torchaudio 2.5.1
torchvision 0.20.1
[root@pod-1341781059626872832 Ascend]# ls ascend-toolkit/
8.0 8.0.T63 latest set_env.sh

相关问题：
ERROR 02-23 17:25:06 engine.py:387] File "/usr/local/lib/python3.11/site-packages/vllm_ascend/ops/rotary_embedding.py", line 44, in rope_forward_oot
ERROR 02-23 17:25:06 engine.py:387] torch_npu.npu_rope(
ERROR 02-23 17:25:06 engine.py:387] ^^^^^^^^^^^^^^^^^^
ERROR 02-23 17:25:06 engine.py:387] AttributeError: module 'torch_npu' has no attribute 'npu_rope'

辛苦帮忙分析下～～

[Yikun]

https://vllm-ascend.readthedocs.io/en/latest/installation.html#setup-vllm-and-vllm-ascend

I guess you didn't install the required pytorch version, try this (which mentioned in above doc)

mkdir pta
cd pta
wget https://pytorch-package.obs.cn-north-4.myhuaweicloud.com/pta/Daily/v2.5.1/20250218.4/pytorch_v2.5.1_py310.tar.gz
tar -xvf pytorch_v2.5.1_py310.tar.gz
pip install ./torch_npu-2.5.1.dev20250218-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

[w1051868626]

确实，你的torch_npu版本不对