Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] 安装依赖时终端报错(deepspeed) #146

Open
5 tasks done
duolaBmeng673 opened this issue May 11, 2024 · 0 comments
Open
5 tasks done

[Question] 安装依赖时终端报错(deepspeed) #146

duolaBmeng673 opened this issue May 11, 2024 · 0 comments
Labels
question Further information is requested

Comments

@duolaBmeng673
Copy link

Required prerequisites

Questions

在终端安装依赖时首先报错显示没有安装torch,成功安装torch==2.0.0之后再次pip install -r requirements,结果终端报错显示
(Baichuan-7B) D:\pythonProject\Baichuan\Baichuan-7B>pip install -r requirements.txt
Collecting deepspeed==0.9.2 (from -r requirements.txt (line 1))
Using cached deepspeed-0.9.2.tar.gz (779 kB)
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error

× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [15 lines of output]
test.c
LINK : fatal error LNK1181: 无法打开输入文件“aio.lib”
Traceback (most recent call last):
File "", line 2, in
File "", line 34, in
File "C:\Users\Lenovo\AppData\Local\Temp\pip-install-9oftderk\deepspeed_3ae52cc2f38a4fcd8b677103ea44601c\setup.py", line 162, in
abort(f"Unable to pre-compile {op_name}")
File "C:\Users\Lenovo\AppData\Local\Temp\pip-install-9oftderk\deepspeed_3ae52cc2f38a4fcd8b677103ea44601c\setup.py", line 51, in abort
assert False, msg
AssertionError: Unable to pre-compile async_io
DS_BUILD_OPS=1
[WARNING] async_io requires the dev libaio .so object and headers but these were not found.
[WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
[WARNING] One can disable async_io with DS_BUILD_AIO=0
[ERROR] Unable to pre-compile async_io
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
经查阅后得知libaio为linux系统的包,有没有方法可以再win11上解决这个问题?

Checklist

  • I have provided all relevant and necessary information above.
  • I have chosen a suitable title for this issue.
@duolaBmeng673 duolaBmeng673 added the question Further information is requested label May 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

1 participant