我们正在FastAPI框架中构建一个api,需要从python访问delta lake存储。
我正在浏览文章https://pypi.org/project/delta-lake-reader/
安装该软件包,但它失败,并出现以下错误:
我使用Visual Studio Code编写代码,并创建了虚拟环境。Python 3.11.3
用户图像
错误:
请指导我解决这个问题。
(.venv) PS C:\Users\vsahu015\deltalake\OI_Blob_Manager> pip install delta-lake-reader[azure]
Collecting delta-lake-reader[azure]
Using cached delta_lake_reader-0.2.13-py3-none-any.whl (12 kB)
Collecting adlfs<0.8.0,>=0.7.5 (from delta-lake-reader[azure])
Using cached adlfs-0.7.7.tar.gz (37 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting aiohttp<4.0.0,>=3.7.3 (from delta-lake-reader[azure])
Using cached aiohttp-3.8.4-cp311-cp311-win_amd64.whl (317 kB)
Collecting fsspec<2022.0,>=2021.5 (from delta-lake-reader[azure])
Using cached fsspec-2021.11.1-py3-none-any.whl (132 kB)
Collecting pandas<2.0.0,>=1.3.1 (from delta-lake-reader[azure])
Using cached pandas-1.5.3-cp311-cp311-win_amd64.whl (10.3 MB)
Collecting pip<22.0.0,>=21.0.1 (from delta-lake-reader[azure])
Using cached pip-21.3.1-py3-none-any.whl (1.7 MB)
Collecting pyarrow<6.0.0,>=5.0.0 (from delta-lake-reader[azure])
Using cached pyarrow-5.0.0.tar.gz (739 kB)
Installing build dependencies ... error
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> [222 lines of output]
Ignoring numpy: markers 'python_version < "3.9"' don't match your environment
Collecting cython>=0.29
Using cached Cython-0.29.35-py2.py3-none-any.whl (988 kB)
Collecting numpy==1.19.4
Using cached numpy-1.19.4.zip (7.3 MB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'error'
error: subprocess-exited-with-error
Preparing metadata (pyproject.toml) did not run successfully.
exit code: 1
[194 lines of output]
setup.py:67: RuntimeWarning: NumPy 1.19.4 may not yet support Python 3.11.
warnings.warn(
Running from numpy source directory.
setup.py:480: UserWarning: Unrecognized setuptools command, proceeding with generating Cython sources and expanding templates
run_build = parse_setuppy_commands()
Processing numpy/random\_bounded_integers.pxd.in
Processing numpy/random\bit_generator.pyx
Processing numpy/random\mtrand.pyx
Processing numpy/random\_bounded_integers.pyx.in
Processing numpy/random\_common.pyx
Processing numpy/random\_generator.pyx
Processing numpy/random\_mt19937.pyx
Processing numpy/random\_pcg64.pyx
Processing numpy/random\_philox.pyx
Processing numpy/random\_sfc64.pyx
Cythonizing sources
blas_opt_info:
blas_mkl_info:
No module named 'numpy.distutils._msvccompiler' in numpy.distutils; trying from distutils
customize MSVCCompiler
libraries mkl_rt not found in ['c:\\Users\\vsahu015\\deltalake\\OI_Blob_Manager\\.venv\\lib', 'C:\\']
NOT AVAILABLE
blis_info:
libraries blis not found in ['c:\\Users\\vsahu015\\deltalake\\OI_Blob_Manager\\.venv\\lib', 'C:\\']
NOT AVAILABLE
openblas_info:
libraries openblas not found in ['c:\\Users\\vsahu015\\deltalake\\OI_Blob_Manager\\.venv\\lib', 'C:\\']
get_default_fcompiler: matching types: '['gnu', 'intelv', 'absoft', 'compaqv', 'intelev', 'gnu95', 'g95', 'intelvem', 'intelem', 'flang']'
customize GnuFCompiler
Could not locate executable g77
Could not locate executable f77
customize IntelVisualFCompiler
Could not locate executable ifort
Could not locate executable ifl
customize AbsoftFCompiler
Could not locate executable f90
customize CompaqVisualFCompiler
Could not locate executable DF
customize IntelItaniumVisualFCompiler
Could not locate executable efl
customize Gnu95FCompiler
Could not locate executable gfortran
Could not locate executable f95
customize G95FCompiler
Could not locate executable g95
customize IntelEM64VisualFCompiler
customize IntelEM64TFCompiler
Could not locate executable efort
Could not locate executable efc
customize PGroupFlangCompiler
Could not locate executable flang
don't know how to compile Fortran code on platform 'nt'
NOT AVAILABLE
atlas_3_10_blas_threads_info:
Setting PTATLAS=ATLAS
libraries tatlas not found in ['c:\\Users\\vsahu015\\deltalake\\OI_Blob_Manager\\.venv\\lib', 'C:\\']
NOT AVAILABLE
atlas_3_10_blas_info:
libraries satlas not found in ['c:\\Users\\vsahu015\\deltalake\\OI_Blob_Manager\\.venv\\lib', 'C:\\']
NOT AVAILABLE
atlas_blas_threads_info:
Setting PTATLAS=ATLAS
libraries ptf77blas,ptcblas,atlas not found in ['c:\\Users\\vsahu015\\deltalake\\OI_Blob_Manager\\.venv\\lib', 'C:\\']
NOT AVAILABLE
atlas_blas_info:
libraries f77blas,cblas,atlas not found in ['c:\\Users\\vsahu015\\deltalake\\OI_Blob_Manager\\.venv\\lib', 'C:\\']
NOT AVAILABLE
accelerate_info:
NOT AVAILABLE
C:\Users\vsahu015\AppData\Local\Temp\pip-install-qvpa_09h\numpy_d10a25859e50498fb6ca81231b1a5850\numpy\distutils\system_info.py:1914: UserWarning:
Optimized (vendor) Blas libraries are not found.
Falls back to netlib Blas library which has worse performance.
A better performance should be easily gained by switching
Blas library.
if self._calc_info(blas):
blas_info:
libraries blas not found in ['c:\\Users\\vsahu015\\deltalake\\OI_Blob_Manager\\.venv\\lib', 'C:\\']
NOT AVAILABLE
C:\Users\vsahu015\AppData\Local\Temp\pip-install-qvpa_09h\numpy_d10a25859e50498fb6ca81231b1a5850\numpy\distutils\system_info.py:1914: UserWarning:
Blas (http://www.netlib.org/blas/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [blas]) or by setting
the BLAS environment variable.
if self._calc_info(blas):
blas_src_info:
NOT AVAILABLE
C:\Users\vsahu015\AppData\Local\Temp\pip-install-qvpa_09h\numpy_d10a25859e50498fb6ca81231b1a5850\numpy\distutils\system_info.py:1914: UserWarning:
Blas (http://www.netlib.org/blas/) sources not found.
Directories to search for the sources can be specified in the
numpy/distutils/site.cfg file (section [blas_src]) or by setting
the BLAS_SRC environment variable.
if self._calc_info(blas):
NOT AVAILABLE
non-existing path in 'numpy\\distutils': 'site.cfg'
lapack_opt_info:
lapack_mkl_info:
libraries mkl_rt not found in ['c:\\Users\\vsahu015\\deltalake\\OI_Blob_Manager\\.venv\\lib', 'C:\\']
NOT AVAILABLE
openblas_lapack_info:
libraries openblas not found in ['c:\\Users\\vsahu015\\deltalake\\OI_Blob_Manager\\.venv\\lib', 'C:\\']
NOT AVAILABLE
openblas_clapack_info:
libraries openblas,lapack not found in ['c:\\Users\\vsahu015\\deltalake\\OI_Blob_Manager\\.venv\\lib', 'C:\\']
NOT AVAILABLE
flame_info:
libraries flame not found in ['c:\\Users\\vsahu015\\deltalake\\OI_Blob_Manager\\.venv\\lib', 'C:\\']
NOT AVAILABLE
atlas_3_10_threads_info:
Setting PTATLAS=ATLAS
libraries lapack_atlas not found in c:\Users\vsahu015\deltalake\OI_Blob_Manager\.venv\lib
libraries tatlas,tatlas not found in c:\Users\vsahu015\deltalake\OI_Blob_Manager\.venv\lib
libraries lapack_atlas not found in C:\
libraries tatlas,tatlas not found in C:\
<class 'numpy.distutils.system_info.atlas_3_10_threads_info'>
NOT AVAILABLE
atlas_3_10_info:
libraries lapack_atlas not found in c:\Users\vsahu015\deltalake\OI_Blob_Manager\.venv\lib
libraries satlas,satlas not found in c:\Users\vsahu015\deltalake\OI_Blob_Manager\.venv\lib
libraries lapack_atlas not found in C:\
libraries satlas,satlas not found in C:\
<class 'numpy.distutils.system_info.atlas_3_10_info'>
NOT AVAILABLE
atlas_threads_info:
Setting PTATLAS=ATLAS
libraries lapack_atlas not found in c:\Users\vsahu015\deltalake\OI_Blob_Manager\.venv\lib
libraries ptf77blas,ptcblas,atlas not found in c:\Users\vsahu015\deltalake\OI_Blob_Manager\.venv\lib
libraries lapack_atlas not found in C:\
libraries ptf77blas,ptcblas,atlas not found in C:\
<class 'numpy.distutils.system_info.atlas_threads_info'>
NOT AVAILABLE
atlas_info:
libraries lapack_atlas not found in c:\Users\vsahu015\deltalake\OI_Blob_Manager\.venv\lib
libraries f77blas,cblas,atlas not found in c:\Users\vsahu015\deltalake\OI_Blob_Manager\.venv\lib
libraries lapack_atlas not found in C:\
libraries f77blas,cblas,atlas not found in C:\
<class 'numpy.distutils.system_info.atlas_info'>
NOT AVAILABLE
lapack_info:
libraries lapack not found in ['c:\\Users\\vsahu015\\deltalake\\OI_Blob_Manager\\.venv\\lib', 'C:\\']
NOT AVAILABLE
C:\Users\vsahu015\AppData\Local\Temp\pip-install-qvpa_09h\numpy_d10a25859e50498fb6ca81231b1a5850\numpy\distutils\system_info.py:1748: UserWarning:
Lapack (http://www.netlib.org/lapack/) libraries not found.
Directories to search for the libraries can be specified in the
numpy/distutils/site.cfg file (section [lapack]) or by setting
the LAPACK environment variable.
return getattr(self, '_calc_info_{}'.format(name))()
lapack_src_info:
NOT AVAILABLE
C:\Users\vsahu015\AppData\Local\Temp\pip-install-qvpa_09h\numpy_d10a25859e50498fb6ca81231b1a5850\numpy\distutils\system_info.py:1748: UserWarning:
Lapack (http://www.netlib.org/lapack/) sources not found.
Directories to search for the sources can be specified in the
numpy/distutils/site.cfg file (section [lapack_src]) or by setting
the LAPACK_SRC environment variable.
return getattr(self, '_calc_info_{}'.format(name))()
NOT AVAILABLE
numpy_linalg_lapack_lite:
FOUND:
language = c
define_macros = [('HAVE_BLAS_ILP64', None), ('BLAS_SYMBOL_SUFFIX', '64_')]
C:\Users\vsahu015\AppData\Local\Temp\pip-build-env-9s19zcbj\overlay\Lib\site-packages\setuptools\_distutils\dist.py:275: UserWarning: Unknown distribution option: 'define_macros'
warnings.warn(msg)
running dist_info
running build_src
build_src
building py_modules sources
creating build
creating build\src.win-amd64-3.11
creating build\src.win-amd64-3.11\numpy
creating build\src.win-amd64-3.11\numpy\distutils
building library "npymath" sources
error: Microsoft Visual C++ 14.0 is required. Get it with "Build Tools for Visual Studio": https://visualstudio.microsoft.com/downloads/
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
Encountered error while generating package metadata.
See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
1条答案
按热度按时间e37o9pze1#
我试着安装
使用Python 3.11和Python 3.10,但收到的错误代码与您相同:-
这是因为,pyarrow模块依赖于numpy==1.21.2。包含pyarrow的Numpy 1.21.2版本不适用于Python 3.10或更高版本。参考here。
因此,我将我的Python版本降级到3.9,安装了Python 3.9版本,并尝试安装pip install delta-lake-reader[azure],它成功安装了,参考如下:-
我使用--user标志来避免pip安装模块时出现任何与管理相关的问题:-
现在,我把终端切换到Python 3.11,上面的模块被安装为满足需求:-