我正在尝试将dags从blob存储导入到Azure数据工厂的托管气流。ADF示例可以通过系统管理身份访问blob存储(我可以通过ADF浏览存储),但当我尝试上传dags时,我遇到了以下问题:
Microsoft.WindowsAzure.Storage.StorageException: This request is not authorized to perform this operation.
at Microsoft.WindowsAzure.Storage.Core.Executor.Executor.ExecuteAsyncInternal[T](RESTCommand`1 cmd, IRetryPolicy policy, OperationContext operationContext, CancellationToken token)
at Microsoft.WindowsAzure.Storage.Blob.CloudBlobContainer.ListBlobsSegmentedAsync(String prefix, Boolean useFlatBlobListing, BlobListingDetails blobListingDetails, Nullable`1 maxResults, BlobContinuationToken currentToken, BlobRequestOptions options, OperationContext operationContext, CancellationToken cancellationToken)
at Microsoft.ADF.PipelineManager.AirflowHandler.ListDAGsAsync(String integrationRuntimeName, String linkedServiceName, String containerName, String folderPath, Boolean copyFolderStructure, SystemProperties systemProperties, CancellationToken cancellationToken) in C:\__w\1\s\PipelineManager\src\PipelineManager.Core\JobHandlers\AirflowHandlers\AirflowHandler.cs:line 165
at Microsoft.ADF.PipelineManager.AirflowController.ListAirflowDAGsAsync(String factoryName, String integrationRuntimeName, ListAirflowDagsRequest request, CancellationToken cancellationToken) in C:\__w\1\s\PipelineManager\src\PipelineManager.Core.FX\AirflowControllers\AirflowController.cs:line 163
Request Information
RequestID:2dd561ad-a01e-0064-643a-bcdb21000000
RequestDate:Sat, 22 Jul 2023 01:18:05 GMT
StatusMessage:This request is not authorized to perform this operation.
ErrorCode:AuthorizationFailure
ErrorMessage:This request is not authorized to perform this operation.
RequestId:2dd561ad-a01e-0064-643a-bcdb21000000
Time:2023-07-22T01:18:05.0775853Z
字符串
我使用一个公共的集成运行时来实现这个目的(不是自托管的)。
到存储blob的连接测试正常。
Aiflow版本:2.4.3授权:AAD
我正在尝试将DAGS python文件从Azure Storage附加到Airflow,但出现了异常。
2条答案
按热度按时间gtlvzcf81#
我能够使用Azure数据工厂将DAG从Blob存储导入到托管Airflow示例,并按照official documentation中的步骤成功完成
但是,根据您的错误,我假设您还使用Azure Functions或ADF Pipeline通过托管身份访问存储
是否可以尝试将ADF MSI添加到具有以下角色的存储帐户:存储Blob数据所有者/存储Blob数据贡献者。告诉我怎么用?
lhcgjxsq2#
试试我的教程:https://techcommunity.microsoft.com/t5/fasttrack-for-azure/mastering-the-art-orchestrating-adf-with-the-power-of-managed/ba-p/3880515您需要在AAD中添加ADF工作区应用程序才能使其正常工作