至少有一个文件系统不支持acl:distcp hdfs

guykilcj  于 2021-05-29  发布在  Hadoop
关注(0)|答案(1)|浏览(613)
  1. As per distcp documentation ->
  2. If -pa is specified, DistCp preserves the permissions also because
  3. ACLs are a super-set of permissions.
  1. but hadoop distcp -pa -delete -update /src/path /dest/path/
  2. is failing with ACLs not supported on at least one file system.
  3. Complete logs below

执行的上述命令失败。期望使用acl将hdfs文件从源复制到目标。
org.apache.hadoop.tools.copylisting$aclsnotsupportedexception:文件系统不支持acls:hdfs://10.20.0.7:8020位于org.apache.hadoop.tools.util.distcputils.checkfilesystemaclsupport(distcputils)。java:381)在org.apache.hadoop.tools.distcp.configureoutputformat(distcp。java:353)在org.apache.hadoop.tools.distcp.createjob(distcp。java:247)在org.apache.hadoop.tools.distcp.createandsubmitjob(distcp。java:176)在org.apache.hadoop.tools.distcp.execute(distcp。java:155)在org.apache.hadoop.tools.distcp.run(distcp。java:128)在org.apache.hadoop.util.toolrunner.run(toolrunner。java:76)在org.apache.hadoop.tools.distcp.main(distcp。java:462)

zphenhs4

zphenhs41#

  1. hadoop distcp -D ipc.client.fallback-to-simple-auth-allowed=true hdfs://<insecure_hdp>/test01.txt hdfs://<secure_hdp>/user/hdfs

如果有的话,请确保从安全集群运行此命令。

在您的 core-site.xml 然后重试:

  1. <property>
  2. <name>ipc.client.fallback-to-simple-auth-allowed</name>
  3. <value>true</value>
  4. </property>

相关问题