aws emr设置hadoop类路径

egmofgnx  于 2021-05-27  发布在  Hadoop
关注(0)|答案(0)|浏览(314)

我在向hadoop类路径添加jar库时遇到问题。我正在使用emr label 5.31.0,并将avro-1.10.0.jar下载到/home/hadoop/lib中。我还按照说明将库附加到hadoop类路径,但没有一个有效https://docs.aws.amazon.com/emr/latest/releaseguide/emr-3x-customizeappconfig.html

  1. # !/bin/bash
  2. export HADOOP_USER_CLASSPATH_FIRST=true;
  3. echo "HADOOP_CLASSPATH=/path/to/my.jar" >> /home/hadoop/conf/hadoop-user-env.sh
  1. [
  2. {
  3. "Classification":"hadoop-env",
  4. "Properties":{
  5. },
  6. "Configurations":[
  7. {
  8. "Classification":"export",
  9. "Properties":{
  10. "HADOOP_USER_CLASSPATH_FIRST":"true",
  11. "HADOOP_CLASSPATH":"/path/to/my.jar"
  12. }
  13. }
  14. ]
  15. }
  16. ]

问题是什么?

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题