我使用的是hive1.0.0和apache-tez 0.4.1当我配置hive使用tez时,出现了一个异常。
当hive.execution.engine值为 mr
它很好用。但如果我把它设成 tez
我得到这个错误:
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.tez.mapreduce.hadoop.MRHelpers.updateEnvBasedOnMRAMEnv(Lorg/apache/hadoop/conf/Configuration;Ljava/util/Map;)V
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:169)
at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:122)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:454)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:626)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:570)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
我错过了什么?
1条答案
按热度按时间4urapxun1#
我自己解决了。。。。我刚刚将tez的版本从0.4.1升级到了0.5.2。我刚刚听说tez0.4.1在与hive集成时遇到了一些问题。