oozie配置单元操作停留在准备状态,作业停留在运行状态

xkftehaa  于 2021-05-30  发布在  Hadoop
关注(0)|答案(1)|浏览(495)

我的oozieHive动作永远停留在运行模式。oozie.log文件中未显示任何错误。

<workflow-app xmlns="uri:oozie:workflow:0.2.5" name="example-wf">
<credentials>
            <credential name='hive_credentials' type='hive'>
                    <property>
                         <name>hive.metastore.uris</name>
                         <value>thrift://localhost:9083</value>
                    </property>
            </credential>
</credentials>
<start to="hive-example"/>
<action name="hive-example" cred="hive_credentials">
    <hive xmlns="uri:oozie:hive-action:0.2">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>
            <job-xml>hive-site.xml</job-xml>
            <configuration>
                <property>
                    <name>oozie.log.hive.level</name>
                    <value>DEBUG</value>
                </property>
                <property>
                    <name>oozie.hive.defaults</name>
                    <value>hive-default.xml</value>
                </property>
            </configuration>     
        <script>script.q</script>
        <file>hive-site.xml</file>
    </hive>
    <ok to="end"/>
    <error to="fail"/>
    </action>
    <kill name="fail">
    <message>Workflow failed, error message[${wf:errorMessage(wf:lastErrorNode())}] 
    </message>
   </kill>
   <end name="end"/>
   </workflow-app>

另外,我的job.properties如下所示

nameNode=hdfs://hadoopmaster:54310
jobTracker=localhost:54311
workflowRoot=${nameNode}/user/${user.name}/oozie-workflows
oozie.wf.application.path=hdfs://hadoopmaster:54310/home/hadoopuser/Downloads/oozie
workflows

我的工作日志如下所示
2014-11-13 18:19:57697信息行动之星txcommand:539 - user[hadoopuser]group[-]token[]app[example wf]job[0000001-141113180803793-oozie-hado-w]action[0000001-141113180803793-oozie-hado-w@:start:]start action[0000001-141113180803793-oozie-hado-w@:start:],用户重试状态:userretrycount[0],userretrymax[0],用户重试间隔[10]2014-11-13 18:19:57698警告actionstartxcommand:542 - user[hadoopuser]group[-]token[]app[example wf]job[0000001-141113180803793-oozie-hado-w]action[0000001-141113180803793-oozie-hado-w@:start:][0000001-141113180803793-oozie-hado-w@:start:]action status=done 2014-11-13 18:19:57,698警告行动之星txcommand:542 - user[hadoopuser]group[-]token[]app[example wf]job[0000001-141113180803793-oozie-hado-w]action[0000001-141113180803793-oozie-hado-w@:start:][0000001-141113180803793-oozie-hado-w@:start:]action updated in db!2014-11-13 18:19:57801信息行动之星txcommand:539 - 用户[hadoopuser]组[-]令牌[]应用程序[example wf]作业[0000001-141113180803793-oozie-hado-w]操作[0000001-141113180803793-oozie-hado-w@hive-example]开始行动[0000001-141113180803793-oozie-hado-w@hive-example]用户重试状态为:userretrycount[0],userretrymax[0],用户重试间隔[10]
我已经将我的hive-site.xml放在oozie的工作流目录中,并将工作流目录(包含workflow.xml、hive-site.xml、hive-default.xml)上载到hdfs。作业日志中没有错误。所以我不知道我在哪里犯了错误。非常感谢您的帮助。

dldeef67

dldeef671#

您的群集设置有多少个容器?当您执行工作流时,一个容器将被oozie占用(它将继续保持该容器直到查询执行),其余的将用于执行实际作业。

相关问题