org.apache.samza.job.yarn.YarnJobUtil类的使用及代码示例

x33g5p2x  于2022-02-05 转载在 其他  
字(1.4k)|赞(0)|评价(0)|浏览(142)

本文整理了Java中org.apache.samza.job.yarn.YarnJobUtil类的一些代码示例,展示了YarnJobUtil类的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。YarnJobUtil类的具体详情如下:
包路径:org.apache.samza.job.yarn.YarnJobUtil
类名称:YarnJobUtil

YarnJobUtil介绍

暂无

代码示例

代码示例来源:origin: org.apache.samza/samza-yarn

/**
 * Cleans up the staging directory of the job. All exceptions during the cleanup
 * are swallowed.
 */
private void cleanupStagingDir() {
 String yarnJobStagingDirectory = yarnConfig.getYarnJobStagingDirectory();
 if(yarnJobStagingDirectory != null) {
  JobContext context = new JobContext();
  context.setAppStagingDir(new Path(yarnJobStagingDirectory));
  FileSystem fs = null;
  try {
   fs = FileSystem.get(yarnConfiguration);
  } catch (IOException e) {
   log.error("Unable to clean up file system: {}", e);
   return;
  }
  if(fs != null) {
   YarnJobUtil.cleanupStagingDir(context, fs);
  }
 }
}

代码示例来源:origin: org.apache.samza/samza-yarn_2.11

/**
 * Cleans up the staging directory of the job. All exceptions during the cleanup
 * are swallowed.
 */
private void cleanupStagingDir() {
 String yarnJobStagingDirectory = yarnConfig.getYarnJobStagingDirectory();
 if(yarnJobStagingDirectory != null) {
  JobContext context = new JobContext();
  context.setAppStagingDir(new Path(yarnJobStagingDirectory));
  FileSystem fs = null;
  try {
   fs = FileSystem.get(yarnConfiguration);
  } catch (IOException e) {
   log.error("Unable to clean up file system: {}", e);
   return;
  }
  if(fs != null) {
   YarnJobUtil.cleanupStagingDir(context, fs);
  }
 }
}

相关文章