org.apache.hadoop.tools.rumen.ZombieJob.makeUpReduceRuntime()方法的使用及代码示例

x33g5p2x  于2022-02-05 转载在 其他  
字(2.6k)|赞(0)|评价(0)|浏览(105)

本文整理了Java中org.apache.hadoop.tools.rumen.ZombieJob.makeUpReduceRuntime()方法的一些代码示例,展示了ZombieJob.makeUpReduceRuntime()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。ZombieJob.makeUpReduceRuntime()方法的具体详情如下:
包路径:org.apache.hadoop.tools.rumen.ZombieJob
类名称:ZombieJob
方法名:makeUpReduceRuntime

ZombieJob.makeUpReduceRuntime介绍

暂无

代码示例

代码示例来源:origin: com.github.jiayuhan-it/hadoop-rumen

private TaskAttemptInfo makeUpTaskAttemptInfo(TaskType taskType, TaskInfo taskInfo,
  int taskAttemptNumber, int taskNumber, int locality) {
 if (taskType == TaskType.MAP) {
  State state = State.SUCCEEDED;
  long runtime = 0;
  // make up state
  state = makeUpState(taskAttemptNumber, job.getMapperTriesToSucceed());
  runtime = makeUpMapRuntime(state, locality);
  runtime = sanitizeTaskRuntime(runtime, makeTaskAttemptID(taskType,
                       taskNumber, taskAttemptNumber));
  TaskAttemptInfo tai
   = new MapTaskAttemptInfo(state, taskInfo, runtime, null);
  return tai;
 } else if (taskType == TaskType.REDUCE) {
  State state = State.SUCCEEDED;
  long shuffleTime = 0;
  long sortTime = 0;
  long reduceTime = 0;
  // TODO make up state
  // state = makeUpState(taskAttemptNumber, job.getReducerTriesToSucceed());
  reduceTime = makeUpReduceRuntime(state);
  TaskAttemptInfo tai = new ReduceTaskAttemptInfo
   (state, taskInfo, shuffleTime, sortTime, reduceTime, null);
  return tai;
 }
 throw new IllegalArgumentException("taskType is neither MAP nor REDUCE: "
   + taskType);
}

代码示例来源:origin: ch.cern.hadoop/hadoop-rumen

private TaskAttemptInfo makeUpTaskAttemptInfo(TaskType taskType, TaskInfo taskInfo,
  int taskAttemptNumber, int taskNumber, int locality) {
 if (taskType == TaskType.MAP) {
  State state = State.SUCCEEDED;
  long runtime = 0;
  // make up state
  state = makeUpState(taskAttemptNumber, job.getMapperTriesToSucceed());
  runtime = makeUpMapRuntime(state, locality);
  runtime = sanitizeTaskRuntime(runtime, makeTaskAttemptID(taskType,
                       taskNumber, taskAttemptNumber));
  TaskAttemptInfo tai
   = new MapTaskAttemptInfo(state, taskInfo, runtime, null);
  return tai;
 } else if (taskType == TaskType.REDUCE) {
  State state = State.SUCCEEDED;
  long shuffleTime = 0;
  long sortTime = 0;
  long reduceTime = 0;
  // TODO make up state
  // state = makeUpState(taskAttemptNumber, job.getReducerTriesToSucceed());
  reduceTime = makeUpReduceRuntime(state);
  TaskAttemptInfo tai = new ReduceTaskAttemptInfo
   (state, taskInfo, shuffleTime, sortTime, reduceTime, null);
  return tai;
 }
 throw new IllegalArgumentException("taskType is neither MAP nor REDUCE: "
   + taskType);
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-rumen

long reduceTime = makeUpReduceRuntime(state);
return new ReduceTaskAttemptInfo
 (state, taskInfo, 0, 0, reduceTime, allSplitVectors);

代码示例来源:origin: ch.cern.hadoop/hadoop-rumen

long reduceTime = makeUpReduceRuntime(state);
return new ReduceTaskAttemptInfo
 (state, taskInfo, 0, 0, reduceTime, allSplitVectors);

相关文章