org.apache.hadoop.mapred.YarnOutputFiles.getAttemptOutputDir()方法的使用及代码示例

x33g5p2x  于2022-02-05 转载在 其他  
字(6.1k)|赞(0)|评价(0)|浏览(84)

本文整理了Java中org.apache.hadoop.mapred.YarnOutputFiles.getAttemptOutputDir()方法的一些代码示例,展示了YarnOutputFiles.getAttemptOutputDir()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。YarnOutputFiles.getAttemptOutputDir()方法的具体详情如下:
包路径:org.apache.hadoop.mapred.YarnOutputFiles
类名称:YarnOutputFiles
方法名:getAttemptOutputDir

YarnOutputFiles.getAttemptOutputDir介绍

暂无

代码示例

代码示例来源:origin: org.apache.hadoop/hadoop-mapreduce-client-app

  1. /**
  2. * Return the path to a local map output index file created earlier
  3. *
  4. * @return path
  5. * @throws IOException
  6. */
  7. public Path getOutputIndexFile() throws IOException {
  8. Path attemptIndexOutput =
  9. new Path(getAttemptOutputDir(), MAP_OUTPUT_FILENAME_STRING +
  10. MAP_OUTPUT_INDEX_SUFFIX_STRING);
  11. return lDirAlloc.getLocalPathToRead(attemptIndexOutput.toString(), conf);
  12. }

代码示例来源:origin: io.hops/hadoop-mapreduce-client-app

  1. /**
  2. * Return the path to a local map output index file created earlier
  3. *
  4. * @return path
  5. * @throws IOException
  6. */
  7. public Path getOutputIndexFile() throws IOException {
  8. Path attemptIndexOutput =
  9. new Path(getAttemptOutputDir(), MAP_OUTPUT_FILENAME_STRING +
  10. MAP_OUTPUT_INDEX_SUFFIX_STRING);
  11. return lDirAlloc.getLocalPathToRead(attemptIndexOutput.toString(), conf);
  12. }

代码示例来源:origin: io.hops/hadoop-mapreduce-client-app

  1. /**
  2. * Create a local map output file name.
  3. *
  4. * @param size the size of the file
  5. * @return path
  6. * @throws IOException
  7. */
  8. public Path getOutputFileForWrite(long size) throws IOException {
  9. Path attemptOutput =
  10. new Path(getAttemptOutputDir(), MAP_OUTPUT_FILENAME_STRING);
  11. return lDirAlloc.getLocalPathForWrite(attemptOutput.toString(), size, conf);
  12. }

代码示例来源:origin: org.apache.hadoop/hadoop-mapreduce-client-app

  1. /**
  2. * Return the path to local map output file created earlier
  3. *
  4. * @return path
  5. * @throws IOException
  6. */
  7. public Path getOutputFile() throws IOException {
  8. Path attemptOutput =
  9. new Path(getAttemptOutputDir(), MAP_OUTPUT_FILENAME_STRING);
  10. return lDirAlloc.getLocalPathToRead(attemptOutput.toString(), conf);
  11. }

代码示例来源:origin: com.github.jiayuhan-it/hadoop-mapreduce-client-app

  1. /**
  2. * Return the path to local map output file created earlier
  3. *
  4. * @return path
  5. * @throws IOException
  6. */
  7. public Path getOutputFile() throws IOException {
  8. Path attemptOutput =
  9. new Path(getAttemptOutputDir(), MAP_OUTPUT_FILENAME_STRING);
  10. return lDirAlloc.getLocalPathToRead(attemptOutput.toString(), conf);
  11. }

代码示例来源:origin: com.github.jiayuhan-it/hadoop-mapreduce-client-app

  1. /**
  2. * Return the path to a local map output index file created earlier
  3. *
  4. * @return path
  5. * @throws IOException
  6. */
  7. public Path getOutputIndexFile() throws IOException {
  8. Path attemptIndexOutput =
  9. new Path(getAttemptOutputDir(), MAP_OUTPUT_FILENAME_STRING +
  10. MAP_OUTPUT_INDEX_SUFFIX_STRING);
  11. return lDirAlloc.getLocalPathToRead(attemptIndexOutput.toString(), conf);
  12. }

代码示例来源:origin: org.apache.hadoop/hadoop-mapreduce-client-app

  1. /**
  2. * Create a local map output file name.
  3. *
  4. * @param size the size of the file
  5. * @return path
  6. * @throws IOException
  7. */
  8. public Path getOutputFileForWrite(long size) throws IOException {
  9. Path attemptOutput =
  10. new Path(getAttemptOutputDir(), MAP_OUTPUT_FILENAME_STRING);
  11. return lDirAlloc.getLocalPathForWrite(attemptOutput.toString(), size, conf);
  12. }

代码示例来源:origin: com.github.jiayuhan-it/hadoop-mapreduce-client-app

  1. /**
  2. * Create a local map output file name.
  3. *
  4. * @param size the size of the file
  5. * @return path
  6. * @throws IOException
  7. */
  8. public Path getOutputFileForWrite(long size) throws IOException {
  9. Path attemptOutput =
  10. new Path(getAttemptOutputDir(), MAP_OUTPUT_FILENAME_STRING);
  11. return lDirAlloc.getLocalPathForWrite(attemptOutput.toString(), size, conf);
  12. }

代码示例来源:origin: io.hops/hadoop-mapreduce-client-app

  1. /**
  2. * Return the path to local map output file created earlier
  3. *
  4. * @return path
  5. * @throws IOException
  6. */
  7. public Path getOutputFile() throws IOException {
  8. Path attemptOutput =
  9. new Path(getAttemptOutputDir(), MAP_OUTPUT_FILENAME_STRING);
  10. return lDirAlloc.getLocalPathToRead(attemptOutput.toString(), conf);
  11. }

代码示例来源:origin: com.github.jiayuhan-it/hadoop-mapreduce-client-app

  1. /**
  2. * Create a local map output index file name.
  3. *
  4. * @param size the size of the file
  5. * @return path
  6. * @throws IOException
  7. */
  8. public Path getOutputIndexFileForWrite(long size) throws IOException {
  9. Path attemptIndexOutput =
  10. new Path(getAttemptOutputDir(), MAP_OUTPUT_FILENAME_STRING +
  11. MAP_OUTPUT_INDEX_SUFFIX_STRING);
  12. return lDirAlloc.getLocalPathForWrite(attemptIndexOutput.toString(),
  13. size, conf);
  14. }

代码示例来源:origin: org.apache.hadoop/hadoop-mapreduce-client-app

  1. /**
  2. * Create a local map output index file name.
  3. *
  4. * @param size the size of the file
  5. * @return path
  6. * @throws IOException
  7. */
  8. public Path getOutputIndexFileForWrite(long size) throws IOException {
  9. Path attemptIndexOutput =
  10. new Path(getAttemptOutputDir(), MAP_OUTPUT_FILENAME_STRING +
  11. MAP_OUTPUT_INDEX_SUFFIX_STRING);
  12. return lDirAlloc.getLocalPathForWrite(attemptIndexOutput.toString(),
  13. size, conf);
  14. }

代码示例来源:origin: io.hops/hadoop-mapreduce-client-app

  1. /**
  2. * Create a local map output index file name.
  3. *
  4. * @param size the size of the file
  5. * @return path
  6. * @throws IOException
  7. */
  8. public Path getOutputIndexFileForWrite(long size) throws IOException {
  9. Path attemptIndexOutput =
  10. new Path(getAttemptOutputDir(), MAP_OUTPUT_FILENAME_STRING +
  11. MAP_OUTPUT_INDEX_SUFFIX_STRING);
  12. return lDirAlloc.getLocalPathForWrite(attemptIndexOutput.toString(),
  13. size, conf);
  14. }

代码示例来源:origin: com.github.jiayuhan-it/hadoop-mapreduce-client-app

  1. /**
  2. * Create a local reduce input file name.
  3. *
  4. * @param mapId a map task id
  5. * @param size the size of the file
  6. * @return path
  7. * @throws IOException
  8. */
  9. public Path getInputFileForWrite(org.apache.hadoop.mapreduce.TaskID mapId,
  10. long size) throws IOException {
  11. return lDirAlloc.getLocalPathForWrite(String.format(
  12. REDUCE_INPUT_FILE_FORMAT_STRING,
  13. getAttemptOutputDir().toString(), mapId.getId()),
  14. size, conf);
  15. }

代码示例来源:origin: io.hops/hadoop-mapreduce-client-app

  1. /**
  2. * Create a local reduce input file name.
  3. *
  4. * @param mapId a map task id
  5. * @param size the size of the file
  6. * @return path
  7. * @throws IOException
  8. */
  9. public Path getInputFileForWrite(org.apache.hadoop.mapreduce.TaskID mapId,
  10. long size) throws IOException {
  11. return lDirAlloc.getLocalPathForWrite(String.format(
  12. REDUCE_INPUT_FILE_FORMAT_STRING,
  13. getAttemptOutputDir().toString(), mapId.getId()),
  14. size, conf);
  15. }

代码示例来源:origin: org.apache.hadoop/hadoop-mapreduce-client-app

  1. /**
  2. * Create a local reduce input file name.
  3. *
  4. * @param mapId a map task id
  5. * @param size the size of the file
  6. * @return path
  7. * @throws IOException
  8. */
  9. public Path getInputFileForWrite(org.apache.hadoop.mapreduce.TaskID mapId,
  10. long size) throws IOException {
  11. return lDirAlloc.getLocalPathForWrite(String.format(
  12. REDUCE_INPUT_FILE_FORMAT_STRING,
  13. getAttemptOutputDir().toString(), mapId.getId()),
  14. size, conf);
  15. }

相关文章