org.apache.tez.dag.api.Vertex.getTaskLocalFiles()方法的使用及代码示例

x33g5p2x  于2022-02-01 转载在 其他  
字(1.8k)|赞(0)|评价(0)|浏览(123)

本文整理了Java中org.apache.tez.dag.api.Vertex.getTaskLocalFiles()方法的一些代码示例,展示了Vertex.getTaskLocalFiles()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Vertex.getTaskLocalFiles()方法的具体详情如下:
包路径:org.apache.tez.dag.api.Vertex
类名称:Vertex
方法名:getTaskLocalFiles

Vertex.getTaskLocalFiles介绍

[英]Get the files etc that must be provided by the tasks of this vertex
[中]获取此顶点的任务必须提供的文件等

代码示例

代码示例来源:origin: org.apache.pig/pig

for (Vertex vertex : dag.getVertices()) {
  if (!inputSplitInDiskVertices.contains(vertex.getName())) {
    if (vertex.getTaskLocalFiles().containsKey(
        MRJobConfig.JOB_SPLIT)) {
      throw new RuntimeException(
              + MRJobConfig.JOB_SPLIT);
    vertex.getTaskLocalFiles().put(MRJobConfig.JOB_SPLIT,
        localResource);

代码示例来源:origin: org.apache.tez/tez-api

for (Vertex v : vertices.values()) {
 for (Map.Entry<String, LocalResource> localResource : v
   .getTaskLocalFiles().entrySet()) {
  String resourceName = localResource.getKey();
  LocalResource resource = localResource.getValue();

代码示例来源:origin: org.apache.tez/tez-tests

PreWarmVertex preWarmVertex = PreWarmVertex.create("PreWarm", preWarmNumContainers, dag
  .getVertex("initialmap").getTaskResource());
preWarmVertex.addTaskLocalFiles(dag.getVertex("initialmap").getTaskLocalFiles());
preWarmVertex.setTaskEnvironment(dag.getVertex("initialmap").getTaskEnvironment());
preWarmVertex.setTaskLaunchCmdOpts(dag.getVertex("initialmap").getTaskLaunchCmdOpts());

代码示例来源:origin: org.apache.tez/tez-api

Set<Path> lrPaths = new HashSet<Path>();
for (Vertex v: dag.getVertices()) {
 for (LocalResource lr: v.getTaskLocalFiles().values()) {
  lrPaths.add(ConverterUtils.getPathFromYarnURL(lr.getResource()));

代码示例来源:origin: org.apache.tez/tez-api

vertexLRs.putAll(vertex.getTaskLocalFiles());
List<DataSourceDescriptor> dataSources = vertex.getDataSources();
for (DataSourceDescriptor dataSource : dataSources) {

相关文章