本文整理了Java中org.apache.tez.dag.api.Vertex.getTaskLocalFiles()
方法的一些代码示例,展示了Vertex.getTaskLocalFiles()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Vertex.getTaskLocalFiles()
方法的具体详情如下:
包路径:org.apache.tez.dag.api.Vertex
类名称:Vertex
方法名:getTaskLocalFiles
[英]Get the files etc that must be provided by the tasks of this vertex
[中]获取此顶点的任务必须提供的文件等
代码示例来源:origin: org.apache.pig/pig
for (Vertex vertex : dag.getVertices()) {
if (!inputSplitInDiskVertices.contains(vertex.getName())) {
if (vertex.getTaskLocalFiles().containsKey(
MRJobConfig.JOB_SPLIT)) {
throw new RuntimeException(
+ MRJobConfig.JOB_SPLIT);
vertex.getTaskLocalFiles().put(MRJobConfig.JOB_SPLIT,
localResource);
代码示例来源:origin: org.apache.tez/tez-api
for (Vertex v : vertices.values()) {
for (Map.Entry<String, LocalResource> localResource : v
.getTaskLocalFiles().entrySet()) {
String resourceName = localResource.getKey();
LocalResource resource = localResource.getValue();
代码示例来源:origin: org.apache.tez/tez-tests
PreWarmVertex preWarmVertex = PreWarmVertex.create("PreWarm", preWarmNumContainers, dag
.getVertex("initialmap").getTaskResource());
preWarmVertex.addTaskLocalFiles(dag.getVertex("initialmap").getTaskLocalFiles());
preWarmVertex.setTaskEnvironment(dag.getVertex("initialmap").getTaskEnvironment());
preWarmVertex.setTaskLaunchCmdOpts(dag.getVertex("initialmap").getTaskLaunchCmdOpts());
代码示例来源:origin: org.apache.tez/tez-api
Set<Path> lrPaths = new HashSet<Path>();
for (Vertex v: dag.getVertices()) {
for (LocalResource lr: v.getTaskLocalFiles().values()) {
lrPaths.add(ConverterUtils.getPathFromYarnURL(lr.getResource()));
代码示例来源:origin: org.apache.tez/tez-api
vertexLRs.putAll(vertex.getTaskLocalFiles());
List<DataSourceDescriptor> dataSources = vertex.getDataSources();
for (DataSourceDescriptor dataSource : dataSources) {
内容来源于网络,如有侵权,请联系作者删除!