本文整理了Java中org.apache.flink.yarn.YarnClusterDescriptor.addShipFiles()
方法的一些代码示例,展示了YarnClusterDescriptor.addShipFiles()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。YarnClusterDescriptor.addShipFiles()
方法的具体详情如下:
包路径:org.apache.flink.yarn.YarnClusterDescriptor
类名称:YarnClusterDescriptor
方法名:addShipFiles
暂无
代码示例来源:origin: apache/flink
@Nonnull
YarnClusterDescriptor createYarnClusterDescriptor(org.apache.flink.configuration.Configuration flinkConfiguration) {
final YarnClusterDescriptor yarnClusterDescriptor = new YarnClusterDescriptor(
flinkConfiguration,
YARN_CONFIGURATION,
CliFrontend.getConfigurationDirectoryFromEnv(),
yarnClient,
true);
yarnClusterDescriptor.setLocalJarPath(new Path(flinkUberjar.toURI()));
yarnClusterDescriptor.addShipFiles(Collections.singletonList(flinkLibFolder));
return yarnClusterDescriptor;
}
代码示例来源:origin: apache/flink
shipFiles.add(libFolder);
descriptor.addShipFiles(shipFiles);
代码示例来源:origin: apache/flink
@Test
public void testJobRecoversAfterKillingTaskManager() throws Exception {
final YarnClusterDescriptor yarnClusterDescriptor = setupYarnClusterDescriptor();
yarnClusterDescriptor.addShipFiles(Arrays.asList(flinkShadedHadoopDir.listFiles()));
final RestClusterClient<ApplicationId> restClusterClient = deploySessionCluster(yarnClusterDescriptor);
try {
final JobID jobId = submitJob(restClusterClient);
waitUntilJobIsRunning(restClusterClient, jobId);
stopTaskManagerContainer();
waitUntilJobIsRestarted(restClusterClient, jobId, 1);
waitForJobTermination(restClusterClient, jobId);
killApplicationAndWait(restClusterClient.getClusterId());
} finally {
restClusterClient.shutdown();
}
}
代码示例来源:origin: apache/flink
yarnClusterDescriptor.addShipFiles(Arrays.asList(flinkLibFolder.listFiles()));
yarnClusterDescriptor.addShipFiles(Arrays.asList(flinkShadedHadoopDir.listFiles()));
代码示例来源:origin: apache/flink
clusterDescriptor.addShipFiles(Arrays.asList(flinkLibFolder.listFiles()));
clusterDescriptor.addShipFiles(Arrays.asList(flinkShadedHadoopDir.listFiles()));
代码示例来源:origin: apache/flink
/**
* Tests that Yarn will restart a killed {@link YarnSessionClusterEntrypoint} which will then resume
* a persisted {@link JobGraph}.
*/
@Test
public void testKillYarnSessionClusterEntrypoint() throws Exception {
assumeTrue(
"This test kills processes via the pkill command. Thus, it only runs on Linux, Mac OS, Free BSD and Solaris.",
OperatingSystem.isLinux() || OperatingSystem.isMac() || OperatingSystem.isFreeBSD() || OperatingSystem.isSolaris());
final YarnClusterDescriptor yarnClusterDescriptor = setupYarnClusterDescriptor();
yarnClusterDescriptor.addShipFiles(Arrays.asList(flinkShadedHadoopDir.listFiles()));
final RestClusterClient<ApplicationId> restClusterClient = deploySessionCluster(yarnClusterDescriptor);
try {
final JobID jobId = submitJob(restClusterClient);
final ApplicationId id = restClusterClient.getClusterId();
waitUntilJobIsRunning(restClusterClient, jobId);
killApplicationMaster(yarnClusterDescriptor.getYarnSessionClusterEntrypoint());
waitForApplicationAttempt(id, 2);
waitForJobTermination(restClusterClient, jobId);
killApplicationAndWait(id);
} finally {
restClusterClient.shutdown();
}
}
内容来源于网络,如有侵权,请联系作者删除!