org.apache.hadoop.yarn.client.api.YarnClientApplication.getApplicationSubmissionContext()方法的使用及代码示例

x33g5p2x  于2022-02-05 转载在 其他  
字(10.6k)|赞(0)|评价(0)|浏览(105)

本文整理了Java中org.apache.hadoop.yarn.client.api.YarnClientApplication.getApplicationSubmissionContext()方法的一些代码示例，展示了YarnClientApplication.getApplicationSubmissionContext()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。YarnClientApplication.getApplicationSubmissionContext()方法的具体详情如下：
包路径：org.apache.hadoop.yarn.client.api.YarnClientApplication
类名称：YarnClientApplication
方法名：getApplicationSubmissionContext

YarnClientApplication.getApplicationSubmissionContext介绍

暂无

代码示例

代码示例来源：origin: apache/flink

ApplicationSubmissionContext appContext = yarnApplication.getApplicationSubmissionContext();
Set<File> systemShipFiles = new HashSet<>(shipFiles.size());
for (File file : shipFiles) {

代码示例来源：origin: alibaba/jstorm

ApplicationSubmissionContext appContext = app.getApplicationSubmissionContext();
ApplicationId appId = appContext.getApplicationId();

代码示例来源：origin: Qihoo360/XLearning

ApplicationSubmissionContext applicationContext = newAPP.getApplicationSubmissionContext();
applicationContext.setApplicationId(applicationId);
applicationContext.setApplicationName(clientArguments.appName);

代码示例来源：origin: apache/ignite

ApplicationSubmissionContext appContext = app.getApplicationSubmissionContext();
appContext.setApplicationName("ignition"); // application name
appContext.setAMContainerSpec(amContainer);

代码示例来源：origin: apache/incubator-gobblin

ApplicationId setupAndSubmitApplication() throws IOException, YarnException {
 YarnClientApplication gobblinYarnApp = this.yarnClient.createApplication();
 ApplicationSubmissionContext appSubmissionContext = gobblinYarnApp.getApplicationSubmissionContext();
 appSubmissionContext.setApplicationType(GOBBLIN_YARN_APPLICATION_TYPE);
 ApplicationId applicationId = appSubmissionContext.getApplicationId();

代码示例来源：origin: apache/drill

.getApplicationSubmissionContext();

代码示例来源：origin: uber/AthenaX

ApplicationId createApplication() throws IOException, YarnException {
 YarnClientApplication app = yarnClient.createApplication();
 return app.getApplicationSubmissionContext().getApplicationId();
}

代码示例来源：origin: apache/metron

ApplicationSubmissionContext appContext = app.getApplicationSubmissionContext();
ApplicationId appId = appContext.getApplicationId();

代码示例来源：origin: org.apache.hadoop/hadoop-mapreduce-client-jobclient

public JobID getNewJobID() throws IOException, InterruptedException {
 try {
  this.application = client.createApplication().getApplicationSubmissionContext();
  this.applicationId = this.application.getApplicationId();
  return TypeConverter.fromYarn(applicationId);
 } catch (YarnException e) {
  throw new IOException(e);
 }
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-mapreduce-client-jobclient

public JobID getNewJobID() throws IOException, InterruptedException {
 try {
  this.application = client.createApplication().getApplicationSubmissionContext();
  this.applicationId = this.application.getApplicationId();
  return TypeConverter.fromYarn(applicationId);
 } catch (YarnException e) {
  throw new IOException(e);
 }
}

代码示例来源：origin: org.apache.reef/reef-runtime-yarn

UnmanagedAmYarnSubmissionHelper(
  final YarnConfiguration yarnConfiguration,
  final YarnProxyUser yarnProxyUser,
  final SecurityTokenProvider tokenProvider) throws IOException, YarnException {
 this.tokenProvider = tokenProvider;
 this.yarnProxyUser = yarnProxyUser;
 LOG.log(Level.FINE, "Initializing YARN Client");
 this.yarnClient = YarnClient.createYarnClient();
 this.yarnClient.init(yarnConfiguration);
 this.yarnClient.start();
 LOG.log(Level.FINE, "Initialized YARN Client");
 LOG.log(Level.FINE, "Requesting UNMANAGED Application ID from YARN.");
 final ContainerLaunchContext launchContext = YarnTypes.getContainerLaunchContext(
   Collections.<String>emptyList(), Collections.<String, LocalResource>emptyMap(), tokenProvider.getTokens());
 final YarnClientApplication yarnClientApplication = this.yarnClient.createApplication();
 this.applicationSubmissionContext = yarnClientApplication.getApplicationSubmissionContext();
 this.applicationSubmissionContext.setAMContainerSpec(launchContext);
 this.applicationSubmissionContext.setUnmanagedAM(true);
 this.applicationId = this.applicationSubmissionContext.getApplicationId();
 LOG.log(Level.INFO, "YARN UNMANAGED Application ID: {0}", this.applicationId);
}

代码示例来源：origin: org.apache.slider/slider-core

@Test
public void testExtractYarnResourceManagerAmRetryCountWindowMsDefaultValue()
  throws Exception {
 Map<String, String> options = new HashMap<String, String>();
 EasyMock.replay(mockYarnClient, yarnClientApp);
 appMasterLauncher = new AppMasterLauncher("am1", SliderKeys.APP_TYPE, null,
   null, mockYarnClient, false, null, options, tags, null);
 ApplicationSubmissionContext ctx = appMasterLauncher.application
   .getApplicationSubmissionContext();
 long retryIntervalWindow = ctx.getAttemptFailuresValidityInterval();
 Assert.assertEquals(ResourceKeys.DEFAULT_AM_RETRY_COUNT_WINDOW_MS,
   retryIntervalWindow);
}

代码示例来源：origin: org.apache.slider/slider-core

@Test
public void testExtractYarnResourceManagerAmRetryCountWindowMs() throws
  Exception {
 Map<String, String> options = new HashMap<String, String>();
 final String expectedInterval = Integer.toString (120000);
 options.put(ResourceKeys.YARN_RESOURCEMANAGER_AM_RETRY_COUNT_WINDOW_MS,
   expectedInterval);
 EasyMock.replay(mockYarnClient, yarnClientApp);
 appMasterLauncher = new AppMasterLauncher("am1", SliderKeys.APP_TYPE, null,
   null, mockYarnClient, false, null, options, tags, null);
 ApplicationSubmissionContext ctx = appMasterLauncher.application
   .getApplicationSubmissionContext();
 String retryIntervalWindow = Long.toString(ctx
   .getAttemptFailuresValidityInterval());
 Assert.assertEquals(expectedInterval, retryIntervalWindow);
}

代码示例来源：origin: org.apache.reef/reef-runtime-yarn

public YarnSubmissionHelper(final YarnConfiguration yarnConfiguration,
              final REEFFileNames fileNames,
              final ClasspathProvider classpath,
              final YarnProxyUser yarnProxyUser,
              final SecurityTokenProvider tokenProvider,
              final boolean isUnmanaged,
              final List<String> commandPrefixList) throws IOException, YarnException {
 this.classpath = classpath;
 this.yarnProxyUser = yarnProxyUser;
 this.isUnmanaged = isUnmanaged;
 this.driverStdoutFilePath =
   ApplicationConstants.LOG_DIR_EXPANSION_VAR + "/" + fileNames.getDriverStdoutFileName();
 this.driverStderrFilePath =
   ApplicationConstants.LOG_DIR_EXPANSION_VAR + "/" + fileNames.getDriverStderrFileName();
 LOG.log(Level.FINE, "Initializing YARN Client");
 this.yarnClient = YarnClient.createYarnClient();
 this.yarnClient.init(yarnConfiguration);
 this.yarnClient.start();
 LOG.log(Level.FINE, "Initialized YARN Client");
 LOG.log(Level.FINE, "Requesting Application ID from YARN.");
 final YarnClientApplication yarnClientApplication = this.yarnClient.createApplication();
 this.applicationResponse = yarnClientApplication.getNewApplicationResponse();
 this.applicationSubmissionContext = yarnClientApplication.getApplicationSubmissionContext();
 this.applicationSubmissionContext.setUnmanagedAM(isUnmanaged);
 this.applicationId = this.applicationSubmissionContext.getApplicationId();
 this.tokenProvider = tokenProvider;
 this.commandPrefixList = commandPrefixList;
 this.configurationFilePaths = Collections.singletonList(fileNames.getDriverConfigurationPath());
 LOG.log(Level.INFO, "YARN Application ID: {0}", this.applicationId);
}

代码示例来源：origin: apache/incubator-slider

@Test
public void testExtractYarnResourceManagerAmRetryCountWindowMs() throws
  Exception {
 Map<String, String> options = new HashMap<String, String>();
 final String expectedInterval = Integer.toString (120000);
 options.put(ResourceKeys.YARN_RESOURCEMANAGER_AM_RETRY_COUNT_WINDOW_MS,
   expectedInterval);
 EasyMock.replay(mockYarnClient, yarnClientApp);
 appMasterLauncher = new AppMasterLauncher("am1", SliderKeys.APP_TYPE, null,
   null, mockYarnClient, false, null, options, tags, null);
 ApplicationSubmissionContext ctx = appMasterLauncher.application
   .getApplicationSubmissionContext();
 String retryIntervalWindow = Long.toString(ctx
   .getAttemptFailuresValidityInterval());
 Assert.assertEquals(expectedInterval, retryIntervalWindow);
}

代码示例来源：origin: apache/incubator-slider

@Test
public void testExtractYarnResourceManagerAmRetryCountWindowMsDefaultValue()
  throws Exception {
 Map<String, String> options = new HashMap<String, String>();
 EasyMock.replay(mockYarnClient, yarnClientApp);
 appMasterLauncher = new AppMasterLauncher("am1", SliderKeys.APP_TYPE, null,
   null, mockYarnClient, false, null, options, tags, null);
 ApplicationSubmissionContext ctx = appMasterLauncher.application
   .getApplicationSubmissionContext();
 long retryIntervalWindow = ctx.getAttemptFailuresValidityInterval();
 Assert.assertEquals(ResourceKeys.DEFAULT_AM_RETRY_COUNT_WINDOW_MS,
   retryIntervalWindow);
}

代码示例来源：origin: org.apache.slider/slider-core

@Before
public void initialize() throws Exception {
 mockYarnClient = EasyMock.createNiceMock(SliderYarnClientImpl.class);
 yarnClientApp = EasyMock.createNiceMock(YarnClientApplication.class);
 appSubmissionContext = EasyMock
   .createNiceMock(ApplicationSubmissionContext.class);
 EasyMock.expect(yarnClientApp.getApplicationSubmissionContext())
   .andReturn(appSubmissionContext).once();
 EasyMock.expect(mockYarnClient.createApplication())
   .andReturn(yarnClientApp).once();
 try {
  LogAggregationContext.class.getMethod("newInstance", String.class,
    String.class, String.class, String.class);
  isOldApi = false;
  rolledLogsIncludeMethod = LogAggregationContext.class
    .getMethod("getRolledLogsIncludePattern");
  rolledLogsExcludeMethod = LogAggregationContext.class
    .getMethod("getRolledLogsExcludePattern");
 } catch (Exception e) {
  isOldApi = true;
 }
}

代码示例来源：origin: apache/incubator-slider

@Before
public void initialize() throws Exception {
 mockYarnClient = EasyMock.createNiceMock(SliderYarnClientImpl.class);
 yarnClientApp = EasyMock.createNiceMock(YarnClientApplication.class);
 appSubmissionContext = EasyMock
   .createNiceMock(ApplicationSubmissionContext.class);
 EasyMock.expect(yarnClientApp.getApplicationSubmissionContext())
   .andReturn(appSubmissionContext).once();
 EasyMock.expect(mockYarnClient.createApplication())
   .andReturn(yarnClientApp).once();
 try {
  LogAggregationContext.class.getMethod("newInstance", String.class,
    String.class, String.class, String.class);
  isOldApi = false;
  rolledLogsIncludeMethod = LogAggregationContext.class
    .getMethod("getRolledLogsIncludePattern");
  rolledLogsExcludeMethod = LogAggregationContext.class
    .getMethod("getRolledLogsExcludePattern");
 } catch (Exception e) {
  isOldApi = true;
 }
}

代码示例来源：origin: apache/twill

final ApplicationSubmissionContext appSubmissionContext = application.getApplicationSubmissionContext();
appSubmissionContext.setApplicationId(appId);
appSubmissionContext.setApplicationName(twillSpec.getName());

代码示例来源：origin: org.apache.twill/twill-yarn

final ApplicationSubmissionContext appSubmissionContext = application.getApplicationSubmissionContext();
appSubmissionContext.setApplicationId(appId);
appSubmissionContext.setApplicationName(twillSpec.getName());

内容来源于网络，如有侵权，请联系作者删除！

YarnClientApplication

相关文章

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com