org.apache.samza.zk.ZkKeyBuilder.getJobModelVersionPath()方法的使用及代码示例

x33g5p2x  于2022-02-05 转载在 其他  
字(11.2k)|赞(0)|评价(0)|浏览(85)

本文整理了Java中org.apache.samza.zk.ZkKeyBuilder.getJobModelVersionPath()方法的一些代码示例，展示了ZkKeyBuilder.getJobModelVersionPath()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。ZkKeyBuilder.getJobModelVersionPath()方法的具体详情如下：
包路径：org.apache.samza.zk.ZkKeyBuilder
类名称：ZkKeyBuilder
方法名：getJobModelVersionPath

ZkKeyBuilder.getJobModelVersionPath介绍

暂无

代码示例

代码示例来源：origin: apache/samza

/**
 * subscribe for changes of JobModel version
 * @param dataListener describe this
 */
public void subscribeToJobModelVersionChange(GenerationAwareZkDataListener dataListener) {
 LOG.info(" subscribing for jm version change at:" + keyBuilder.getJobModelVersionPath());
 zkClient.subscribeDataChanges(keyBuilder.getJobModelVersionPath(), dataListener);
 metrics.subscriptions.inc();
}

代码示例来源：origin: org.apache.samza/samza-core_2.12

/**
 * subscribe for changes of JobModel version
 * @param dataListener describe this
 */
public void subscribeToJobModelVersionChange(GenerationAwareZkDataListener dataListener) {
 LOG.info(" subscribing for jm version change at:" + keyBuilder.getJobModelVersionPath());
 zkClient.subscribeDataChanges(keyBuilder.getJobModelVersionPath(), dataListener);
 metrics.subscriptions.inc();
}

代码示例来源：origin: org.apache.samza/samza-core_2.11

/**
 * subscribe for changes of JobModel version
 * @param dataListener describe this
 */
public void subscribeToJobModelVersionChange(GenerationAwareZkDataListener dataListener) {
 LOG.info(" subscribing for jm version change at:" + keyBuilder.getJobModelVersionPath());
 zkClient.subscribeDataChanges(keyBuilder.getJobModelVersionPath(), dataListener);
 metrics.subscriptions.inc();
}

代码示例来源：origin: org.apache.samza/samza-core_2.10

/**
 * subscribe for changes of JobModel version
 * @param dataListener describe this
 */
public void subscribeToJobModelVersionChange(GenerationAwareZkDataListener dataListener) {
 LOG.info(" subscribing for jm version change at:" + keyBuilder.getJobModelVersionPath());
 zkClient.subscribeDataChanges(keyBuilder.getJobModelVersionPath(), dataListener);
 metrics.subscriptions.inc();
}

代码示例来源：origin: org.apache.samza/samza-core

/**
 * subscribe for changes of JobModel version
 * @param dataListener describe this
 */
public void subscribeToJobModelVersionChange(GenerationAwareZkDataListener dataListener) {
 LOG.info(" subscribing for jm version change at:" + keyBuilder.getJobModelVersionPath());
 zkClient.subscribeDataChanges(keyBuilder.getJobModelVersionPath(), dataListener);
 metrics.subscriptions.inc();
}

代码示例来源：origin: apache/samza

/**
 * read the jobmodel version from ZK
 * @return jobmodel version as a string
 */
public String getJobModelVersion() {
 String jobModelVersion = zkClient.readData(keyBuilder.getJobModelVersionPath(), true);
 metrics.reads.inc();
 return jobModelVersion;
}

代码示例来源：origin: org.apache.samza/samza-core_2.10

/**
 * read the jobmodel version from ZK
 * @return jobmodel version as a string
 */
public String getJobModelVersion() {
 String jobModelVersion = zkClient.readData(keyBuilder.getJobModelVersionPath(), true);
 metrics.reads.inc();
 return jobModelVersion;
}

代码示例来源：origin: org.apache.samza/samza-core

/**
 * read the jobmodel version from ZK
 * @return jobmodel version as a string
 */
public String getJobModelVersion() {
 String jobModelVersion = zkClient.readData(keyBuilder.getJobModelVersionPath(), true);
 metrics.reads.inc();
 return jobModelVersion;
}

代码示例来源：origin: org.apache.samza/samza-core_2.12

/**
 * read the jobmodel version from ZK
 * @return jobmodel version as a string
 */
public String getJobModelVersion() {
 String jobModelVersion = zkClient.readData(keyBuilder.getJobModelVersionPath(), true);
 metrics.reads.inc();
 return jobModelVersion;
}

代码示例来源：origin: org.apache.samza/samza-core_2.11

/**
 * read the jobmodel version from ZK
 * @return jobmodel version as a string
 */
public String getJobModelVersion() {
 String jobModelVersion = zkClient.readData(keyBuilder.getJobModelVersionPath(), true);
 metrics.reads.inc();
 return jobModelVersion;
}

代码示例来源：origin: org.apache.samza/samza-core_2.11

/**
 * publish the version number of the next JobModel
 * @param oldVersion - used to validate, that no one has changed the version in the meanwhile.
 * @param newVersion - new version.
 */
public void publishJobModelVersion(String oldVersion, String newVersion) {
 Stat stat = new Stat();
 String currentVersion = zkClient.readData(keyBuilder.getJobModelVersionPath(), stat);
 metrics.reads.inc();
 LOG.info("publishing new version: " + newVersion + "; oldVersion = " + oldVersion + "(" + stat
   .getVersion() + ")");
 if (currentVersion != null && !currentVersion.equals(oldVersion)) {
  throw new SamzaException(
    "Someone changed JobModelVersion while the leader was generating one: expected" + oldVersion + ", got " + currentVersion);
 }
 // data version is the ZK version of the data from the ZK.
 int dataVersion = stat.getVersion();
 try {
  stat = zkClient.writeDataReturnStat(keyBuilder.getJobModelVersionPath(), newVersion, dataVersion);
  metrics.writes.inc();
 } catch (Exception e) {
  String msg = "publish job model version failed for new version = " + newVersion + "; old version = " + oldVersion;
  LOG.error(msg, e);
  throw new SamzaException(msg, e);
 }
 LOG.info("published new version: " + newVersion + "; expected data version = " + (dataVersion + 1) +
   "(actual data version after update = " + stat.getVersion() + ")");
}

代码示例来源：origin: org.apache.samza/samza-core_2.10

/**
 * publish the version number of the next JobModel
 * @param oldVersion - used to validate, that no one has changed the version in the meanwhile.
 * @param newVersion - new version.
 */
public void publishJobModelVersion(String oldVersion, String newVersion) {
 Stat stat = new Stat();
 String currentVersion = zkClient.readData(keyBuilder.getJobModelVersionPath(), stat);
 metrics.reads.inc();
 LOG.info("publishing new version: " + newVersion + "; oldVersion = " + oldVersion + "(" + stat
   .getVersion() + ")");
 if (currentVersion != null && !currentVersion.equals(oldVersion)) {
  throw new SamzaException(
    "Someone changed JobModelVersion while the leader was generating one: expected" + oldVersion + ", got " + currentVersion);
 }
 // data version is the ZK version of the data from the ZK.
 int dataVersion = stat.getVersion();
 try {
  stat = zkClient.writeDataReturnStat(keyBuilder.getJobModelVersionPath(), newVersion, dataVersion);
  metrics.writes.inc();
 } catch (Exception e) {
  String msg = "publish job model version failed for new version = " + newVersion + "; old version = " + oldVersion;
  LOG.error(msg, e);
  throw new SamzaException(msg, e);
 }
 LOG.info("published new version: " + newVersion + "; expected data version = " + (dataVersion + 1) +
   "(actual data version after update = " + stat.getVersion() + ")");
}

代码示例来源：origin: apache/samza

@Override
public void start() {
 ZkKeyBuilder keyBuilder = zkUtils.getKeyBuilder();
 zkUtils.validateZkVersion();
 zkUtils.validatePaths(new String[]{keyBuilder.getProcessorsPath(), keyBuilder.getJobModelVersionPath(), keyBuilder.getJobModelPathPrefix(), keyBuilder.getTaskLocalityPath()});
 systemAdmins.start();
 leaderElector.tryBecomeLeader();
 zkUtils.subscribeToJobModelVersionChange(new ZkJobModelVersionChangeHandler(zkUtils));
}

代码示例来源：origin: org.apache.samza/samza-core_2.12

@Override
public void start() {
 ZkKeyBuilder keyBuilder = zkUtils.getKeyBuilder();
 zkUtils.validateZkVersion();
 zkUtils.validatePaths(new String[]{keyBuilder.getProcessorsPath(), keyBuilder.getJobModelVersionPath(), keyBuilder
   .getJobModelPathPrefix()});
 startMetrics();
 systemAdmins.start();
 leaderElector.tryBecomeLeader();
 zkUtils.subscribeToJobModelVersionChange(new ZkJobModelVersionChangeHandler(zkUtils));
}

代码示例来源：origin: org.apache.samza/samza-core_2.11

@Override
public void start() {
 ZkKeyBuilder keyBuilder = zkUtils.getKeyBuilder();
 zkUtils.validateZkVersion();
 zkUtils.validatePaths(new String[]{keyBuilder.getProcessorsPath(), keyBuilder.getJobModelVersionPath(), keyBuilder
   .getJobModelPathPrefix()});
 startMetrics();
 systemAdmins.start();
 leaderElector.tryBecomeLeader();
 zkUtils.subscribeToJobModelVersionChange(new ZkJobModelVersionChangeHandler(zkUtils));
}

代码示例来源：origin: org.apache.samza/samza-core_2.10

@Override
public void start() {
 ZkKeyBuilder keyBuilder = zkUtils.getKeyBuilder();
 zkUtils.validateZkVersion();
 zkUtils.validatePaths(new String[]{keyBuilder.getProcessorsPath(), keyBuilder.getJobModelVersionPath(), keyBuilder
   .getJobModelPathPrefix()});
 startMetrics();
 systemAdmins.start();
 leaderElector.tryBecomeLeader();
 zkUtils.subscribeToJobModelVersionChange(new ZkJobModelVersionChangeHandler(zkUtils));
}

代码示例来源：origin: org.apache.samza/samza-core

@Override
public void start() {
 ZkKeyBuilder keyBuilder = zkUtils.getKeyBuilder();
 zkUtils.validateZkVersion();
 zkUtils.validatePaths(new String[]{keyBuilder.getProcessorsPath(), keyBuilder.getJobModelVersionPath(), keyBuilder
   .getJobModelPathPrefix()});
 startMetrics();
 systemAdmins.start();
 leaderElector.tryBecomeLeader();
 zkUtils.subscribeToJobModelVersionChange(new ZkJobModelVersionChangeHandler(zkUtils));
}

代码示例来源：origin: apache/samza

@Test
 public void testJobModelPath() {
  ZkKeyBuilder builder = new ZkKeyBuilder("test");

  Assert.assertEquals("/test/" + ZkKeyBuilder.JOBMODEL_GENERATION_PATH + "/jobModelVersion", builder.getJobModelVersionPath());
  Assert.assertEquals("/test/" + ZkKeyBuilder.JOBMODEL_GENERATION_PATH + "/jobModels", builder.getJobModelPathPrefix());
  String version = "2";
  Assert.assertEquals("/test/" + ZkKeyBuilder.JOBMODEL_GENERATION_PATH + "/jobModels/" + version, builder.getJobModelPath(version));
  Assert.assertEquals("/test/" + ZkKeyBuilder.JOBMODEL_GENERATION_PATH + "/" + ZkKeyBuilder.JOB_MODEL_UPGRADE_BARRIER_PATH + "/versionBarriers", builder.getJobModelVersionBarrierPrefix());
 }
}

代码示例来源：origin: apache/samza

@Test
public void testPublishNewJobModel() {
 ZkKeyBuilder keyBuilder = new ZkKeyBuilder("test");
 String root = keyBuilder.getRootPath();
 zkClient.deleteRecursive(root);
 String version = "1";
 String oldVersion = "0";
 zkUtils.validatePaths(new String[]{root, keyBuilder.getJobModelPathPrefix(), keyBuilder.getJobModelVersionPath()});
 zkUtils.publishJobModelVersion(oldVersion, version);
 Assert.assertEquals(version, zkUtils.getJobModelVersion());
 String newerVersion = Long.toString(Long.valueOf(version) + 1);
 zkUtils.publishJobModelVersion(version, newerVersion);
 Assert.assertEquals(newerVersion, zkUtils.getJobModelVersion());
 try {
  zkUtils.publishJobModelVersion(oldVersion, "10"); //invalid new version
  Assert.fail("publish invalid version should've failed");
 } catch (SamzaException e) {
  // expected
 }
 // create job model
 Map<String, String> configMap = new HashMap<>();
 Map<String, ContainerModel> containers = new HashMap<>();
 MapConfig config = new MapConfig(configMap);
 JobModel jobModel = new JobModel(config, containers);
 zkUtils.publishJobModel(version, jobModel);
 Assert.assertEquals(jobModel, zkUtils.getJobModel(version));
}

代码示例来源：origin: apache/samza

@Test
public void testgetNextJobModelVersion() {
 // Set up the Zk base paths for testing.
 ZkKeyBuilder keyBuilder = new ZkKeyBuilder("test");
 String root = keyBuilder.getRootPath();
 zkClient.deleteRecursive(root);
 zkUtils.validatePaths(new String[]{root, keyBuilder.getJobModelPathPrefix(), keyBuilder.getJobModelVersionPath()});
 String version = "1";
 String oldVersion = "0";
 // Set zkNode JobModelVersion to 1.
 zkUtils.publishJobModelVersion(oldVersion, version);
 Assert.assertEquals(version, zkUtils.getJobModelVersion());
 // Publish JobModel with a higher version (2).
 zkUtils.publishJobModel("2", new JobModel(new MapConfig(), new HashMap<>()));
 // Get on the JobModel version should return 2, taking into account the published version 2.
 Assert.assertEquals("3", zkUtils.getNextJobModelVersion(zkUtils.getJobModelVersion()));
}

内容来源于网络，如有侵权，请联系作者删除！

ZkKeyBuilder

相关文章

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com