org.apache.flink.runtime.checkpoint.ZooKeeperCheckpointIDCounter类的使用及代码示例

x33g5p2x  于2022-02-05 转载在 其他  
字(4.0k)|赞(0)|评价(0)|浏览(268)

本文整理了Java中org.apache.flink.runtime.checkpoint.ZooKeeperCheckpointIDCounter类的一些代码示例,展示了ZooKeeperCheckpointIDCounter类的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。ZooKeeperCheckpointIDCounter类的具体详情如下:
包路径:org.apache.flink.runtime.checkpoint.ZooKeeperCheckpointIDCounter
类名称:ZooKeeperCheckpointIDCounter

ZooKeeperCheckpointIDCounter介绍

[英]CheckpointIDCounter instances for JobManagers running in HighAvailabilityMode#ZOOKEEPER.

Each counter creates a ZNode:

+----O /flink/checkpoint-counter/<job-id> 1 [persistent] 
. 
. 
. 
+----O /flink/checkpoint-counter/<job-id> N [persistent]

The checkpoints IDs are required to be ascending (per job). In order to guarantee this in case of job manager failures we use ZooKeeper to have a shared counter across job manager instances.
[中]在HighAvailabilityMode#ZOOKEEPER中运行的作业管理器的CheckpointIDCounter实例。
每个计数器创建一个ZNode:

+----O /flink/checkpoint-counter/<job-id> 1 [persistent] 
. 
. 
. 
+----O /flink/checkpoint-counter/<job-id> N [persistent]

检查点ID需要升序(每个作业)。为了在作业管理器失败的情况下保证这一点,我们使用ZooKeeper在作业管理器实例之间拥有一个共享计数器。

代码示例

代码示例来源:origin: org.apache.flink/flink-runtime

/**
 * Creates a {@link ZooKeeperCheckpointIDCounter} instance.
 *
 * @param client        The {@link CuratorFramework} ZooKeeper client to use
 * @param configuration {@link Configuration} object
 * @param jobId         ID of job to create the instance for
 * @return {@link ZooKeeperCheckpointIDCounter} instance
 */
public static ZooKeeperCheckpointIDCounter createCheckpointIDCounter(
    CuratorFramework client,
    Configuration configuration,
    JobID jobId) {
  String checkpointIdCounterPath = configuration.getString(
      HighAvailabilityOptions.HA_ZOOKEEPER_CHECKPOINT_COUNTER_PATH);
  checkpointIdCounterPath += ZooKeeperSubmittedJobGraphStore.getPathForJob(jobId);
  return new ZooKeeperCheckpointIDCounter(client, checkpointIdCounterPath);
}

代码示例来源:origin: org.apache.flink/flink-runtime_2.11

/**
 * Creates a {@link ZooKeeperCheckpointIDCounter} instance.
 *
 * @param client        The {@link CuratorFramework} ZooKeeper client to use
 * @param configuration {@link Configuration} object
 * @param jobId         ID of job to create the instance for
 * @return {@link ZooKeeperCheckpointIDCounter} instance
 */
public static ZooKeeperCheckpointIDCounter createCheckpointIDCounter(
    CuratorFramework client,
    Configuration configuration,
    JobID jobId) {
  String checkpointIdCounterPath = configuration.getString(
      HighAvailabilityOptions.HA_ZOOKEEPER_CHECKPOINT_COUNTER_PATH);
  checkpointIdCounterPath += ZooKeeperSubmittedJobGraphStore.getPathForJob(jobId);
  return new ZooKeeperCheckpointIDCounter(client, checkpointIdCounterPath);
}

代码示例来源:origin: com.alibaba.blink/flink-runtime

/**
 * Creates a {@link ZooKeeperCheckpointIDCounter} instance.
 *
 * @param client        The {@link CuratorFramework} ZooKeeper client to use
 * @param configuration {@link Configuration} object
 * @param jobId         ID of job to create the instance for
 * @return {@link ZooKeeperCheckpointIDCounter} instance
 */
public static ZooKeeperCheckpointIDCounter createCheckpointIDCounter(
    CuratorFramework client,
    Configuration configuration,
    JobID jobId) {
  String checkpointIdCounterPath = configuration.getString(
      HighAvailabilityOptions.HA_ZOOKEEPER_CHECKPOINT_COUNTER_PATH);
  checkpointIdCounterPath += ZooKeeperSubmittedJobGraphStore.getPathForJob(jobId);
  return new ZooKeeperCheckpointIDCounter(client, checkpointIdCounterPath);
}

代码示例来源:origin: org.apache.flink/flink-runtime_2.10

/**
 * Creates a {@link ZooKeeperCheckpointIDCounter} instance.
 *
 * @param client        The {@link CuratorFramework} ZooKeeper client to use
 * @param configuration {@link Configuration} object
 * @param jobId         ID of job to create the instance for
 * @return {@link ZooKeeperCheckpointIDCounter} instance
 */
public static ZooKeeperCheckpointIDCounter createCheckpointIDCounter(
    CuratorFramework client,
    Configuration configuration,
    JobID jobId) {
  String checkpointIdCounterPath = ConfigurationUtil.getStringWithDeprecatedKeys(
      configuration,
      ConfigConstants.HA_ZOOKEEPER_CHECKPOINT_COUNTER_PATH,
      ConfigConstants.DEFAULT_ZOOKEEPER_CHECKPOINT_COUNTER_PATH,
      ConfigConstants.ZOOKEEPER_CHECKPOINT_COUNTER_PATH);
  checkpointIdCounterPath += ZooKeeperSubmittedJobGraphStore.getPathForJob(jobId);
  return new ZooKeeperCheckpointIDCounter(client, checkpointIdCounterPath);
}

相关文章

ZooKeeperCheckpointIDCounter类方法