org.apache.hadoop.util.curator.ZKCuratorManager类的使用及代码示例

x33g5p2x  于2022-02-05 转载在 其他  
字(8.3k)|赞(0)|评价(0)|浏览(74)

本文整理了Java中org.apache.hadoop.util.curator.ZKCuratorManager类的一些代码示例，展示了ZKCuratorManager类的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。ZKCuratorManager类的具体详情如下：
包路径：org.apache.hadoop.util.curator.ZKCuratorManager
类名称：ZKCuratorManager

ZKCuratorManager介绍

[英]Helper class that provides utility methods specific to ZK operations.
[中]提供特定于ZK操作的实用程序方法的Helper类。

代码示例

代码示例来源：origin: org.apache.hadoop/hadoop-common

/**
 * Create a ZNode.
 * @param path Path of the ZNode.
 * @return If the ZNode was created.
 * @throws Exception If it cannot contact Zookeeper.
 */
public boolean create(final String path) throws Exception {
 return create(path, null);
}

代码示例来源：origin: org.apache.hadoop/hadoop-common

/**
 * Utility function to ensure that the configured base znode exists.
 * This recursively creates the znode as well as all of its parents.
 * @param path Path of the znode to create.
 * @throws Exception If it cannot create the file.
 */
public void createRootDirRecursively(String path) throws Exception {
 createRootDirRecursively(path, null);
}

代码示例来源：origin: org.apache.hadoop/hadoop-common

public void safeCreate(String path, byte[] data, List<ACL> acl,
  CreateMode mode, List<ACL> fencingACL, String fencingNodePath)
  throws Exception {
 if (!exists(path)) {
  SafeTransaction transaction = createTransaction(fencingACL,
    fencingNodePath);
  transaction.create(path, data, acl, mode);
  transaction.commit();
 }
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

this.zkManager =
  rmContext.getResourceManager().createAndStartZKManager(conf);
this.zkAcl = ZKCuratorManager.getZKAcls(conf);
this.fencingNodePath = getNodePath(znodeParentPath, FENCING_PATH);
zkManager.createRootDirRecursively(znodeParentPath, zkAcl);
zkManager.delete(fencingNodePath);
if (!zkManager.exists(logsPath)) {
 zkManager.create(logsPath);
 zkManager.setData(logsPath,
   serializeObject(new LinkedList<LogMutation>()), -1);
if (!zkManager.exists(confStorePath)) {
 zkManager.create(confStorePath);
 HashMap<String, String> mapSchedConf = new HashMap<>();
 for (Map.Entry<String, String> entry : schedConf) {
  mapSchedConf.put(entry.getKey(), entry.getValue());
 zkManager.setData(confStorePath, serializeObject(mapSchedConf), -1);

代码示例来源：origin: org.apache.hadoop/hadoop-common

/**
 * Get the data in a ZNode.
 * @param path Path of the ZNode.
 * @return The data in the ZNode.
 * @throws Exception If it cannot contact Zookeeper.
 */
public String getStringData(final String path) throws Exception {
 byte[] bytes = getData(path);
 if (bytes != null) {
  return new String(bytes, Charset.forName("UTF-8"));
 }
 return null;
}

代码示例来源：origin: org.apache.hadoop/hadoop-common

public void safeSetData(String path, byte[] data, int version,
  List<ACL> fencingACL, String fencingNodePath)
  throws Exception {
 SafeTransaction transaction = createTransaction(fencingACL,
   fencingNodePath);
 transaction.setData(path, data, version);
 transaction.commit();
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Override
public synchronized void storeVersion() throws Exception {
 byte[] data =
   ((VersionPBImpl) CURRENT_VERSION_INFO).getProto().toByteArray();
 if (zkManager.exists(zkVersionPath)) {
  zkManager.safeSetData(zkVersionPath, data, -1, zkAcl, fencingNodePath);
 } else {
  zkManager.safeCreate(zkVersionPath, data, zkAcl, CreateMode.PERSISTENT,
    zkAcl, fencingNodePath);
 }
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Override
public Version getConfStoreVersion() throws Exception {
 if (zkManager.exists(zkVersionPath)) {
  byte[] data = zkManager.getData(zkVersionPath);
  return new VersionPBImpl(YarnServerCommonProtos.VersionProto
    .parseFrom(data));
 }
 return null;
}

代码示例来源：origin: org.apache.hadoop/hadoop-common

/**
 * Delete a ZNode.
 * @param path Path of the ZNode.
 * @return If the znode was deleted.
 * @throws Exception If it cannot contact ZooKeeper.
 */
public boolean delete(final String path) throws Exception {
 if (exists(path)) {
  curator.delete().deletingChildrenIfNeeded().forPath(path);
  return true;
 }
 return false;
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Override
public void logMutation(LogMutation logMutation) throws Exception {
 byte[] storedLogs = zkManager.getData(logsPath);
 LinkedList<LogMutation> logs = new LinkedList<>();
 if (storedLogs != null) {
  logs = (LinkedList<LogMutation>) deserializeObject(storedLogs);
 }
 logs.add(logMutation);
 if (logs.size() > maxLogs) {
  logs.remove(logs.removeFirst());
 }
 zkManager.safeSetData(logsPath, serializeObject(logs), -1, zkAcl,
   fencingNodePath);
 pendingMutation = logMutation;
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

/**
 * Get ZooKeeper Curator manager, creating and starting if not exists.
 * @param config Configuration for the ZooKeeper curator.
 * @return ZooKeeper Curator manager.
 * @throws IOException If it cannot create the manager.
 */
public ZKCuratorManager createAndStartZKManager(Configuration
  config) throws IOException {
 ZKCuratorManager manager = new ZKCuratorManager(config);
 // Get authentication
 List<AuthInfo> authInfos = new ArrayList<>();
 if (HAUtil.isHAEnabled(config) && HAUtil.getConfValueForRMInstance(
   YarnConfiguration.ZK_RM_STATE_STORE_ROOT_NODE_ACL, config) == null) {
  String zkRootNodeUsername = HAUtil.getConfValueForRMInstance(
    YarnConfiguration.RM_ADDRESS,
    YarnConfiguration.DEFAULT_RM_ADDRESS, config);
  String defaultFencingAuth =
    zkRootNodeUsername + ":" + zkRootNodePassword;
  byte[] defaultFencingAuthData =
    defaultFencingAuth.getBytes(Charset.forName("UTF-8"));
  String scheme = new DigestAuthenticationProvider().getScheme();
  AuthInfo authInfo = new AuthInfo(scheme, defaultFencingAuthData);
  authInfos.add(authInfo);
 }
 manager.start(authInfos);
 return manager;
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

YarnConfiguration.DEFAULT_RM_ZK_TIMEOUT_MS);
List<ACL> zkAcls = ZKCuratorManager.getZKAcls(conf);
List<ZKUtil.ZKAuthInfo> zkAuths = ZKCuratorManager.getZKAuths(conf);

代码示例来源：origin: org.apache.hadoop/hadoop-common

/**
 * Start the connection to the ZooKeeper ensemble.
 * @throws IOException If the connection cannot be started.
 */
public void start() throws IOException {
 this.start(new ArrayList<>());
}

代码示例来源：origin: org.apache.hadoop/hadoop-common

/**
 * Set data into a ZNode.
 * @param path Path of the ZNode.
 * @param data Data to set as String.
 * @param version Version of the data to store.
 * @throws Exception If it cannot contact Zookeeper.
 */
public void setData(String path, String data, int version) throws Exception {
 byte[] bytes = data.getBytes(Charset.forName("UTF-8"));
 setData(path, bytes, version);
}

代码示例来源：origin: org.apache.hadoop/hadoop-common

List<ZKUtil.ZKAuthInfo> zkAuths = getZKAuths(conf);
if (authInfos == null) {
 authInfos = new ArrayList<>();

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Override
protected void serviceStop() throws Exception {
 if (webApp != null) {
  webApp.stop();
 }
 if (fetcher != null) {
  fetcher.stop();
 }
 if (configurationProvider != null) {
  configurationProvider.close();
 }
 super.serviceStop();
 if (zkManager != null) {
  zkManager.close();
 }
 transitionToStandby(false);
 rmContext.setHAServiceState(HAServiceState.STOPPING);
}

代码示例来源：origin: org.apache.hadoop/hadoop-common

/**
 * Get the data in a ZNode.
 * @param path Path of the ZNode.
 * @param stat Output statistics of the ZNode.
 * @return The data in the ZNode.
 * @throws Exception If it cannot contact Zookeeper.
 */
public String getStringData(final String path, Stat stat) throws Exception {
 byte[] bytes = getData(path, stat);
 if (bytes != null) {
  return new String(bytes, Charset.forName("UTF-8"));
 }
 return null;
}

代码示例来源：origin: org.apache.hadoop/hadoop-yarn-server-resourcemanager

@Override
protected synchronized void storeReservationState(
  ReservationAllocationStateProto reservationAllocation, String planName,
  String reservationIdName) throws Exception {
 SafeTransaction trx = zkManager.createTransaction(zkAcl, fencingNodePath);
 addOrUpdateReservationState(reservationAllocation, planName,
   reservationIdName, trx, false);
 trx.commit();
}

代码示例来源：origin: org.apache.hadoop/hadoop-common

/**
 * Create a ZNode.
 * @param path Path of the ZNode.
 * @param zkAcl ACL for the node.
 * @return If the ZNode was created.
 * @throws Exception If it cannot contact Zookeeper.
 */
public boolean create(final String path, List<ACL> zkAcl) throws Exception {
 boolean created = false;
 if (!exists(path)) {
  curator.create()
    .withMode(CreateMode.PERSISTENT)
    .withACL(zkAcl)
    .forPath(path, null);
  created = true;
 }
 return created;
}

代码示例来源：origin: org.apache.hadoop/hadoop-common

/**
 * Deletes the path. Checks for existence of path as well.
 * @param path Path to be deleted.
 * @throws Exception if any problem occurs while performing deletion.
 */
public void safeDelete(final String path, List<ACL> fencingACL,
  String fencingNodePath) throws Exception {
 if (exists(path)) {
  SafeTransaction transaction = createTransaction(fencingACL,
    fencingNodePath);
  transaction.delete(path);
  transaction.commit();
 }
}

内容来源于网络，如有侵权，请联系作者删除！

ZKCuratorManager

相关文章

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com