com.facebook.presto.spi.Node.getNodeIdentifier()方法的使用及代码示例

x33g5p2x  于2022-01-25 转载在 其他  
字(9.1k)|赞(0)|评价(0)|浏览(169)

本文整理了Java中com.facebook.presto.spi.Node.getNodeIdentifier()方法的一些代码示例，展示了Node.getNodeIdentifier()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。Node.getNodeIdentifier()方法的具体详情如下：
包路径：com.facebook.presto.spi.Node
类名称：Node
方法名：getNodeIdentifier

Node.getNodeIdentifier介绍

暂无

代码示例

代码示例来源：origin: prestodb/presto

  1. public int getQueuedSplitCountForStage(Node node)
  2. {
  3.   return queuedSplitCountByNode.getOrDefault(node.getNodeIdentifier(), 0) + assignmentCount.getOrDefault(node, 0);
  4. }

代码示例来源：origin: prestodb/presto

  1. @Inject
  2. public JmxRecordSetProvider(MBeanServer mbeanServer, NodeManager nodeManager, JmxHistoricalData jmxHistoricalData)
  3. {
  4.   this.mbeanServer = requireNonNull(mbeanServer, "mbeanServer is null");
  5.   this.nodeId = requireNonNull(nodeManager, "nodeManager is null").getCurrentNode().getNodeIdentifier();
  6.   this.jmxHistoricalData = requireNonNull(jmxHistoricalData, "jmxHistoryHolder is null");
  7. }

代码示例来源：origin: prestodb/presto

  1. @Override
  2. public URI createTaskLocation(Node node, TaskId taskId)
  3. {
  4.   return URI.create("http://fake.invalid/task/" + node.getNodeIdentifier() + "/" + taskId);
  5. }

代码示例来源：origin: prestodb/presto

  1. @Override
  2.   public URI createMemoryInfoLocation(Node node)
  3.   {
  4.     return URI.create("http://fake.invalid/" + node.getNodeIdentifier() + "/memory");
  5.   }
  6. }

代码示例来源：origin: prestodb/presto

  1. public static ResettableRandomizedIterator<Node> randomizedNodes(NodeMap nodeMap, boolean includeCoordinator, Set<Node> excludedNodes)
  2. {
  3.   ImmutableList<Node> nodes = nodeMap.getNodesByHostAndPort().values().stream()
  4.       .filter(node -> includeCoordinator || !nodeMap.getCoordinatorNodeIds().contains(node.getNodeIdentifier()))
  5.       .filter(node -> !excludedNodes.contains(node))
  6.       .collect(toImmutableList());
  7.   return new ResettableRandomizedIterator<>(nodes);
  8. }

代码示例来源：origin: prestodb/presto

  1. private synchronized void updateNodes(MemoryPoolAssignmentsRequest assignments)
  2. {
  3.   ImmutableSet.Builder<Node> builder = ImmutableSet.builder();
  4.   Set<Node> aliveNodes = builder
  5.       .addAll(nodeManager.getNodes(ACTIVE))
  6.       .addAll(nodeManager.getNodes(SHUTTING_DOWN))
  7.       .build();
  8.   ImmutableSet<String> aliveNodeIds = aliveNodes.stream()
  9.       .map(Node::getNodeIdentifier)
  10.       .collect(toImmutableSet());
  11.   // Remove nodes that don't exist anymore
  12.   // Make a copy to materialize the set difference
  13.   Set<String> deadNodes = ImmutableSet.copyOf(difference(nodes.keySet(), aliveNodeIds));
  14.   nodes.keySet().removeAll(deadNodes);
  15.   // Add new nodes
  16.   for (Node node : aliveNodes) {
  17.     if (!nodes.containsKey(node.getNodeIdentifier())) {
  18.       nodes.put(node.getNodeIdentifier(), new RemoteNodeMemory(node, httpClient, memoryInfoCodec, assignmentsRequestJsonCodec, locationFactory.createMemoryInfoLocation(node)));
  19.     }
  20.   }
  21.   // If work isn't scheduled on the coordinator (the current node) there is no point
  22.   // in polling or updating (when moving queries to the reserved pool) its memory pools
  23.   if (!isWorkScheduledOnCoordinator) {
  24.     nodes.remove(nodeManager.getCurrentNode().getNodeIdentifier());
  25.   }
  26.   // Schedule refresh
  27.   for (RemoteNodeMemory node : nodes.values()) {
  28.     node.asyncRefresh(assignments);
  29.   }
  30. }

代码示例来源：origin: prestodb/presto

  1. private void addRows(Builder table, Set<Node> nodes, NodeState state)
  2. {
  3.   for (Node node : nodes) {
  4.     table.addRow(node.getNodeIdentifier(), node.getHttpUri().toString(), getNodeVersion(node), isCoordinator(node), state.toString().toLowerCase(Locale.ENGLISH));
  5.   }
  6. }

代码示例来源：origin: prestodb/presto

  1. private Response proxyJsonResponse(String nodeId, String workerPath)
  2. {
  3.   Set<Node> nodes = nodeManager.getNodes(NodeState.ACTIVE);
  4.   Node node = nodes.stream()
  5.       .filter(n -> n.getNodeIdentifier().equals(nodeId))
  6.       .findFirst()
  7.       .orElseThrow(() -> new WebApplicationException(NOT_FOUND));
  8.   Request request = prepareGet()
  9.       .setUri(uriBuilderFrom(node.getHttpUri())
  10.           .appendPath(workerPath)
  11.           .build())
  12.       .build();
  13.   InputStream responseStream = httpClient.execute(request, new StreamingJsonResponseHandler());
  14.   return Response.ok(responseStream, APPLICATION_JSON_TYPE).build();
  15. }

代码示例来源：origin: prestodb/presto

  1. private void pollWorkers()
  2. {
  3.   AllNodes allNodes = getAllNodes();
  4.   Set<Node> aliveNodes = ImmutableSet.<Node>builder()
  5.       .addAll(allNodes.getActiveNodes())
  6.       .addAll(allNodes.getShuttingDownNodes())
  7.       .build();
  8.   ImmutableSet<String> aliveNodeIds = aliveNodes.stream()
  9.       .map(Node::getNodeIdentifier)
  10.       .collect(toImmutableSet());
  11.   // Remove nodes that don't exist anymore
  12.   // Make a copy to materialize the set difference
  13.   Set<String> deadNodes = difference(nodeStates.keySet(), aliveNodeIds).immutableCopy();
  14.   nodeStates.keySet().removeAll(deadNodes);
  15.   // Add new nodes
  16.   for (Node node : aliveNodes) {
  17.     nodeStates.putIfAbsent(node.getNodeIdentifier(),
  18.         new RemoteNodeState(httpClient, uriBuilderFrom(node.getHttpUri()).appendPath("/v1/info/state").build()));
  19.   }
  20.   // Schedule refresh
  21.   nodeStates.values().forEach(RemoteNodeState::asyncRefresh);
  22.   // update indexes
  23.   refreshNodesInternal();
  24. }

代码示例来源：origin: prestodb/presto

  1. .filter(node -> includeCoordinator || !coordinatorIds.contains(node.getNodeIdentifier()))
  2. .forEach(chosen::add);
  3.   .filter(node -> includeCoordinator || !coordinatorIds.contains(node.getNodeIdentifier()))
  4.   .forEach(chosen::add);

代码示例来源：origin: prestodb/presto

  1. node.getNodeIdentifier(),
  2. locationFactory.createTaskLocation(node, taskId),
  3. fragment,

代码示例来源：origin: prestodb/presto

  1. @Override
  2.   public ConnectorSplitSource getSplits(ConnectorTransactionHandle transaction, ConnectorSession session, ConnectorTableLayoutHandle layout, SplitSchedulingStrategy splitSchedulingStrategy)
  3.   {
  4.     JmxTableLayoutHandle jmxLayout = (JmxTableLayoutHandle) layout;
  5.     JmxTableHandle tableHandle = jmxLayout.getTable();
  6.     TupleDomain<ColumnHandle> predicate = jmxLayout.getConstraint();
  8.     //TODO is there a better way to get the node column?
  9.     Optional<JmxColumnHandle> nodeColumnHandle = tableHandle.getColumnHandles().stream()
  10.         .filter(jmxColumnHandle -> jmxColumnHandle.getColumnName().equals(NODE_COLUMN_NAME))
  11.         .findFirst();
  12.     checkState(nodeColumnHandle.isPresent(), "Failed to find %s column", NODE_COLUMN_NAME);
  14.     List<ConnectorSplit> splits = nodeManager.getAllNodes().stream()
  15.         .filter(node -> {
  16.           NullableValue value = NullableValue.of(createUnboundedVarcharType(), utf8Slice(node.getNodeIdentifier()));
  17.           return predicate.overlaps(fromFixedValues(ImmutableMap.of(nodeColumnHandle.get(), value)));
  18.         })
  19.         .map(node -> new JmxSplit(tableHandle, ImmutableList.of(node.getHostAndPort())))
  20.         .collect(toList());
  22.     return new FixedSplitSource(splits);
  23.   }
  24. }

代码示例来源：origin: prestodb/presto

  1. private SimpleConsumer createConsumer(HostAddress host)
  2.   {
  3.     log.info("Creating new Consumer for %s", host);
  4.     return new SimpleConsumer(host.getHostText(),
  5.         host.getPort(),
  6.         connectTimeoutMillis,
  7.         bufferSizeBytes,
  8.         format("presto-kafka-%s-%s", connectorId, nodeManager.getCurrentNode().getNodeIdentifier()));
  9.   }
  10. }

代码示例来源：origin: prestodb/presto

  1. log.info("Previously active node is missing: %s (last seen at %s)", missingNode.getNodeIdentifier(), missingNode.getHostAndPort());

代码示例来源：origin: prestodb/presto

  1. @Test
  2. public void testPredicatePushdown()
  3.     throws Exception
  4. {
  5.   for (Node node : nodes) {
  6.     String nodeIdentifier = node.getNodeIdentifier();
  7.     TupleDomain<ColumnHandle> nodeTupleDomain = TupleDomain.fromFixedValues(ImmutableMap.of(columnHandle, NullableValue.of(createUnboundedVarcharType(), utf8Slice(nodeIdentifier))));
  8.     ConnectorTableLayoutHandle layout = new JmxTableLayoutHandle(tableHandle, nodeTupleDomain);
  9.     ConnectorSplitSource splitSource = splitManager.getSplits(JmxTransactionHandle.INSTANCE, SESSION, layout, UNGROUPED_SCHEDULING);
  10.     List<ConnectorSplit> allSplits = getAllSplits(splitSource);
  11.     assertEquals(allSplits.size(), 1);
  12.     assertEquals(allSplits.get(0).getAddresses().size(), 1);
  13.     assertEquals(allSplits.get(0).getAddresses().get(0).getHostText(), nodeIdentifier);
  14.   }
  15. }

代码示例来源：origin: prestodb/presto

  1. boolean summarizeTaskInfo)
  2. return new MockRemoteTask(taskId, fragment, node.getNodeIdentifier(), executor, scheduledExecutor, initialSplits, totalPartitions, partitionedSplitCountTracker);

代码示例来源：origin: prestodb/presto

  1. @Test
  2. public void testGetCurrentNode()
  3. {
  4.   Node expected = activeNodes.get(0);
  5.   NodeInfo nodeInfo = new NodeInfo(new NodeConfig()
  6.       .setEnvironment("test")
  7.       .setNodeId(expected.getNodeIdentifier()));
  8.   DiscoveryNodeManager manager = new DiscoveryNodeManager(selector, nodeInfo, new NoOpFailureDetector(), expectedVersion, testHttpClient, internalCommunicationConfig);
  9.   assertEquals(manager.getCurrentNode(), expected);
  10. }

代码示例来源：origin: prestodb/presto

  1. if (useNetworkTopology && (includeCoordinator || !coordinatorNodeIds.contains(node.getNodeIdentifier()))) {
  2.   NetworkLocation location = networkLocationCache.get(node.getHostAndPort());
  3.   for (int i = 0; i <= location.getSegments().size(); i++) {

代码示例来源：origin: uk.co.nichesolutions.presto/presto-main

  1. public static ResettableRandomizedIterator<Node> randomizedNodes(NodeMap nodeMap, boolean includeCoordinator)
  2. {
  3.   ImmutableList<Node> nodes = nodeMap.getNodesByHostAndPort().values().stream()
  4.       .filter(node -> includeCoordinator || !nodeMap.getCoordinatorNodeIds().contains(node.getNodeIdentifier()))
  5.       .collect(toImmutableList());
  6.   return new ResettableRandomizedIterator<>(nodes);
  7. }

代码示例来源：origin: uk.co.nichesolutions.presto/presto-main

  1. @Test
  2. public void testGetCurrentNode()
  3. {
  4.   Node expected = activeNodes.get(0);
  5.   NodeInfo nodeInfo = new NodeInfo(new NodeConfig()
  6.       .setEnvironment("test")
  7.       .setNodeId(expected.getNodeIdentifier()));
  8.   DiscoveryNodeManager manager = new DiscoveryNodeManager(selector, nodeInfo, new NoOpFailureDetector(), expectedVersion, testHttpClient);
  9.   assertEquals(manager.getCurrentNode(), expected);
  10. }

内容来源于网络，如有侵权，请联系作者删除！

Node

相关文章

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com