org.apache.flink.runtime.execution.Environment.getAccumulatorRegistry()方法的使用及代码示例

x33g5p2x  于2022-01-19 转载在 其他  
字(11.6k)|赞(0)|评价(0)|浏览(249)

本文整理了Java中org.apache.flink.runtime.execution.Environment.getAccumulatorRegistry()方法的一些代码示例，展示了Environment.getAccumulatorRegistry()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。Environment.getAccumulatorRegistry()方法的具体详情如下：
包路径：org.apache.flink.runtime.execution.Environment
类名称：Environment
方法名：getAccumulatorRegistry

Environment.getAccumulatorRegistry介绍

[英]Return the registry for accumulators which are periodically sent to the job manager.
[中]返回定期发送到作业管理器的累加器的注册表。

代码示例

代码示例来源：origin: apache/flink

  1. /**
  2.  * Constructor for initialization, possibly with initial state (recovery / savepoint / etc).
  3.  *
  4.  * <p>This constructor accepts a special {@link ProcessingTimeService}. By default (and if
  5.  * null is passes for the time provider) a {@link SystemProcessingTimeService DefaultTimerService}
  6.  * will be used.
  7.  *
  8.  * @param environment The task environment for this task.
  9.  * @param timeProvider Optionally, a specific time provider to use.
  10.  */
  11. protected StreamTask(
  12.     Environment environment,
  13.     @Nullable ProcessingTimeService timeProvider) {
  14.   super(environment);
  15.   this.timerService = timeProvider;
  16.   this.configuration = new StreamConfig(getTaskConfiguration());
  17.   this.accumulatorMap = getEnvironment().getAccumulatorRegistry().getUserMap();
  18.   this.recordWriters = createRecordWriters(configuration, environment);
  19. }

代码示例来源：origin: com.alibaba.blink/flink-runtime

  1. /**
  2.  * Creates a writer for each output. Creates an OutputCollector which forwards its input to all writers.
  3.  * The output collector applies the configured shipping strategy.
  4.  */
  5. private void initOutputs(ClassLoader cl) throws Exception {
  6.   this.chainedTasks = new ArrayList<ChainedDriver<?, ?>>();
  7.   this.eventualOutputs = new ArrayList<RecordWriter<?>>();
  8.   this.output = BatchTask.initOutputs(this, cl, this.config, this.chainedTasks, this.eventualOutputs,
  9.       getExecutionConfig(), getEnvironment().getAccumulatorRegistry());
  10. }

代码示例来源：origin: com.alibaba.blink/flink-runtime

  1. /**
  2.  * Creates a writer for each output. Creates an OutputCollector which forwards its input to all writers.
  3.  * The output collector applies the configured shipping strategies for each writer.
  4.  */
  5. protected void initOutputs() throws Exception {
  6.   this.chainedTasks = new ArrayList<ChainedDriver<?, ?>>();
  7.   this.eventualOutputs = new ArrayList<RecordWriter<?>>();
  8.   ClassLoader userCodeClassLoader = getUserCodeClassLoader();
  9.   this.accumulatorRegistry = getEnvironment().getAccumulatorRegistry();
  10.   this.output = initOutputs(this, userCodeClassLoader, this.config, this.chainedTasks, this.eventualOutputs,
  11.       this.getExecutionConfig(), this.accumulatorRegistry);
  12. }

代码示例来源：origin: org.apache.flink/flink-runtime_2.11

  1. /**
  2.  * Creates a writer for each output. Creates an OutputCollector which forwards its input to all writers.
  3.  * The output collector applies the configured shipping strategy.
  4.  */
  5. private void initOutputs(ClassLoader cl) throws Exception {
  6.   this.chainedTasks = new ArrayList<ChainedDriver<?, ?>>();
  7.   this.eventualOutputs = new ArrayList<RecordWriter<?>>();
  8.   this.output = BatchTask.initOutputs(this, cl, this.config, this.chainedTasks, this.eventualOutputs,
  9.       getExecutionConfig(), getEnvironment().getAccumulatorRegistry().getUserMap());
  10. }

代码示例来源：origin: org.apache.flink/flink-runtime

  1. /**
  2.  * Creates a writer for each output. Creates an OutputCollector which forwards its input to all writers.
  3.  * The output collector applies the configured shipping strategy.
  4.  */
  5. private void initOutputs(ClassLoader cl) throws Exception {
  6.   this.chainedTasks = new ArrayList<ChainedDriver<?, ?>>();
  7.   this.eventualOutputs = new ArrayList<RecordWriter<?>>();
  8.   this.output = BatchTask.initOutputs(this, cl, this.config, this.chainedTasks, this.eventualOutputs,
  9.       getExecutionConfig(), getEnvironment().getAccumulatorRegistry().getUserMap());
  10. }

代码示例来源：origin: org.apache.flink/flink-runtime_2.10

  1. /**
  2.  * Creates a writer for each output. Creates an OutputCollector which forwards its input to all writers.
  3.  * The output collector applies the configured shipping strategy.
  4.  */
  5. private void initOutputs(ClassLoader cl) throws Exception {
  6.   this.chainedTasks = new ArrayList<ChainedDriver<?, ?>>();
  7.   this.eventualOutputs = new ArrayList<RecordWriter<?>>();
  8.   this.output = BatchTask.initOutputs(this, cl, this.config, this.chainedTasks, this.eventualOutputs,
  9.       getExecutionConfig(), getEnvironment().getAccumulatorRegistry().getUserMap());
  10. }

代码示例来源：origin: org.apache.flink/flink-runtime_2.10

  1. /**
  2.  * Creates a writer for each output. Creates an OutputCollector which forwards its input to all writers.
  3.  * The output collector applies the configured shipping strategies for each writer.
  4.  */
  5. protected void initOutputs() throws Exception {
  6.   this.chainedTasks = new ArrayList<ChainedDriver<?, ?>>();
  7.   this.eventualOutputs = new ArrayList<RecordWriter<?>>();
  8.   ClassLoader userCodeClassLoader = getUserCodeClassLoader();
  9.   this.accumulatorMap = getEnvironment().getAccumulatorRegistry().getUserMap();
  10.   this.output = initOutputs(this, userCodeClassLoader, this.config, this.chainedTasks, this.eventualOutputs,
  11.       this.getExecutionConfig(), this.accumulatorMap);
  12. }

代码示例来源：origin: org.apache.flink/flink-runtime

  1. /**
  2.  * Creates a writer for each output. Creates an OutputCollector which forwards its input to all writers.
  3.  * The output collector applies the configured shipping strategies for each writer.
  4.  */
  5. protected void initOutputs() throws Exception {
  6.   this.chainedTasks = new ArrayList<ChainedDriver<?, ?>>();
  7.   this.eventualOutputs = new ArrayList<RecordWriter<?>>();
  8.   ClassLoader userCodeClassLoader = getUserCodeClassLoader();
  9.   this.accumulatorMap = getEnvironment().getAccumulatorRegistry().getUserMap();
  10.   this.output = initOutputs(this, userCodeClassLoader, this.config, this.chainedTasks, this.eventualOutputs,
  11.       this.getExecutionConfig(), this.accumulatorMap);
  12. }

代码示例来源：origin: org.apache.flink/flink-runtime_2.11

  1. /**
  2.  * Creates a writer for each output. Creates an OutputCollector which forwards its input to all writers.
  3.  * The output collector applies the configured shipping strategies for each writer.
  4.  */
  5. protected void initOutputs() throws Exception {
  6.   this.chainedTasks = new ArrayList<ChainedDriver<?, ?>>();
  7.   this.eventualOutputs = new ArrayList<RecordWriter<?>>();
  8.   ClassLoader userCodeClassLoader = getUserCodeClassLoader();
  9.   this.accumulatorMap = getEnvironment().getAccumulatorRegistry().getUserMap();
  10.   this.output = initOutputs(this, userCodeClassLoader, this.config, this.chainedTasks, this.eventualOutputs,
  11.       this.getExecutionConfig(), this.accumulatorMap);
  12. }

代码示例来源：origin: com.alibaba.blink/flink-runtime

  1. public DistributedRuntimeUDFContext createRuntimeContext() {
  2.     Environment env = getEnvironment();
  4.     String sourceName =  getEnvironment().getTaskInfo().getTaskName().split("->")[0].trim();
  5.     sourceName = sourceName.startsWith("CHAIN") ? sourceName.substring(6) : sourceName;
  6.     return new DistributedRuntimeUDFContext(env.getTaskInfo(), getUserCodeClassLoader(),
  7.         getExecutionConfig(), env.getDistributedCacheEntries(), env.getAccumulatorRegistry(),
  8.         getEnvironment().getMetricGroup().addOperator(sourceName));
  9.   }
  10. }

代码示例来源：origin: org.apache.flink/flink-streaming-java_2.11

  1. /**
  2.  * Constructor for initialization, possibly with initial state (recovery / savepoint / etc).
  3.  *
  4.  * <p>This constructor accepts a special {@link ProcessingTimeService}. By default (and if
  5.  * null is passes for the time provider) a {@link SystemProcessingTimeService DefaultTimerService}
  6.  * will be used.
  7.  *
  8.  * @param environment The task environment for this task.
  9.  * @param timeProvider Optionally, a specific time provider to use.
  10.  */
  11. protected StreamTask(
  12.     Environment environment,
  13.     @Nullable ProcessingTimeService timeProvider) {
  14.   super(environment);
  15.   this.timerService = timeProvider;
  16.   this.configuration = new StreamConfig(getTaskConfiguration());
  17.   this.accumulatorMap = getEnvironment().getAccumulatorRegistry().getUserMap();
  18.   this.streamRecordWriters = createStreamRecordWriters(configuration, environment);
  19. }

代码示例来源：origin: org.apache.flink/flink-runtime_2.11

  1. public DistributedRuntimeUDFContext createRuntimeContext() {
  2.     Environment env = getEnvironment();
  4.     String sourceName =  getEnvironment().getTaskInfo().getTaskName().split("->")[0].trim();
  5.     sourceName = sourceName.startsWith("CHAIN") ? sourceName.substring(6) : sourceName;
  6.     return new DistributedRuntimeUDFContext(env.getTaskInfo(), getUserCodeClassLoader(),
  7.         getExecutionConfig(), env.getDistributedCacheEntries(), env.getAccumulatorRegistry().getUserMap(), 
  8.         getEnvironment().getMetricGroup().getOrAddOperator(sourceName));
  9.   }
  10. }

代码示例来源：origin: org.apache.flink/flink-streaming-java

  1. /**
  2.  * Constructor for initialization, possibly with initial state (recovery / savepoint / etc).
  3.  *
  4.  * <p>This constructor accepts a special {@link ProcessingTimeService}. By default (and if
  5.  * null is passes for the time provider) a {@link SystemProcessingTimeService DefaultTimerService}
  6.  * will be used.
  7.  *
  8.  * @param environment The task environment for this task.
  9.  * @param timeProvider Optionally, a specific time provider to use.
  10.  */
  11. protected StreamTask(
  12.     Environment environment,
  13.     @Nullable ProcessingTimeService timeProvider) {
  14.   super(environment);
  15.   this.timerService = timeProvider;
  16.   this.configuration = new StreamConfig(getTaskConfiguration());
  17.   this.accumulatorMap = getEnvironment().getAccumulatorRegistry().getUserMap();
  18.   this.streamRecordWriters = createStreamRecordWriters(configuration, environment);
  19. }

代码示例来源：origin: org.apache.flink/flink-runtime_2.10

  1. public DistributedRuntimeUDFContext createRuntimeContext() {
  2.     Environment env = getEnvironment();
  4.     String sourceName =  getEnvironment().getTaskInfo().getTaskName().split("->")[0].trim();
  5.     sourceName = sourceName.startsWith("CHAIN") ? sourceName.substring(6) : sourceName;
  6.     return new DistributedRuntimeUDFContext(env.getTaskInfo(), getUserCodeClassLoader(),
  7.         getExecutionConfig(), env.getDistributedCacheEntries(), env.getAccumulatorRegistry().getUserMap(), 
  8.         getEnvironment().getMetricGroup().addOperator(sourceName));
  9.   }
  10. }

代码示例来源：origin: org.apache.flink/flink-runtime

  1. public DistributedRuntimeUDFContext createRuntimeContext() {
  2.     Environment env = getEnvironment();
  4.     String sourceName =  getEnvironment().getTaskInfo().getTaskName().split("->")[0].trim();
  5.     sourceName = sourceName.startsWith("CHAIN") ? sourceName.substring(6) : sourceName;
  6.     return new DistributedRuntimeUDFContext(env.getTaskInfo(), getUserCodeClassLoader(),
  7.         getExecutionConfig(), env.getDistributedCacheEntries(), env.getAccumulatorRegistry().getUserMap(), 
  8.         getEnvironment().getMetricGroup().getOrAddOperator(sourceName));
  9.   }
  10. }

代码示例来源：origin: com.alibaba.blink/flink-runtime

  1. public DistributedRuntimeUDFContext createRuntimeContext() {
  2.     Environment env = getEnvironment();
  4.     return new DistributedRuntimeUDFContext(env.getTaskInfo(), getUserCodeClassLoader(),
  5.         getExecutionConfig(), env.getDistributedCacheEntries(), env.getAccumulatorRegistry(),
  6.         getEnvironment().getMetricGroup().addOperator(getEnvironment().getTaskInfo().getTaskName()));
  7.   }
  8. }

代码示例来源：origin: org.apache.flink/flink-runtime_2.11

  1. public DistributedRuntimeUDFContext createRuntimeContext() {
  2.     Environment env = getEnvironment();
  4.     return new DistributedRuntimeUDFContext(env.getTaskInfo(), getUserCodeClassLoader(),
  5.         getExecutionConfig(), env.getDistributedCacheEntries(), env.getAccumulatorRegistry().getUserMap(), 
  6.         getEnvironment().getMetricGroup().getOrAddOperator(getEnvironment().getTaskInfo().getTaskName()));
  7.   }
  8. }

代码示例来源：origin: org.apache.flink/flink-runtime

  1. public DistributedRuntimeUDFContext createRuntimeContext() {
  2.     Environment env = getEnvironment();
  4.     return new DistributedRuntimeUDFContext(env.getTaskInfo(), getUserCodeClassLoader(),
  5.         getExecutionConfig(), env.getDistributedCacheEntries(), env.getAccumulatorRegistry().getUserMap(), 
  6.         getEnvironment().getMetricGroup().getOrAddOperator(getEnvironment().getTaskInfo().getTaskName()));
  7.   }
  8. }

代码示例来源：origin: org.apache.flink/flink-runtime_2.10

  1. public DistributedRuntimeUDFContext createRuntimeContext() {
  2.     Environment env = getEnvironment();
  4.     return new DistributedRuntimeUDFContext(env.getTaskInfo(), getUserCodeClassLoader(),
  5.         getExecutionConfig(), env.getDistributedCacheEntries(), env.getAccumulatorRegistry().getUserMap(), 
  6.         getEnvironment().getMetricGroup().addOperator(getEnvironment().getTaskInfo().getTaskName()));
  7.   }
  8. }

代码示例来源：origin: org.apache.flink/flink-streaming-java_2.10

  1. accumulatorMap = getEnvironment().getAccumulatorRegistry().getUserMap();

内容来源于网络，如有侵权，请联系作者删除！

Environment

相关文章

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com