org.apache.flink.streaming.api.watermark.Watermark.<init>()方法的使用及代码示例

x33g5p2x  于2022-02-03 转载在 其他  
字(4.9k)|赞(0)|评价(0)|浏览(185)

本文整理了Java中org.apache.flink.streaming.api.watermark.Watermark.<init>()方法的一些代码示例,展示了Watermark.<init>()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Watermark.<init>()方法的具体详情如下:
包路径:org.apache.flink.streaming.api.watermark.Watermark
类名称:Watermark
方法名:<init>

Watermark.<init>介绍

[英]Creates a new watermark with the given timestamp in milliseconds.
[中]以毫秒为单位创建具有给定时间戳的新水印。

代码示例

代码示例来源:origin: apache/flink

@Nullable
  @Override
  public Watermark getCurrentWatermark() {
    return new Watermark(currentTimestamp == Long.MIN_VALUE ? Long.MIN_VALUE : currentTimestamp - 1);
  }
}

代码示例来源:origin: apache/flink

@Override
  public Watermark getCurrentWatermark() {
    // make sure timestamps are monotonously increasing, even when the system clock re-syncs
    final long now = Math.max(System.currentTimeMillis(), maxTimestamp);
    maxTimestamp = now;
    return new Watermark(now - 1);
  }
}

代码示例来源:origin: apache/flink

@Override
  public Watermark checkAndGetNextWatermark(Tuple2<String, Integer> lastElement, long extractedTimestamp) {
    return new Watermark(lastElement.f1 - 1);
  }
}

代码示例来源:origin: apache/flink

@Override
  public Watermark checkAndGetNextWatermark(Integer element, long extractedTimestamp) {
    return new Watermark(extractedTimestamp - 1);
  }
})

代码示例来源:origin: apache/flink

@Override
  public Watermark getCurrentWatermark() {
    return new Watermark(currentTimestamp == Long.MIN_VALUE ? Long.MIN_VALUE : currentTimestamp - 1);
  }
}

代码示例来源:origin: apache/flink

@Override
  public Watermark checkAndGetNextWatermark(Integer element, long extractedTimestamp) {
    return new Watermark(extractedTimestamp - 1);
  }
})

代码示例来源:origin: apache/flink

@Override
  public Watermark checkAndGetNextWatermark(Tuple2<String, Integer> element, long extractedTimestamp) {
    return new Watermark(extractedTimestamp - 1);
  }
}

代码示例来源:origin: apache/flink

@Override
  public Watermark checkAndGetNextWatermark(Tuple3<String, String, Integer> lastElement, long extractedTimestamp) {
    return new Watermark(lastElement.f2 - 1);
  }
}

代码示例来源:origin: apache/flink

@Override
public void run(SourceContext<Tuple3<String, Long, Integer>> ctx) throws Exception {
  for (Tuple3<String, Long, Integer> value : input) {
    ctx.collectWithTimestamp(value, value.f1);
    ctx.emitWatermark(new Watermark(value.f1 - 1));
  }
  ctx.emitWatermark(new Watermark(Long.MAX_VALUE));
}

代码示例来源:origin: apache/flink

@Nullable
  @Override
  public Watermark checkAndGetNextWatermark(T lastElement, long extractedTimestamp) {
    return new Watermark(extractedTimestamp);
  }
}

代码示例来源:origin: apache/flink

public void processWatermark1(Watermark mark) throws Exception {
  input1Watermark = mark.getTimestamp();
  long newMin = Math.min(input1Watermark, input2Watermark);
  if (newMin > combinedWatermark) {
    combinedWatermark = newMin;
    processWatermark(new Watermark(combinedWatermark));
  }
}

代码示例来源:origin: apache/flink

@Nullable
  @Override
  public Watermark checkAndGetNextWatermark(T lastElement, long extractedTimestamp) {
    return new Watermark(extractedTimestamp);
  }
}

代码示例来源:origin: apache/flink

@Nullable
  @Override
  public Watermark getCurrentWatermark() {
    return new Watermark(maxTimestamp);
  }
}

代码示例来源:origin: apache/flink

@Nullable
@Override
public Watermark checkAndGetNextWatermark(Integer lastElement, long extractedTimestamp) {
  return new Watermark(extractedTimestamp);
}

代码示例来源:origin: apache/flink

@Nullable
@Override
public Watermark checkAndGetNextWatermark(Long lastElement, long extractedTimestamp) {
  return extractedTimestamp % 3 == 0 ? new Watermark(extractedTimestamp) : null;
}

代码示例来源:origin: apache/flink

@Override
protected void handleElement(StreamRecord<String> element) {
  long timestamp = Long.valueOf(element.getValue());
  if (timestamp > lastWatermark) {
    output.emitWatermark(new Watermark(timestamp));
    lastWatermark = timestamp;
  }
}

代码示例来源:origin: apache/flink

@Override
public void run(SourceContext<Integer> ctx) throws Exception {
  for (int i = 0; i < numWatermarks; i++) {
    ctx.collectWithTimestamp(i, initialTime + i);
    ctx.emitWatermark(new Watermark(initialTime + i));
  }
}

代码示例来源:origin: apache/flink

@Override
public void onProcessingTime(long timestamp) throws Exception {
  // register next timer
  long newWatermark = userFunction.getCurrentWatermark();
  if (newWatermark > currentWatermark) {
    currentWatermark = newWatermark;
    // emit watermark
    output.emitWatermark(new Watermark(currentWatermark));
  }
  long now = getProcessingTimeService().getCurrentProcessingTime();
  getProcessingTimeService().registerTimer(now + watermarkInterval, this);
}

代码示例来源:origin: apache/flink

@Override
public void run(SourceContext<Integer> ctx) throws Exception {
  ctx.collectWithTimestamp(1, 0);
  ctx.emitWatermark(new Watermark(0));
  ctx.collectWithTimestamp(2, 1);
  ctx.collectWithTimestamp(5, 2);
  ctx.emitWatermark(new Watermark(2));
  ctx.collectWithTimestamp(3, 3);
  ctx.collectWithTimestamp(4, 4);
}

代码示例来源:origin: apache/flink

@Override
public void processElement(StreamRecord<T> element) throws Exception {
  long newTimestamp = userFunction.extractTimestamp(element.getValue(), element.getTimestamp());
  output.collect(element.replace(element.getValue(), newTimestamp));
  long watermark = userFunction.extractWatermark(element.getValue(), newTimestamp);
  if (watermark > currentWatermark) {
    currentWatermark = watermark;
    output.emitWatermark(new Watermark(currentWatermark));
  }
}

相关文章