kafka.message.Message.size()方法的使用及代码示例

x33g5p2x  于2022-01-25 转载在 其他  
字(3.6k)|赞(0)|评价(0)|浏览(188)

本文整理了Java中kafka.message.Message.size()方法的一些代码示例,展示了Message.size()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Message.size()方法的具体详情如下:
包路径:kafka.message.Message
类名称:Message
方法名:size

Message.size介绍

暂无

代码示例

代码示例来源:origin: apache/incubator-gobblin

  1. public Kafka08ConsumerRecord(MessageAndOffset messageAndOffset) {
  2. super(messageAndOffset.offset(), messageAndOffset.message().size());
  3. this.messageAndOffset = messageAndOffset;
  4. }

代码示例来源:origin: linkedin/camus

  1. /**
  2. * Fetches the next Kafka message and stuffs the results into the key and
  3. * value
  4. *
  5. * @param etlKey
  6. * @return true if there exists more events
  7. * @throws IOException
  8. */
  9. public KafkaMessage getNext(EtlKey etlKey) throws IOException {
  10. if (hasNext()) {
  11. MessageAndOffset msgAndOffset = messageIter.next();
  12. Message message = msgAndOffset.message();
  13. byte[] payload = getBytes(message.payload());
  14. byte[] key = getBytes(message.key());
  15. if (payload == null) {
  16. log.warn("Received message with null message.payload(): " + msgAndOffset);
  17. }
  18. etlKey.clear();
  19. etlKey.set(kafkaRequest.getTopic(), kafkaRequest.getLeaderId(), kafkaRequest.getPartition(), currentOffset,
  20. msgAndOffset.offset() + 1, message.checksum());
  21. etlKey.setMessageSize(msgAndOffset.message().size());
  22. currentOffset = msgAndOffset.offset() + 1; // increase offset
  23. currentCount++; // increase count
  24. return new KafkaMessage(payload, key, kafkaRequest.getTopic(), kafkaRequest.getPartition(),
  25. msgAndOffset.offset(), message.checksum());
  26. } else {
  27. return null;
  28. }
  29. }

代码示例来源:origin: com.linkedin.gobblin/gobblin-kafka-08

  1. public Kafka08ConsumerRecord(MessageAndOffset messageAndOffset) {
  2. super(messageAndOffset.offset(), messageAndOffset.message().size());
  3. this.messageAndOffset = messageAndOffset;
  4. }

代码示例来源:origin: org.apache.gobblin/gobblin-kafka-08

  1. public Kafka08ConsumerRecord(MessageAndOffset messageAndOffset) {
  2. super(messageAndOffset.offset(), messageAndOffset.message().size());
  3. this.messageAndOffset = messageAndOffset;
  4. }

代码示例来源:origin: apache/apex-malhar

  1. if ((emitCount > 0) && ((maxTotalMsgSizePerWindow - emitTotalMsgSize) < message.msg.size())) {
  2. pendingMessage = message;
  3. break;
  4. emitTotalMsgSize += message.msg.size();
  5. offsetStats.put(message.kafkaPart, message.offSet);
  6. MutablePair<Long, Integer> offsetAndCount = currentWindowRecoveryState.get(message.kafkaPart);

代码示例来源:origin: org.apache.apex/malhar-contrib

  1. if ((emitCount > 0) && ((maxTotalMsgSizePerWindow - emitTotalMsgSize) < message.msg.size())) {
  2. pendingMessage = message;
  3. break;
  4. emitTotalMsgSize += message.msg.size();
  5. offsetStats.put(message.kafkaPart, message.offSet);
  6. MutablePair<Long, Integer> offsetAndCount = currentWindowRecoveryState.get(message.kafkaPart);

代码示例来源:origin: HiveKa/HiveKa

  1. msgAndOffset.offset() + 1, message.checksum());
  2. key.setMessageSize(msgAndOffset.message().size());

代码示例来源:origin: com.linkedin.camus/camus-etl-kafka

  1. /**
  2. * Fetches the next Kafka message and stuffs the results into the key and
  3. * value
  4. *
  5. * @param etlKey
  6. * @return true if there exists more events
  7. * @throws IOException
  8. */
  9. public KafkaMessage getNext(EtlKey etlKey) throws IOException {
  10. if (hasNext()) {
  11. MessageAndOffset msgAndOffset = messageIter.next();
  12. Message message = msgAndOffset.message();
  13. byte[] payload = getBytes(message.payload());
  14. byte[] key = getBytes(message.key());
  15. if (payload == null) {
  16. log.warn("Received message with null message.payload(): " + msgAndOffset);
  17. }
  18. etlKey.clear();
  19. etlKey.set(kafkaRequest.getTopic(), kafkaRequest.getLeaderId(), kafkaRequest.getPartition(), currentOffset,
  20. msgAndOffset.offset() + 1, message.checksum());
  21. etlKey.setMessageSize(msgAndOffset.message().size());
  22. currentOffset = msgAndOffset.offset() + 1; // increase offset
  23. currentCount++; // increase count
  24. return new KafkaMessage(payload, key, kafkaRequest.getTopic(), kafkaRequest.getPartition(),
  25. msgAndOffset.offset(), message.checksum());
  26. } else {
  27. return null;
  28. }
  29. }

相关文章