kafka.message.Message.checksum()方法的使用及代码示例

x33g5p2x  于2022-01-25 转载在 其他  
字(4.0k)|赞(0)|评价(0)|浏览(212)

本文整理了Java中kafka.message.Message.checksum()方法的一些代码示例,展示了Message.checksum()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Message.checksum()方法的具体详情如下:
包路径:kafka.message.Message
类名称:Message
方法名:checksum

Message.checksum介绍

暂无

代码示例

代码示例来源:origin: linkedin/camus

  1. public void validate() throws IOException {
  2. // check the checksum of message.
  3. Message readMessage;
  4. if (key == null){
  5. readMessage = new Message(payload);
  6. } else {
  7. readMessage = new Message(payload, key);
  8. }
  9. if (checksum != readMessage.checksum()) {
  10. throw new ChecksumException("Invalid message checksum : " + readMessage.checksum() + ". Expected " + checksum,
  11. offset);
  12. }
  13. }

代码示例来源:origin: linkedin/camus

  1. /**
  2. * Fetches the next Kafka message and stuffs the results into the key and
  3. * value
  4. *
  5. * @param etlKey
  6. * @return true if there exists more events
  7. * @throws IOException
  8. */
  9. public KafkaMessage getNext(EtlKey etlKey) throws IOException {
  10. if (hasNext()) {
  11. MessageAndOffset msgAndOffset = messageIter.next();
  12. Message message = msgAndOffset.message();
  13. byte[] payload = getBytes(message.payload());
  14. byte[] key = getBytes(message.key());
  15. if (payload == null) {
  16. log.warn("Received message with null message.payload(): " + msgAndOffset);
  17. }
  18. etlKey.clear();
  19. etlKey.set(kafkaRequest.getTopic(), kafkaRequest.getLeaderId(), kafkaRequest.getPartition(), currentOffset,
  20. msgAndOffset.offset() + 1, message.checksum());
  21. etlKey.setMessageSize(msgAndOffset.message().size());
  22. currentOffset = msgAndOffset.offset() + 1; // increase offset
  23. currentCount++; // increase count
  24. return new KafkaMessage(payload, key, kafkaRequest.getTopic(), kafkaRequest.getPartition(),
  25. msgAndOffset.offset(), message.checksum());
  26. } else {
  27. return null;
  28. }
  29. }

代码示例来源:origin: com.linkedin.camus/camus-etl-kafka

  1. public void validate() throws IOException {
  2. // check the checksum of message.
  3. Message readMessage;
  4. if (key == null){
  5. readMessage = new Message(payload);
  6. } else {
  7. readMessage = new Message(payload, key);
  8. }
  9. if (checksum != readMessage.checksum()) {
  10. throw new ChecksumException("Invalid message checksum : " + readMessage.checksum() + ". Expected " + checksum,
  11. offset);
  12. }
  13. }

代码示例来源:origin: HiveKa/HiveKa

  1. key.set(kafkaRequest.getTopic(), kafkaRequest.getLeaderId(),
  2. kafkaRequest.getPartition(), currentOffset,
  3. msgAndOffset.offset() + 1, message.checksum());

代码示例来源:origin: HiveKa/HiveKa

  1. Message messageWithoutKey = new Message(bytes);
  2. long checksum = key.getChecksum();
  3. if (checksum != messageWithKey.checksum() && checksum != messageWithoutKey.checksum()) {
  4. throw new ChecksumException("Invalid message checksum : MessageWithKey : "
  5. + messageWithKey.checksum() + " MessageWithoutKey checksum : "
  6. + messageWithoutKey.checksum()
  7. + ". Expected " + key.getChecksum(),
  8. key.getOffset());

代码示例来源:origin: com.linkedin.camus/camus-etl-kafka

  1. /**
  2. * Fetches the next Kafka message and stuffs the results into the key and
  3. * value
  4. *
  5. * @param etlKey
  6. * @return true if there exists more events
  7. * @throws IOException
  8. */
  9. public KafkaMessage getNext(EtlKey etlKey) throws IOException {
  10. if (hasNext()) {
  11. MessageAndOffset msgAndOffset = messageIter.next();
  12. Message message = msgAndOffset.message();
  13. byte[] payload = getBytes(message.payload());
  14. byte[] key = getBytes(message.key());
  15. if (payload == null) {
  16. log.warn("Received message with null message.payload(): " + msgAndOffset);
  17. }
  18. etlKey.clear();
  19. etlKey.set(kafkaRequest.getTopic(), kafkaRequest.getLeaderId(), kafkaRequest.getPartition(), currentOffset,
  20. msgAndOffset.offset() + 1, message.checksum());
  21. etlKey.setMessageSize(msgAndOffset.message().size());
  22. currentOffset = msgAndOffset.offset() + 1; // increase offset
  23. currentCount++; // increase count
  24. return new KafkaMessage(payload, key, kafkaRequest.getTopic(), kafkaRequest.getPartition(),
  25. msgAndOffset.offset(), message.checksum());
  26. } else {
  27. return null;
  28. }
  29. }

代码示例来源:origin: HomeAdvisor/Kafdrop

  1. private MessageVO createMessage(Message message, MessageDeserializer deserializer)
  2. {
  3. MessageVO vo = new MessageVO();
  4. if (message.hasKey())
  5. {
  6. vo.setKey(ByteUtils.readString(message.key()));
  7. }
  8. if (!message.isNull())
  9. {
  10. final String messageString = deserializer.deserializeMessage(message.payload());
  11. vo.setMessage(messageString);
  12. }
  13. vo.setValid(message.isValid());
  14. vo.setCompressionCodec(message.compressionCodec().name());
  15. vo.setChecksum(message.checksum());
  16. vo.setComputedChecksum(message.computeChecksum());
  17. return vo;
  18. }

相关文章