1.我的 namenode
日志总是打印错误日志 java.io.IOException: Requested data length 113675682 is longer than maximum configured RPC length 67108864. RPC came from 172.16..
以及 datanode
印刷品 Unsuccessfully sent block report 0x706cd6d00df0effe, containing 1 storage report(s), of which we sent 0. The reports had 9016550 total blocks and used 0 RPC(s). This took 1734 msec to generate and 252 msecs for RPC and NN processing. Got back no commands
2.我设置 ipc.maximum.data.length
到134217728解决了问题,但不幸的是,我发现设置长度后,我的 hdfs
客户机通常无法写入数据,但每次只需几分钟 namenode
当客户端无法写入时抛出新异常, DatanodeProtocol.blockReport from 172.16..:43410 Call#30074227 Retry#0 java.lang.IllegalStateException: com.google.protobuf.InvalidProtocolBufferException: Protocol message was too large. May be malicious. Use CodedInputStream.setSizeLimit() to increase the size limit.
就像参考hdfs-5153一样,它说namesystem写锁在这段时间内保持`
我必须破解protobuf jar并设置限制?
编辑:
我发现了同样的问题,但没有解决办法
暂无答案!
目前还没有任何答案,快来回答吧!