配置单元查询失败,出现blockmissingexception和死数据节点

p8ekf7hl  于 2021-06-24  发布在  Hive
关注(0)|答案(0)|浏览(320)

配置单元查询失败 BlockMissingException 我发现的根本原因是包含块的数据节点死了。那么,为什么datanode会死机,我该如何修复它呢?
配置单元查询失败

org.apache.tez.dag.app.dag.impl.AMUserCodeException: 
org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BLOCK_ABC123 file=/FILELOCATION

Yarn应用程序日志

Could not obtain BLOCK_ABC123 from any node:  
No live nodes contain current block Block locations: 
DatanodeInfoWithStorage[10.100.0.0:30010,DS-dd009c-568-da4b8a661,DISK] 
DatanodeInfoWithStorage[10.100.0.1:30010,DS-db8b97f-3dfsg43ser34,DISK] 
Dead nodes: 
DatanodeInfoWithStorage[10.100.0.0:30010,DS-dd009c-568-da4b8a661,DISK] 
DatanodeInfoWithStorage[10.100.0.1:30010,DS-db8b97f-3dfsg43ser34,DISK]. Will get new block locations from namenode and retry...

datanode也出现了,但我不确定这是否相关。

Xceiver count 1025 exceeds the limit of concurrent xcievers: 1024

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题