这是我运行mapreduce作业时从计数器得到的结果。
如何在终端上显示cpu时间、物理内存(字节)、虚拟内存(字节)等其他计数器?
文件系统计数器
FILE: Number of bytes read=615414
FILE: Number of bytes written=1469792
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=7948610
HDFS: Number of bytes written=216734
HDFS: Number of read operations=13
HDFS: Number of large read operations=0
HDFS: Number of write operations=4
map-reduce框架
Map input records=32562
Map output records=488415
Map output bytes=5927964
Map output materialized bytes=304438
Input split bytes=110
Combine input records=488415
Combine output records=22055
Reduce input groups=22055
Reduce shuffle bytes=304438
Reduce input records=22055
Reduce output records=22055
Spilled Records=44110
Shuffled Maps =1
Failed Shuffles=0
Merged Map outputs=1
GC time elapsed (ms)=346
Total committed heap usage (bytes)=554172416
洗牌错误
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
文件输入格式计数器
Bytes Read=3974305
文件输出格式计数器
Bytes Written=216734
谢谢你的关注。
暂无答案!
目前还没有任何答案,快来回答吧!