为什么我的cpu时间和其他计数器没有出现[hadoop 2.7.1版]

dy1byipe  于 2021-06-02  发布在  Hadoop
关注(0)|答案(0)|浏览(236)

这是我运行mapreduce作业时从计数器得到的结果。
如何在终端上显示cpu时间、物理内存(字节)、虚拟内存(字节)等其他计数器?
文件系统计数器

FILE: Number of bytes read=615414

    FILE: Number of bytes written=1469792

    FILE: Number of read operations=0

    FILE: Number of large read operations=0

    FILE: Number of write operations=0

    HDFS: Number of bytes read=7948610

    HDFS: Number of bytes written=216734

    HDFS: Number of read operations=13

    HDFS: Number of large read operations=0

    HDFS: Number of write operations=4

map-reduce框架

Map input records=32562

    Map output records=488415

    Map output bytes=5927964

    Map output materialized bytes=304438

    Input split bytes=110

    Combine input records=488415

    Combine output records=22055

    Reduce input groups=22055

    Reduce shuffle bytes=304438

    Reduce input records=22055

    Reduce output records=22055

    Spilled Records=44110

    Shuffled Maps =1

    Failed Shuffles=0

    Merged Map outputs=1

    GC time elapsed (ms)=346

    Total committed heap usage (bytes)=554172416

洗牌错误

BAD_ID=0

    CONNECTION=0

    IO_ERROR=0

    WRONG_LENGTH=0

    WRONG_MAP=0

    WRONG_REDUCE=0

文件输入格式计数器

Bytes Read=3974305

文件输出格式计数器

Bytes Written=216734

谢谢你的关注。

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题