在clouderacdh5.10中哪里可以找到hadoop日志,以及如何使用flume将这些(hadoop节点日志)加载到hdfs中

bxfogqkk  于 2021-06-01  发布在  Hadoop
关注(0)|答案(0)|浏览(269)

到目前为止,我能找到的只有这个,在/var/log/hadoop目录中,我能看到下面的.out和.log文件。但我不确定这些是否真的被称为hadoop日志文件,我需要加载到hdfs中。如果这些是我们所说的hadoop日志文件,那么什么样的.conf文件能够成功地将它们加载到hdfs中呢。

[cloudera@quickstart /]$ cd /var/log/hadoop-yarn
[cloudera@quickstart hadoop-yarn]$ ls -lart
total 2684
-rw-r--r--   1 yarn yarn       704 Nov  3 12:40 yarn-yarn-nodemanager-quickstart.cloudera.out.2
-rw-r--r--   1 yarn yarn       704 Nov  3 12:40 yarn-yarn-proxyserver-quickstart.cloudera.out.2
-rw-r--r--   1 yarn yarn       704 Nov  3 12:40 yarn-yarn-resourcemanager-quickstart.cloudera.out.2
-rw-r--r--   1 yarn yarn       704 Nov  4 01:40 yarn-yarn-nodemanager-quickstart.cloudera.out.1
-rw-r--r--   1 yarn yarn       704 Nov  4 01:40 yarn-yarn-proxyserver-quickstart.cloudera.out.1
-rw-r--r--   1 yarn yarn       704 Nov  4 01:40 yarn-yarn-resourcemanager-quickstart.cloudera.out.1
-rw-r--r--   1 yarn yarn       704 Nov  4 01:50 yarn-yarn-nodemanager-quickstart.cloudera.out
-rw-r--r--   1 yarn yarn       704 Nov  4 01:50 yarn-yarn-proxyserver-quickstart.cloudera.out
-rw-r--r--   1 yarn yarn     72615 Nov  4 01:50 yarn-yarn-proxyserver-quickstart.cloudera.log
-rw-r--r--   1 yarn yarn       704 Nov  4 01:50 yarn-yarn-resourcemanager-quickstart.cloudera.out
drwxr-xr-x   2 yarn yarn      4096 Nov  4 01:52 containers
-rw-r--r--   1 yarn yarn    116956 Nov  4 01:54 yarn-yarn-resourcemanager-quickstart.cloudera.log
-rw-r--r--   1 yarn yarn    105950 Nov  4 01:54 yarn-yarn-nodemanager-quickstart.cloudera.log
drwxr-xr-x   2 yarn hadoop    4096 Nov  4 10:28 stacks
drwxrwxr-x   5 yarn hadoop    4096 Nov  4 10:28 .
drwxr-xr-x. 41 root root      4096 Dec  4 08:46 ..
-rw-r--r--   1 yarn yarn   1710159 Dec  4 10:14 hadoop-cmf-yarn-NODEMANAGER-quickstart.cloudera.log.out
drwxr-xr-x   2 yarn hadoop    4096 Dec  4 10:46 container
-rw-r--r--   1 yarn yarn    671383 Dec  4 10:46 hadoop-cmf-yarn-RESOURCEMANAGER-quickstart.cloudera.log.out
[cloudera@quickstart hadoop-yarn]$

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题