hadoop作业和任务跟踪器不工作

3htmauhk  于 2021-06-03  发布在  Hadoop
关注(0)|答案(1)|浏览(323)

当我启动hadoop作业跟踪器和任务跟踪器不工作。
我在用两台电脑工作。主人-furkanb@master 192.168.2.135和从属-detay@slave 192.168.2.250.
xml和hosts文件在两台计算机上相同。
我已经写信给jps控制台了。

日本

15568 jps 12126辅助名称节点11812名称节点11934数据节点12314资源管理器
我的主机文件

/etc/主机

127.0.0.1本地主机
127.0.1.1 ubuntu.ubuntu-domain ubuntu
192.168.2.135主机
192.168.2.250从机

core-site.xml文件

<configuration>

<property>
   <name>fs.default.name</name>
   <value>hdfs://master:54310</value>
</property>

</configuration>

hdfs-site.xml文件

<configuration>
<property>
   <name>dfs.replication</name>
   <value>2</value>
</property>
</configuration>

mapred-site.xml文件

<configuration>

<property>
   <name>mapred.job.tracker</name>
   <value>master:54311</value>
</property>

<property>
   <name>mapreduce.framework.name</name>
   <value>yarn</value>
</property>

</configuration>

yarn-site.xml文件

<configuration>
 <property>
 <name>yarn.nodemanager.aux-services</name>
 <value>mapreduce.shuffle</value>
 </property>
 <property>
 <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
 <value>org.apache.hadoop.mapred.ShuffleHandler</value>
 </property>
</configuration>

主机:
/etc/hadoop/mastersfurkanb@master
/etc/hadoop/从机furkanb@master detay@slave
从机:
/etc/hadoop/slaves本地主机
在控制台上编写start-all.sh时:

This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
14/04/09 14:52:58 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [master]
master: starting namenode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-namenode-master.out
furkanb@master: starting datanode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-datanode-master.out
detay@slave: starting datanode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-detay-datanode-slave.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-secondarynamenode-master.out
14/04/09 14:53:19 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
starting yarn daemons
starting resourcemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-furkanb-resourcemanager-master.out
furkanb@master: starting nodemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-furkanb-nodemanager-master.out
detay@slave: starting nodemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-detay-nodemanager-slave.out

我够得着localhost:50070 and master:50070. 但我够不着localhost:50030 or master:50030

ha5z0ras

ha5z0ras1#

您使用的是Yarn而不是经典的mapreduce。你在这里找不到jobtracker。要检查正在运行的应用程序的状态,需要使用资源管理器的http端口。工业工程师8088
查看以下urllocalhost:8088

相关问题