无法启动tasktracker因为java.lang.illegalargumentexception:不包含有效的host:port authority:

rjzwgtxy  于 2021-06-03  发布在  Hadoop
关注(0)|答案(1)|浏览(437)

编辑了mapred site.xml、core site.xml、hadoop env.sh、hdfs site.xml、masters和slaves。
我有1个datanode和2个namenodes。它们都已成功启动,我可以在浏览器中看到它。启动start-mapred.sh,并在namenode上启动jobtracker和tasktracker,但无法在datanaode上启动tasktracker。
已启动tasktracker,下面是输出。

->hadoop tasktracker
Warning: $HADOOP_HOME is deprecated.

13/10/17 03:21:55 INFO mapred.TaskTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting TaskTracker
STARTUP_MSG:   host = tintin/10.193.184.157
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 1.1.2
STARTUP_MSG:   build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.1 -r 1440782; compiled by 'hortonf                                                      o' on Thu Jan 31 02:03:24 UTC 2013

************************************************************/

13/10/17 03:21:55 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
13/10/17 03:21:55 INFO impl.MetricsSourceAdapter: MBean for source MetricsSystem,sub=Stats registered.
13/10/17 03:21:55 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
13/10/17 03:21:55 INFO impl.MetricsSystemImpl: TaskTracker metrics system started
13/10/17 03:21:55 INFO util.NativeCodeLoader: Loaded the native-hadoop library
13/10/17 03:21:55 INFO impl.MetricsSourceAdapter: MBean for source ugi registered.
13/10/17 03:21:55 WARN impl.MetricsSystemImpl: Source name ugi already exists!
13/10/17 03:21:55 ERROR mapred.TaskTracker: Can not start task tracker because java.lang.IllegalArgumentException: Does no                                                      t contain a valid host:port authority:
10.193.184.132:54311   

at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:149)
    at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:130)
    at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:2312)
    at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1532)
    at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3906)

13/10/17 03:21:55 INFO mapred.TaskTracker: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker at tintin/10.193.184.157

************************************************************/
envsm3lx

envsm3lx1#

虽然回答这个问题已经很晚了,但是mapred-site.xml是否仍然包含mapred.job.tracker属性?
我的作业跟踪器运行在8021上,因此配置如下:

<configuration>
<property>
<name>mapred.job.tracker</name>
<value>http://localhost:8021</value>
</property>
</configuration>

我面临这样一个问题,因为缺少属性。

相关问题