jobtracker api error-localhost/127.0.0.1:50030本地异常调用失败：java.io.eofexception

qxgroojn 于 2021-06-03 发布在 Hadoop

关注(0)|答案(1)|浏览(269)

我正在尝试用java连接我的jobtracker。
下面显示的是我试图执行的程序

public static void main(String args[]) throws IOException {

            Configuration conf = new Configuration();
            conf.addResource(new Path(
                    "/home/user/hadoop-1.0.3/conf/core-site.xml"));
            conf.addResource(new Path(
                    "/home/user/hadoop-1.0.3/conf/hdfs-site.xml"));
            conf.addResource(new Path(
                    "/home/user/hadoop-1.0.3/conf/mapred-site.xml"));

            InetSocketAddress jobtracker = new InetSocketAddress("localhost", 50030);
            JobClient jobClient = new JobClient(jobtracker, conf);
            jobClient.setConf(conf);
            JobStatus[] jobs = jobClient.jobsToComplete();

            for (int i = 0; i < jobs.length; i++) {
                JobStatus js = jobs[i];
                if (js.getRunState() == JobStatus.RUNNING) {
                    JobID jobId = js.getJobID();
                    System.out.println(jobId);
                }
            }

这是我得到的例外。即使我尝试用127.0.0.1替换localhost，它也不起作用。同样的错误。

Exception in thread "main" java.io.IOException: Call to localhost/127.0.0.1:50030 failed on local exception: java.io.EOFException
        at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
        at org.apache.hadoop.ipc.Client.call(Client.java:1075)
        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
        at org.apache.hadoop.mapred.$Proxy1.getProtocolVersion(Unknown Source)
        at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396)
        at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379)
        at org.apache.hadoop.mapred.JobClient.createRPCProxy(JobClient.java:480)
        at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:534)
        at com.tcs.nextgen.searchablemetadata.executor.factory.JobChecker.main(JobChecker.java:34)
    Caused by: java.io.EOFException
        at java.io.DataInputStream.readInt(DataInputStream.java:375)
        at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:811)
        at org.apache.hadoop.ipc.Client$Connection.run(Client.java:749)

我添加了所有与hadoop相关的jar。我不明白为什么“/”出现在localhost/127.0.0.1:50030之间

Java hadoop hdfs mapreduce

来源：https://stackoverflow.com/questions/12813365/jobtracker-api-error-call-to-localhost-127-0-0-150030-failed-on-local-excepti

1条答案

按热度按时间

mwg9r5ms1#

您是否尝试了实际的jobtracker端口号，而不是http端口（50030）。
请尝试下面的$hadoop\u home/conf/mapred-site.xml中列出的端口号 mapred.job.tracker 财产。这是我的伪mapred-site.xml配置文件

<property>
    <name>mapred.job.tracker</name>
    <value>localhost:9001</value>
</property>

如果你看看 JobTracker.getAddress(Configuration) 方法，如果不显式指定jobtracker主机/端口，则可以看到它使用此属性：

public static InetSocketAddress getAddress(Configuration conf) {
  String jobTrackerStr =
    conf.get("mapred.job.tracker", "localhost:8012");
  return NetUtils.createSocketAddr(jobTrackerStr);
}

赞(0）回复(0）举报 2021-06-03

我来回答

jobtracker api error-localhost/127.0.0.1:50030本地异常调用失败：java.io.eofexception

1条答案

相关问题

热门标签

最新问答