没有磁盘空间分配给HDFS文件系统

我尝试在我的本地机器上设置Hadoop。但是，当我运行基于map reduce的wordcount示例时（* 我之前做了hdfs namenode -format *）：

这可能很难阅读，但我最终得到一个 “作业失败，状态为失败，原因是：由于AM Container退出，应用程序失败2次，退出代码为：-1000此尝试失败。诊断：任何本地目录中都没有可用空间。"
我不明白为什么我有这样的错误。这是我的申请和尝试看起来像：

我学习了几个教程，最后得到了这些参数：
Map站点. xml：

configuration>
   <property>
     <name>mapreduce.framework.name</name>
     <value>yarn</value>
   </property>
</configuration>

网站名称：

<configuration>

<!-- Site specific YARN configuration properties -->
 <property>
 <name>yarn.nodemanager.aux-services</name>
 <value>mapreduce_shuffle</value>
 </property>
 <property>
 <name>yarn.nodemanager.auxservices.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
 </property>
 <property>
 <name>yarn.nodemanager.disk-health-checker.enable</name>
 <value>false</value>
 </property>
  <property>
       <name>yarn.application.classpath</name>
       <value>
            %HADOOP_HOME%\etc\hadoop,
            %HADOOP_HOME%\share\hadoop\common\*,
            %HADOOP_HOME%\share\hadoop\common\lib\*,
            %HADOOP_HOME%\share\hadoop\hdfs\*,
            %HADOOP_HOME%\share\hadoop\hdfs\lib\*,
            %HADOOP_HOME%\share\hadoop\mapreduce\*,
            %HADOOP_HOME%\share\hadoop\mapreduce\lib\*,
            %HADOOP_HOME%\share\hadoop\yarn\*,
            %HADOOP_HOME%\share\hadoop\yarn\lib\*
       </value>
    </property>
 
</configuration>

核心站点. xml：

<configuration>
 <property>
 <name>fs.default.name</name>
 <value>hdfs://localhost:9000</value>
 </property>
</configuration>

hdfs-site.xml文件：

<configuration>
 <property>
<name>dfs.replication</name>
 <value>1</value>
 </property>
 <property>
 <name>dfs.namenode.name.dir</name>
 <value>file:///C:/hadoop-3.3.0/data/namenode</value>
 </property>
 <property>
 <name>dfs.datanode.data.dir</name>
 <value>file:///C:/hadoop-3.3.0/data/datanode</value>
 </property>
</configuration>

你能帮我一下吗？我已经试过这些问题中提到的：

Hadoop errorcode -1000, No space available in any of the local directories，除了名称节点清空缓存部分。
Hadoop Windows setup. Error while running WordCountJob: "No space available in any of the local directories"

你觉得怎么样？
谢谢大家！

WARNING: Use "yarn jar" to launch YARN applications. 23/01/14 16:31:01 INFO utils.FileUtils: BLANK_LINE_NOT_ADDING_LINE_:4 23/01/14 16:31:01 INFO client.RMProxy: Connecting to ResourceManager at hp8300one/10.0.0.3:8032 23/01/14 16:31:02 INFO client.RMProxy: Connecting to ResourceManager at hp8300one/10.0.0.3:8032 23/01/14 16:31:02 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 23/01/14 16:31:02 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /user/sanjay/.staging/job_1673158307170_0002 23/01/14 16:31:03 INFO mapred.FileInputFormat: Total input files to process : 3 23/01/14 16:31:03 INFO net.NetworkTopology: Adding a new node: /default/10.0.0.3:9866 23/01/14 16:31:03 INFO net.NetworkTopology: Adding a new node: /default/10.0.0.4:9866 23/01/14 16:31:03 INFO net.NetworkTopology: Adding a new node: /default/10.0.0.161:9866 23/01/14 16:31:03 INFO mapreduce.JobSubmitter: number of splits:4 23/01/14 16:31:03 INFO Configuration.deprecation: yarn.resourcemanager.system-metrics-publisher.enabled is deprecated. Instead, use yarn.system-metrics-publisher.enabled 23/01/14 16:31:03 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1673158307170_0002 23/01/14 16:31:03 INFO mapreduce.JobSubmitter: Executing with tokens: [] 23/01/14 16:31:03 INFO conf.Configuration: resource-types.xml not found 23/01/14 16:31:03 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'. 23/01/14 16:31:03 INFO impl.YarnClientImpl: Submitted application application_1673158307170_0002 23/01/14 16:31:03 INFO mapreduce.Job: The url to track the job: http://hp8300one:8088/proxy/application_1673158307170_0002/ 23/01/14 16:31:03 INFO mapreduce.Job: Running job: job_1673158307170_0002 23/01/14 16:31:05 INFO mapreduce.Job: Job job_1673158307170_0002 running in uber mode : false 23/01/14 16:31:05 INFO mapreduce.Job: map 0% reduce 0% 23/01/14 16:31:05 INFO mapreduce.Job: Job job_1673158307170_0002 failed with state FAILED due to: Application application_1673158307170_0002 failed 2 times due to AM Container for appattempt_1673158307170_0002_000002 exited with exitCode: -1000 Failing this attempt.Diagnostics: [2023-01-14 16:31:05.401]No space available in any of the local directories. For more detailed output, check the application tracking page: http://hp8300one:8088/cluster/app/application_1673158307170_0002 Then click on links to logs of each attempt. . Failing the application. 23/01/14 16:31:05 INFO mapreduce.Job: Counters: 0 Exception in thread "main" java.io.IOException: Job failed! at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:876) at com.bbscima.utils.AersLoader.main(AersLoader.java:82) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:313) at org.apache.hadoop.util.RunJar.main(RunJar.java:227)

没有磁盘空间分配给HDFS文件系统

1条答案

相关问题

热门标签

最新问答