Flume中的hdfs io错误

qcbq4gxm  于 2021-06-03  发布在  Flume
关注(0)|答案(1)|浏览(368)

我正在尝试使用flume将一个文件从windows计算机加载到hdfs。
我得到以下错误:

  1. 12:42:02 WARN hdfs.HDFSEventSink: HDFS IO error
  2. java.io.IOException: Incomplete HDFS URI, no host: hdfs://10.74.xxx.217:9000:/user/urmi/FlumeData.1374649892113
  3. at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:118)
  4. at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2150)
  5. at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:80)
  6. at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2184)
  7. at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2166)
  8. at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:302)
  9. at org.apache.hadoop.fs.Path.getFileSystem(Path.java:194)
  10. at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:123)
  11. at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:183)
  12. at org.apache.flume.sink.hdfs.HDFSEventSink$1.doCall(HDFSEventSink.java:432)
  13. at org.apache.flume.sink.hdfs.HDFSEventSink$1.doCall(HDFSEventSink.java:429)
  14. at org.apache.flume.sink.hdfs.HDFSEventSink$ProxyCallable.call(HDFSEventSink.java:164)
  15. at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
  16. at java.util.concurrent.FutureTask.run(FutureTask.java:138)
  17. at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
  18. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
  19. at java.lang.Thread.run(Thread.java:662)
lf5gs5x2

lf5gs5x21#

url中的端口号后面还有一个冒号(:)。所以正确的网址应该是
hdfs://10.74.162.217:9000/

相关问题