从eclipe ide运行flink程序时出现异常

58wvjzkj  于 2021-06-25  发布在  Flink
关注(0)|答案(1)|浏览(648)

这个问题在这里已经有答案了

从ide独立运行的本地flink配置(3个答案)
三年前关门了。
从eclipse运行flink程序时出现以下异常:

Caused by: java.io.IOException: Insufficient number of network buffers: required 8, but only 4 available. The total number of network buffers is currently set to 2048. You can increase this number by setting the configuration key 'taskmanager.network.numberOfBuffers'.
    at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:196)
    at org.apache.flink.runtime.io.network.NetworkEnvironment.registerTask(NetworkEnvironment.java:173)
    at org.apache.flink.runtime.taskmanager.Task.run(Task.java:577)
    at java.lang.Thread.run(Thread.java:745)

文件(https://ci.apache.org/projects/flink/flink-docs-release-1.3/setup/config.html#configuring-网络缓冲区)表示网络缓冲区的数量可以通过 conf/flink-conf.yaml . 但在ide中运行程序时,如何更改它还不清楚。
感谢您的帮助!

yftpprvb

yftpprvb1#

通过使用配置对象创建执行环境解决了这个问题

Configuration cfg = new Configuration();
int defaultLocalParallelism = Runtime.getRuntime().availableProcessors();
cfg.setString("taskmanager.network.numberOfBuffers", "3000");
env = StreamExecutionEnvironment.createLocalEnvironment(defaultLocalParallelism, cfg);

相关问题