在dcos中安装flink时出错

2q5ifsrm  于 2021-06-25  发布在  Flink
关注(0)|答案(3)|浏览(511)

我在digitalocean上部署了DCO，配置如下

digitalocean_token = "***"

region = "fra1"

master_size = "4GB"

agent_size = "4GB"

boot_size = "4GB"

dcos_cluster_name = "digitalocean-dcos"

dcos_master_count = "1"

dcos_agent_count = "4"

dcos_public_agent_count = "1"

dcos_installer_url = "https://downloads.dcos.io/dcos/stable/dcos_generate_config.sh"

dcos_ssh_key_path = "./do-key"

dcos_ssh_public_key_path = "./do-key.pub"

ssh_key_fingerprint = "***"

通过gui和dcos cli安装flink都失败。
显然错误在于：

2017-07-29 17:10:05,553 ERROR org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  - Mesos JobManager initialization failed
java.net.UnknownHostException: digitalocean-dcos-agent-00: digitalocean-dcos-agent-00: Name or service not known
    at java.net.InetAddress.getLocalHost(InetAddress.java:1505)

复制自：flink--mesos-appmaster-digitalocean-dcos-agent-00.log

2017-07-29 17:10:04,930 WARN  org.apache.hadoop.util.NativeCodeLoader                       - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-07-29 17:10:05,223 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  - --------------------------------------------------------------------------------
2017-07-29 17:10:05,224 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  Starting Mesos AppMaster (Version: 1.3.1, Rev:1ca6e5b, Date:20.06.2017 @ 10:08:43 PDT)
2017-07-29 17:10:05,224 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  Current user: root
2017-07-29 17:10:05,224 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.111-b14
2017-07-29 17:10:05,224 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  Maximum heap size: 880 MiBytes
2017-07-29 17:10:05,224 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64/jre
2017-07-29 17:10:05,229 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  Hadoop version: 2.3.0
2017-07-29 17:10:05,229 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  JVM Options:
2017-07-29 17:10:05,229 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dlog.file=/mnt/mesos/sandbox/flink--mesos-appmaster-digitalocean-dcos-agent-00.log
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dlog4j.configuration=file:/flink-1.3.1/conf/log4j.properties
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dlogback.configurationFile=file:/flink-1.3.1/conf/logback.xml
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  Program Arguments:
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dblob.server.port=20262
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Djobmanager.heap.mb=256
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Djobmanager.rpc.port=20261
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Djobmanager.web.port=20260
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dmesos.artifact-server.port=20263
2017-07-29 17:10:05,230 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dmesos.initial-tasks=1
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dmesos.resourcemanager.tasks.cpus=1
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dmesos.resourcemanager.tasks.mem=1024
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dtaskmanager.heap.mb=512
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dtaskmanager.memory.preallocate=true
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dtaskmanager.numberOfTaskSlots=1
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dparallelism.default=1
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dmesos.resourcemanager.framework.role=*
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -     -Dsecurity.kerberos.login.use-ticket-cache=true
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  -  Classpath: /flink-1.3.1/lib/flink-python_2.10-1.3.1.jar:/flink-1.3.1/lib/flink-shaded-hadoop2-uber-1.3.1.jar:/flink-1.3.1/lib/log4j-1.2.17.jar:/flink-1.3.1/lib/slf4j-log4j12-1.7.7.jar:/flink-1.3.1/lib/flink-dist_2.10-1.3.1.jar::/etc/hadoop/conf/:
2017-07-29 17:10:05,231 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  - --------------------------------------------------------------------------------
2017-07-29 17:10:05,234 INFO  org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  - Registered UNIX signal handlers for [TERM, HUP, INT]
2017-07-29 17:10:05,252 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.master, zk://leader.mesos:2181/mesos
2017-07-29 17:10:05,252 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.failover-timeout, 60
2017-07-29 17:10:05,254 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.initial-tasks, 1
2017-07-29 17:10:05,254 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.container.type, mesos
2017-07-29 17:10:05,254 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.container.image.name, openjdk:8-jre
2017-07-29 17:10:05,255 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.cpus, 1
2017-07-29 17:10:05,255 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.mem, 1024
2017-07-29 17:10:05,257 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.rpc.port, 6123
2017-07-29 17:10:05,258 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.heap.mb, 256
2017-07-29 17:10:05,258 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.heap.mb, 512
2017-07-29 17:10:05,258 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2017-07-29 17:10:05,258 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.memory.preallocate, false
2017-07-29 17:10:05,258 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: parallelism.default, 1
2017-07-29 17:10:05,259 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.web.port, 8081
2017-07-29 17:10:05,306 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.master, zk://leader.mesos:2181/mesos
2017-07-29 17:10:05,307 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.failover-timeout, 60
2017-07-29 17:10:05,307 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.initial-tasks, 1
2017-07-29 17:10:05,307 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.container.type, mesos
2017-07-29 17:10:05,307 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.container.image.name, openjdk:8-jre
2017-07-29 17:10:05,307 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.cpus, 1
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: mesos.resourcemanager.tasks.mem, 1024
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.rpc.port, 6123
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.heap.mb, 256
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.heap.mb, 512
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.numberOfTaskSlots, 1
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.memory.preallocate, false
2017-07-29 17:10:05,308 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: parallelism.default, 1
2017-07-29 17:10:05,309 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.web.port, 8081
2017-07-29 17:10:05,402 INFO  org.apache.flink.runtime.security.modules.HadoopModule        - Hadoop user set to root (auth:SIMPLE)
2017-07-29 17:10:05,553 ERROR org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner  - Mesos JobManager initialization failed
java.net.UnknownHostException: digitalocean-dcos-agent-00: digitalocean-dcos-agent-00: Name or service not known
    at java.net.InetAddress.getLocalHost(InetAddress.java:1505)
    at org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner.runPrivileged(MesosApplicationMasterRunner.java:216)
    at org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner$1.call(MesosApplicationMasterRunner.java:181)
    at org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner$1.call(MesosApplicationMasterRunner.java:178)
    at org.apache.flink.runtime.security.HadoopSecurityContext$1.run(HadoopSecurityContext.java:43)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
    at org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:40)
    at org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner.run(MesosApplicationMasterRunner.java:178)
    at org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner.main(MesosApplicationMasterRunner.java:139)
Caused by: java.net.UnknownHostException: digitalocean-dcos-agent-00: Name or service not known
    at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
    at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
    at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
    at java.net.InetAddress.getLocalHost(InetAddress.java:1500)
    ... 10 more

日志（这是无限循环）

+ '[' '' '!=' '' ']'
+ add_mesos_configurations
++ hostname -f
hostname: Name or service not known
+ add_if_non_empty jobmanager.rpc.address
+ '[' -n '' ']'
+ add_if_non_empty mesos.resourcemanager.framework.role '*'
+ '[' -n '*' ']'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=*'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=*'
+ add_if_non_empty mesos.resourcemanager.framework.principal ''
+ '[' -n '' ']'
+ add_if_non_empty mesos.resourcemanager.framework.secret ''
+ '[' -n '' ']'
+ add_ssl_configurations
+ [[ '' == true ]]
+ add_kerberos_configurations
+ add_if_non_empty security.kerberos.login.use-ticket-cache true
+ '[' -n true ']'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=* -Dsecurity.kerberos.login.use-ticket-cache=true'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=* -Dsecurity.kerberos.login.use-ticket-cache=true'
+ '[' '' '!=' '' ']'
+ add_if_non_empty security.kerberos.login.principal ''
+ '[' -n '' ']'
+ [[ '' != '' ]]
+ update_log_level
+ [[ INFO != '' ]]
+ sed -ie 's/log4j.rootLogger=INFO, file/log4j.rootLogger=INFO, file/g' /flink-1.3.1/conf/log4j.properties
+ exec /flink-1.3.1/bin/mesos-appmaster.sh -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 '-Dmesos.resourcemanager.framework.role=*' -Dsecurity.kerberos.login.use-ticket-cache=true
+ FLINK_SECURITY_DIR=/etc/security/flink
+ mkdir -p /etc/security/flink
+ export APPLICATION_WEB_PROXY_BASE=/service/flink
+ APPLICATION_WEB_PROXY_BASE=/service/flink
+ add_flink_configurations
+ export FLINK_JAVA_OPTS=
+ FLINK_JAVA_OPTS=
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1'
+ '[' '' '!=' '' ']'
+ add_mesos_configurations
++ hostname -f
hostname: Name or service not known
+ add_if_non_empty jobmanager.rpc.address
+ '[' -n '' ']'
+ add_if_non_empty mesos.resourcemanager.framework.role '*'
+ '[' -n '*' ']'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=*'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=*'
+ add_if_non_empty mesos.resourcemanager.framework.principal ''
+ '[' -n '' ']'
+ add_if_non_empty mesos.resourcemanager.framework.secret ''
+ '[' -n '' ']'
+ add_ssl_configurations
+ [[ '' == true ]]
+ add_kerberos_configurations
+ add_if_non_empty security.kerberos.login.use-ticket-cache true
+ '[' -n true ']'
+ export 'FLINK_JAVA_OPTS= -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=* -Dsecurity.kerberos.login.use-ticket-cache=true'
+ FLINK_JAVA_OPTS=' -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 -Dmesos.resourcemanager.framework.role=* -Dsecurity.kerberos.login.use-ticket-cache=true'
+ '[' '' '!=' '' ']'
+ add_if_non_empty security.kerberos.login.principal ''
+ '[' -n '' ']'
+ [[ '' != '' ]]
+ update_log_level
+ [[ INFO != '' ]]
+ sed -ie 's/log4j.rootLogger=INFO, file/log4j.rootLogger=INFO, file/g' /flink-1.3.1/conf/log4j.properties
+ exec /flink-1.3.1/bin/mesos-appmaster.sh -Dblob.server.port=20262 -Djobmanager.heap.mb=256 -Djobmanager.rpc.port=20261 -Djobmanager.web.port=20260 -Dmesos.artifact-server.port=20263 -Dmesos.initial-tasks=1 -Dmesos.resourcemanager.tasks.cpus=1 -Dmesos.resourcemanager.tasks.mem=1024 -Dtaskmanager.heap.mb=512 -Dtaskmanager.memory.preallocate=true -Dtaskmanager.numberOfTaskSlots=1 -Dparallelism.default=1 '-Dmesos.resourcemanager.framework.role=*' -Dsecurity.kerberos.login.use-ticket-cache=true

我得到一个持续运行的“部署1的1”与状态不健康。
另一方面，安装kafka和redis等其他软件包也取得了成功。

apache-flinkdcosdigital-ocean

3条答案

按热度按时间
at0kjp5o

at0kjp5o1#

我在进行内部安装时也遇到了类似的错误。原来centos 7在安装过程中没有将其主机名添加到/etc/hosts文件中。我只需要加一行

127.0.0.1 myhostname

或者将主机名添加到该行（如果已经存在）
马上就开始工作了

赞(0）分享  回复(0）举报  2021-06-25
8qgya5xd

8qgya5xd2#

此问题在aws故障排除下进行了说明。虽然可以适应数字海洋。
引用上面的链接：
存在这样一种情况，即jobmaster无法解析其主机名。这会导致启动的taskmanager容器永远不会与jobmanager通信，并且集群永远不会进入就绪状态。日志中包含类似于

2017-07-29 17:10:05,553 ERROR org.apache.flink.mesos.runtime.clusterframework.MesosApplicationMasterRunner - Mesos JobManager initialization failed
java.net.UnknownHostException: agentname: agentname: Name or service not known
at java.net.InetAddress.getLocalHost(InetAddress.java:1505)

这可以通过在vpc中为代理启用“dns主机名”支持来解决。

aws ec2 modify-vpc-attribute --vpc-id vpc-a01106c2 --enable-dns-hostnames "{\"Value\":true}"
赞(0）分享  回复(0）举报  2021-06-25
tkqqtvp1

tkqqtvp13#

我相信这是由于dcos-flink包中的一个bug导致的，这个bug是几天前修复的。
修复：将jobmanger.rpc.address设置为当前主机
假设修复程序尚未部署到您的dcos领域。

赞(0）分享  回复(0）举报  2021-06-25
我来回答

相关问题

    查看更多

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新问答

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com