flume将hadoop与slf4j冲突:类路径包含多个slf4j绑定

vatpfxk5  于 2021-06-02  发布在  Hadoop
关注(0)|答案(1)|浏览(886)

每次启动flume时,我都会在flume、hive和hadoop之间收到这些消息。避免这种情况的最佳方法是什么?我想从flume lib目录中删除一个jar,但不确定这是否会影响其他jar(hive、hadoop)。

Info: Sourcing environment configuration script /usr/local/flume/conf/flume-env.sh
Info: Including Hadoop libraries found via (/usr/local/hadoop/bin/hadoop) for HDFS access
+ exec /usr/java/jdk1.7.0_79/bin/java -Xms100m -Xmx200m -Dcom.sun.management.jmxremote -cp '/usr/local/flume/conf:/usr/local/flume/lib/*:/usr/local/hadoop/etc/hadoop:/usr/local/hadoop/share/hadoop/common/lib/*:/usr/local/hadoop/share/hadoop/common/*:/usr/local/hadoop/share/hadoop/hdfs:/usr/local/hadoop/share/hadoop/hdfs/lib/*:/usr/local/hadoop/share/hadoop/hdfs/*:/usr/local/hadoop/share/hadoop/yarn/lib/*:/usr/local/hadoop/share/hadoop/yarn/*:/usr/local/hadoop/share/hadoop/mapreduce/lib/*:/usr/local/hadoop/share/hadoop/mapreduce/*:/usr/local/hadoop/contrib/capacity-scheduler/*.jar' -Djava.library.path=:/usr/local/hadoop/lib/native org.apache.flume.node.Application --conf-file /usr/local/flume/conf/spooling3.properties --name agent1
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/flume/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
lhcgjxsq

lhcgjxsq1#

您提到的日志消息可能被视为“普通警告消息”(没有错误。)
如果你看看https://issues.apache.org/jira/browse/flume-2913 ,你可以看到一些进一步的解释。
apache flume的类路径构造方式如下: bin/flume-ng bash脚本从hbase和hdfs收集所有类路径,并将它们与flume自己的类路径相结合。
如果任何地方有不同的slf4j jar,您将看到警告。

相关问题