我知道企业(例如cloudera)的方式,通过使用cm(通过浏览器)或clouderarestapi可以访问监视和配置设施。但是如何调度(运行和重新运行)flume代理livecycle,并在没有cm的情况下监视它们的运行/失败状态呢?Flume分布中有这样的东西吗?
hmmo2u0o1#
flume的json报告api可以用来监视运行状况和性能。链接
uoifb46i2#
我试着添加 flume.monitoring.type/port 至 flume-ng 开始时。完全符合我的需要。让我们创建一个简单的代理 a1 例如。哪个在听 localhost:44444 并作为接收器登录到控制台:
flume.monitoring.type/port
flume-ng
a1
localhost:44444
# flume.conf a1.sources = s1 a1.channels = c1 a1.sinks = d1 a1.sources.s1.channels = c1 a1.sources.s1.type = netcat a1.sources.s1.bind = localhost a1.sources.s1.port = 44444 a1.sinks.d1.channel = c1 a1.sinks.d1.type = logger a1.channels.c1.type = memory a1.channels.c1.capacity = 100 a1.channels.c1.transactionCapacity = 10
使用其他参数运行它 flume.monitoring.type/port :
flume-ng agent -n a1 -c conf -f flume.conf -Dflume.root.logger=INFO,console -Dflume.monitoring.type=http -Dflume.monitoring.port=44123
然后在浏览器中监视 localhost:44123/metrics ```{"CHANNEL.c1":{"ChannelCapacity":"100","ChannelFillPercentage":"0.0","Type":"CHANNEL","EventTakeSuccessCount":"570448","ChannelSize":"0","EventTakeAttemptCount":"570573","StartTime":"1567002601836","EventPutAttemptCount":"570449","EventPutSuccessCount":"570448","StopTime":"0"}}
localhost:44123/metrics
试试看:
dd if=/dev/urandom count=1024 bs=1024 | base64 | nc localhost 44444
2条答案
按热度按时间hmmo2u0o1#
flume的json报告api可以用来监视运行状况和性能。链接
uoifb46i2#
我试着添加
flume.monitoring.type/port
至flume-ng
开始时。完全符合我的需要。让我们创建一个简单的代理
a1
例如。哪个在听localhost:44444
并作为接收器登录到控制台:使用其他参数运行它
flume.monitoring.type/port
:然后在浏览器中监视
localhost:44123/metrics
```{"CHANNEL.c1":{"ChannelCapacity":"100","ChannelFillPercentage":"0.0","Type":"CHANNEL","EventTakeSuccessCount":"570448","ChannelSize":"0","EventTakeAttemptCount":"570573","StartTime":"1567002601836","EventPutAttemptCount":"570449","EventPutSuccessCount":"570448","StopTime":"0"}}
dd if=/dev/urandom count=1024 bs=1024 | base64 | nc localhost 44444