开放式遥测-生 rust ：增加批处理OtlpTracePipeline的通道大小

cbeh67ev 于 2022-11-12 发布在其他

关注(0)|答案(1)|浏览(172)

是否可以增加OpenTelemetry span批处理器的通道大小？
我目前在高流量情况下收到OpenTelemetry trace error occurred. cannot send span to the batch span processor because the channel is full错误。
下面是我的配置代码：

let mut exporter_metadata = MetadataMap::new();
exporter_metadata.insert(
    "api-key",
    "<redacted>".parse()?,
);
let exporter = opentelemetry_otlp::new_exporter()
    .tonic()
    .with_endpoint("https://otlp.nr-data.net:4317")
    .with_tls_config(ClientTlsConfig::default())
    .with_metadata(exporter_metadata);
let trace_config = opentelemetry::sdk::trace::config()
    .with_resource(Resource::new(vec![
        KeyValue::new(
            opentelemetry_semantic_conventions::resource::SERVICE_NAME,
            "worker",
        ),
        KeyValue::new(
            opentelemetry_semantic_conventions::resource::SERVICE_INSTANCE_ID,
            "dev-instance",
        ),
        KeyValue::new("kind", "server"),
    ]))
    .with_sampler(Sampler::TraceIdRatioBased(1.0));
let tracer = opentelemetry_otlp::new_pipeline()
    .tracing()
    .with_exporter(exporter)
    .with_trace_config(trace_config)
    .install_batch(opentelemetry::runtime::Tokio)?;
let otel_filter = Targets::new().with_target("worker", LevelFilter::INFO);
let otel_layer = tracing_opentelemetry::layer()
    .with_tracer(tracer)
    .with_filter(otel_filter);

我已经看过了文档，但是没有提到通道大小的配置。

rust

来源：https://stackoverflow.com/questions/74264248/opentelemetry-rust-increasing-the-channel-size-of-batched-otlptracepipeline

1条答案

按热度按时间

ryevplcw1#

在深入研究了源代码之后，我提出了以下解决方案：
在batch_config.rs中，声明新特征并为OtlpTracePipeline实现它：

use anyhow::Result;
use core::convert::Into;
use core::option::Option;
use core::option::Option::{None, Some};
use core::result::Result::Ok;
use opentelemetry::sdk::trace::{BatchConfig, BatchSpanProcessor, Config, TraceRuntime};
use opentelemetry::trace::{TraceError, TracerProvider};
use opentelemetry::{global, sdk};
use opentelemetry_otlp::{Error, OtlpTracePipeline, SpanExporter, SpanExporterBuilder};

pub trait BatchConfigurable {
    fn install_batch_manual<B, R>(
        self,
        trace_config: Option<Config>,
        exporter_builder: Option<B>,
        batch_config: BatchConfig,
        runtime: R,
    ) -> Result<sdk::trace::Tracer, TraceError>
    where
        B: Into<SpanExporterBuilder>,
        R: TraceRuntime;
}

fn build_batch_with_config_and_exporter<R: TraceRuntime>(
    exporter: SpanExporter,
    batch_config: BatchConfig,
    trace_config: Option<Config>,
    runtime: R,
) -> sdk::trace::Tracer {
    let batch = BatchSpanProcessor::builder(exporter, runtime)
        .with_batch_config(batch_config)
        .build();
    let mut provider_builder = sdk::trace::TracerProvider::builder().with_span_processor(batch);
    if let Some(config) = trace_config {
        provider_builder = provider_builder.with_config(config);
    }
    let provider = provider_builder.build();
    let tracer =
        provider.versioned_tracer("opentelemetry-otlp", Some(env!("CARGO_PKG_VERSION")), None);
    let _ = global::set_tracer_provider(provider);
    tracer
}

impl BatchConfigurable for OtlpTracePipeline {
    fn install_batch_manual<B, R>(
        self,
        trace_config: Option<Config>,
        exporter_builder: Option<B>,
        batch_config: BatchConfig,
        runtime: R,
    ) -> Result<sdk::trace::Tracer, TraceError>
    where
        B: Into<SpanExporterBuilder>,
        R: TraceRuntime,
    {
        let exporter_builder = exporter_builder.map(|b| b.into());
        Ok(build_batch_with_config_and_exporter(
            exporter_builder
                .ok_or(Error::NoExporterBuilder)?
                .build_span_exporter()?,
            batch_config,
            trace_config,
            runtime,
        ))
    }
}

然后像这样使用它：

let batch_config = BatchConfig::default().with_max_queue_size(1048576);
    let tracer = opentelemetry_otlp::new_pipeline()
        .tracing()
        .install_batch_manual(
            Some(trace_config),
            Some(exporter),
            batch_config,
            opentelemetry::runtime::Tokio,
        )?;

粗略地说，install_batch_manual相当于调用.with_exporter().with_trace_config().install_batch，但带有可自定义的BatchConfig选项。

赞(0）回复(0）举报 2022-11-12

我来回答

开放式遥测-生 rust ：增加批处理OtlpTracePipeline的通道大小

1条答案

相关问题

热门标签

最新问答