Sending Queue Is Full

Error

Key error

{
  "kind": "exporter",
  "data_type": "logs",
  "name": "clickhouse",
  "error": "sending queue is full",
  "rejected_items": 210
}

Source error

2025-01-07T06:32:50.218Z   error   internal/base_exporter.go:130   Exporting failed. Rejecting data.       {"kind": "exporter", "data_type": "logs", "name": "clickhouse", "error": "sending queue is full", "rejected_items": 210}
go.opentelemetry.io/collector/exporter/exporterhelper/internal.(*BaseExporter).Send
        go.opentelemetry.io/collector/exporter@v0.114.0/exporterhelper/internal/base_exporter.go:130
go.opentelemetry.io/collector/exporter/exporterhelper.NewLogsRequest.func1
        go.opentelemetry.io/collector/exporter@v0.114.0/exporterhelper/logs.go:135
go.opentelemetry.io/collector/consumer.ConsumeLogsFunc.ConsumeLogs
        go.opentelemetry.io/collector/consumer@v0.114.0/logs.go:26
go.opentelemetry.io/collector/processor/processorhelper.NewLogs.func1
        go.opentelemetry.io/collector/processor@v0.114.0/processorhelper/logs.go:66
go.opentelemetry.io/collector/consumer.ConsumeLogsFunc.ConsumeLogs
        go.opentelemetry.io/collector/consumer@v0.114.0/logs.go:26
go.opentelemetry.io/collector/processor/batchprocessor.(*batchLogs).export
        go.opentelemetry.io/collector/processor/batchprocessor@v0.114.0/batch_processor.go:535
go.opentelemetry.io/collector/processor/batchprocessor.(*shard[...]).sendItems
        go.opentelemetry.io/collector/processor/batchprocessor@v0.114.0/batch_processor.go:261
go.opentelemetry.io/collector/processor/batchprocessor.(*shard[...]).startLoop
        go.opentelemetry.io/collector/processor/batchprocessor@v0.114.0/batch_processor.go:221

Solution

Set sending_queue size:

clickhouse/nginx:
database: default
endpoint: tcp://clickhouse.monitor.svc.cluster.local:9000
logs_table_name: xxx
username: xxx
password: xxx
sending_queue:
    queue_size: 5000