Confluent.Kafka.ConsumeException: Local: Timed out

See original GitHub issue

Description

We are experiencing the below error intermittently while consuming the messages from Kafka

Confluent.Kafka.ConsumeException: Local: Timed out at Confluent.Kafka.Consumer2.ConsumeImpl[K,V](Int32 millisecondsTimeout, IDeserializer1 keyDeserializer, IDeserializer1 valueDeserializer) at Confluent.Kafka.Consumer2.Consume(CancellationToken cancellationToken)

How to reproduce

The below configuration is using in our application return new ConsumerConfig { BootstrapServers = _consumerConfiguration.BootstrapServers, GroupId = _consumerConfiguration.GroupId, SessionTimeoutMs = 100000, AutoOffsetReset = AutoOffsetReset.Earliest, EnablePartitionEof = true, EnableAutoCommit = _consumerConfiguration.EnableAutoCommit };

Checklist

Please provide the following information:

  • A complete (i.e. we can run it), minimal program demonstrating the problem. No need to supply a project file.
  • Confluent.Kafka nuget version.
  • Apache Kafka version.
  • Client configuration.
  • Operating system.
  • Provide logs (with “debug” : “…” as necessary in configuration).
  • Provide broker log excerpts.
  • Critical issue.

Issue Analytics

  • State:open
  • Created 4 years ago
  • Reactions:2
  • Comments:8 (3 by maintainers)

github_iconTop GitHub Comments

5reactions
kalpanathakur08commented, Jul 31, 2020

ed-alertedh, I am seeing similar issue, have you got to the solution to it?

After these errors, some consumers doesn’t resume message/record processing even if partition has records and consumer is healthy and polling.

  1. “error”:“Local: Timed out”,“error”:“commit error” : This is happening on commit.
  2. “error”:“GroupCoordinator: 1 request(s) timed out: disconnect (after 6847266ms in state UP, 1 identical error(s) suppressed)” socket.timeout.ms is set to 60000ms right now.
0reactions
yangerlei1207commented, Aug 23, 2022

We have the same issue in Producer, Exception like this: Confluent.Kafka.ProduceException2[System.String,System.String]: Local: Message timed out at Confluent.Kafka.Producer2.ProduceAsync(TopicPartition topicPartition, Message`2 message, CancellationToken cancellationToken)

Read more comments on GitHub >

github_iconTop Results From Across the Web

Can't send message to kafka topic use Confluent.Kafka C# ...
This method work 5 minutes and finished with error : Local: Message timed out. If i use method Produce, the program goes next...
Read more >
Enum ErrorCode | Confluent.Kafka
Enumeration of local and broker generated error codes. Namespace: Confluent.Kafka ... Transaction timeout is larger than the maximum value allowed by the ...
Read more >
confluent_kafka API — confluent-kafka 2.2.0 documentation
KafkaException – Operation failed locally or on broker. ... timeout (float) – The maximum response time before timing out, or -1 for infinite...
Read more >
kafka - Go Documentation Server
A timeout error indicates that the operation timed out locally. func (Error) String ¶. func (e Error) String() string. String returns a human...
Read more >
Kafka Consumer configuration reference
The timeout used to detect client failures when using Kafka's group management facility. The client sends periodic heartbeats to indicate its liveness to...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found