Redis connection lost and command aborted. code: 'UNCERTAIN_STATE'

See original GitHub issue

We have a node.js app deployed on Heroku and we are using kue to run some background jobs. It usually works fine, but few days back we saw following errors in our production server:

Jul 10 11:19:23 refocus app/web.6: Error removing 4628051 { AbortError: Redis connection lost and command aborted. It might have been processed. 
Jul 10 11:19:23 refocus app/web.6:     at RedisClient.flush_and_error (/app/node_modules/kue/node_modules/redis/index.js:357:23) 
Jul 10 11:19:23 refocus app/web.6:     at RedisClient.connection_gone (/app/node_modules/kue/node_modules/redis/index.js:659:14) 
Jul 10 11:19:23 refocus app/web.6:     at Socket.<anonymous> (/app/node_modules/kue/node_modules/redis/index.js:293:14) 
Jul 10 11:19:23 refocus app/web.6:     at Socket.g (events.js:286:16) 
Jul 10 11:19:23 refocus app/web.6:     at emitNone (events.js:91:20) 
Jul 10 11:19:23 refocus app/web.6:     at Socket.emit (events.js:185:7) 
Jul 10 11:19:23 refocus app/web.6:     at endReadableNT (_stream_readable.js:975:12) 
Jul 10 11:19:23 refocus app/web.6:     at _combinedTickCallback (internal/process/next_tick.js:74:11) 
Jul 10 11:19:23 refocus app/web.6:     at process._tickDomainCallback [as _tickCallback] (internal/process/next_tick.js:122:9) 
Jul 10 11:19:23 refocus app/web.6:   code: 'UNCERTAIN_STATE', 
Jul 10 11:19:23 refocus app/web.6:   command: 'EXEC', 
Jul 10 11:19:23 refocus app/web.6:   errors:  
Jul 10 11:19:23 refocus app/web.6:    [ { AbortError: Redis connection lost and command aborted. It might have been processed. 
Jul 10 11:19:23 refocus app/web.6:          at RedisClient.flush_and_error (/app/node_modules/kue/node_modules/redis/index.js:357:23) 
Jul 10 11:19:23 refocus app/web.6:          at RedisClient.connection_gone (/app/node_modules/kue/node_modules/redis/index.js:659:14) 
Jul 10 11:19:23 refocus app/web.6:          at Socket.<anonymous> (/app/node_modules/kue/node_modules/redis/index.js:293:14) 
Jul 10 11:19:23 refocus app/web.6:          at Socket.g (events.js:286:16) 
Jul 10 11:19:23 refocus app/web.6:          at emitNone (events.js:91:20) 
Jul 10 11:19:23 refocus app/web.6:          at Socket.emit (events.js:185:7) 
Jul 10 11:19:23 refocus app/web.6:          at endReadableNT (_stream_readable.js:975:12) 
Jul 10 11:19:23 refocus app/web.6:          at _combinedTickCallback (internal/process/next_tick.js:74:11) 
Jul 10 11:19:23 refocus app/web.6:          at process._tickDomainCallback [as _tickCallback] (internal/process/next_tick.js:122:9) 
Jul 10 11:19:23 refocus app/web.6:        code: 'UNCERTAIN_STATE', 
Jul 10 11:19:23 refocus app/web.6:        command: 'ZREM', 
Jul 10 11:19:23 refocus app/web.6:        args: [Object], 
Jul 10 11:19:23 refocus app/web.6:        position: 0 },  .............

We have seen these ‘UNCERTAIN_STATE’ errors before as well. I went through other related issues and it seems a network problem, but since it looks like it is coming from kue, I just wanted to confirm whether we have some potential options to prevent this in future.

Issue Analytics

  • State:open
  • Created 6 years ago
  • Reactions:1
  • Comments:11

github_iconTop GitHub Comments

3reactions
mzalazarcommented, Jun 12, 2018

I have found a limit with my server (max connextion): root@ar:/var/log# sysctl net.core.somaxconn net.core.somaxconn = 128 Using this command, i changed my settings sysctl -w net.core.somaxconn=1024 (you can “tune” this setting) By using: sysctl -p we apply new settings to kernel… and i had to restart redis of course.

2reactions
danielmhanovercommented, Mar 18, 2019

Also getting this issue. Is it a connections count issue?

Read more comments on GitHub >

github_iconTop Results From Across the Web

ready check failed: redis connection lost and command ...
AbortError: Ready check failed : Redis connection lost and command aborted. It might have been processed. For cdg and ams. It's from the...
Read more >
Intermittent redis connection error: 'UNCERTAIN STATE'
Time and time again, we get this error: { Error: Redis connection to some-redis-server:6379 failed - read ETIMEDOUT at TCP.
Read more >
Developers - Redis error on new project start - - Bountysource
error: Error: Ready check failed: Redis connection lost and command aborted in uncertain state. It might have been processed.
Read more >
Redis connection lost - LeanCloud 用户社区
... 10:21:37 Error: Redis connection lost and command aborted in uncertain state. ... ERROR 2016-04-09 10:21:37 npm ERR! code ELIFECYCLE
Read more >
My Node.js droplet can't connect to DigitalOcean Managed redis
2|index | AbortError: Ready check failed: Redis connection lost and command aborted. It might have been processed.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found