[Core|RLlib] Using `grpcio==1.46.0` produces log spam `Other threads are currently calling into gRPC, skipping fork() handlers`

See original GitHub issue

What happened + What you expected to happen

What happened

I executed my RLlib algorithm with tune and everything ran, however I got some strange outputs on the shell:

Current time: 2022-05-18 11:57:45 (running for 00:09:26.08)
Memory usage on this node: 12.1/30.8 GiB
Using FIFO scheduling algorithm.
Resources requested: 1.0/4 CPUs, 0/0 GPUs, 0.0/12.29 GiB heap, 0.0/6.14 GiB objects
Result logdir: /home/simon/ray_results/PPO
Number of trials: 2/2 (1 RUNNING, 1 TERMINATED)


E0518 11:57:49.106725340  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:49.131257880  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:49.579279097  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:49.602543929  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:50.052098254  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:50.506077511  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:50.537421565  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:53.942052272  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:53.972954713  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:54.398336884  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:54.421898407  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:54.893307029  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:54.917423100  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:55.417104878  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:59.279049882  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:59.605033204  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:59.628368438  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:57:59.940306465  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:00.299949046  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:03.696490892  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:04.179267262  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:04.210603355  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:05.137953663  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:05.168799602  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:08.597303677  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:08.621023183  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:09.061257467  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:09.084924173  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:09.549874124  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:13.611053202  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:13.634605365  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:14.109608982  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:14.133265700  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:14.611030533  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:14.634902296  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:15.121164078  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:15.146424097  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:18.868297636  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:18.892836183  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:19.406614241  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:19.430436205  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:19.899460829  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:19.930325695  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:20.426148405  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:24.286596129  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:24.317546064  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:24.647222229  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:24.994967377  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:25.018785989  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:25.342555868  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:25.366225436  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:28.862438307  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:29.316299809  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:29.343223263  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:29.763160944  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:29.790140481  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:30.225725151  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:30.252505288  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:33.696588326  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:33.723807352  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:34.150454927  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:34.177290099  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:34.628579937  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:34.655626103  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:35.152989535  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:35.178422763  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:38.626212892  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:38.653581311  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:39.100803671  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:39.124715243  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:39.650818379  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:39.678636862  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:40.169798923  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:40.194586388  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:43.643094706  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:43.668712946  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:44.112191616  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:44.579227060  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:44.604283069  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers
E0518 11:58:45.061602256  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers

This could be connected to the same environment variable as in this PR in grpcio.

What you expected to happen

That I get the same output but without the lines

E0518 11:58:44.604283069  152858 fork_posix.cc:76]           Other threads are currently calling into gRPC, skipping fork() handlers

Versions / Dependencies

Linux Fedora 35 Python 3.9.0 ray dev2.0.0

Reproduction script

Run the ǹoveld_exploration.py` from this PR.

Issue Severity

Low: It annoys or frustrates me.

Issue Analytics

  • State:closed
  • Created a year ago
  • Comments:21 (16 by maintainers)

github_iconTop GitHub Comments

4reactions
ferstarcommented, Jun 23, 2022

@mwtian @simonsays1980 ~~Good news: grpcio 1.47.0 has been released and fixed this issue. I have test in my Python env. ~~

sorry, It happen again, still not fixed 😭

3reactions
VOvchinnikovcommented, Aug 26, 2022

1.48.0 still spams, unfortunately

Read more comments on GitHub >

github_iconTop Results From Across the Web

grpcio 1.7.3 - PyPI
Package for gRPC Python. ... gRPC Python is available for Linux, macOS, and Windows. >From PyPI ~~~~~~~~~ If you are installing locally.
Read more >
Python gRPC - Hoani.net
Now we create a client which makes a unary call to the server. # client_unary.py import logging import grpc import fibonacci_pb2 import ...
Read more >
Unable to install grpcio using pip install grpcio==1.18.0
When I use pip install grpcio==1.18.0 I get an error, while pip install grpcio ... During handling of the above exception, another exception ......
Read more >
grpcio-tools - Python Package Health Analysis - Snyk
Protobuf code generator for gRPC For more information about how to use this package ... Snyk scans all the packages in your projects...
Read more >
grpc-io installation failed - Google Groups
Hi,. I am running error when I am trying to install *grpcio* in a Ubuntu system. I have python version 2.7 installed.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found