Frequent connection errors when accessing cloud instance

[Joxter]

Hi team,

We're using this package to connect to our Permify cloud instance and have been experiencing frequent errors when making requests to the service.

Logs we have:

File "/usr/local/lib/python3.11/site-packages/urllib3/connectionpool.py", line 791, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/urllib3/connectionpool.py", line 537, in _make_request
response = conn.getresponse()
^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/urllib3/connection.py", line 461, in getresponse
httplib_response = super().getresponse()
^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/http/client.py", line 1374, in getresponse
response.begin()
File "/usr/local/lib/python3.11/http/client.py", line 318, in begin
version, status, reason = self._read_status()
^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/http/client.py", line 279, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/socket.py", line 706, in readinto
return self._sock.recv_into(b)
^^^^^^^^^^^^^^^^^^^^^^^
ConnectionResetError: [Errno 104] Connection reset by peer

We do not use urllib3, it is a dependency of the permify-python package.

Environment:

• Package version: 1.0.2

Observations:

• Retry requests usually succeed
• No similar issues with other services we use
• Problem seems specific to Permify connections

Expected behavior:
Reliable connections without frequent retry requirements

Could you help us identify the root cause of these connection issues? We'd appreciate any insights into what might be causing this problem.

Thank you!

[Joxter]

The retries parameter has no visible effect

[Joxter]

It helped me, but it's a dirty hack. Pls help me to find a proper solution.

import urllib3

original_urlopen = urllib3.PoolManager.urlopen
def urlopen_with_fresh_connection(self, method, url, *args, **kwargs):
    # Force connection to close after request
    if 'headers' not in kwargs:
        kwargs['headers'] = {}
    kwargs['headers']['Connection'] = 'close'
    return original_urlopen(self, method, url, *args, **kwargs)

urllib3.PoolManager.urlopen = urlopen_with_fresh_connection

[ucatbas]

hi @Joxter, i would like to help you in this. can you briefly mention about your use case and what is missing in our sdk? i couldn't get the issue fully

[Joxter]

Hi @ucatbas , thanks for the help. I'm almost done working on that project, but the code there was like this:

config = Configuration(host=base_url, retries=3)
config.connection_pool_maxsize = 1 # <- this line solves our problem

entapi_client = ApiClient(configuration=config)

mission_api = PermissionApi(api_client)
self.data_api = DataApi(api_client)
self.schema_api = SchemaApi(api_client)
self.tenancy_api = TenancyApi(api_client)

and usage like all over the project:

response = self.data_api.data_relationships_read( ... )

And quite often, any API calls (I mean data_api.data_relationships_read or permission_api.permissions_lookup_entity or anything else) randomly failed with the error described above. Everything was fine locally, but it happened only on the cloud. Changes to Cloud settings did not give noticeable results. Right now we use config.connection_pool_maxsize = 1 and have zero network errors.