colossal-nightfall-74781
07/24/2025, 4:04 PMFailed to connect to remote host: connect: Connection refused (111)
(full trace back in 🧵 ) The cluster is clearly up, why doesn't this work?colossal-nightfall-74781
07/24/2025, 4:04 PM[1/1] currentAttempt done. Last Error: SYSTEM::Trace:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/grpc/_interceptor.py", line 315, in continuation
response, call = self._thunk(new_method).with_call(
File "/usr/local/lib/python3.10/site-packages/grpc/_interceptor.py", line 343, in with_call
return self._with_call(
File "/usr/local/lib/python3.10/site-packages/grpc/_interceptor.py", line 332, in _with_call
return call.result(), call
File "/usr/local/lib/python3.10/site-packages/grpc/_channel.py", line 440, in result
raise self
File "/usr/local/lib/python3.10/site-packages/grpc/_interceptor.py", line 315, in continuation
response, call = self._thunk(new_method).with_call(
File "/usr/local/lib/python3.10/site-packages/grpc/_interceptor.py", line 343, in with_call
return self._with_call(
File "/usr/local/lib/python3.10/site-packages/grpc/_interceptor.py", line 332, in _with_call
return call.result(), call
File "/usr/local/lib/python3.10/site-packages/grpc/_channel.py", line 440, in result
raise self
File "/usr/local/lib/python3.10/site-packages/grpc/_interceptor.py", line 315, in continuation
response, call = self._thunk(new_method).with_call(
File "/usr/local/lib/python3.10/site-packages/grpc/_channel.py", line 1198, in with_call
return _end_unary_response_blocking(state, call, True, None)
File "/usr/local/lib/python3.10/site-packages/grpc/_channel.py", line 1006, in _end_unary_response_blocking
raise _InactiveRpcError(state) # pytype: disable=not-instantiable
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30080: Failed to connect to remote host: connect: Connection refused (111)"
debug_error_string = "UNKNOWN:Error received from peer {created_time:"2025-07-24T16:01:54.074934284+00:00", grpc_status:14, grpc_message:"failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30080: Failed to connect to remote host: connect: Connection refused (111)"}"
>
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/flytekit/bin/entrypoint.py", line 190, in _dispatch_execute
outputs = task_def.dispatch_execute(ctx, idl_input_literals)
File "/usr/local/lib/python3.10/site-packages/flytekit/core/python_function_task.py", line 742, in dispatch_execute
exec_models, _ = remote.client.list_executions_paginated(
File "/usr/local/lib/python3.10/site-packages/flytekit/clients/friendly.py", line 638, in list_executions_paginated
exec_list = super(SynchronousFlyteClient, self).list_executions_paginated(
File "/usr/local/lib/python3.10/site-packages/flytekit/clients/raw.py", line 410, in list_executions_paginated
return self._stub.ListExecutions(resource_list_request, metadata=self._metadata)
File "/usr/local/lib/python3.10/site-packages/grpc/_interceptor.py", line 277, in __call__
response, ignored_call = self._with_call(
File "/usr/local/lib/python3.10/site-packages/grpc/_interceptor.py", line 329, in _with_call
call = self._interceptor.intercept_unary_unary(
File "/usr/local/lib/python3.10/site-packages/flytekit/clients/grpc_utils/wrap_exception_interceptor.py", line 46, in intercept_unary_unary
raise e
File "/usr/local/lib/python3.10/site-packages/flytekit/clients/grpc_utils/wrap_exception_interceptor.py", line 42, in intercept_unary_unary
self._raise_if_exc(request, e)
File "/usr/local/lib/python3.10/site-packages/flytekit/clients/grpc_utils/wrap_exception_interceptor.py", line 32, in _raise_if_exc
raise FlyteSystemUnavailableException() from e
flytekit.exceptions.system.FlyteSystemUnavailableException: Flyte cluster is currently unavailable. Please make sure the cluster is up and running.
Message:
FlyteSystemUnavailableException: Flyte cluster is currently unavailable. Please make sure the cluster is up and running.
freezing-airport-6809
freezing-airport-6809