square-table-43037
06/10/2022, 10:00 PMsquare-table-43037
06/10/2022, 10:09 PMport-forward
flytectl config init --host=localhost:8080
---
fort forward is the following:
kubectl port-forward svc/flyteadmin -n flyte 8080:80
---
when I try to run I receive the following:
viniciusesperanca@Viniciuss-Mini flyte-deployment-aws % pyflyte run example.py wf --n 500 --mean 42 --sigma 2
E0610 19:07:30.345097000 4337059200 <http://ssl_transport_security.cc:1495]|ssl_transport_security.cc:1495]> Handshake failed with fatal error SSL_ERROR_SSL: error:100000f7:SSL routines:OPENSSL_internal:WRONG_VERSION_NUMBER.
E0610 19:07:30.812457000 4337059200 <http://ssl_transport_security.cc:1495]|ssl_transport_security.cc:1495]> Handshake failed with fatal error SSL_ERROR_SSL: error:100000f7:SSL routines:OPENSSL_internal:WRONG_VERSION_NUMBER.
DefaultNamedTupleOutput(o0=41.92207532626968, o1=2.125158116611769)
I am not really sure how to test itacceptable-policeman-57188
square-table-43037
06/10/2022, 10:18 PMacceptable-policeman-57188
acceptable-policeman-57188
freezing-airport-6809
freezing-airport-6809
freezing-airport-6809
freezing-airport-6809
freezing-airport-6809
freezing-airport-6809
square-table-43037
06/13/2022, 12:49 PMpyflyte run --remote example.py wf --n 500 --mean 42 --sigma 2
, using the example.py
, I am getting
viniciusesperanca@Viniciuss-Mini flyte-deployment-aws % pyflyte run --remote example.py wf --n 500 --mean 42 --sigma 2
{"asctime": "2022-06-13 09:43:43,653", "name": "flytekit.cli", "levelname": "ERROR", "message": "Non-auth RPC error <_InactiveRpcError of RPC that terminated with:\n\tstatus = StatusCode.UNAVAILABLE\n\tdetails = \"failed to connect to all addresses\"\n\tdebug_error_string = \"{\"created\":\"@1655124223.653297000\",\"description\":\"Failed to pick subchannel\",\"file\":\"src/core/ext/filters/client_channel/client_channel.cc\",\"file_line\":3218,\"referenced_errors\":[{\"created\":\"@1655124223.653297000\",\"description\":\"failed to connect to all addresses\",\"file\":\"src/core/lib/transport/error_utils.cc\",\"file_line\":165,\"grpc_status\":14}]}\"\n>, sleeping 200ms and retrying"}
I think I did config it properly
flytectl config init --host=<hostname-with-ssl>
square-table-43037
06/13/2022, 12:49 PMfreezing-airport-6809
freezing-airport-6809
square-table-43037
06/13/2022, 4:00 PMflytectl config init --host=<http://flyte.sidetrek.com|flyte.sidetrek.com>
high-accountant-32689
06/13/2022, 5:23 PMpyflyte run
to ensure it's using the right config file?
Just set this env var in your call, e.g.:
FLYTE_SDK_LOGGING_LEVEL=20 pyflyte run --remote example.py wf --n 500 --mean 42 --sigma 2
square-table-43037
06/13/2022, 6:15 PM{
"asctime": "2022-06-13 15:12:22,563",
"name": "flytekit",
"levelname": "INFO",
"message": "Using flytectl/YAML config /Users/viniciusesperanca/.flyte/config.yaml"
}
viniciusesperanca@Viniciuss-Mini flyte-deployment-aws % cat /Users/viniciusesperanca/.flyte/config.yaml
admin:
# For GRPC endpoints you might want to use dns:///flyte.myexample.com
endpoint: dns:///flyte.sidetrek.com
authType: Pkce
insecure: false
logger:
show-source: true
level: 0%
high-accountant-32689
06/13/2022, 6:22 PMflytectl get projects --config ~/.flyte/config.yaml
square-table-43037
06/13/2022, 6:27 PMError: rpc error: code = Unavailable desc = upstream connect error or disconnect/reset before headers. reset reason: connection termination
high-accountant-32689
06/13/2022, 10:01 PMsquare-table-43037
06/13/2022, 10:18 PMsquare-table-43037
06/13/2022, 10:18 PMhigh-accountant-32689
06/14/2022, 4:35 AMflytectl
can't reach admin.icy-agent-73298
06/14/2022, 4:48 AMicy-agent-73298
06/14/2022, 4:58 AMgreat-school-54368
06/14/2022, 5:05 AMsquare-table-43037
06/14/2022, 10:57 AMsquare-table-43037
06/14/2022, 10:58 AMflyte console
and show default projectssquare-table-43037
06/14/2022, 11:00 AMMappings
? They represent same as ingress rules.square-table-43037
06/14/2022, 11:11 AMgrpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "failed to connect to all addresses"
debug_error_string = "{"created":"@1655204980.718613000","description":"Failed to pick subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3218,"referenced_errors":[{"created":"@1655204980.718609000","description":"failed to connect to all addresses","file":"src/core/lib/transport/error_utils.cc","file_line":165,"grpc_status":14}]}"
I think I am missing some inner configuration, but I am not really sure wheregreat-school-54368
06/14/2022, 11:14 AMsquare-table-43037
06/14/2022, 12:11 PMMapping
I can use get projects
viniciusesperanca@web flyte-deployment-aws % flytectl get projects --config ~/.flyte/config.yaml
--------------- --------------- ---------------------------
| ID | NAME | DESCRIPTION |
--------------- --------------- ---------------------------
| flyteexamples | flyteexamples | flyteexamples description |
--------------- --------------- ---------------------------
| flytetester | flytetester | flytetester description |
--------------- --------------- ---------------------------
| flytesnacks | flytesnacks | flytesnacks description |
--------------- --------------- ---------------------------
3 rows
square-table-43037
06/14/2022, 12:11 PMgreat-school-54368
06/14/2022, 12:11 PMsquare-table-43037
06/14/2022, 12:12 PMviniciusesperanca@web flyte-deployment-aws % pyflyte run --remote example.py wf --n 500 --mean 42 --sigma 2
{"asctime": "2022-06-14 09:08:51,001", "name": "flytekit.cli", "levelname": "ERROR", "message": "Non-auth RPC error <_InactiveRpcError of RPC that terminated with:\n\tstatus = StatusCode.UNAVAILABLE\n\tdetails = \"failed to connect to all addresses\"\n\tdebug_error_string = \"{\"created\":\"@1655208531.001191000\",\"description\":\"Failed to pick subchannel\",\"file\":\"src/core/ext/filters/client_channel/client_channel.cc\",\"file_line\":3218,\"referenced_errors\":[{\"created\":\"@1655208531.001189000\",\"description\":\"failed to connect to all addresses\",\"file\":\"src/core/lib/transport/error_utils.cc\",\"file_line\":165,\"grpc_status\":14}]}\"\n>, sleeping 200ms and retrying"}
{"asctime": "2022-06-14 09:08:51,207", "name": "flytekit.cli", "levelname": "ERROR", "message": "Non-auth RPC error <_InactiveRpcError of RPC that terminated with:\n\tstatus = StatusCode.UNAVAILABLE\n\tdetails = \"failed to connect to all addresses\"\n\tdebug_error_string = \"{\"created\":\"@1655208531.206841000\",\"description\":\"Failed to pick subchannel\",\"file\":\"src/core/ext/filters/client_channel/client_channel.cc\",\"file_line\":3218,\"referenced_errors\":[{\"created\":\"@1655208531.206838000\",\"description\":\"failed to connect to all addresses\",\"file\":\"src/core/lib/transport/error_utils.cc\",\"file_line\":165,\"grpc_status\":14}]}\"\n>, sleeping 400ms and retrying"}
Traceback (most recent call last):
File "/opt/homebrew/bin/pyflyte", line 8, in <module>
sys.exit(main())
File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1130, in __call__
return self.main(*args, **kwargs)
File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1055, in main
rv = self.invoke(ctx)
File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 1404, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/opt/homebrew/lib/python3.9/site-packages/click/core.py", line 760, in invoke
return __callback(*args, **kwargs)
File "/opt/homebrew/lib/python3.9/site-packages/flytekit/clis/sdk_in_container/run.py", line 473, in _run
wf = remote.register_script(
File "/opt/homebrew/lib/python3.9/site-packages/flytekit/remote/remote.py", line 536, in register_script
upload_location, md5_bytes = fast_register_single_script(
File "/opt/homebrew/lib/python3.9/site-packages/flytekit/tools/script_mode.py", line 117, in fast_register_single_script
upload_location = create_upload_location_fn(content_md5=md5)
File "/opt/homebrew/lib/python3.9/site-packages/flytekit/clients/friendly.py", line 998, in get_upload_signed_url
return super(SynchronousFlyteClient, self).create_upload_location(
File "/opt/homebrew/lib/python3.9/site-packages/flytekit/clients/raw.py", line 40, in handler
return fn(*args, **kwargs)
File "/opt/homebrew/lib/python3.9/site-packages/flytekit/clients/raw.py", line 834, in create_upload_location
return self._dataproxy_stub.CreateUploadLocation(create_upload_location_request, metadata=self._metadata)
File "/opt/homebrew/lib/python3.9/site-packages/grpc/_channel.py", line 946, in __call__
return _end_unary_response_blocking(state, call, False, None)
File "/opt/homebrew/lib/python3.9/site-packages/grpc/_channel.py", line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "failed to connect to all addresses"
debug_error_string = "{"created":"@1655208531.612898000","description":"Failed to pick subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3218,"referenced_errors":[{"created":"@1655208531.612891000","description":"failed to connect to all addresses","file":"src/core/lib/transport/error_utils.cc","file_line":165,"grpc_status":14}]}"
>
great-school-54368
06/14/2022, 12:12 PMsquare-table-43037
06/14/2022, 12:14 PMviniciusesperanca@web flyte-deployment-aws % cat ~/.flyte/config.yaml
admin:
# For GRPC endpoints you might want to use dns:///flyte.myexample.com
endpoint: dns:///flyte.sidetrek.com
authType: Pkce
insecure: false
logger:
show-source: true
level: 0%
great-school-54368
06/14/2022, 1:14 PMgreat-school-54368
06/14/2022, 1:18 PMsquare-table-43037
06/15/2022, 12:34 AMhigh-accountant-32689
06/15/2022, 1:33 AMsquare-table-43037
06/15/2022, 11:32 AMlarger apps deploy
and kept my configuration with emissary ingress
I still don’t know which ingress mapping I am missing in order to run with pyflyte
, but uploading workflow directly to my flyte cluster worked
I will probably keep investigating this further and can post here if I find something