https://flyte.org logo
Join Slack
Powered by
Flytectl with devcontainer
# flyte-deployment
a
Hi all, Pretty new to flyte and doing a bit of learning. I'm just following through the getting started tutorials for now. I've gotten a local demo cluster up and running using 
flytectl demo start
. What I would like to do now is to have my devcontainer (running in Docker) run a workflow against the remote cluster running on my host machine. This is the config I have within the devcontainer:
Copy code
[.flyte/config.yaml]
admin:
  # For GRPC endpoints you might want to use dns:///flyte.myexample.com
  endpoint: dns:///host.docker.internal:30080
  insecure: true
logger:
  show-source: true
  level: 0
When I run the command:
Copy code
pyflyte -c .flyte/config.yml run --remote example_workflow.py training_workflow --hyperparameters '{"C": 0.1}'
I get the following errors:
Copy code
Failed with Unknown Exception <class 'requests.exceptions.ConnectionError'> Reason: HTTPConnectionPool(host='localhost', port=30002): Max retries exceeded with url: /my-s3-bucket/flytesnacks/development/Z7RBA57NTP5424RGXLLVDVDS6Y%3D%3D%3D%3D%3D%3D/script_mode.tar.gz?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=minio%2F20231117%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20231117T011145Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=content-md5%3Bhost&X-Amz-Signature=08a3aecceb4590508dc68093b1b1973644bffb92bcaf2b96eb074bc458a5fe14 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fffd85d06a0>: Failed to establish a new connection: [Errno 111] Connection refused'))
HTTPConnectionPool(host='localhost', port=30002): Max retries exceeded with url: /my-s3-bucket/flytesnacks/development/Z7RBA57NTP5424RGXLLVDVDS6Y%3D%3D%3D%3D%3D%3D/script_mode.tar.gz?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=minio%2F20231117%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20231117T011145Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=content-md5%3Bhost&X-Amz-Signature=08a3aecceb4590508dc68093b1b1973644bffb92bcaf2b96eb074bc458a5fe14 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fffd85d06a0>: Failed to establish a new connection: [Errno 111] Connection refused'))
Anyone know what I can do here? Thank you
Oh I also tried setting the storage endpoint in the host config:
Copy code
admin:
  # For GRPC endpoints you might want to use dns:///flyte.myexample.com
  endpoint: dns:///localhost:30080
  insecure: true
storage:
  connection:
    endpoint: dns://host.docker.internal:30002
but that didn't seem to work either
4 Views
Open in Slack
PreviousNext
Powered by