<#959 Add dataproxy client selector> Pull request ...
# flyte-github
a
#959 Add dataproxy client selector Pull request opened by katrogan NOT TO BE MERGED UNTIL BE CHANGES ARE IN. This PR adds a new dependency on the flyte remote client for dataproxy endpoints 1. Use a client conn cache for dataproxy operations, using 'operation' and 'resource' as cache keys 2. On cache misses call SelectCluster to get the respective cluster endpoint and initialize and cache a new client conn Going forward all new dataproxy calls should use this pattern. Today this PR updates the only uses of dataproxy in the sdk: UploadInputs and CreateUploadLocation --- Testing Verified that the CreateRun path (which calls UploadInputs now) works with a local cluster
Copy code
flyte -vvv  --config .flyte/config-oss-local.yaml  run -p flytesnacks -d development examples/basics/hello.py main
...
╭────────────────────────────────────────── Remote Run ───────────────────────────────────────────╮
│ Created Run: rmj7wwft78l69stlj69j                                                               │
│ URL: <http://localhost:30080/v2/domain/development/project/flytesnacks/runs/rmj7wwft78l69stlj69j> │
╰─────────────────────────────────────────────────────────────────────────────────────────────────╯
ref 26-353 flyteorg/flyte-sdk