https://flyte.org logo
s

Shahwar Saleem

07/27/2022, 2:44 PM
Hey Flyte Fellows, I was wondering what is the best way to override values in this config: https://docs.flyte.org/en/latest/deployment/cluster_config/flytepropeller_config.html#sagemaker-config-config-sagemaker My initial guess is that it goes somewhere in propeller config map, but how do I overwrite these in there?
1
attn: @katrina
y

Yee

07/27/2022, 3:49 PM
@Brian Connolly do you know where these live?
if not i’ll take a look
or @Yuvraj actually, sorry
k

katrina

07/27/2022, 5:30 PM
ah! i think we might need to change the open source chart. for qubole (another plugin) for example we natively embed the config defined in values.yaml: https://github.com/flyteorg/flyte/blob/master/charts/flyte-core/templates/propeller/configmap.yaml#L33,L35
we probably need to introduce another block for sagemaker
cc @Dan Rammer (hamersaw) is that correct?
d

Dan Rammer (hamersaw)

07/27/2022, 6:06 PM
It needs to be set in the flytepropeller config like:
Copy code
plugins:
  sagemaker:
    prebuiltAlgorithms:
    - name: xgboost
      regionalConfigs:
      - region: us-east-1
        versionConfigs:
        - image: <http://683313688378.dkr.ecr.us-east-1.amazonaws.com/sagemaker-xgboost:0.90-2-cpu-py3|683313688378.dkr.ecr.us-east-1.amazonaws.com/sagemaker-xgboost:0.90-2-cpu-py3>
          version: "0.90"
    region: us-east-1
    roleAnnotationKey: ""
    roleArn: default_role
@katrina I think you are correct. It looks like each plugin configuration is defined with a block like above and then added to the flytepropeller configmap as it's own yaml. For example the default k8s plugin configuration.
s

Shahwar Saleem

07/27/2022, 8:35 PM
Yes, I think that seems closer to what I was thinking. Thanks Dan!
2 Views