Dan Corbiani
02/14/2023, 4:10 PMflytectl demo start
2. Build the container with the tag localhost:30000/custom_container:v1
3. exported the config export FLYTECTL_CONFIG=/home/user/.flyte/config-sandbox.yaml
4. Tried to run the workflow pyflyte run --remote workflows/mvp.py mvp --input_s3_path="<s3://data/path>"
The error I get is that it cannot pull the image. Am a I missing something very basic here?Niels Bantilan
02/14/2023, 4:15 PMdocker push localhost:30000/custom_container:v1
correct?Dan Corbiani
02/14/2023, 4:15 PMNiels Bantilan
02/14/2023, 4:15 PMpyflyte run
as well, with the --image
flagDan Corbiani
02/14/2023, 4:16 PMNiels Bantilan
02/14/2023, 4:17 PMpyflyte run --remote --image localhost:30000/custom_container:v1 ...
makes the workflow run with that imageDan Corbiani
02/14/2023, 4:18 PMNiels Bantilan
02/14/2023, 4:18 PMdocker pushlocalhost:30000/…
should make it available in the local Flyte cluster docker registryDan Corbiani
02/14/2023, 4:18 PMNiels Bantilan
02/14/2023, 4:19 PMDan Corbiani
02/14/2023, 4:20 PMNiels Bantilan
02/14/2023, 4:29 PMDan Corbiani
02/14/2023, 5:00 PM_FSEC_
prefix from the environment variables? It seems like there should be a way to set it for this config (https://github.com/flyteorg/flytekit/blob/9d313429c577a919ec0ad4cd397a5db356a1df0d/flytekit/configuration/internal.py#L141-L159) object but I'm not sure where it should be set. Is that in config-sandbox.yaml?Niels Bantilan
02/14/2023, 5:07 PMDan Corbiani
02/14/2023, 5:07 PM_fsec_
Niels Bantilan
02/14/2023, 5:12 PMFLYTE_SECRET_ENV_PREFIX=""
? (docs here)Dan Corbiani
02/14/2023, 6:12 PMNiels Bantilan
02/14/2023, 7:12 PMexport
it before running pyflyte runDan Corbiani
02/15/2023, 3:36 PMNiels Bantilan
02/15/2023, 4:12 PMFLYTE_SECRET_ENV_PREFIX
configuration right?Eduardo Apolinario (eapolinario)
02/15/2023, 7:32 PMNiels Bantilan
02/15/2023, 8:05 PMDan Corbiani
02/15/2023, 8:47 PMNiels Bantilan
02/15/2023, 9:09 PM@task(
secret_requests=[
Secret(key=USERNAME_SECRET, group=SECRET_GROUP),
Secret(key=PASSWORD_SECRET, group=SECRET_GROUP),
]
)
def user_info_task() -> Tuple[str, str]:
secret_username = flytekit.current_context().secrets.get(
SECRET_GROUP, USERNAME_SECRET
)
secret_pwd = flytekit.current_context().secrets.get(SECRET_GROUP, PASSWORD_SECRET)
# use secrets here
Dan Corbiani
02/22/2023, 8:55 PMNiels Bantilan
02/27/2023, 4:57 PM