nice-judge-43061
09/22/2022, 12:08 PM@task(container_image="{{.image.trainer.fqn }}:{{.image.trainer.version}}")
My sandbox.config looks like this:
[images]
trainer = <http://ghcr.io/flyteorg/flytecookbook:core-latest|ghcr.io/flyteorg/flytecookbook:core-latest>
predictor = <http://ghcr.io/flyteorg/flytecookbook:pima_diabetes-d4838f0f5e39a21f845a93b9e3375a675bd75eaa|ghcr.io/flyteorg/flytecookbook:pima_diabetes-d4838f0f5e39a21f845a93b9e3375a675bd75eaa>
I'm getting this error:
raise AssertionError(f"Image Config with name {name} not hound in the configuration")
AssertionError:Image Config with name trainer not found in the configuration
Any suggestions about this ?few-animal-62717
09/22/2022, 3:55 PMpyflyte --config sandbox.config register ....
?high-accountant-32689
09/22/2022, 9:26 PMnice-judge-43061
09/23/2022, 4:30 AMpyflyte run --remote script.py wf
tall-lock-23197
pyflyte run …
command?billowy-sundown-31926
09/26/2022, 5:30 AMpyflyte -c sandbox.config
I believefew-animal-62717
09/26/2022, 3:13 PMValueError: Unimplemented, just specify pkgs like folder/files as args at the end of the command
few-animal-62717
09/26/2022, 3:13 PMtall-lock-23197
few-animal-62717
09/26/2022, 3:33 PMpyflyte --config ./sandbox.config register -p flytesnacks -d development --version v1.0 src
tall-lock-23197
few-animal-62717
09/26/2022, 3:35 PM--image <base-image> --image <other-image>
flagstall-lock-23197
tall-lock-23197
glamorous-carpet-83516
09/28/2022, 7:32 AMconfig-sandbox.yaml
instead, and use --image
to specify image config.
Here is an example.
pyflyte --config ~/.flyte/config-sandbox.yaml register --image trainer=<http://ghcr.io/flyteorg/flytecookbook:core-latest|ghcr.io/flyteorg/flytecookbook:core-latest> --image predictor=<http://ghcr.io/flyteorg/flytecookbook:core-latest|ghcr.io/flyteorg/flytecookbook:core-latest> containerization/multi_images.py
glamorous-carpet-83516
09/28/2022, 7:35 AMpyflyte --config ~/.flyte/config-remote.yaml run --remote --image trainer=<http://ghcr.io/flyteorg/flytecookbook:core-latest|ghcr.io/flyteorg/flytecookbook:core-latest> --image predictor=<http://ghcr.io/flyteorg/flytecookbook:core-latest|ghcr.io/flyteorg/flytecookbook:core-latest> containerization/multi_images.py my_workflow
few-animal-62717
09/28/2022, 1:16 PMfew-animal-62717
09/28/2022, 1:17 PM—image <k>=<v>
? I can imagine this getting clunky when there are more imagesfew-animal-62717
09/28/2022, 2:14 PMfreezing-airport-6809
freezing-airport-6809
few-animal-62717
09/28/2022, 2:22 PMfreezing-airport-6809
few-animal-62717
09/28/2022, 2:25 PMhigh-accountant-32689
09/28/2022, 6:16 PMpyflyte run
command again, but this time can you prepend it with FLYTE_SDK_LOGGING_LEVEL=10
? This will tell you exactly what config file was loaded (look for a log line that says something along the lines of "Using flytectl/YAML config /home/tux/.flyte/config-sandbox.yaml"}
)few-animal-62717
09/28/2022, 6:19 PMfew-animal-62717
09/28/2022, 7:12 PMpyflyte run
thats giving me the issue, but pyflyte register
high-accountant-32689
09/28/2022, 8:45 PMpyflyte register
command but this time setting the FLYTE_SDK_LOGGING_LEVEL
env var to 10
?few-animal-62717
09/28/2022, 8:46 PMpyflyte
command with pyflyte --config <fully-qualified-path-to-config>
, everything appears to run correctlyhigh-accountant-32689
09/28/2022, 8:47 PMFLYTECTL_CONFIG
env var to point to the config filefew-animal-62717
09/28/2022, 8:48 PMfew-animal-62717
09/28/2022, 8:49 PMfew-animal-62717
09/28/2022, 8:49 PMFLYTECTL_CONFIG
points to a file config-sandbox.yaml
. That config looks like this:
admin:
# For GRPC endpoints you might want to use dns:///flyte.myexample.com
endpoint: localhost:30081
authType: Pkce
insecure: true
logger:
show-source: true
level: 0%
few-animal-62717
09/28/2022, 8:50 PMpyflyte
commands looks like this:
[platform]
url = localhost:30081
insecure = True
[sdk]
workflow_packages=flyte.workflows
high-accountant-32689
09/28/2022, 8:50 PMhigh-accountant-32689
09/28/2022, 8:51 PMfew-animal-62717
09/28/2022, 8:51 PMfew-animal-62717
09/28/2022, 8:52 PM--image <k> <v>
flags to pyflyte
commands by having the image names specified in the confighigh-accountant-32689
09/28/2022, 8:52 PMhigh-accountant-32689
09/28/2022, 8:52 PMpyflyte
is using the correct config filehigh-accountant-32689
09/28/2022, 8:53 PMFLYTECTL_CONFIG
env var)few-animal-62717
09/28/2022, 8:59 PMhigh-accountant-32689
09/28/2022, 8:59 PMgray-magician-44602
09/30/2022, 5:09 AMgray-magician-44602
09/30/2022, 7:05 AMpyflyte --config config.yaml register test1.py --version 1.0.1
The config.yaml is,
admin:
# For GRPC endpoints you might want to use dns:///flyte.myexample.com
endpoint: dns:///##############-16##<http://26454.us-west-1.elb.amazonaws.com:80|26454.us-west-1.elb.amazonaws.com:80>
authType: Pkce
insecure: true
logger:
show-source: true
level: 0
images:
trainer: <http://ghcr.io/flyteorg/flytecookbook:core-latest|ghcr.io/flyteorg/flytecookbook:core-latest>
predictor: moulee31/sample:1.0
The error is,
Traceback (most recent call last):
File "/home/sanjaychouhan/.local/bin/pyflyte", line 8, in <module>
sys.exit(main())
File "/usr/lib/python3/dist-packages/click/core.py", line 764, in __call__
return self.main(*args, **kwargs)
File "/usr/lib/python3/dist-packages/click/core.py", line 717, in main
rv = self.invoke(ctx)
File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python3/dist-packages/click/core.py", line 956, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/lib/python3/dist-packages/click/core.py", line 555, in invoke
return callback(*args, **kwargs)
File "/usr/lib/python3/dist-packages/click/decorators.py", line 17, in new_func
return f(get_current_context(), *args, **kwargs)
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/clis/sdk_in_container/register.py", line 174, in register
registerable_entities = load_packages_and_modules(
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/tools/repo.py", line 225, in load_packages_and_modules
registrable_entities = serialize(pkgs_and_modules, ss, str(project_root), options)
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/tools/repo.py", line 54, in serialize
registrable_entities = get_registrable_entities(ctx, options=options)
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/tools/serialize_helpers.py", line 75, in get_registrable_entities
get_serializable(new_api_serializable_entities, ctx.serialization_settings, entity, options=options)
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/tools/translator.py", line 578, in get_serializable
cp_entity = get_serializable_task(entity_mapping, settings, entity)
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/tools/translator.py", line 173, in get_serializable_task
container = entity.get_container(settings)
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/core/python_auto_container.py", line 164, in get_container
image=get_registerable_container_image(self.container_image, settings.image_config),
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/core/python_auto_container.py", line 235, in get_registerable_container_image
raise AssertionError(f"Image Config with name {name} not found in the configuration")
AssertionError: Image Config with name trainer not found in the configuration
gray-magician-44602
09/30/2022, 7:07 AMfew-animal-62717
09/30/2022, 12:51 PMfreezing-airport-6809
freezing-airport-6809
few-animal-62717
09/30/2022, 2:52 PMfew-animal-62717
09/30/2022, 2:52 PMpyflyte --config <path/to/config> register
was:
ValueError: Unimplemented, just specify pkgs like folder/files as args at the end of the command
high-accountant-32689
09/30/2022, 3:53 PMfew-animal-62717
09/30/2022, 3:54 PMhallowed-plastic-61640
10/06/2022, 5:48 AMtall-lock-23197
high-accountant-32689
10/07/2022, 7:37 AMhallowed-plastic-61640
10/10/2022, 5:24 AM