KS Tarun
09/22/2022, 12:08 PM@task(container_image="{{.image.trainer.fqn }}:{{.image.trainer.version}}")
My sandbox.config looks like this:
[images]
trainer = <http://ghcr.io/flyteorg/flytecookbook:core-latest|ghcr.io/flyteorg/flytecookbook:core-latest>
predictor = <http://ghcr.io/flyteorg/flytecookbook:pima_diabetes-d4838f0f5e39a21f845a93b9e3375a675bd75eaa|ghcr.io/flyteorg/flytecookbook:pima_diabetes-d4838f0f5e39a21f845a93b9e3375a675bd75eaa>
I'm getting this error:
raise AssertionError(f"Image Config with name {name} not hound in the configuration")
AssertionError:Image Config with name trainer not found in the configuration
Any suggestions about this ?James Evers
09/22/2022, 3:55 PMpyflyte --config sandbox.config register ....
?Eduardo Apolinario (eapolinario)
09/22/2022, 9:26 PMKS Tarun
09/23/2022, 4:30 AMpyflyte run --remote script.py wf
Samhita Alla
pyflyte run …
command?Smriti Satyan
09/26/2022, 5:30 AMpyflyte -c sandbox.config
I believeJames Evers
09/26/2022, 3:13 PMValueError: Unimplemented, just specify pkgs like folder/files as args at the end of the command
Samhita Alla
James Evers
09/26/2022, 3:33 PMpyflyte --config ./sandbox.config register -p flytesnacks -d development --version v1.0 src
Samhita Alla
James Evers
09/26/2022, 3:35 PM--image <base-image> --image <other-image>
flagsSamhita Alla
Kevin Su
09/28/2022, 7:32 AMconfig-sandbox.yaml
instead, and use --image
to specify image config.
Here is an example.
pyflyte --config ~/.flyte/config-sandbox.yaml register --image trainer=<http://ghcr.io/flyteorg/flytecookbook:core-latest|ghcr.io/flyteorg/flytecookbook:core-latest> --image predictor=<http://ghcr.io/flyteorg/flytecookbook:core-latest|ghcr.io/flyteorg/flytecookbook:core-latest> containerization/multi_images.py
pyflyte --config ~/.flyte/config-remote.yaml run --remote --image trainer=<http://ghcr.io/flyteorg/flytecookbook:core-latest|ghcr.io/flyteorg/flytecookbook:core-latest> --image predictor=<http://ghcr.io/flyteorg/flytecookbook:core-latest|ghcr.io/flyteorg/flytecookbook:core-latest> containerization/multi_images.py my_workflow
James Evers
09/28/2022, 1:16 PM—image <k>=<v>
? I can imagine this getting clunky when there are more imagesKetan (kumare3)
James Evers
09/28/2022, 2:22 PMKetan (kumare3)
James Evers
09/28/2022, 2:25 PMEduardo Apolinario (eapolinario)
09/28/2022, 6:16 PMpyflyte run
command again, but this time can you prepend it with FLYTE_SDK_LOGGING_LEVEL=10
? This will tell you exactly what config file was loaded (look for a log line that says something along the lines of "Using flytectl/YAML config /home/tux/.flyte/config-sandbox.yaml"}
)James Evers
09/28/2022, 6:19 PMpyflyte run
thats giving me the issue, but pyflyte register
Eduardo Apolinario (eapolinario)
09/28/2022, 8:45 PMpyflyte register
command but this time setting the FLYTE_SDK_LOGGING_LEVEL
env var to 10
?James Evers
09/28/2022, 8:46 PMpyflyte
command with pyflyte --config <fully-qualified-path-to-config>
, everything appears to run correctlyEduardo Apolinario (eapolinario)
09/28/2022, 8:47 PMFLYTECTL_CONFIG
env var to point to the config fileJames Evers
09/28/2022, 8:48 PMFLYTECTL_CONFIG
points to a file config-sandbox.yaml
. That config looks like this:
admin:
# For GRPC endpoints you might want to use dns:///flyte.myexample.com
endpoint: localhost:30081
authType: Pkce
insecure: true
logger:
show-source: true
level: 0%
pyflyte
commands looks like this:
[platform]
url = localhost:30081
insecure = True
[sdk]
workflow_packages=flyte.workflows
Eduardo Apolinario (eapolinario)
09/28/2022, 8:50 PMJames Evers
09/28/2022, 8:51 PM--image <k> <v>
flags to pyflyte
commands by having the image names specified in the configEduardo Apolinario (eapolinario)
09/28/2022, 8:52 PMpyflyte
is using the correct config fileFLYTECTL_CONFIG
env var)James Evers
09/28/2022, 8:59 PMEduardo Apolinario (eapolinario)
09/28/2022, 8:59 PMSanjay Chouhan
09/30/2022, 5:09 AMpyflyte --config config.yaml register test1.py --version 1.0.1
The config.yaml is,
admin:
# For GRPC endpoints you might want to use dns:///flyte.myexample.com
endpoint: dns:///##############-16##<http://26454.us-west-1.elb.amazonaws.com:80|26454.us-west-1.elb.amazonaws.com:80>
authType: Pkce
insecure: true
logger:
show-source: true
level: 0
images:
trainer: <http://ghcr.io/flyteorg/flytecookbook:core-latest|ghcr.io/flyteorg/flytecookbook:core-latest>
predictor: moulee31/sample:1.0
The error is,
Traceback (most recent call last):
File "/home/sanjaychouhan/.local/bin/pyflyte", line 8, in <module>
sys.exit(main())
File "/usr/lib/python3/dist-packages/click/core.py", line 764, in __call__
return self.main(*args, **kwargs)
File "/usr/lib/python3/dist-packages/click/core.py", line 717, in main
rv = self.invoke(ctx)
File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/lib/python3/dist-packages/click/core.py", line 956, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/lib/python3/dist-packages/click/core.py", line 555, in invoke
return callback(*args, **kwargs)
File "/usr/lib/python3/dist-packages/click/decorators.py", line 17, in new_func
return f(get_current_context(), *args, **kwargs)
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/clis/sdk_in_container/register.py", line 174, in register
registerable_entities = load_packages_and_modules(
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/tools/repo.py", line 225, in load_packages_and_modules
registrable_entities = serialize(pkgs_and_modules, ss, str(project_root), options)
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/tools/repo.py", line 54, in serialize
registrable_entities = get_registrable_entities(ctx, options=options)
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/tools/serialize_helpers.py", line 75, in get_registrable_entities
get_serializable(new_api_serializable_entities, ctx.serialization_settings, entity, options=options)
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/tools/translator.py", line 578, in get_serializable
cp_entity = get_serializable_task(entity_mapping, settings, entity)
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/tools/translator.py", line 173, in get_serializable_task
container = entity.get_container(settings)
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/core/python_auto_container.py", line 164, in get_container
image=get_registerable_container_image(self.container_image, settings.image_config),
File "/home/sanjaychouhan/.local/lib/python3.8/site-packages/flytekit/core/python_auto_container.py", line 235, in get_registerable_container_image
raise AssertionError(f"Image Config with name {name} not found in the configuration")
AssertionError: Image Config with name trainer not found in the configuration
James Evers
09/30/2022, 12:51 PMKetan (kumare3)
James Evers
09/30/2022, 2:52 PMpyflyte --config <path/to/config> register
was:
ValueError: Unimplemented, just specify pkgs like folder/files as args at the end of the command
Eduardo Apolinario (eapolinario)
09/30/2022, 3:53 PMJames Evers
09/30/2022, 3:54 PMChandramoulee K V
10/06/2022, 5:48 AMSamhita Alla
Eduardo Apolinario (eapolinario)
10/07/2022, 7:37 AMChandramoulee K V
10/10/2022, 5:24 AM